Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Path resolution exception when submitting tasks in remote mode on Windows environment #3534

Open
3 tasks done
linweijiang opened this issue Feb 4, 2024 · 2 comments
Labels
bug Something isn't working

Comments

@linweijiang
Copy link
Contributor

Search before asking

  • I had searched in the issues and found no similar issues.

Java Version

1.8

Scala Version

2.12.x

StreamPark Version

2.1.2(The dev branch has not yet addressed that)

Flink Version

1.18.1

deploy mode

remote

What happened

In services running locally on Windows using Idea, there is a path conversion exception when submitting tasks in remote mode.

Do we have a dedicated module or a utility class specifically for converting things for Windows? I've done a quick and dirty conversion and it works fine, but I feel it's not elegant enough. There are likely many more areas that require adaptation for the Windows environment.

Error Exception

Caused by: java.net.URISyntaxException: Illegal character in opaque part at index 2: D:\opt\streampark_workspace\workspace\100003\streampark-flinkjob_test-remote-yarn-local.jar
	at java.net.URI$Parser.fail(URI.java:2848)
	at java.net.URI$Parser.checkChars(URI.java:3021)
	at java.net.URI$Parser.parse(URI.java:3058)
	at java.net.URI.<init>(URI.java:588)
	at org.apache.flink.client.program.PackagedProgramUtils.resolveURI(PackagedProgramUtils.java:243)
	at org.apache.streampark.flink.client.trait.FlinkClientTrait.submit(FlinkClientTrait.scala:83)
	at org.apache.streampark.flink.client.trait.FlinkClientTrait.submit$(FlinkClientTrait.scala:60)
	at org.apache.streampark.flink.client.impl.RemoteClient$.submit(RemoteClient.scala:34)
	at org.apache.streampark.flink.client.FlinkClientHandler$.submit(FlinkClientHandler.scala:40)
	at org.apache.streampark.flink.client.FlinkClientHandler.submit(FlinkClientHandler.scala)

Screenshots

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!(您是否要贡献这个PR?)

Code of Conduct

@linweijiang linweijiang added the bug Something isn't working label Feb 4, 2024
@linweijiang linweijiang changed the title [Bug] Path Resolution Exception When Submitting Tasks in Remote Mode on Windows Environment [Bug] Path resolution exception when submitting tasks in remote mode on Windows environment Feb 4, 2024
@chenshaojin
Copy link
Contributor

chenshaojin commented Feb 4, 2024

I think this is related to the issue of flink. https://wiki.avatr.com/pages/viewpage.action?pageId=21660370

@chenshaojin
Copy link
Contributor

I just tested it, and the problem you mentioned does exist. Currently, submitting jobs on Windows does not meet this condition.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants