Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] quick-start-flink not working !!! ? #6832

Open
2 of 3 tasks
zhouhoo opened this issue May 10, 2024 · 7 comments
Open
2 of 3 tasks

[Bug] quick-start-flink not working !!! ? #6832

zhouhoo opened this issue May 10, 2024 · 7 comments
Labels

Comments

@zhouhoo
Copy link

zhouhoo commented May 10, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

When I try seatunne on flink as offical doc says in the link, I got no error , flink job running but console had NO sink data output as the doc says!!! I tried to ask slack channel for help ,but slack link is outdated!!!
BTW, I tried to sink to mysql database, still no data sinked!

SeaTunnel Version

2.3.3

SeaTunnel Config

only modified seatunnel-env.sh file:
FLINK_HOME=/root/shen/flink-1.13.5

Running Command

1. add mysql-connector-j-8.3.0.jar to lib, 
2. install some plugins including fake-source and console.
3. ./bin/start-seatunnel-flink-13-connector-v2.sh --config ./config/v2.batch.config.template

Error Exception

Job has been submitted with JobID 607d2d65753670b5f381fc502cb65c57
Program execution finished
Job with JobID 607d2d65753670b5f381fc502cb65c57 has finished.
Job Runtime: 2207 ms

Zeta or Flink or Spark Version

flink 1.13.5

Java or Scala Version

No response

Screenshots

无标题

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@zhouhoo zhouhoo added the bug label May 10, 2024
@liunaijie
Copy link
Contributor

you submitted config is fake source to console, the console out is print in your worker node. not your submit job node.

@liunaijie
Copy link
Contributor

you can update the config, write data to a local file or other connector, then verify the result

@zhouhoo
Copy link
Author

zhouhoo commented May 11, 2024

you submitted config is fake source to console, the console out is print in your worker node. not your submit job node.

flink worker node? I start flink 、seatunnel all on same host, only one host. just a quick start.

@zhouhoo
Copy link
Author

zhouhoo commented May 11, 2024

you can update the config, write data to a local file or other connector, then verify the result

I also sink to mysql database, no data sinked in.

@liunaijie
Copy link
Contributor

try this way to verify:

  1. submit v2.streaming.conf.template config ( this is streaming job config)
  2. login flink ui check running flink jobs, check whether this job has submitted to your flink cluster.
  3. check log

@zhouhoo
Copy link
Author

zhouhoo commented May 11, 2024

try this way to verify:

  1. submit v2.streaming.conf.template config ( this is streaming job config)
  2. login flink ui check running flink jobs, check whether this job has submitted to your flink cluster.
  3. check log

I tried, job was successfully submitted to flink, no error ,running status. but no data consuming.
flink logs print some checkpoings was done successfully.
seatunnel has no log output.

@liunaijie
Copy link
Contributor

liunaijie commented May 11, 2024

try this way to verify:

  1. submit v2.streaming.conf.template config ( this is streaming job config)
  2. login flink ui check running flink jobs, check whether this job has submitted to your flink cluster.
  3. check log

I tried, job was successfully submitted to flink, no error ,running status. but no data consuming. flink logs print some checkpoings was done successfully. seatunnel has no log output.

Hi, i package from dev, using flink 1.13.5.
some update to v2.streaming.conf.template :

  1. update env.parallelism and FakeSource.parallelism to 1
  2. update FakeSource.row.num to 100

Then it can run well. i can see the result in taskmanager's log.
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants