Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [Flink] In version 1.0.2 of the YARN service, the Flink task cannot obtain the status after enabling the Kerberos authentication of the HTTP Web console. #3470

Open
2 of 3 tasks
miaoze8 opened this issue May 10, 2024 · 2 comments
Assignees
Labels
Bug Something isn't working Waiting for reply Waiting for reply

Comments

@miaoze8
Copy link

miaoze8 commented May 10, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

验证环境:
dinky 1.0.2
flink 1.17.0
CDH6.3.2

问题:
YARN服务 启用 HTTP Web 控制台的 Kerberos 身份验证后 application模式或者 perjob模式无法获取到任务状态
递交时候获取状态报错
2024-05-10 16:26:37.939 ERROR org.dinky.gateway.AbstractGateway(402): Yarn application state is not running, please check yarn cluster status. Log content: Authentication required
image

虽然最后递交成功时候拿到返回状态,但是在运维中心查看不到任务
image
返回数据开发页面 重新点击打开任务页面也找不到状态了
image

What you expected to happen

YARN服务启用 HTTP Web 控制台的 Kerberos 身份验证后 也能正常拿到状态

How to reproduce

创建flink sql任务 使用官网demo代码
https://www.dinky.org.cn/docs/next/practical_guide/Integration_practice/dinky_integration_flink#%E5%88%9B%E5%BB%BA-datagen-%E4%BB%BB%E5%8A%A1

使用application或者perjob模式时虽然最后递交成功 但中间有报错 后续也拿不到状态
2024-05-10 16:23:46.438 ERROR org.dinky.gateway.AbstractGateway(402): Yarn application state is not running, please check yarn cluster status. Log content: Authentication required
2024-05-10 16:23:48.447 ERROR org.dinky.gateway.AbstractGateway(402): Yarn application state is not running, please check yarn cluster status. Log content: Authentication required
2024-05-10 16:23:50.457 ERROR org.dinky.gateway.AbstractGateway(402): Yarn application state is not running, please check yarn cluster status. Log content: Authentication required
2024-05-10 16:23:52.466 ERROR org.dinky.gateway.AbstractGateway(402): Yarn application state is not running, please check yarn cluster status. Log content: Authentication required
2024-05-10 16:23:52.666 INFO org.dinky.service.impl.TaskServiceImpl(192): execute job finished,status is SUCCESS
Process Step SUBMIT_EXECUTE exit with status:FINISHED
2024-05-10 16:23:52.666 INFO org.dinky.service.impl.TaskServiceImpl(323): Job Submit success

Anything else

No response

Version

1.0.2

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@miaoze8 miaoze8 added Bug Something isn't working Waiting for reply Waiting for reply labels May 10, 2024
Copy link

Hello @miaoze8, this issue is about web, so I assign it to @Zzm0809. If you have any questions, you can comment and reply.

你好 @miaoze8, 这个 issue 是关于 web 的,所以我把它分配给了 @Zzm0809。如有任何问题,可以评论回复。

@github-actions github-actions bot changed the title [Bug] [Flink] 1.0.2版本YARN服务启用 HTTP Web 控制台的 Kerberos 身份验证后Flink任务获取不到状态 [Bug] [Flink] In version 1.0.2 of the YARN service, the Flink task cannot obtain the status after enabling the Kerberos authentication of the HTTP Web console. May 10, 2024
@Zzm0809
Copy link
Contributor

Zzm0809 commented May 11, 2024

可以着手来优化此建议吗??

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working Waiting for reply Waiting for reply
Projects
None yet
Development

No branches or pull requests

2 participants