Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inner portal links (yarn nodemangers links) YARN UI Reverse Proxy #1005

Open
rachid-drago opened this issue Nov 10, 2021 · 0 comments
Open

Comments

@rachid-drago
Copy link
Contributor

rachid-drago commented Nov 10, 2021

I tried to find a reverse proxy for hadoop like spark reverse proxy to redirect the inner links of the nodemanager, but unfortunately there isn't an official one, here is a link to a discussion of a similar problem helm/charts#13671

I can change the nodeID of the node http address manually by changing the hostname of the container to trydev2.activeeon.com for example and I get trydev2.activeeon.com:8042 as address, but there is an issue with https proxy.

There is a Web Application Proxy for version 3.x, and we have 2.x https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html but in the documentation they said it's for security reasons only, not a reverse proxy like spark.
I've built a docker version with hadoop 3.3.1, and I run it with the workflow yarn, but I didn't find the right configuration to run the Web Application Proxy yet.

@rachid-drago rachid-drago changed the title Inner portal links (yarn nodemangers links) Inner portal links (yarn nodemangers links) YARN UI Reverse Proxy Nov 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant