You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have searched in the issues and found no similar issues.
Describe the bug
When using a Kyuubi cluster to proxy multiple big data environments, we use the kyuubi.engineEnv.HADOOP_CONF_DIR in sessionConf to specify the configuration related to the big data environment. However, after creating the engine, the yarnClient used in KyuubiApplicationManager.getApplicationInfo is not created using sessionConf, which will result in the connection not being the cluster specified by kyuubi.engineEnv.HADOOP_CONF_DIR.
Related classes:
org.apache.kyuubi.engine.KyuubiApplicationManager#getApplicationInfo
org.apache.kyuubi.engine.ApplicationOperation#getApplicationInfoByTag
org.apache.kyuubi.engine.ApplicationOperation#killApplicationByTag
org.apache.kyuubi.engine.YarnApplicationOperation#initialize
org.apache.kyuubi.util.KyuubiHadoopUtils#newYarnConfiguration
The same problem will also occur in BatchSession, KubernetesApplicationOperation, HiveEngine YARN mode, and so on.
Affects Version(s)
1.9.0
Kyuubi Server Log Output
None
Kyuubi Engine Log Output
None
Kyuubi Server Configurations
None
Kyuubi Engine Configurations
None
Additional context
No response
Are you willing to submit PR?
Yes. I would be willing to submit a PR with guidance from the Kyuubi community to fix.
No. I cannot submit a PR at this time.
The text was updated successfully, but these errors were encountered:
@ic4y Thank you for reporting this issue. YarnApplicationOperation should probably consider kyuubi.engineEnv.HADOOP_CONF_DIR/YARN_CONF_DIR of session conf. and cc @yaooqinn
Code of Conduct
Search before asking
Describe the bug
When using a Kyuubi cluster to proxy multiple big data environments, we use the kyuubi.engineEnv.HADOOP_CONF_DIR in sessionConf to specify the configuration related to the big data environment. However, after creating the engine, the yarnClient used in KyuubiApplicationManager.getApplicationInfo is not created using sessionConf, which will result in the connection not being the cluster specified by kyuubi.engineEnv.HADOOP_CONF_DIR.
Related classes:
org.apache.kyuubi.engine.KyuubiApplicationManager#getApplicationInfo
org.apache.kyuubi.engine.ApplicationOperation#getApplicationInfoByTag
org.apache.kyuubi.engine.ApplicationOperation#killApplicationByTag
org.apache.kyuubi.engine.YarnApplicationOperation#initialize
org.apache.kyuubi.util.KyuubiHadoopUtils#newYarnConfiguration
The same problem will also occur in BatchSession, KubernetesApplicationOperation, HiveEngine YARN mode, and so on.
Affects Version(s)
1.9.0
Kyuubi Server Log Output
None
Kyuubi Engine Log Output
None
Kyuubi Server Configurations
None
Kyuubi Engine Configurations
None
Additional context
No response
Are you willing to submit PR?
The text was updated successfully, but these errors were encountered: