sh /dss/dss_linkis/linkis/bin/linkis-cli -engineType python-python2 -code "print('hello world')" -codeType python 执行失败 #925

shenqihui · 2022-07-29T04:24:24Z

shenqihui
Jul 29, 2022

sh /dss/dss_linkis/linkis/bin/linkis-cli -engineType shell-1 -code "echo \"Hello world\"" -codeType shell -submitUser root -proxyUser root
这个能正常执行

sh /dss/dss_linkis/linkis/bin/linkis-cli -engineType python-python2 -code "print('hello world')" -codeType python
这个执行失败。

错误的大致信息是

=====Java Start Command=====
exec /usr/local/java/jdk1.8.0_141/bin/java -server -Xms32m -Xmx2048m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/dss/dss_linkis/linkis/logs/linkis-cli -XX:ErrorFile=/dss/dss_linkis/linkis/logs/linkis-cli/ps_err_pid%p.log -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=80 -XX:+DisableExplicitGC    -classpath /dss/dss_linkis/linkis/conf/linkis-cli:/dss/dss_linkis/linkis/lib/linkis-computation-governance/linkis-client/linkis-cli/*:/dss/dss_linkis/linkis/lib/linkis-commons/public-module/*:.:/usr/local/java/jdk1.8.0_141/lib/dt.jar:/usr/local/java/jdk1.8.0_141/lib -Dconf.root=/dss/dss_linkis/linkis/conf/linkis-cli -Dconf.file=linkis-cli.properties -Dlog.path=/dss/dss_linkis/linkis/logs/linkis-cli -Dlog.file=linkis-client.root.log.20220729122651457555176  org.apache.linkis.cli.application.LinkisClientApplication '-engineType python-python2 -code print('hello world') -codeType python'

[INFO] LogFile path: /dss/dss_linkis/linkis/logs/linkis-cli/linkis-client.root.log.20220729122651457555176
[INFO] User does not provide usr-configuration file. Will use default config
[INFO] user does not specify submit-user, will use current Linux user "root" by default.
[INFO] user does not specify proxy-user, will use current submit-user "root" by default.
[INFO] connecting to linkis gateway:http://dssnode1:9001
JobId:44
TaskId:44
ExecId:exec_id018013linkis-cg-entrancedssnode1:9104LINKISCLI_root_python_1
[INFO] Job is successfully submitted!

2022-07-29 12:26:54.026 INFO Program is substituting variables for you
2022-07-29 12:26:54.026 INFO Variables substitution ended successfully
2022-07-29 12:26:54.026 WARN The code you submit will not be limited by the limit
Job with jobId : LINKISCLI_root_python_1 and execID : LINKISCLI_root_python_1 submitted
2022-07-29 12:26:54.026 INFO You have submitted a new job, script code (after variable substitution) is
************************************SCRIPT CODE************************************
print('hello world')
************************************SCRIPT CODE************************************
2022-07-29 12:26:54.026 INFO Your job is accepted,  jobID is LINKISCLI_root_python_1 and jobReqId is 44 in ServiceInstance(linkis-cg-entrance, dssnode1:9104). Please wait it to be scheduled
job is scheduled.
2022-07-29 12:26:54.026 INFO Your job is Scheduled. Please wait it to run.
Your job is being scheduled by orchestrator.
2022-07-29 12:26:55.026 INFO job is running.
2022-07-29 12:26:55.026 INFO Your job is Running now. Please wait it to complete.
2022-07-29 12:26:55.026 INFO Job with jobGroupId : 44 and subJobId : 42 was submitted to Orchestrator.
2022-07-29 12:26:55.026 INFO Background is starting a new engine for you,execId astJob_15_codeExec_15 mark id is mark_15, it may take several seconds, please wait
2022-07-29 12:27:32.027 INFO EngineConn local log path: ServiceInstance(linkis-cg-engineconn, dssnode1:33407) /appcom/tmp/root/20220729/python/9b30bca8-e285-40c9-8ccc-221231d99f03/logs
2022-07-29 12:27:32.308 WARN  [Linkis-Default-Scheduler-Thread-1] org.apache.linkis.engineconn.computation.executor.hook.executor.ExecuteOnceHook 50 warn - execute once become effective, register lock listener
2022-07-29 12:28:03.521 ERROR [Linkis-Default-Scheduler-Thread-1] org.apache.linkis.manager.engineplugin.python.executor.PythonSession 136 apply - initialize python executor failed, please ask administrator for help! java.util.concurrent.TimeoutException: null
	at org.apache.linkis.common.utils.Utils$.aux$1(Utils.scala:194) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.waitUntil(Utils.scala:199) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.waitUntil(Utils.scala:202) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession.org$apache$linkis$manager$engineplugin$python$executor$PythonSession$$initGateway(PythonSession.scala:129) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession$$anonfun$lazyInitGageWay$1.apply$mcV$sp(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession$$anonfun$lazyInitGageWay$1.apply(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession$$anonfun$lazyInitGageWay$1.apply(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryThrow(Utils.scala:57) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession.lazyInitGageWay(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonEngineConnExecutor.executeLine(PythonEngineConnExecutor.scala:59) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:181) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:180) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:182) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:176) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at scala.collection.immutable.Range.foreach(Range.scala:160) ~[scala-library-2.11.12.jar:?]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:175) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:151) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryFinally(Utils.scala:61) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor.toExecuteTask(ComputationExecutor.scala:228) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:243) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:243) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryFinally(Utils.scala:61) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:55) ~[linkis-accessible-executor-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:49) ~[linkis-accessible-executor-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor.ensureOp(ComputationExecutor.scala:135) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor.execute(ComputationExecutor.scala:242) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl.org$apache$linkis$engineconn$computation$executor$service$TaskExecutionServiceImpl$$executeTask(TaskExecutionServiceImpl.scala:288) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2$$anonfun$run$2.apply$mcV$sp(TaskExecutionServiceImpl.scala:221) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2$$anonfun$run$2.apply(TaskExecutionServiceImpl.scala:219) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2$$anonfun$run$2.apply(TaskExecutionServiceImpl.scala:219) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryAndWarn(Utils.scala:69) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2.run(TaskExecutionServiceImpl.scala:219) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_141]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_141]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_141]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_141]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_141]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_141]
	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_141]
2022-07-29 12:28:03.559 ERROR [Linkis-Default-Scheduler-Thread-1] org.apache.linkis.manager.engineplugin.python.executor.PythonEngineConnExecutor 58 error - execute code failed! java.util.concurrent.TimeoutException: null
	at org.apache.linkis.common.utils.Utils$.aux$1(Utils.scala:194) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.waitUntil(Utils.scala:199) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.waitUntil(Utils.scala:202) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession.org$apache$linkis$manager$engineplugin$python$executor$PythonSession$$initGateway(PythonSession.scala:129) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession$$anonfun$lazyInitGageWay$1.apply$mcV$sp(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession$$anonfun$lazyInitGageWay$1.apply(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession$$anonfun$lazyInitGageWay$1.apply(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryThrow(Utils.scala:57) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession.lazyInitGageWay(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonEngineConnExecutor.executeLine(PythonEngineConnExecutor.scala:59) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:181) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:180) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:182) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:176) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at scala.collection.immutable.Range.foreach(Range.scala:160) ~[scala-library-2.11.12.jar:?]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:175) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:151) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryFinally(Utils.scala:61) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor.toExecuteTask(ComputationExecutor.scala:228) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:243) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:243) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryFinally(Utils.scala:61) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:55) ~[linkis-accessible-executor-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:49) ~[linkis-accessible-executor-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor.ensureOp(ComputationExecutor.scala:135) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor.execute(ComputationExecutor.scala:242) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl.org$apache$linkis$engineconn$computation$executor$service$TaskExecutionServiceImpl$$executeTask(TaskExecutionServiceImpl.scala:288) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2$$anonfun$run$2.apply$mcV$sp(TaskExecutionServiceImpl.scala:221) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2$$anonfun$run$2.apply(TaskExecutionServiceImpl.scala:219) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2$$anonfun$run$2.apply(TaskExecutionServiceImpl.scala:219) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryAndWarn(Utils.scala:69) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2.run(TaskExecutionServiceImpl.scala:219) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_141]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_141]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_141]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_141]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_141]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_141]
	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_141]
2022-07-29 12:28:03.582 ERROR [Linkis-Default-Scheduler-Thread-1] org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl 58 error - TimeoutException: java.util.concurrent.TimeoutException: null
	at org.apache.linkis.common.utils.Utils$.aux$1(Utils.scala:194) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.waitUntil(Utils.scala:199) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.waitUntil(Utils.scala:202) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession.org$apache$linkis$manager$engineplugin$python$executor$PythonSession$$initGateway(PythonSession.scala:129) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession$$anonfun$lazyInitGageWay$1.apply$mcV$sp(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession$$anonfun$lazyInitGageWay$1.apply(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession$$anonfun$lazyInitGageWay$1.apply(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryThrow(Utils.scala:57) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonSession.lazyInitGageWay(PythonSession.scala:135) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.manager.engineplugin.python.executor.PythonEngineConnExecutor.executeLine(PythonEngineConnExecutor.scala:59) ~[linkis-engineplugin-python-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:181) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:180) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:182) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:176) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at scala.collection.immutable.Range.foreach(Range.scala:160) ~[scala-library-2.11.12.jar:?]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:175) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:151) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryFinally(Utils.scala:61) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor.toExecuteTask(ComputationExecutor.scala:228) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:243) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:243) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryFinally(Utils.scala:61) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:55) ~[linkis-accessible-executor-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:49) ~[linkis-accessible-executor-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor.ensureOp(ComputationExecutor.scala:135) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.execute.ComputationExecutor.execute(ComputationExecutor.scala:242) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl.org$apache$linkis$engineconn$computation$executor$service$TaskExecutionServiceImpl$$executeTask(TaskExecutionServiceImpl.scala:288) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2$$anonfun$run$2.apply$mcV$sp(TaskExecutionServiceImpl.scala:221) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2$$anonfun$run$2.apply(TaskExecutionServiceImpl.scala:219) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2$$anonfun$run$2.apply(TaskExecutionServiceImpl.scala:219) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.common.utils.Utils$.tryAndWarn(Utils.scala:69) ~[linkis-common-1.1.1.jar:1.1.1]
	at org.apache.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$2.run(TaskExecutionServiceImpl.scala:219) ~[linkis-computation-engineconn-1.1.1.jar:1.1.1]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_141]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_141]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_141]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_141]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_141]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_141]
	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_141]
2022-07-29 12:28:03.028 ERROR Job with execId-LINKISCLI_root_python_1 + subJobId : 42  execute failed,21304, Task is Failed,errorMsg: TimeoutException:

2022-07-29 12:28:03.028 INFO job is completed.
2022-07-29 12:28:03.028 INFO Task creation time(任务创建时间): 2022-07-29 12:26:54, Task scheduling time(任务调度时间): 2022-07-29 12:26:54, Task start time(任务开始时间): 2022-07-29 12:26:55, Mission end time(任务结束时间): 2022-07-29 12:28:03
2022-07-29 12:28:03.028 INFO Your mission(您的任务) 44 The total time spent is(总耗时时间为): 1.1 分钟
2022-07-29 12:28:03.028 INFO Sorry. Your job completed with a status Failed. You can view logs for the reason.

[INFO] Job status is not success but 'FAILED'. Will not try to retrieve any Result
[INFO] Job failed! Will not try get execute result.
============Result:================
TaskId:44
ExecId: exec_id018013linkis-cg-entrancedssnode1:9104LINKISCLI_root_python_1
User:root
Current job status:FAILED
extraMsg:
errCode: 21002
errDesc: 创建Python解释器失败，请联系管理员

[INFO] JobStatus is not 'success'. Will not retrieve result-set.
############Execute Error!!!########

Answered by shenqihui

Jul 29, 2022

需要安装一下pip包：

pip-9.0.1
backports.functools_lru_cache-1.6.1-py2.py3-none-any.whl
cycler-0.10.0-py2.py3-none-any.whl
future-0.18.2.tar.gz
kiwisolver-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl
matplotlib-2.2.4-cp27-cp27mu-manylinux1_x86_64.whl
numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl
pandas-0.24.2-cp27-cp27mu-manylinux1_x86_64.whl
PyHive-0.6.4.tar.gz
pyparsing-2.4.2-py2.py3-none-any.whl
python_dateutil-2.8.0-py2.py3-none-any.whl
requests-2.10.0-py2.py3-none-any.whl
scikit_learn-0.20.4-cp27-cp27mu-manylinux1_x86_64.whl
scipy-0.14.0.tar
scipy-1.2.3-cp27-cp27mu-manylinux1_x86_64.whl
six-1.12.0-py2.py3-none-any.whl
subprocess32-3.5.4-cp27-cp27mu-manylinux1_x86_64.whl
tabulate-0.8.9.tar.gz
whee…

View full answer

shenqihui · 2022-07-29T04:25:31Z

shenqihui
Jul 29, 2022
Author

同时 sh /dss/dss_linkis/linkis/bin/linkis-cli-hive -code "show databases" 也执行失败的:

=====Java Start Command=====
exec /usr/local/java/jdk1.8.0_141/bin/java -server -Xms32m -Xmx2048m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/dss/dss_linkis/linkis/logs/linkis-cli -XX:ErrorFile=/dss/dss_linkis/linkis/logs/linkis-cli/ps_err_pid%p.log -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=80 -XX:+DisableExplicitGC    -classpath /dss/dss_linkis/linkis/conf/linkis-cli:/dss/dss_linkis/linkis/lib/linkis-computation-governance/linkis-client/linkis-cli/*:/dss/dss_linkis/linkis/lib/linkis-commons/public-module/*:.:/usr/local/java/jdk1.8.0_141/lib/dt.jar:/usr/local/java/jdk1.8.0_141/lib -Dconf.root=/dss/dss_linkis/linkis/conf/linkis-cli -Dconf.file=linkis-cli.properties -Dlog.path=/dss/dss_linkis/linkis/logs/linkis-cli -Dlog.file=linkis-client.root.log.20220729122402907657189  org.apache.linkis.cli.application.LinkisClientApplication '-engineType hive-2.3.3 -codeType hql -code show databases'
[INFO] LogFile path: /dss/dss_linkis/linkis/logs/linkis-cli/linkis-client.root.log.20220729122402907657189
[INFO] User does not provide usr-configuration file. Will use default config
[INFO] user does not specify submit-user, will use current Linux user "root" by default.
[INFO] user does not specify proxy-user, will use current submit-user "root" by default.
[INFO] connecting to linkis gateway:http://dssnode1:9001
JobId:43
TaskId:43
ExecId:exec_id018013linkis-cg-entrancedssnode1:9104LINKISCLI_root_hive_3
[INFO] Job is successfully submitted!

2022-07-29 12:24:06.024 INFO Program is substituting variables for you
2022-07-29 12:24:06.024 INFO Variables substitution ended successfully
2022-07-29 12:24:06.024 WARN The code you submit will not be limited by the limit
Job with jobId : LINKISCLI_root_hive_3 and execID : LINKISCLI_root_hive_3 submitted
2022-07-29 12:24:06.024 INFO You have submitted a new job, script code (after variable substitution) is
************************************SCRIPT CODE************************************
show databases
************************************SCRIPT CODE************************************
2022-07-29 12:24:06.024 INFO Your job is accepted,  jobID is LINKISCLI_root_hive_3 and jobReqId is 43 in ServiceInstance(linkis-cg-entrance, dssnode1:9104). Please wait it to be scheduled
job is scheduled.
2022-07-29 12:24:06.024 INFO Your job is Scheduled. Please wait it to run.
Your job is being scheduled by orchestrator.
2022-07-29 12:24:06.024 INFO job is running.
2022-07-29 12:24:06.024 INFO Your job is Running now. Please wait it to complete.
2022-07-29 12:24:06.024 INFO Job with jobGroupId : 43 and subJobId : 41 was submitted to Orchestrator.
2022-07-29 12:24:06.024 INFO Background is starting a new engine for you,execId astJob_14_codeExec_14 mark id is mark_14, it may take several seconds, please wait
2022-07-29 12:24:07.024 ERROR Job with execId-LINKISCLI_root_hive_3 + subJobId : 41  execute failed,21304, Task is Failed,errorMsg: errCode: 12003 ,desc: dssnode1:9101_14 Failed  to async get EngineNode AMErrorException: errCode: 30001 ,desc: Failed to createEngine ask em ServiceInstance(linkis-cg-engineconnmanager, dssnode1:9102) ,ip: dssnode1 ,port: 9101 ,serviceKind: linkis-cg-linkismanager ,ip: dssnode1 ,port: 9104 ,serviceKind: linkis-cg-entrance

2022-07-29 12:24:07.024 INFO job is completed.
2022-07-29 12:24:07.024 INFO Task creation time(任务创建时间): 2022-07-29 12:24:06, Task scheduling time(任务调度时间): 2022-07-29 12:24:06, Task start time(任务开始时间): 2022-07-29 12:24:06, Mission end time(任务结束时间): 2022-07-29 12:24:07
2022-07-29 12:24:07.024 INFO Your mission(您的任务) 43 The total time spent is(总耗时时间为): 940 ms
2022-07-29 12:24:07.024 INFO Sorry. Your job completed with a status Failed. You can view logs for the reason.

[INFO] Job status is not success but 'FAILED'. Will not try to retrieve any Result
[INFO] Job failed! Will not try get execute result.
============Result:================
TaskId:43
ExecId: exec_id018013linkis-cg-entrancedssnode1:9104LINKISCLI_root_hive_3
User:root
Current job status:FAILED
extraMsg:
errDesc: 21304, Task is Failed,errorMsg: errCode: 12003 ,desc: dssnode1:9101_14 Failed  to async get EngineNode AMErrorException: errCode: 30001 ,desc: Failed to createEngine ask em ServiceInstance(linkis-cg-engineconnmanager, dssnode1:9102) ,ip: dssnode1 ,port: 91

[INFO] JobStatus is not 'success'. Will not retrieve result-set.
############Execute Error!!!########

0 replies

shenqihui · 2022-07-29T06:34:11Z

shenqihui
Jul 29, 2022
Author

需要安装一下pip包：

pip-9.0.1
backports.functools_lru_cache-1.6.1-py2.py3-none-any.whl
cycler-0.10.0-py2.py3-none-any.whl
future-0.18.2.tar.gz
kiwisolver-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl
matplotlib-2.2.4-cp27-cp27mu-manylinux1_x86_64.whl
numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl
pandas-0.24.2-cp27-cp27mu-manylinux1_x86_64.whl
PyHive-0.6.4.tar.gz
pyparsing-2.4.2-py2.py3-none-any.whl
python_dateutil-2.8.0-py2.py3-none-any.whl
requests-2.10.0-py2.py3-none-any.whl
scikit_learn-0.20.4-cp27-cp27mu-manylinux1_x86_64.whl
scipy-0.14.0.tar
scipy-1.2.3-cp27-cp27mu-manylinux1_x86_64.whl
six-1.12.0-py2.py3-none-any.whl
subprocess32-3.5.4-cp27-cp27mu-manylinux1_x86_64.whl
tabulate-0.8.9.tar.gz
wheel-0.29.0-py2.py3-none-any.whl

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

sh /dss/dss_linkis/linkis/bin/linkis-cli -engineType python-python2 -code "print('hello world')" -codeType python 执行失败 #925

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 2 comments

{{title}}

{{title}}

Select a reply

sh /dss/dss_linkis/linkis/bin/linkis-cli -engineType python-python2 -code "print('hello world')" -codeType python 执行失败 #925

shenqihui Jul 29, 2022

Replies: 2 comments

shenqihui Jul 29, 2022 Author

shenqihui Jul 29, 2022 Author

shenqihui
Jul 29, 2022

shenqihui
Jul 29, 2022
Author

shenqihui
Jul 29, 2022
Author