Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] exchangis start duplicated engine error and import #416

Open
1 of 2 tasks
ryze124 opened this issue Apr 29, 2024 · 0 comments
Open
1 of 2 tasks

[Bug] exchangis start duplicated engine error and import #416

ryze124 opened this issue Apr 29, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@ryze124
Copy link

ryze124 commented Apr 29, 2024

Search before asking

  • I searched the issues and found no similar issues.

Exchangis Component

exchangis-job-server

What happened + What you expected to happen

  1. after submited a datax job,linkis started 2 linkis-datax engines and the import data was double;
  • my job
    image
  • linkis-datax engine:
    image
  • source data
    image
  • imported data
    image
  1. 1 linkis-datax engine , 1 data
  2. job log
2024-04-29 13:27:08.228 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Init to create launched job and begin generating
2.   2024-04-29 13:27:08.260 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Fetch data source parameters in [MYSQL]
3.   2024-04-29 13:27:08.280 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Fetch data source parameters in [HIVE]
4.   2024-04-29 13:27:08.477 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Datax-code built complete, output: {
5.     "content" : [ {
6.       "transformer" : [ ],
7.       "reader" : {
8.         "name" : "mysqlreader",
9.         "parameter" : {
10.           "column" : [ {
11.             "name" : "id",
12.             "type" : "INT",
13.             "index" : "0"
14.           }, {
15.             "name" : "name",
16.             "type" : "VARCHAR",
17.             "index" : "1"
18.           }, {
19.             "name" : "create_time",
20.             "type" : "DATETIME",
21.             "index" : "2"
22.           } ],
23.           "connection" : [ {
24.             "jdbcUrl" : [ {
25.               "host" : "xx.xx.x.xxx",
26.               "port" : "3306",
27.               "database" : "test"
28.             } ],
29.             "querySql" : [ " SELECT id, name, create_time  FROM test_table_bk" ]
30.           } ],
31.           "where" : "",
32.           "username" : "root"
33.         }
34.       },
35.       "writer" : {
36.         "name" : "hdfswriter",
37.         "parameter" : {
38.           "fileName" : "exch_hive_",
39.           "nullFormat" : "",
40.           "compress" : "GZIP",
41.           "column" : [ {
42.             "name" : "id",
43.             "type" : "bigint",
44.             "index" : "0"
45.           }, {
46.             "name" : "name",
47.             "type" : "string",
48.             "index" : "1"
49.           }, {
50.             "name" : "create_time",
51.             "type" : "string",
52.             "index" : "2"
54.           } ],
55.           "writeMode" : "append",
56.           "fieldDelimiter" : "\u0001",
57.           "encoding" : "utf-8",
58.           "hiveTable" : "test_datax2004",
59.           "path" : "/user/hadoop/hadoop_test.db/test_datax2004",
60.           "hiveMetastoreUris" : "thrift://xx.xxx.xx.xx:9083",
61.           "hadoopConfig" : {
62.             "dfs.ha.namenodes.nameservice1" : "nn1,nn2",
63.             "fs.defaultFS" : "hdfs://nameservice1",
64.             "dfs.namenode.rpc-address.nameservice1.nn1" : "xxxx:8020",
65.             "dfs.namenode.rpc-address.nameservice1.nn2" : "xxxx:8020",
66.             "dfs.nameservices" : "nameservice1",
67.             "dfs.client.failover.proxy.provider.nameservice1" : "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"
68.           },
69.           "defaultFS" : "hdfs://nameservice1",
70.           "fileType" : "TEXT",
71.           "hiveDatabase" : "hadoop_test"
72.         }
73.       }
74.     } ]
75.   }
76.   2024-04-29 13:27:08.495 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Success to generate launched job, output tasks [1]
77.   2024-04-29 13:27:08.519 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Submit the launchable task: [name:datax-test ,id:1996209572313960448 ] to launcher: [Linkis], retry_count: 0
78.   2024-04-29 13:27:08.530 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Submit the launchable task: [name:datax-test ,id:1996209572313960448 ] to launcher: [Linkis], retry_count: 0
79.   2024-04-29 13:27:31.578 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Success to submit task:[name:datax-test, id:1996209572313960448] to Linkis [linkis_id: 36_20_1c2f8a77-f12f-49e6-a502-6ea87fb15692linkis-cg-engineconniotdb-03.hostname.com:17840, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
80.   2024-04-29 13:27:31.607 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Status of task: [name: datax-test, id: 1996209572313960448] change to Running, info: []
81.   2024-04-29 13:27:32.283 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Success to submit task:[name:datax-test, id:1996209572313960448] to Linkis [linkis_id: 36_20_274fd827-5741-48cf-b960-d920beee23a1linkis-cg-engineconniotdb-03.hostname.com:3584, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
82.   2024-04-29 13:27:32.308 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Status of task: [name: datax-test, id: 1996209572313960448] change to Running, info: []
83.   2024-04-29 13:27:35.351 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
84.   2024-04-29 13:27:36.011 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
85.   2024-04-29 13:27:38.413 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
86.   2024-04-29 13:27:39.064 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
87.   2024-04-29 13:27:41.497 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
88.   2024-04-29 13:27:42.125 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
89.   2024-04-29 13:27:46.781 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Progress of task: [1996209572313960448] change 0.0 => 1.0
90.   2024-04-29 13:27:46.781 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Status of task: [name: datax-test, id: 1996209572313960448] change Running => Success
91.   2024-04-29 13:27:47.432 INFO  - [hadoop:42848560-078d-4eda-a65b-ed8e27d8ae79] Status of task: [name: datax-test, id: 1996209572313960448] change Running => Success

Relevent platform

  • centos 7.9
  • java version "1.8.0_333"
  • dss 1.1.2
  • linkis 1.4.0
  • exchangis 1.1.2

Reproduction script

  1. exchangis job
    image
    image

  2. exchangis log

2024-04-29 13:37:43.931 [INFO ] [qtp568168963-5448                       ] c.w.w.e.c.AuditLogUtils (33) [printLog] - [2024-04-29T13:37:43.930+0800],[hadoop],[proxyUser is: hadoop],[Exchangis-1.1.2],[job],[5835],[Job id is: 5835],[update],[Request(PUT //iotdb-03.hostname.com:8008/api/rest_j/v1/dss/exchangis/main/job/5835/content)@564dd9de]
2024-04-29 13:37:43.975 [INFO ] [qtp568168963-5337                       ] c.w.w.e.j.s.e.g.AbstractTaskGenerator (51) [init] - Generate job execution id: [5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] for job: [datax_9561]
2024-04-29 13:37:43.986 [INFO ] [qtp568168963-5337                       ] c.w.w.e.j.s.l.s.LocalSimpleJobLogService (244) [lambda$getOrCreateLogCache$1] - Create the new job log file: /data/bdp/dss/exchangis/main/logs/hadoop/2024-04-29/5095d23c-6a4b-48ae-b1d9-87ceb6503eaf
2024-04-29 13:37:43.987 [INFO ] [qtp568168963-5337                       ] c.w.w.e.j.s.e.g.DefaultTaskGenerator (35) [info] - Init to create launched job and begin generating
2024-04-29 13:37:43.987 [INFO ] [qtp568168963-5337                       ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Init to create launched job and begin generating
2024-04-29 13:37:43.987 [INFO ] [qtp568168963-5337                       ] c.w.w.e.j.s.s.i.DefaultJobExecuteService (297) [executeJob] - Submit the generation scheduler task: [5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] for job: [5835], tenancy: [hadoop] to TaskExecution
2024-04-29 13:37:43.994 [INFO ] [Multi-Tenancy-Group-hadoop_0ConsumerThread] c.w.w.e.j.s.e.s.t.GenerationSchedulerTask (97) [transition] - Scheduler-GenerationTask-5095d23c-6a4b-48ae-b1d9-87ceb6503eaf change status Inited => Scheduled.
2024-04-29 13:37:43.994 [INFO ] [qtp568168963-5337                       ] c.w.w.e.c.AuditLogUtils (33) [printLog] - [2024-04-29T13:37:43.994+0800],[hadoop],[proxyUser is: hadoop],[Exchangis-1.1.2],[job],[5835],[Execute task is: datax_9561],[execute],[Request(POST //iotdb-03.hostname.com:8008/api/rest_j/v1/dss/exchangis/main/job/5835/execute)@564dd9de]
2024-04-29 13:37:43.995 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.e.s.t.GenerationSchedulerTask (97) [transition] - Scheduler-GenerationTask-5095d23c-6a4b-48ae-b1d9-87ceb6503eaf change status Scheduled => Running.
2024-04-29 13:37:43.995 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.b.t.GenericExchangisTransformJobBuilder (87) [buildJob] - To parse content ExchangisJob: id: [5835], name: [datax_9561], expect subJobs: [1]
2024-04-29 13:37:43.996 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.b.t.GenericExchangisTransformJobBuilder (101) [buildJob] - Invoke job handlers to handle the subJobs, ExchangisJob: id: [5835], name: [datax_9561]
2024-04-29 13:37:43.996 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.b.t.GenericExchangisTransformJobBuilder (35) [info] - Fetch data source parameters in [MYSQL]
2024-04-29 13:37:43.997 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Fetch data source parameters in [MYSQL]
2024-04-29 13:37:44.003 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.d.s.ExchangisDataSourceService (1226) [getDataSourceConnectParamsById] - getDataSourceConnectParamsById userName:hadoop
2024-04-29 13:37:44.019 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/data-source-manager/2/connect-params?system=system taken: 15 ms.
2024-04-29 13:37:44.019 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.b.t.GenericExchangisTransformJobBuilder (35) [info] - Fetch data source parameters in [HIVE]
2024-04-29 13:37:44.020 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Fetch data source parameters in [HIVE]
2024-04-29 13:37:44.020 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.d.s.ExchangisDataSourceService (1226) [getDataSourceConnectParamsById] - getDataSourceConnectParamsById userName:hadoop
2024-04-29 13:37:44.032 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/data-source-manager/6/connect-params?system=system taken: 12 ms.
2024-04-29 13:37:44.168 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/metadatamanager/partitions/6/db/hadoop_test/table/test_datax2004?system=exchangis taken: 135 ms.
2024-04-29 13:37:44.213 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/metadatamanager/props/6/db/hadoop_test/table/test_datax2004?system=exchangis taken: 44 ms.
2024-04-29 13:37:44.230 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/metadataQuery/getConnectionInfo?system=exchangis&uri=hdfs%3A%2F%2Fnameservice1%2Fuser%2Fhadoop%2Fhadoop_test.db%2Ftest_datax2004&dataSourceName=.LOCAL_HDFS taken: 15 ms.
2024-04-29 13:37:44.231 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.b.e.DataxExchangisEngineJobBuilder (35) [info] - Datax-code built complete, output: {
  "content" : [ {
    "transformer" : [ ],
    "reader" : {
      "name" : "mysqlreader",
      "parameter" : {
        "column" : [ {
          "name" : "id",
          "type" : "INT",
          "index" : "0"
        }, {
          "name" : "name",
          "type" : "VARCHAR",
          "index" : "1"
        }, {
          "name" : "create_time",
          "type" : "DATETIME",
          "index" : "2"
        } ],
        "password" : "xxxxxx",
        "connection" : [ {
          "jdbcUrl" : [ {
            "host" : "xxxxx",
            "port" : "3306",
            "database" : "test"
          } ],
          "querySql" : [ " SELECT id, name, create_time  FROM test_table_bk" ]
        } ],
        "where" : "",
        "username" : "root"
      }
    },
    "writer" : {
      "name" : "hdfswriter",
      "parameter" : {
        "fileName" : "exch_hive_",
        "nullFormat" : "",
        "compress" : "GZIP",
        "column" : [ {
          "name" : "id",
          "type" : "bigint",
          "index" : "0"
        }, {
          "name" : "name",
          "type" : "string",
          "index" : "1"
        }, {
          "name" : "create_time",
          "type" : "string",
          "index" : "2"
        } ],
        "writeMode" : "append",
        "fieldDelimiter" : "\u0001",
        "encoding" : "utf-8",
        "hiveTable" : "test_datax2004",
        "path" : "/user/hadoop/hadoop_test.db/test_datax2004",
        "hiveMetastoreUris" : "thrift://xxxxxxxx:9083",
        "hadoopConfig" : {
          "dfs.ha.namenodes.nameservice1" : "nn1,nn2",
          "fs.defaultFS" : "hdfs://nameservice1",
          "dfs.namenode.rpc-address.nameservice1.nn1" : "xxxx.hadoop.com:8020",
          "dfs.namenode.rpc-address.nameservice1.nn2" : "xxxxxxxxxxxxxxxx:8020",
          "dfs.nameservices" : "nameservice1",
          "dfs.client.failover.proxy.provider.nameservice1" : "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"
        },
        "defaultFS" : "hdfs://nameservice1",
        "fileType" : "TEXT",
        "hiveDatabase" : "hadoop_test"
      }
    }
  } ]
}
2024-04-29 13:37:44.231 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Datax-code built complete, output: {
  "content" : [ {
    "transformer" : [ ],
    "reader" : {
      "name" : "mysqlreader",
      "parameter" : {
        "column" : [ {
          "name" : "id",
          "type" : "INT",
          "index" : "0"
        }, {
          "name" : "name",
          "type" : "VARCHAR",
          "index" : "1"
        }, {
          "name" : "create_time",
          "type" : "DATETIME",
          "index" : "2"
        } ],
        "password" : "xxxxxxxxxxxxxxxxxxxxxxx",
        "connection" : [ {
          "jdbcUrl" : [ {
            "host" : "xx.xx.xx.xx",
            "port" : "3306",
            "database" : "test"
          } ],
          "querySql" : [ " SELECT id, name, create_time  FROM test_table_bk" ]
        } ],
        "where" : "",
        "username" : "root"
      }
    },
    "writer" : {
      "name" : "hdfswriter",
      "parameter" : {
        "fileName" : "exch_hive_",
        "nullFormat" : "",
        "compress" : "GZIP",
        "column" : [ {
          "name" : "id",
          "type" : "bigint",
          "index" : "0"
        }, {
          "name" : "name",
          "type" : "string",
          "index" : "1"
        }, {
          "name" : "create_time",
          "type" : "string",
          "index" : "2"
        } ],
        "writeMode" : "append",
        "fieldDelimiter" : "\u0001",
        "encoding" : "utf-8",
        "hiveTable" : "test_datax2004",
        "path" : "/user/hadoop/hadoop_test.db/test_datax2004",
        "hiveMetastoreUris" : "thrift://xx.xxx.xx.xx:9083",
        "hadoopConfig" : {
          "dfs.ha.namenodes.nameservice1" : "nn1,nn2",
          "fs.defaultFS" : "hdfs://nameservice1",
          "dfs.namenode.rpc-address.nameservice1.nn1" : "xxxx.hadoop.com:8020",
          "dfs.namenode.rpc-address.nameservice1.nn2" : "xxxx.hadoop.com:8020",
          "dfs.nameservices" : "nameservice1",
          "dfs.client.failover.proxy.provider.nameservice1" : "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"
        },
        "defaultFS" : "hdfs://nameservice1",
        "fileType" : "TEXT",
        "hiveDatabase" : "hadoop_test"
      }
    }
  } ]
}
2024-04-29 13:37:44.232 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.l.b.LinkisExchangisLauncherJobBuilder (60) [buildJob] - Use the engine resources: [{"engineType":"datax","id":null,"name":"mysqlreader.zip","type":"bml","path":"/datax/plugin/reader/mysqlreader","createTime":1711440244000,"modifyTime":1711440244000,"creator":"hadoop","resourceId":"c0972d27-9bc1-44ea-8d8b-12e2ae1933c9","version":"v000001","inputStream":null,"uri":"bml:///c0972d27-9bc1-44ea-8d8b-12e2ae1933c9/v000001"},{"engineType":"datax","id":null,"name":"hdfswriter.zip","type":"bml","path":"/datax/plugin/writer/hdfswriter","createTime":1711440290000,"modifyTime":1711440290000,"creator":"hadoop","resourceId":"0e1cde82-dc72-45c2-9bc3-95cc1a5fc066","version":"v000001","inputStream":null,"uri":"bml:///0e1cde82-dc72-45c2-9bc3-95cc1a5fc066/v000001"}] for job/task: [datax-test]
2024-04-29 13:37:44.250 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.e.g.DefaultTaskGenerator (35) [info] - Success to generate launched job, output tasks [1]
2024-04-29 13:37:44.250 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Success to generate launched job, output tasks [1]
2024-04-29 13:37:44.250 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-378 ] c.w.w.e.j.s.e.s.t.GenerationSchedulerTask (97) [transition] - Scheduler-GenerationTask-5095d23c-6a4b-48ae-b1d9-87ceb6503eaf change status Running => Succeed.
2024-04-29 13:37:44.251 [INFO ] [Observe-Thread-NewInTaskObserver        ] c.w.w.e.j.s.e.s.NewInTaskObserver (34) [onPublishNext] - Get the launchable task from database, size: [1]
2024-04-29 13:37:44.267 [INFO ] [Multi-Tenancy-Group-hadoop_0ConsumerThread] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Inited => Scheduled.
2024-04-29 13:37:44.268 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Scheduled => Running.
2024-04-29 13:37:44.268 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (35) [info] - Submit the launchable task: [name:datax-test ,id:1996212238863699968 ] to launcher: [Linkis], retry_count: 0
2024-04-29 13:37:44.268 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Submit the launchable task: [name:datax-test ,id:1996212238863699968 ] to launcher: [Linkis], retry_count: 0
2024-04-29 13:37:44.278 [INFO ] [Multi-Tenancy-Group-hadoop_0ConsumerThread] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Inited => Scheduled.
2024-04-29 13:37:44.279 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Scheduled => Running.
2024-04-29 13:37:44.279 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (35) [info] - Submit the launchable task: [name:datax-test ,id:1996212238863699968 ] to launcher: [Linkis], retry_count: 0
2024-04-29 13:37:44.279 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Submit the launchable task: [name:datax-test ,id:1996212238863699968 ] to launcher: [Linkis], retry_count: 0
2024-04-29 13:37:45.058 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/bml/upload taken: 788 ms.
2024-04-29 13:37:45.059 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (118) [doSubmit] - Ready to create a engineConn: {"createService":"exchangis","ignoreTimeout":true,"properties":{"wds.linkis.engineconn.datax.bml.resources":"[{\"engineType\":\"datax\",\"id\":null,\"name\":\"mysqlreader.zip\",\"type\":\"bml\",\"path\":\"/datax/plugin/reader/mysqlreader\",\"createTime\":1711440244000,\"modifyTime\":1711440244000,\"creator\":\"hadoop\",\"resourceId\":\"c0972d27-9bc1-44ea-8d8b-12e2ae1933c9\",\"version\":\"v000001\",\"inputStream\":null,\"uri\":\"bml:///c0972d27-9bc1-44ea-8d8b-12e2ae1933c9/v000001\"},{\"engineType\":\"datax\",\"id\":null,\"name\":\"hdfswriter.zip\",\"type\":\"bml\",\"path\":\"/datax/plugin/writer/hdfswriter\",\"createTime\":1711440290000,\"modifyTime\":1711440290000,\"creator\":\"hadoop\",\"resourceId\":\"0e1cde82-dc72-45c2-9bc3-95cc1a5fc066\",\"version\":\"v000001\",\"inputStream\":null,\"uri\":\"bml:///0e1cde82-dc72-45c2-9bc3-95cc1a5fc066/v000001\"}]","_datax_.setting.speed.channel":"1","_datax_.setting.speed.byte":5242880,"wds.linkis.engineconn.java.driver.memory":"1024MB","_datax_.setting.speed.record":"100","_datax_.setting.errorLimit.record":"","label.codeType":null,"_datax_.setting.max.memory":"1024","wds.linkis.engineconn.datax.execution.id":1996212238863699968,"onceExecutorContent":"resource_036587d8f85-24f7-47f5-b53a-463c1deb5063v000001"},"timeout":30000,"labels":{"userCreator":"hadoop-exchangis","engineType":"datax-3.0.0","engineConnMode":"once"}}.
2024-04-29 13:37:45.068 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/bml/upload taken: 788 ms.
2024-04-29 13:37:45.069 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (118) [doSubmit] - Ready to create a engineConn: {"createService":"exchangis","ignoreTimeout":true,"properties":{"wds.linkis.engineconn.datax.bml.resources":"[{\"engineType\":\"datax\",\"id\":null,\"name\":\"mysqlreader.zip\",\"type\":\"bml\",\"path\":\"/datax/plugin/reader/mysqlreader\",\"createTime\":1711440244000,\"modifyTime\":1711440244000,\"creator\":\"hadoop\",\"resourceId\":\"c0972d27-9bc1-44ea-8d8b-12e2ae1933c9\",\"version\":\"v000001\",\"inputStream\":null,\"uri\":\"bml:///c0972d27-9bc1-44ea-8d8b-12e2ae1933c9/v000001\"},{\"engineType\":\"datax\",\"id\":null,\"name\":\"hdfswriter.zip\",\"type\":\"bml\",\"path\":\"/datax/plugin/writer/hdfswriter\",\"createTime\":1711440290000,\"modifyTime\":1711440290000,\"creator\":\"hadoop\",\"resourceId\":\"0e1cde82-dc72-45c2-9bc3-95cc1a5fc066\",\"version\":\"v000001\",\"inputStream\":null,\"uri\":\"bml:///0e1cde82-dc72-45c2-9bc3-95cc1a5fc066/v000001\"}]","_datax_.setting.speed.channel":"1","_datax_.setting.speed.byte":5242880,"wds.linkis.engineconn.java.driver.memory":"1024MB","_datax_.setting.speed.record":"100","_datax_.setting.errorLimit.record":"","label.codeType":null,"_datax_.setting.max.memory":"1024","wds.linkis.engineconn.datax.execution.id":1996212238863699968,"onceExecutorContent":"resource_036a3c662b1-3f16-43cb-bf9f-2b9f0c6b3971v000001"},"timeout":30000,"labels":{"userCreator":"hadoop-exchangis","engineType":"datax-3.0.0","engineConnMode":"once"}}.
2024-04-29 13:37:45.428 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/createEngineConn taken: 369 ms.
2024-04-29 13:37:45.429 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (126) [doSubmit] - EngineConn created with status Starting, the nodeInfo is {managerServiceInstance={instance=iotdb-03.hostname.com:9101, applicationName=linkis-cg-linkismanager}, ecAsyncStartResult=success, ecmServiceInstance={instance=iotdb-03.hostname.com:9102, applicationName=linkis-cg-engineconnmanager}, serviceInstance={instance=iotdb-03.hostname.com:20175, applicationName=linkis-cg-engineconn}, nodeStatus=Starting, ticketId=8a6f79df-ceb4-43e1-8e4a-ba861015d4bb}.
2024-04-29 13:37:45.429 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (130) [doSubmit] - Wait for EngineConn ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175) to be running or completed.
2024-04-29 13:37:45.439 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:45.548 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:45.759 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:45.919 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/createEngineConn taken: 849 ms.
2024-04-29 13:37:45.919 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (126) [doSubmit] - EngineConn created with status Starting, the nodeInfo is {managerServiceInstance={instance=iotdb-03.hostname.com:9101, applicationName=linkis-cg-linkismanager}, ecAsyncStartResult=success, ecmServiceInstance={instance=iotdb-03.hostname.com:9102, applicationName=linkis-cg-engineconnmanager}, serviceInstance={instance=iotdb-03.hostname.com:24775, applicationName=linkis-cg-engineconn}, nodeStatus=Starting, ticketId=e379222c-bcbc-488e-9fbe-063b81d8eb65}.
2024-04-29 13:37:45.919 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (130) [doSubmit] - Wait for EngineConn ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775) to be running or completed.
2024-04-29 13:37:45.930 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:46.042 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:37:46.069 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:46.254 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:37:46.482 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:37:46.543 [INFO ] [qtp568168963-5348                       ] c.w.w.e.j.s.l.s.LocalSimpleJobLogService (174) [logsFromPageAndPath] - have error information
2024-04-29 13:37:46.565 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:46.977 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:37:46.993 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:47.489 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:47.604 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:48.102 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:48.315 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:48.816 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 12 ms.
2024-04-29 13:37:49.126 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:49.635 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 19 ms.
2024-04-29 13:37:50.048 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 21 ms.
2024-04-29 13:37:50.568 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 27 ms.
2024-04-29 13:37:51.059 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:51.579 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:52.169 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:52.689 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:37:53.380 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:37:53.920 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 30 ms.
2024-04-29 13:37:54.949 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 30 ms.
2024-04-29 13:37:55.408 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 17 ms.
2024-04-29 13:37:56.390 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 33 ms.
2024-04-29 13:37:56.835 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 20 ms.
2024-04-29 13:37:58.064 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 45 ms.
2024-04-29 13:37:58.494 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 21 ms.
2024-04-29 13:37:59.836 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 14 ms.
2024-04-29 13:38:00.362 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 45 ms.
2024-04-29 13:38:01.569 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 30 ms.
2024-04-29 13:38:02.287 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 223 ms.
2024-04-29 13:38:03.396 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 20 ms.
2024-04-29 13:38:04.165 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 31 ms.
2024-04-29 13:38:05.586 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 25 ms.
2024-04-29 13:38:06.082 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 15 ms.
2024-04-29 13:38:07.659 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:38:07.660 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (133) [doSubmit] - EngineConn of ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175) is in Running.
2024-04-29 13:38:07.670 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:38:07.670 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (35) [info] - Success to submit task:[name:datax-test, id:1996212238863699968] to Linkis [linkis_id: 36_20_8a6f79df-ceb4-43e1-8e4a-ba861015d4bblinkis-cg-engineconniotdb-03.hostname.com:20175, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
2024-04-29 13:38:07.670 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Success to submit task:[name:datax-test, id:1996212238863699968] to Linkis [linkis_id: 36_20_8a6f79df-ceb4-43e1-8e4a-ba861015d4bblinkis-cg-engineconniotdb-03.hostname.com:20175, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
2024-04-29 13:38:07.744 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.e.DefaultTaskManager (35) [info] - Status of task: [name: datax-test, id: 1996212238863699968] change to Running, info: []
2024-04-29 13:38:07.745 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Status of task: [name: datax-test, id: 1996212238863699968] change to Running, info: []
2024-04-29 13:38:07.755 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-379 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Running => Succeed.
2024-04-29 13:38:08.091 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 9 ms.
2024-04-29 13:38:08.092 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.c.c.o.s.SubmittableSimpleOnceJob (133) [doSubmit] - EngineConn of ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775) is in Running.
2024-04-29 13:38:08.101 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 8 ms.
2024-04-29 13:38:08.101 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (35) [info] - Success to submit task:[name:datax-test, id:1996212238863699968] to Linkis [linkis_id: 36_20_e379222c-bcbc-488e-9fbe-063b81d8eb65linkis-cg-engineconniotdb-03.hostname.com:24775, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
2024-04-29 13:38:08.101 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Success to submit task:[name:datax-test, id:1996212238863699968] to Linkis [linkis_id: 36_20_e379222c-bcbc-488e-9fbe-063b81d8eb65linkis-cg-engineconniotdb-03.hostname.com:24775, info: {"ecmServiceInstance":{"instance":"iotdb-03.hostname.com:9102","applicationName":"linkis-cg-engineconnmanager"}}]
2024-04-29 13:38:08.123 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.e.DefaultTaskManager (35) [info] - Status of task: [name: datax-test, id: 1996212238863699968] change to Running, info: []
2024-04-29 13:38:08.124 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Status of task: [name: datax-test, id: 1996212238863699968] change to Running, info: []
2024-04-29 13:38:08.126 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-380 ] c.w.w.e.j.s.e.s.t.SubmitSchedulerTask (97) [transition] - Scheduler-SubmitTask-1996212238863699968 change status Running => Succeed.
2024-04-29 13:38:10.133 [INFO ] [Balancer-ThreadFlexibleTenancyLoadBalancer] c.w.w.e.j.s.e.l.FlexibleTenancyLoadBalancer (189) [lambda$loop$2] - Monitor: [tenancy: hadoop, task_segments: 15, wait_in_poll: 4]
2024-04-29 13:38:10.777 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-8   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 19 ms.
2024-04-29 13:38:10.777 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-8   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:20175","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"8a6f79df-ceb4-43e1-8e4a-ba861015d4bb"}.
2024-04-29 13:38:11.361 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-7   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 128 ms.
2024-04-29 13:38:11.362 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-7   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:24775","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"e379222c-bcbc-488e-9fbe-063b81d8eb65"}.
2024-04-29 13:38:11.672 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-8   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 894 ms.
2024-04-29 13:38:11.673 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-8   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:11.731 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-8   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:12.115 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-7   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 752 ms.
2024-04-29 13:38:12.115 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-7   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:12.132 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-7   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:12.755 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-2   ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_0-Status]
2024-04-29 13:38:12.766 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-2   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:12.766 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-2   ] o.a.l.c.c.o.i.EngineConnProgressOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnProgress operation, parameters is {"instance":"iotdb-03.hostname.com:20175","parameters":{"__operator_name__":"engineConnProgress"},"applicationName":"linkis-cg-engineconn","ticketId":"8a6f79df-ceb4-43e1-8e4a-ba861015d4bb"}.
2024-04-29 13:38:12.786 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-2   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 19 ms.
2024-04-29 13:38:12.787 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-2   ] o.a.l.c.c.o.i.EngineConnProgressOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnProgress operation, results is {progress=0.0, progressInfo=[{succeedTasks=0, failedTasks=0, id=null, totalTasks=0, runningTasks=0}]} .
2024-04-29 13:38:13.127 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-14  ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_12-Status]
2024-04-29 13:38:13.134 [INFO ] [Balancer-ThreadFlexibleTenancyLoadBalancer] c.w.w.e.j.s.e.l.FlexibleTenancyLoadBalancer (189) [lambda$loop$2] - Monitor: [tenancy: hadoop, task_segments: 15, wait_in_poll: 3]
2024-04-29 13:38:13.137 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-14  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:13.138 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-14  ] o.a.l.c.c.o.i.EngineConnProgressOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnProgress operation, parameters is {"instance":"iotdb-03.hostname.com:24775","parameters":{"__operator_name__":"engineConnProgress"},"applicationName":"linkis-cg-engineconn","ticketId":"e379222c-bcbc-488e-9fbe-063b81d8eb65"}.
2024-04-29 13:38:13.167 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-14  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 29 ms.
2024-04-29 13:38:13.168 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-14  ] o.a.l.c.c.o.i.EngineConnProgressOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnProgress operation, results is {progress=0.0, progressInfo=[{succeedTasks=0, failedTasks=0, id=null, totalTasks=0, runningTasks=0}]} .
2024-04-29 13:38:14.741 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-6   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:14.742 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-6   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:20175","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"8a6f79df-ceb4-43e1-8e4a-ba861015d4bb"}.
2024-04-29 13:38:14.759 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-6   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 17 ms.
2024-04-29 13:38:14.760 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-6   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:14.771 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-6   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:15.143 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-3   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:15.144 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-3   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:24775","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"e379222c-bcbc-488e-9fbe-063b81d8eb65"}.
2024-04-29 13:38:15.161 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-3   ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 17 ms.
2024-04-29 13:38:15.162 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-3   ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:15.173 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-3   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:16.134 [INFO ] [Balancer-ThreadFlexibleTenancyLoadBalancer] c.w.w.e.j.s.e.l.FlexibleTenancyLoadBalancer (189) [lambda$loop$2] - Monitor: [tenancy: hadoop, task_segments: 15, wait_in_poll: 4]
2024-04-29 13:38:17.783 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-16  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:17.784 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-16  ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:20175","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"8a6f79df-ceb4-43e1-8e4a-ba861015d4bb"}.
2024-04-29 13:38:17.791 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-11  ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_9-Status]
2024-04-29 13:38:17.800 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-16  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 16 ms.
2024-04-29 13:38:17.801 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-16  ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:17.803 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-11  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 11 ms.
2024-04-29 13:38:17.803 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-11  ] o.a.l.c.c.o.i.EngineConnProgressOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnProgress operation, parameters is {"instance":"iotdb-03.hostname.com:20175","parameters":{"__operator_name__":"engineConnProgress"},"applicationName":"linkis-cg-engineconn","ticketId":"8a6f79df-ceb4-43e1-8e4a-ba861015d4bb"}.
2024-04-29 13:38:17.810 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-16  ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:17.821 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-11  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 18 ms.
2024-04-29 13:38:17.822 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-11  ] o.a.l.c.c.o.i.EngineConnProgressOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:20175)) to execute engineConnProgress operation, results is {progress=0.0, progressInfo=[{succeedTasks=0, failedTasks=0, id=null, totalTasks=0, runningTasks=0}]} .
2024-04-29 13:38:18.170 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-10  ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_8-Status]
2024-04-29 13:38:18.180 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-10  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:18.181 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-15  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 7 ms.
2024-04-29 13:38:18.181 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-10  ] o.a.l.c.c.o.i.EngineConnProgressOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnProgress operation, parameters is {"instance":"iotdb-03.hostname.com:24775","parameters":{"__operator_name__":"engineConnProgress"},"applicationName":"linkis-cg-engineconn","ticketId":"e379222c-bcbc-488e-9fbe-063b81d8eb65"}.
2024-04-29 13:38:18.181 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-15  ] o.a.l.c.c.o.i.EngineConnMetricsOperator (73) [apply] - hadoop try to ask EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, parameters is {"instance":"iotdb-03.hostname.com:24775","parameters":{"__operator_name__":"engineConnMetrics"},"applicationName":"linkis-cg-engineconn","ticketId":"e379222c-bcbc-488e-9fbe-063b81d8eb65"}.
2024-04-29 13:38:18.197 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-10  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 16 ms.
2024-04-29 13:38:18.197 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-10  ] o.a.l.c.c.o.i.EngineConnProgressOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnProgress operation, results is {progress=0.0, progressInfo=[{succeedTasks=0, failedTasks=0, id=null, totalTasks=0, runningTasks=0}]} .
2024-04-29 13:38:18.199 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-15  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/executeEngineConnOperation taken: 18 ms.
2024-04-29 13:38:18.200 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-15  ] o.a.l.c.c.o.i.EngineConnMetricsOperator (81) [apply] - hadoop asked EngineConn(ServiceInstance(linkis-cg-engineconn, iotdb-03.hostname.com:24775)) to execute engineConnMetrics operation, results is {metrics={NodeResourceJson={"memory":1024.0 MB,"cpu":1}}} .
2024-04-29 13:38:18.208 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-15  ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Metrics info of task: [{"NodeResourceJson":"{\"memory\":1024.0 MB,\"cpu\":1}"}]
2024-04-29 13:38:19.134 [INFO ] [Balancer-ThreadFlexibleTenancyLoadBalancer] c.w.w.e.j.s.e.l.FlexibleTenancyLoadBalancer (189) [lambda$loop$2] - Monitor: [tenancy: hadoop, task_segments: 15, wait_in_poll: 4]
2024-04-29 13:38:20.820 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-13  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 10 ms.
2024-04-29 13:38:21.217 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-12  ] o.a.l.h.d.DWSHttpClient (160) [addAttempt$1] - invoke http://10.192.8.103:9001/api/rest_j/v1/linkisManager/getEngineConn taken: 7 ms.
2024-04-29 13:38:22.135 [INFO ] [Balancer-ThreadFlexibleTenancyLoadBalancer] c.w.w.e.j.s.e.l.FlexibleTenancyLoadBalancer (189) [lambda$loop$2] - Monitor: [tenancy: hadoop, task_segments: 15, wait_in_poll: 4]
2024-04-29 13:38:22.823 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-9   ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_7-Status]
2024-04-29 13:38:22.844 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-9   ] c.w.w.e.j.s.e.DefaultTaskManager (35) [info] - Progress of task: [1996212238863699968] change 0.0 => 1.0
2024-04-29 13:38:22.844 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-9   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Progress of task: [1996212238863699968] change 0.0 => 1.0
2024-04-29 13:38:22.845 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-9   ] c.w.w.e.j.s.e.DefaultTaskManager (35) [info] - Status of task: [name: datax-test, id: 1996212238863699968] change Running => Success
2024-04-29 13:38:22.845 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-9   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Status of task: [name: datax-test, id: 1996212238863699968] change Running => Success
2024-04-29 13:38:23.199 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-5   ] c.w.w.e.j.s.e.s.t.StatusUpdateSchedulerTask (34) [onPoll] - Status update task: [1996212238863699968] in scheduler: [Multi-Tenancy-Group-hadoop_0_3-Status]
2024-04-29 13:38:23.200 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-5   ] c.w.w.e.j.s.e.DefaultTaskManager (35) [info] - Status of task: [name: datax-test, id: 1996212238863699968] change Running => Success
2024-04-29 13:38:23.200 [INFO ] [Multi-Tenancy-Group-hadoop-Executor-5   ] c.w.w.e.j.s.l.DefaultRpcJobLogger$ (23) [onEvent] - [hadoop:5095d23c-6a4b-48ae-b1d9-87ceb6503eaf] Status of task: [name: datax-test, id: 1996212238863699968] change Running => Success

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!
@ryze124 ryze124 added the bug Something isn't working label Apr 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant