Streamis application initialization supports online application import and versioning #67

jefftlin · 2023-03-01T08:55:22Z

What is the purpose of the change

#64

Brief change log

Adjust the order to inspect the savepoint path defined first;
Sort the job version details;
Get latestJobVersion form StreamJobVersion;
Problem in sql expression;
Avoid the ambiguity in sql expression;
Add lastVersion property in the resultSet of querying job list;
Fix the null pointer exception in "/execute/inspect";
Fix the bug of uploading job exception;
Inspections of stream job; Support to define job configuration in meta.json file;
Support to deploy the version of job when the related task not completed.

Verifying this change

View the version upgrade feature in the docs directory and use the feature.

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (no)
Anything that affects deployment: (no)
The Core framework, i.e., JobManager, Server.: (no)

Documentation

Does this pull request introduce a new feature? (yes)
If yes, how is the feature documented? (docs)

… flink will be larger）

Add mysql connector jar.

…ach the tenant label to streamis job; Enable to store the undefined configuration pairs.

…meters that with blank character in job.

…and dss to "1.1.0" and "1.1.3"

…into dev-0.2.0

…-0.2.0

…bState interface

…-0.2.0

…eamis into dev-0.2.3-log-collector

…v-0.2.3-log-collector

…ollector New log collector module

* Upgrade the version of pom to 0.2.3 * Minor fix Co-authored-by: jefftlin <jefft_lin@163.com>

…s.path" fixed WeBankFinTech#56

Fix the problem of transformer component in Streamis

Co-authored-by: jefftlin <jefft_lin@163.com>

* Add keyword filter strategy in log4j/log4j2. * Use the stream log event timestamp as the enqueue time. * Init the structure of supporting multiple disks/drivers. * Load balancer strategies for storing stream log. * Adjust the default value of configuration. * Add test unit for job log storage. * optimize the restful performance. * Add debug mode in log collector; Add the strategy to discard log cache. * Fix the problem in closing log4j bucket. * Optimize the strategies.

…ted.

…a.json file.

green241 and others added 30 commits March 1, 2022 18:32

Add mysql connector jar.

87f0110

Set upload zip file size to 500MB.（Sometimes the fat package built by…

bac661e

… flink will be larger）

Merge pull request WeBankFinTech#14 from green241/main

d9e0427

Add mysql connector jar.

Fix the problem that fetch workspace users failed.

482d258

Merge remote-tracking branch 'origin/main' into main

b467643

Fix the problem that alert records will persistent failed by dao.

1961788

modify stoped to stopped

2932463

Fix the problem that method call in circle.

788267a

Merge remote-tracking branch 'origin/main' into main

77e0fc7

Add support of extra flink configs.

9920549

Consider the situation of no matched configuration in web page

45baf68

Enable the developer to update/insert the configuration of users; Att…

8c4b428

…ach the tenant label to streamis job; Enable to store the undefined configuration pairs.

Adjust the streamis_ddl.sql

cbf02dd

Adjust the streamis_ddl.sql to accept large value of field

4382103

Redefine the project file regex; Filter and replace the specific para…

dd96663

…meters that with blank character in job.

Roll the version to "0.2.0"; Change the dependency version of linkis …

a671944

…and dss to "1.1.0" and "1.1.3"

Init the streamis AppConn

23b62f6

feat: 【前端】流式应用的 Yarn 执行日志展示

bb14b8a

feat: modify detail tab i18n

c7ecaab

add streamis Appconn

bed0842

Merge branch 'dev-0.2.0' of https://github.com/WeDataSphere/Streamis …

297ef5e

…into dev-0.2.0

feat: 初步写下前端逻辑，还剩进度条

0244cfe

Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…

71f5602

…-0.2.0

update streamis Appconn

3e40d5f

feat: 失败信息列表也加一下

c428b9d

Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…

5bcf9cd

…-0.2.0

Adjust dependency and structure of the job launcher module and add Jo…

9035fe0

…bState interface

Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…

d84d239

…-0.2.0

Refresh the TODO list

e38a933

Adjust the module of job launcher for Linkis.

e81b9fa

Davidhua1996 and others added 25 commits October 29, 2022 16:13

Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Str…

626111c

…eamis into dev-0.2.3-log-collector

resolve 413 response status for update task.

0e30a10

Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…

d996cf2

…v-0.2.3-log-collector

adjust the relation path in pom.xml.

016ad6c

Fix the problem in pom.xml of stream job log modules.

d36a385

resolve the LinkisJobInfo is null for adding task.

72b1fd4

Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…

f7a20d2

…v-0.2.3-log-collector

Merge pull request WeBankFinTech#54 from WeDataSphere/dev-0.2.3-log-c…

4d6a455

…ollector New log collector module

Upgrade the version of pom to 0.2.3 (WeBankFinTech#55)

c8ecd3f

* Upgrade the version of pom to 0.2.3 * Minor fix Co-authored-by: jefftlin <jefft_lin@163.com>

Use the "flink.yarn.ship-directories" instead of "flink.app.user.clas…

6221b04

…s.path" fixed WeBankFinTech#56

Merge pull request WeBankFinTech#57 from WeDataSphere/dev-0.2.3-bugfix

ca0c41b

Fix the problem of transformer component in Streamis

Upgrade the version of pom to 0.2.4 (WeBankFinTech#58)

ec3def1

Co-authored-by: jefftlin <jefft_lin@163.com>

Support to deploy the version of job when the related task not comple…

ec778b9

…ted.

Inspections of stream job; Support to define job configuration in met…

bb21dc9

…a.json file.

Fix some problems.

17dbd22

Fix the bug of uploading job exception

58c6338

Fix the null pointer exception in "/execute/inspect".

bb28171

Add lastVersion property in the resultSet of querying job list.

4e48598

Avoid the ambiguity in sql expression.

b055ad3

Problem in sql expression.

781397e

Get latestJobVersion form StreamJobVersion

44ea004

Fix bug of getting inspectName & getLatestJobVersion

3752050

Sort the job version details

49d7cc6

Adjust the order to inspect the savepoint path defined first

27d7bb9

jefftlin requested a review from Davidhua1996 March 1, 2023 08:57

Alexkun force-pushed the dev-0.2.5-job-version branch from 60f6667 to 4b8ce4f Compare November 29, 2023 05:16

GLeXios force-pushed the dev-0.2.5-job-version branch from 4b8ce4f to 27d7bb9 Compare November 29, 2023 14:55

Alexkun force-pushed the dev-0.2.5 branch from 4052f2f to 466938a Compare November 30, 2023 13:07

Alexkun force-pushed the dev-0.2.5 branch from 466938a to f7b6291 Compare April 15, 2024 13:45

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Streamis application initialization supports online application import and versioning #67

Streamis application initialization supports online application import and versioning #67

jefftlin commented Mar 1, 2023

Streamis application initialization supports online application import and versioning #67

Are you sure you want to change the base?

Streamis application initialization supports online application import and versioning #67

Conversation

jefftlin commented Mar 1, 2023

What is the purpose of the change

Brief change log

Verifying this change

Does this pull request potentially affect one of the following parts:

Documentation