Skip to content

Releases: apache/dolphinscheduler

3.2.1

07 Feb 09:49
Compare
Choose a tag to compare

Bugfix

  • fix: Resource relate path invalid when tenant change (#15581)
  • [fix][worker]:Fix the issue of missing disk usage reporting information in the worker (#15565)
  • [Fix] Fix WorkflowInstance batch start failed will throw incorrect exception. (#15577)
  • Fix create parent directory will cause FileAlreadyExistsException (#15576)
  • Fix Recover WorkflowInstance will casue workflow Instance state is success but task insatnce is killed/paused (#15574)
  • fix: data quality may fail in docker mode (#15563)
  • fix: start param for wf not work (#15544)
  • fix: ddl without drop exists (#14128)
  • fix switch js (#15487)
  • fix: data quality can not use (#15551)
  • Fix createFile with permission will not work (#15556)
  • [Bug][force-success] force success add end time (#15144)
  • [Bug][Task Api] fix 'MACPATTERN' in ProcessUtils and cover all cases on MacOS in ProcessUtilsTest (#15480)
  • Fix TaskGroupQueue will never be wakeup due to wakeup failed at one time (#15528)
  • Exit JVM when OOM (#15538)
  • Fix exception occur in RpcServer side, it will not be sent to RpcClient (#15536)
  • front: When you edit a task in the task definition list, the front task list is displayed (#12819)
  • [Fix] [Bug] Change default version of Workflow/TaskDefinition to 1 (#15498)
  • [Bug] Fix a bug, When the worker service offline, workerNodeInfo cache in master cannot delete the offline worker (#15459)
  • fix workflow will have same updatetime when import (#14810)
  • [BUG] #15013 Fix retryInterval in RetryPolicy will never be used in RetryUtils (#15014)
  • Throw IllegalArgumentException if parse time placeholder error (#15514)
  • Fix PostgresqlDatabaseContainerProvider get Image is incorrect (#15434)
  • [Bug][Api] Fix NPE when deleting a workflow instance (#15485)
  • Directly Throw exception when taskInstancy log path is empty which log need to be queried (#15511)
  • Fix notify failover WorkflowInstance will cause NPE (#15499)
  • [HotFix] Fix createTaskInstanceWorkingDirectory failed if the old path exist (#15377)
  • [bug] Exception when using host in ipv6 format (#14040)
  • [Bug][Master]serial_wait strategy workflow unable to wake up (#15270)
  • [BUG][Task] fix java task classpath (#15470)
  • [Bug] [Audit log] Fix Audit log UI query error (#15427)
  • [Bug][Registry] Optimizing waiting strategy (#15223)
  • Set TaskGroupQueue updateTime when force start (#15510)
  • TaskGroupPriority only compare When TaskGroup is same (#15486)
  • Remove taskQueue and looper in worker (#15292)
  • Display the resource file doesn't exist message in task create page (#15350)
  • Recreate new TaskInstance Working Directory when exist in worker (#15358)
  • [Bug] Close SSH session after remote shell finish (#15348)
  • Fix check value rather than key in AbstractDataSourceProcessor#checkOther (#15351)
  • Fix resource file usage(Delete Resource/ResourceUser which is deprecated)
  • [Bug][Master] send ACK event timeout (#15346)
  • Fix k8sTaskExecutionContext setting configYaml (#15116)
  • [Fix #15129] [Dependent] The date rules of the dependent node are ambiguous. (#15289)
  • Fix failover Master might not release taskGroup (#15287)
  • [HotFix] Fix TaskOutputParameterParser might OOM if meed a bad output param expression (#15264)
  • [Bug-15215][Api] non-admin should not modify tenantId and queue (#15254)
  • Set the tenant as the owner in final stage (#15256)
  • Use chown to set the file owner (#15240)
  • [Fix] Change HTTP plugin timeout param to number type (#15234)
  • fix switch condition (#15228)
  • Fix docs style is incorrect by CI pass (#15167)
  • Expire session when update user password (#15219)
  • Fix home page workflow instance miss status (#15193)
  • fix security issue (#15192)
  • fix can't stop bug (#15191)
  • Remove API Result in Service (#15181)
  • Exclude DataSourceAutoConfiguration in worker server (#15169)
  • [Bug] Fix TriggerRelationMapper cannot work due to miss DatabaseIdProvider (#15153)
  • Fix spotless (#15164)
  • Fix incorrect button display text (#15160)
  • [Fix][Data Quality] Change t_ds_dq_rule_input_entry field name fix PostgreSQL not support value issue (#14992)
  • fix missing 'KYUUBI' in droplist of datasource (#15140)
  • [Bug] Fix endless loop (#15092)
  • fix: execute sql error: datasource plugin 'doris' is not found。 (#15123)
  • Fix confusing constant string for unit convertor (#15126)
  • [fix-#11726] fix error when set connection proerty both in the URL and an argument (#15093)
  • [Fix-15072][Resource Center] Non-admin user can not query resource recursively (#15097)
  • [E2E][Bug] Fix k8s-e2e (#15098)
  • Fix SqlTask cannot split the given sql when browser in windows (#15062)
  • [Fix-15036] [API] Fix task definition edit doesn't work (#14801)
  • remove sub workflow finish notify (#15057)
  • Fix missing Kyuubi type in UI (#15051)
  • [Fix-14885][pom] fix spotless format file path (#14889)
  • Fix When the task instance status is 'STOP' (#14967)
  • Revert "[Bug] [Resource] fix resource delete bug (#15003)
  • [Bug] [Resource] fix resource delete bug (#15003)
  • Delete File generated by UT (#15022)

Improvement

  • [Improvement][UT] Improve Worker registry coverage (#15380)
  • refactor comments & function name for confuse (#15546)
  • [Improvement][HTTP] support custom rendering of http body (#15531)
  • [improvement][api] Fix typo for controllers (#15438)
  • [Feature-15475][DinkyTask] DinkyTask supports Dinky-1.0.0 and common sql (#15479)
  • [Improvement][K8S]Optimize MDC for K8S tasks (#15390)
  • Enable set ServerLoadProtection fot Master/Worker (#15439)
  • [Feature] timed scheduler Improvement (#15449)
  • [Improvement][E2E] add e2e javatask case (#15469)
  • [Enhancement][API]Enhance mysql connection properties (#15433)
  • [Improvement][E2E]e2e improve add workflow httpTask e2e case (#15420)
  • Add config for defaultTenantEnabled (#15391)
  • Use DefaultUncaughtExceptionHandler to log the uncached exception (#15496)
  • adjust the sequence of alarm group and add validate (#15382)
  • Use Druid to split sql (#15367)
  • optimize add select filter (#15378)
  • [Improvement][Helm] using helm-docs to generate docs automatically (#15299)
  • [Improvement][K8S] Custom label of a K8S task can be passed to the pod (#15369)
  • Optimize server startup log (#15362)
  • [Improvement][E2E] support e2e compose v2 fix code style (#15325)
  • [Improvement] Ensure that HttpUtils can only get result from certification URL (#15288)
  • delete debugger (#15316)
  • Set maxRows in SqlTask (#15342)
  • [Feature-15146][dolphinscheduler-task-sqoop] add sqoop source/target type (#15146)
  • [Feature-15248][dolphinscheduler-alert-plugins] add alert plugin aliyun-voice (#15248)
  • [Improvement-15260][dolphinscheduler-datasource-hana] add hana related dependencies (#15260)
  • fail-fast for dependent check (#15197)
  • [Improvement] Move delay calculation to Master (#15278)
  • Add dolphinscheduler-extract-common module (#15266)
  • Support parse task output params under multiple log (#15244)
  • [Improvement-15009][Parameter] Change project parameter value to text (#15010)
  • Remove spring cache for dao (#15184)
  • [Improvement] Clean up Scheduler logic (#15198)
  • [Improvement][Alert] Add a test send feature when creating an alert instance (#15163)
  • [Improvement][Helm] support task type filter (#15179)
  • [Improvement][Resource Center] Display brief file name in file-details page (#15137)
  • [Improvement][Alert] Add timeout params for HTTP plugin (#15174)
  • [feature#14654] alert-spi support prometheus alertmanager (#15079)
  • [Improvement][K8S] Remove ResourceQuota (#14991)
  • [Improvement] Refactoring K8S task plugin with connections managed in connection center (#14977)
  • [DSIP-19] Support sagemaker connections in the connection center, as well as external connections to the connection center in sagemaker tasks (#14976)
  • [DSIP-19] Support zeppelin connections in the connection center, as well as external connections to the connection center in zeppelin tasks (#14434)
  • [Feature-14832][Listener]Implementation of Listener Mechanism (#14981)
  • Remove mapper usage in tools (#15073)
  • [Feature-14678][Master][UI]Dependent task parameter passing (#14702)
  • Add IT for mysql5/postgresql16 initialize/upgrade (#15063)
  • Add IT for dolphinscheduler-tools module (#15043)
  • Set kubectl version to v1.28.3 (#15053)
  • Add dolphinscheduler-dao-plugin module (#15019)
  • [improvement][Resources] Improve details page return to the previous list page (#14951)
  • [Improvement][Alert] Alert plugin enhance fail message (#15024)
  • [Improvement][Registry][Jdbc] Add jdbc registry config in helm charts (#14431)
  • [Improvement][Master] Calculate the remainTime then we set the delay execution. (#15012)

Document

  • [Doc][Docker] fix typo on start with docker (#15534)
  • [Doc] remove skywalking, update note (#15028)
  • Change download url in backend.yml (#15526)
  • [Doc][K8S] Add DS K8S Operator into k8s deployment character (#15516)
  • Add guideline link into DolphinScheduler mail list (#15447)
  • Remove unused cache-evict.png (#15220)
  • [Doc-15500][Task] Update cli opts of spark and flink (#15501)
  • doc write wrong,should be MinIO it's not MinION (#15395)
  • [Doc]remove temporary markdown comments (#15385)
  • doc: Classify docs to avoid misleading (#15282)
  • Add deploy on Terraform on README (#15189)
  • Modify the documentation that python task will not work properly when '\n' indicates the presence of a variable and needs to use 'repr(value)' (#15145)
  • [Docs] fix typo (#15032)

Chore

  • merge schema 330 into 321 and change docs (#15582)
  • Set the workflow instance ready state to running in failover (#15572)
  • cp: Reduce the size of tarball to continue ASF release (#15004)
  • chore: Docs change for 3.2.1 release (#15539)
  • [DS-15489][style]rename the vo object suffix (#15504)

3.1.9

22 Dec 06:01
Compare
Choose a tag to compare

What's Change

Bugfix

Doc

Full Changelog: 3.1.8...3.1.9

3.2.0

11 Oct 09:47
Compare
Choose a tag to compare

New release for version 3.2.0

Feature

Click to expand

Improvement

Click to expand
  • [Improvement-11773][api] Optimize the log printing of the api module according… (#11782) @guowei-su
  • [Improvement][Test] Give an example on replacing Powermock with Mockito (#11588) @EricGao888
  • [Improvement-11857][Spark] Remove the spark version of spark task (#11860) @rickchengx
  • [Improvement][SQL Task]use default sql segment separator (#10869) @zhuxt2015
  • [Improvement][Test] Remove powermock in dolphinscheduler-master module (#12143) @EricGao888
  • [Improvement][Test] Remove powermock in service and server modules (#12164) @EricGao888
  • [Improvement-12144] Remove powermock in dolphinschduler-api (#12169) @rickchengx
  • [Improvement-11880][Hivecli] Improve the UI of HiveCli (#11882) @rickchengx
  • [Improvement][Test] Remove the usage of powermock in datasource-plugin module (#12194) @EricGao888
  • [Improvement][Test] Remove powermock from DatasyncTaskTest (#12270) @EricGao888
  • [Improvement][Test] Fully remove the usage of powermock from the whole project (#12244) @EricGao888
  • [Improvement][Test] Migrate all UT cases from jUnit4 to jUnit5 in task-plugin module as an example (#12299) @EricGao888
  • [Improvement-12296][Test] Close static mock (#12300) @rickchengx
  • [Improvement-12289][k8s] update the common.properties in values.yaml (#12290) @rickchengx
  • [Migrate][Test] Migrate all UT cases from jUnit 4 to jUnit 5 in alert and api module (#12337) @EricGao888
  • [improvement] Migrate all UT cases from jUnit4 to jUnit5 in dao module (#12328) @fuchanghai
  • [Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in datasource, registry and data-quality modules (#12352) @EricGao888
  • [Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in common, service, and spi modules (#12363) @DarkAssassinator
  • [Improvement][Test] Block the usage of powermock and move mockito dependencies from sub-modules to root pom (#12311) @EricGao888
  • [Migrate][Test] Migrate all UT cases from jUnit 4 to 5 in master, worker, and remote modules (#12362) @DarkAssassinator
  • [Migrate][Test] Migrate other UT cases from jUnit 4 to 5, change @ignore to @disable (#12382) @DarkAssassinator
  • [Improvement] add presto in datax (#12371) @fuchanghai
  • [Migrate][Test] Add Spotless step to check and block jUnit4 imports (#12398) @EricGao888
  • [Improvement][Style] Fix remaining style errors and wildcard imports (#12412) @EricGao888
  • [Improvement-12333][Test] Migrate all UT cases from jUnit 4 to jUnit 5 in microbench and e2e module (#12348) @rickchengx
  • [Improvement-12446][CI] Run mvn spotless apply (#12447) @DarkAssassinator
  • [Improvement][Style] Update spotless junit4 check scope (#12450) @EricGao888
  • [Refactor] Migrate all command-related interface functions from ProcessServiceImpl (#12474) @DarkAssassinator
  • Update the project introduction (#12501) @davidzollo
  • [Improvement] add springdoc-openapi-ui (#12379) @fuchanghai
  • [Refactor]migrate some task dao functions from ProcessServiceImpl to dao modules. (#12505) @DarkAssassinator
  • [Refactor] Migrate all workergroup-related interface functions from ProcessServiceImpl (#12493) @DarkAssassinator
  • Fix alert status spelling error (#12592) @qingwli
  • [Improvement-12536][k8s] Support the command for the container in k8s task plugin (#12538) @rickchengx
  • [Improvement][Install] Add ${zkRoot} description. ...
Read more

3.1.8

02 Aug 12:10
Compare
Choose a tag to compare

What's Change

Bugfix

  • [Fix-#14537] the branch that needs to be executed overlaps with another branch, it may not be able to complete the normal execution #14563
  • Use adhoc connection in sql/procedure task #14670
  • [Fix][SeaTunnel] Fix wrong judgment condition when building parameters of seatunnel task node. #14594
  • [Bug] [Seatunnel-Task] Run Mode defaults to run, and you cannot select a null value #14267
  • [Fix-#14447]The judgment in k8sUtils#getPodLog is not accurate #14448
  • [Fix-14441] [Bug] [Alarm Instance Manage] Search result list error #14444
  • [Fix-14397][dao] the task node in the imported workflow definition was not displayed on the task definition page #14398
  • [Bug] [Master] fix State event handle error, get a unknown exception, will retry this event with IndexOutOfBoundsException #14361
  • [Fix-#14303][Master] workflow with sub_process task can't be stop when running #14343
  • [Alert] [HTTP Plugin] Lose HTTP port #14341
  • [Fix-#10340][UI] Fix resource center upload file timeout bug #14268
  • [Bug][plugin]Fix: Correct the way to determine the yarn queue in Flink CommandLine and SQL mode #14237
  • [Bug][API] Fix TreeView "Task Status" not show bug and compatibility with older versions use WorkflowExecutionStatus.name() #14207
  • [Fix] default datax plugin, using RDBMS as default. #14204
  • [Fix-#14008][registry] cache keep alive lease #14034
  • [Fix-#11877][UI] Fix the problem that the environment cannot be deleted on the UI of some tasks #11878

Doc

  • [Doc] Support Sqoop in Website #14435

chore

  • [CI] [Test] Try to fix jar conficts #14407
  • [NOTICE]Update the NOTICE year #14272

Full Changelog: 3.1.7...3.1.8

2.0.9

30 May 14:11
Compare
Choose a tag to compare

What's Change

Bugfix

  • [Fix-13581][UI][2.0.9] Speed up the refresh of task status in process instance (#13587)
  • [rollback-12488] Roll back the logic of execution complement failure stop (#13723)
  • [Fix-13760] [server] When running the specified job and its downstream jobs, enable dry running of the specified job, causing the downstream jobs to dry run at the same time (#13961)
  • [Fix-13814] [Built-in variable] shell task transfer param (#13974)

Full Changelog: 2.0.8...2.0.9

3.0.6

25 May 12:43
Compare
Choose a tag to compare
  • [fix-#14086]The subprocess type node is always in the ready stop state #14087
  • [Fix-13913][Master] syncMasterNodes does not make current slot correctly after zookeeper reconnect #14014

3.1.7

22 May 09:38
Compare
Choose a tag to compare

What's Change

Bugfix

  • fix: Save task seatunnel error #14129
  • [fix-#13940] add status of stop in class of TaskExecutionStatus (#14016)
  • [Bug-13951 ][dolphinscheduler-service] StartParams is not applied when task is failover(RECOVER_TOLERANCE_FAULT_PROCESS CommandType) #13958
  • [fix-#14169]The subprocess type node is always in the ready pause or ready stop state (#14170)
  • [fix-11321][ui] fix create workflow contains chunjun node failed (#11979)
  • make status and schedule publish status display together (issue-12834) (#12922)
  • fix the select component on the page of workflow relation (#13805)

doc

  • [Doc] Fix upgrade-schema.sh cannot load driver class (#14072)

Full Changelog: 3.1.6...3.1.7

3.1.6

10 May 03:48
Compare
Choose a tag to compare

What's Change

Bugfix

  • [Fix-13928][UI] Fix repeat CustomParams input box #14029
  • [Fix-13815][master] Fix dependent task incorrect timeout alerts #13822
  • [Fix 13941]Fix replace time variable #13975
  • [BUG][Data Quality] Fixing the incorrect DML statements in upgrade SQL. (#13960)
  • [Fix-13780][api] Fix the problem of process instance DAG can't show dependent task #13823
  • fix-13869: add return success judge #13873
  • [Bug] [worker] WorkerConfig output is wrong #14001
  • OracleSouce edited again, ConnectionType is null #13881
  • [Fix-13596][Task Instance] Throw an error message to tell the user that the file cannot be found instead of NPE during task execution (#13878)
  • [Fix-13828][api] Fix the problem of work groups have two defult records #13829
  • Fix schedule time data primary key conflict when importing workflow definition (#13926)
  • Fix item, workflow, and task parameters in dependent task nodes can be searched (#13918)
  • fix: when sudo enable is false, execute command will failed (#13860)
  • [Bug] [Cron] Parse corn expression error #13841

doc

  • [doc] Change DinkyTask picture to english (#14061)
  • [doc] Change readme and standalone docker quick start (#14002)
  • [doc] Update resource local file system docs (#13982)
  • [doc] Add hyperlink for pydolphinscheduler doc (#13907)

chore

  • [E2E-Test] Try to fix flaky e2e test (#13971)
  • Add release Helm Chart #13385
  • docker auto push tag name (#13858)

Feature

  • [Feature-13052][Task Plugin] Support Seatunnel flink-v2, spark-v2, seatunnel-engine (#13086)

Full Changelog: 3.1.5...3.1.6

3.1.5

03 Apr 10:24
Compare
Choose a tag to compare

What's Change

Bugfix

  • [Fix-13657][Master]NPE caused by the execution of workflow with startNode and forbidden task (#13668)
  • [Bug][Master] fix task failure continue (#13155)
  • fix when the task details are not modified, the predecessor node cannot be modified (#13422)
  • Fix when update scheduler will execute workflow #13285
  • [Fix-11583][UI] Fix the API usage of gantt graph #13778
  • [Fix][Alert] Fix when auth is false and user || pwd null can't send email excection #13761
  • Fix Bug [Athena Datasource] datasource other params illegal (#13032)
  • [fix][sql] Add unique key to process_definition_log avoid TooManyResultExpection #12503
  • [Fix][Data Quality]Dataquality Spark Get Datasource Password Error When Password Has $ #13643
  • [BUG][UI] Flink task display right version and deploy mode (#13628)
  • [Bug-13666] remove WORKER_GROUP in values.yaml #13718
  • Fix webex teams alert plugin null exception error (#13591)
  • feat: Python return datasource object and allow filter by type (#13616)
  • feat: Python add online_schedule for workflow control schedule state (#13551)
  • [fix] Remove tenant arg in workflow definition (#13212)
  • [improve-#13678] add filter in method of setMainJarName (#13748)
  • fix: python gateway tenant code query

chore

  • Publish Docker images to docker hub when released #13631

Full Changelog: 3.1.4...3.1.5

3.0.5

30 Mar 13:33
Compare
Choose a tag to compare

What's Changed

  • fix: when auth is false and user || pwd null can't send alert email excection #13761
  • fix: API usage of gantt graph in UI #13778
  • fix: when update scheduler will execute workflow #13285
  • fix: when the task details are not modified, the predecessor node cannot be modified #13422
  • fix: NPE caused by the execution of workflow with startNode and forbidden task #13668
  • fix: task failure continue #13155
  • chore: Publish Docker images to docker hub when released #13631