3.2.3.0

New Features

1. Count Window for stream processing. The starting and ending condition of a stream processing window is determined by the number of rows in the window
2. TDengine monitoring
   • Refactored the metrics collected by taosd service, and refined the Grafana dashboard for monitoring taosd services
   • Collected rich metrics for taosX service, and designed new Grafana dashboard for monitoring resource usage, taosX services, agents, and data in tasks of various data source types
3. New License Mechanism
   • Advanced database features need to be granted, a single license key can grant the fundamental database and/or one or more advanced features
   • Data in features need to be granted, a single license key can grant one or more data source types
4. Data In: Wonderware Historian data can be ingested into TDengine
5. Data Compression between taosX-Agent and taosX to save bandwidth in case they are not in same network

Improvements

1. Performance improvemnt
   • The cache for last is built when creating super tables and child tables to improve the performance of querying last() or last_row() the first time
   • The cache for last can be utilized when querying both last() and last_row() together in a single SQL statement
   • The performance of querying last_row() when there is a column full of NULL values is improved significantly
   • Performance improvement when transferring data from Pi/OPC to TDengine
   • Performance improvement when transferring data from TDengine 2.6 to TDengine 3.x in case there are millions of tables but each table only has few rows
2. Query optimization
   • Query statement "select count(*)" can filter out empty tables
3. System Operations
   • The impact on data writing when performing "redistribute vgroup" operation is minimized using RAFT learner mechanism
   • Command "restore vnode" can be performed on a single vgroup ID
   • An empty dnode, i.e. without any vnode, can be dropped by force, regardless of online or not
4. Data In Optimizations
   • The initial timestamp can be ignored when writing into TDengine from OPC
   • Advanced options are consolidated and refined for some data source types
   • More options, such as skipRows, delimiter, quoteChar, commentPrefix, have been added for CSV data source
5. Explorer
   • support HTTPS
   • Users can view task related logs

What's Changed

• docs: fix markdown error by @danielclow in #21280
• docs: fix broken links by @sangshuduo in #21288
• merge main into 3.0 branch. by @hjxilinx in #21270
• Enh/rocksdb sstate merge dev3 by @yihaoDeng in #21245
• docs: update readme with libgflags by @sangshuduo in #21293
• docs: update grafana doc for 3.0 by @sangshuduo in #21300
• enh(taosAdapter): update taosAdapter by @huskar-t in #21298
• feat: create dnode limited by grant of cpu cores by @kailixu in #21291
• Correction/纠正 01-data-type.md by @meeki007 in #21313
• Enh/rocksdb sstate merge by @yihaoDeng in #21295
• feature(tmq): add new API to extract offset from result set. by @hjxilinx in #21316
• fix: client hb logic fix and optimization by @kailixu in #21315
• fix: file fd not clear issue by @dapan1121 in #21319
• fix: fix null pointer issue in destroyTimesliceOperator by @glzhao89 in #21308
• pause source task by @54liuyao in #21320
• chore: restore the test cases by @kailixu in #21327
• chore: change rocksdb repo to upstream by @sangshuduo in #21318
• fix: client HB logic by @kailixu in #21334
• fix stream queue mem leak by @54liuyao in #21344
• Update cases.task by @plum-lihui in #21357
• merge main, and do some internal refactor. by @hjxilinx in #21353
• test: add cluster global tdDnodes by @DuanKuanJun in #21317
• feat: add restore command sets to taos-CLI by @DuanKuanJun in #21354
• fix: fill window end issue by @dapan1121 in #21363
• Update container_build.sh by @tomchon in #21370
• Test/td 21161 by @happyguoxy in #21326
• fix pause agg task by @54liuyao in #21367
• state merge into 3.0 by @yihaoDeng in #21364
• restore learner stuck by @cadem in #21350
• refactor: do some internal refactor. by @hjxilinx in #21362
• test: increase timeouts of checking db ready by @tomchon in #21373
• change restore prompt message by @cadem in #21366
• status resp return null when only one ep by @cadem in #21322
• Feat/force drop dnode by @cadem in #21325
• docs: fix zh/02-intro by @sangshuduo in #21380
• doc: refine Kafka source connector configuration parameters by @gccgdb1234 in #21377
• enh(cache/batchread): load columns in one trip by @stephenkgu in #21331
• fix: invalid memory access of buffer after vsnprintf by @wangjiaming0909 in #21348
• doc: refine kafka connector by @gccgdb1234 in #21381
• opt stream ci test by @54liuyao in #21383
• feat: support client meta control by @dapan1121 in #21335
• feat: support update active code by SQL by @kailixu in #21358
• fix: fix interp in nested query and fill value with string issue by @glzhao89 in #21352
• feat(query): interp support ignore null value opition by @glzhao89 in #21329
• fix: fix assert crash in tsort.c by @glzhao89 in #21391
• docs: update wechat tdengine1 by @sangshuduo in #21395
• Refact/fillhistory by @hjxilinx in #21396
• docs: udf requires python 3.7+ by @sangshuduo in #21397
• doc: add td.connect.type by @gccgdb1234 in #21400
• doc: refine td.connect.type by @gccgdb1234 in #21403
• fix: free assignment crash on Windows by @huskar-t in #21402
• add parameter by @yihaoDeng in #21409
• fix(cache/loading): skip partial loading tables by @stephenkgu in #21410
• docs: update docs for tdinsight and monitor by @sunpe in #21408
• Update 01-faq.md by @DuanKuanJun in #21392
• fix: last query taosd crash issue by @dapan1121 in #21415
• Update 01-faq.md by @DuanKuanJun in #21420
• fix(cache/commit): skip batch write if empty by @stephenkgu in #21389
• fix: last(tag) report error issue by @dapan1121 in #21419
• docs: update connect for jdbc version by @sangshuduo in #21426
• fix: tsdb read and append _wstart for tsma by @kailixu in #21413
• enh(taosAdapter): support get assignment and seek by @huskar-t in #21416
• fix(cache/read): set none to null instead of skipping column by @stephenkgu in #21432
• fix(cache): sychronize commit, read and write threads with writebatch by @stephenkgu in #21429
• test:comment unit test catalog in cases by @tomchon in #21435
• test:comment the testcase of tmq by @tomchon in #21425
• Remove taosx, connector, explorer and taoskeeper in cloud tdengine by @wingwing2005 in #21422
• fix: alter dnode option has no effect by @kailixu in #21439
• fix: last(tbname) out of memory issue by @dapan1121 in #21430
• docs: 3.0.4.2 by @xleili in #21443
• build: release ver-3.0.4.2 by @xleili in #21444
• fix: remove taosTools zh duplicate release ver-2.5.0 by @xleili in #21447
• set agg pause status by @54liuyao in #21442
• comfirm msg when add learner by @cadem in #21...

3.2.2.0

New Features

1. Data compacting operations can be queried and killed (Enterprise only)
2. Simple Storage Service or Object Storage Service (aka S3) can be used at the last tier of multi-tier storage (Enterprise only)
3. Stream processing supports Event Window
4. TDenginer server supports Windows/x64 platform (Enterprise only)
5. ODBC driver

Improvements

1. Performance improvement for some query scenarios, like partition by and sorting for super tables
2. Adaptive API for BI tool integration
3. Performance improvement for snapshot transfer, which accelerates the speed of redistributing vgroup or altering replica
4. Floating point numbers can be written into columns of integer type

What's Changed

• test:add testcase of rsma by @tomchon in #23676
• fix(stream): check the status before pause by @hjxilinx in #23710
• TD-27311 by @cadem in #23696
• fix(cos/single): destroy grow buffer or release fd by @stephenkgu in #23715
• Test/ts 3932 by @happyguoxy in #23708
• fix(stream): wait for task to be normal and then send data block. by @hjxilinx in #23727
• Fix/td 27351 by @stephenkgu in #23729
• fix(tsdb/cos-merge): skip stt merging & not block commit by @stephenkgu in #23728
• fix(stream): wait for task to be normal and then send data block. by @hjxilinx in #23723
• fix/TD-27336 by @cadem in #23713
• fix/TD-27336 by @cadem in #23711
• fix(stream): add check for assert. by @hjxilinx in #23732
• doc: insert into stb by @shenglian-zhou in #23738
• doc: insert into stb by @shenglian-zhou in #23737
• docs: build 3.2.1.0 by @xiaopingcs in #23726
• docs: release 3.2.1.0 by @xiaopingcs in #23725
• fix(stream): add check for assert. by @hjxilinx in #23736
• fix(cos/log): dump file name & line no by @stephenkgu in #23733
• docs:add description for tmq by @wangmm0220 in #23735
• fix(stream): remove invalid assert by @hjxilinx in #23742
• fix(stream): remove invalid assert by @hjxilinx in #23743
• enh(stream): add sink_quota/scan-history-idle-duration column for stream tasks. by @hjxilinx in #23750
• fix(tsdb/merge): clear file set before return 0 by @stephenkgu in #23751
• fix(cos/etags): initialize etags to NULL by @stephenkgu in #23749
• fix: update dmodule lib by @kailixu in #23758
• fix: update dmodule lib by @kailixu in #23759
• enh: grant and active codes by @kailixu in #23730
• fix mem leak by @yihaoDeng in #23701
• docs(3.0): update cursor api by @AdamEECS in #23765
• docs: update cursor api by @AdamEECS in #23764
• enh: adjust timeout threshold of snapshot replication by @bgzhao66 in #23760
• TD-27416 by @cadem in #23756
• TD-27416 by @cadem in #23754
• enhance: skip tables pass that reached limit to improve table merge scan performance by @shenglian-zhou in #23744
• fix(stream): fix error in generating token in bucket. by @hjxilinx in #23763
• enh: create replica of the same vgroup one by one for alter db replica by @bgzhao66 in #23761
• fix: errors in snode in conditions like fill history/checkpoint/restart by @wangmm0220 in #23661
• reverse by @hzcheng in #23753
• Enh/xsren/td 27022/windows by @facetosea in #23771
• fix:test case for windows by @wangmm0220 in #23767
• docs: correct redirect and broken links by @danielclow in #23772
• fix: varbinary sma coredump by @hzcheng in #23779
• fix: possible race condition coredump by @hzcheng in #23777
• fix(stream): fix error in generating token in bucket. by @hjxilinx in #23762
• fix: error msg when invalid operator by @facetosea in #23739
• change NumOfTaskQueueThreads size by @yihaoDeng in #23479
• enh: not allow to acquire a vnode in failed mode from vmAcquireVnode by @bgzhao66 in #23786
• fix mem leak by @yihaoDeng in #23768
• fix build error by @xiaopingcs in #23804
• enh: skip request to restore a vnode of single replica in failed mode by @bgzhao66 in #23787
• change http timeout by @yihaoDeng in #23795
• Fix/add http test by @yihaoDeng in #23794
• enh: trigger vnode commit at exit if meta changed by @bgzhao66 in #23801
• fix: slow down report when error occurs by @dapan1121 in #23805
• fix:[TS-4242] tmq status is always RECOVER by @wangmm0220 in #23810
• fix:[TS-4242] tmq status is always RECOVER by @wangmm0220 in #23800
• enhance: bi mode tbname col to tbname func by @shenglian-zhou in #23769
• fix(tsdb/skip-row): remove s3 size condition by @stephenkgu in #23799
• enh(tsdb/read-by-column): calc hint size for preloading by @stephenkgu in #23792
• enh(tsdb/open-file): new s3 failed to connect error code by @stephenkgu in #23797
• Fix bug [4258]: add process ignore/no timezone for timetruncate unit … by @fullhonest in #23807
• param num error by @facetosea in #23789
• refactor: do some internal refactor. by @hjxilinx in #23791
• other: merge fix from 3.0 to main. by @hjxilinx in #23785
• fix: sim error message issue by @dapan1121 in #23815
• set datablock table name by @54liuyao in #23809
• fix: add check in mnode/vnode when alter table col/tag by @kailixu in #23808
• fix:add O_CLOSEXEC for .running & process snode when drop stream by @wangmm0220 in #23818
• add test case for ts-4295 by @flyingangel2013 in #23803
• fix(stream): fix invalid free. by @hjxilinx in #23830
• opti:common message process logic in vnode and snode by @wangmm0220 in #23775
• fix:memory leak & comment length by @wangmm0220 in #23825
• test:update tmq cases and add performance testcase by @tomchon in #23832
• stream event reload state by @54liuyao in #23833
• test:test slave50,59 and 63 in ci by @tomchon in #23836
• test:test slave50,59 and 63 in ci by @tomchon in #23838
• rewrite nodesNodeName by @bobliubj in #23670
• fix: reserve enough buffer for user by @kailixu in #23842
• Update set_core.sh by @plum-lihui in #23853
• Update set_core.sh by @plum-lihui in #23855
• compact history window by @54liuyao in #23852
• add taosdump into rpm and deb by @xiaopingcs in #23858
• change debug info by @yihaoDeng in #23828
• change debug info by @yihaoDeng in #23827
• docs: rename programming connectors to client libraries by @danielclow in #23869
• enh(stream/tsdb): do multiple optimization and fix some bugs. by @hjxilinx in #23831
• fix crash when insert big csv by @bobliubj in #23843
• docs: replace 3.0 absolute links with relative links by @danielclow in #23878
• docs: replace main branch absolute links with relative links by @danielclow in https://githu...

3.2.1.0

New Fetures:

• View
• Optimized query for BI tool integration
• Optimized data recovery when one disk is disrupted using multi-level storage

Improvements

• Performance optimization when querying last()/last_row() with primary key or other functions together

What's Changed

• fix: set JEMALLOC_ENABLED default to false by @DuanKuanJun in #23274
• other: merge stream fix in main branch. by @hjxilinx in #23193
• docs: release ver-3.2.0.0 by @xiaopingcs in #23292
• fix: tag scan support limit and remove slimit optimization by @shenglian-zhou in #23283
• file path contains spaces on linux/mac by @facetosea in #23230
• fix stream snap deadlock by @yihaoDeng in #23289
• enh: proceed sync log buffer on failure of appending too by @bgzhao66 in #23305
• enhance: support select pseduo_column from (select pseudo_column ...) by @shenglian-zhou in #23087
• feat:[TD-19291]Schemaless table name can be composed based on rule by @wangmm0220 in #23306
• feat:add replay logic by @wangmm0220 in #23187
• test: add 500ms sleep after create-stream for branch-3.0 by @jiajingbin in #23314
• enh/TD-24376: show mnode deployment conditions in log by @LiShunGang in #22831
• docs: update tmq offset reset 3.0 by @AdamEECS in #23340
• docs(driver-go): update tmq auto.offset.reset configuration by @huskar-t in #23337
• set fill history range by @54liuyao in #23324
• recover session buff state by @54liuyao in #23248
• opt bloom filter by @54liuyao in #23220
• feat: support restoring vnodes on replaced disks as needed by @bgzhao66 in #23231
• fix auto.offset.reset and snapshot.enable by @sheyanjie-qq in #23348
• Opt/add status send by @yihaoDeng in #23329
• fix: remove subquery user alias name distinct check by @shenglian-zhou in #23312
• feat: support interval syntax of quoted duration and default unit by @wangjiaming0909 in #23222
• gen first tag name by @yihaoDeng in #23353
• fix(tsdb): apply the window range when building blocks from stt files. by @hjxilinx in #23359
• Update test_R.sh by @tomchon in #23379
• fix:add except characters for smlAutoChildTableNameDelimiter by @wangmm0220 in #23346
• test: increase numbers of cases in windows by @tomchon in #23048
• enh(tsdb/cos): new sdk for s3 by @stephenkgu in #23223
• tsdb/commit: skip last tier ts data committing by @stephenkgu in #23366
• fix: union all cast func resType check error by @wangjiaming0909 in #23354
• fix: add lock for trans by @kailixu in #23294
• enh: taosd build info by @kailixu in #23371
• fix: disable life extending of conn cache obj when show queries/conns by @wangjiaming0909 in #23387
• cmake: new option: BUILD_S3 by @stephenkgu in #23391
• http handle empty packet by @yihaoDeng in #23396
• TD-26973: update script by @xiaopingcs in #23398
• docs: add tsz algo doc by @DuanKuanJun in #23408
• docs:Update 07-tsz.md by @DuanKuanJun in #23409
• update script by @xiaopingcs in #23410
• refactor(stream): add fsm for managing task status. by @hjxilinx in #23343
• cmake/xml2: use sha256 to verify distribution release by @stephenkgu in #23402
• feat: add env TDENGINE_DSN to taos-CLI by @DuanKuanJun in #23401
• TD-26884 by @cadem in #23381
• Fix/td 26884 3.0 by @cadem in #23384
• fix(tsdb/commmit): make ts big enough to skip row by @stephenkgu in #23413
• test: support replica3 in splited/transform tmqvnode by @tomchon in #23418
• test:delete zlib cache in ci by @tomchon in #23420
• Revert "test:delete zlib cache in ci" by @tomchon in #23423
• fix:add req_id for raw block interface by @wangmm0220 in #23429
• jdbc release 3.2.7 by @sheyanjie-qq in #23443
• Enh/xsren/td 26169/shell query by @facetosea in #23385
• feat: support all utf8 characters as alias by @wangjiaming0909 in #23392
• enh: only float/double allowed for sum/avg of rsma by @kailixu in #23430
• enh: dmodule API dependence and grant process by @kailixu in #23422
• feat: support to_timestamp/to_char by @wangjiaming0909 in #23344
• fix: interval more than 1000 years by @facetosea in #23426
• feat: do not build taosx in ci by @tjuzyp in #23468
• feat: do not build taosx in ci by @tjuzyp in #23469
• [Typo fixed] in 03-k8s.md by @khalid586 in #23450
• feat: alloc disk acorrding to avail disk space by @hzcheng in #23407
• refactor: do some internal refactor. by @hjxilinx in #23424
• feat: concurrency on fileset by @hzcheng in #23440
• TD-26971 by @cadem in #23437
• TD-26971 by @cadem in #23439
• enh: disable telemetry in enterprise version by default by @dapan1121 in #23477
• feat: support pipelining of snap replication by @bgzhao66 in #23377
• enhance: bi mode tag scan by @shenglian-zhou in #23432
• increase the timeout for CI by @tomchon in #23486
• increase the timeout for CI by @tomchon in #23485
• enh: use placeholder '-' for interval of 1st retention level by @kailixu in #23464
• enh: optimize permission denied error message by @dapan1121 in #23481
• enh: new errcode TSDB_CODE_MND_NO_ENOUGH_VNODES by @LiShunGang in #23475
• other: merge refactor into 3.0 by @hjxilinx in #23428
• refactor: do some internal refactor. by @hjxilinx in #23455
• change NumOfTaskQueueThreads size by @yihaoDeng in #23480
• feat: support view by @dapan1121 in #23457
• session window max delay by @54liuyao in #23491
• fix:[TD-25756]return error if table not exist by @wangmm0220 in #23452
• fix:print log if assert & check epoch when update epoch by @wangmm0220 in #23451
• fix:print log if assert & check epoch when update epoch by @wangmm0220 in #23445
• continued ci test for insert stb by @shenglian-zhou in #23372
• enhance: insert target is supertable by @shenglian-zhou in #23332
• enhance: insert super table tbname column by @shenglian-zhou in #23499
• test:add testcase of the same ts data by @tomchon in #23502
• fix: possible coredump by @hzcheng in #23507
• fix(stream): fix dead lock. by @hjxilinx in #23503
• build(taosAdapter): use the same version number of TDengine by @huskar-t in #23508
• fix: remove user table/view privilege issue by @dapan1121 in #23511
• build(taosAdapter): use the same version number of TDengine by @huskar-t in #23517
• fix: invalid read when file is deleted by @hzcheng in #23520
• Update cases.task by @tomchon in #23524
• db and resource by @cadem in...

3.2.0.0

New Features

1. IP White List
2. Configurable floating point lossy compression
3. balance vgroup leader for a specific vgroup

Improvements

1. Performance optimization for partition by column
2. Performance optimization for partition by column with limit/slimit
3. Performance optimization for partition by column with interval
4. Block leve lcache for retrieving data on S3
5. Split vgroup and redistribue vnode with existing of data subscription

What's Changed

• fix: keep stt iterator valid by @shenglian-zhou in #22289
• release 3.1.0.0 by @xiaopingcs in #22293
• comment out splitVgroup.py by @shenglian-zhou in #22329
• docs: supplement r language connnector note by @sangshuduo in #22340
• delete atomic_exchange_64 by @54liuyao in #22311
• update packaging script by @xiaopingcs in #22344
• fix state mem leak by @yihaoDeng in #22278
• fix invalid free by @yihaoDeng in #22337
• fix: memory leak by @hzcheng in #22345
• merge 3.0 to feat/TD-22970 by @cadem in #22347
• fix:set terrno = 0 to avoid affect next fetch msg by @wangmm0220 in #22343
• fix: fix tsort crash caused by not enough disk space by @glzhao89 in #22333
• fix: ins_indexes vgroup_id using null value instead of -1 for invalid by @glzhao89 in #22331
• fix(stream): commit the update to make sure the new state of tasks will be persistent to disk. by @hjxilinx in #22353
• other: merge main and fix bugs in stop stream tasks. by @hjxilinx in #22350
• fix: restore stt block and data block merge back by @shenglian-zhou in #22348
• fix: snapshot invalid read by @hzcheng in #22346
• fix: memory leak when drop db which acquired by user with grant/revoke by @wangjiaming0909 in #22288
• feat: optimize table merge scan when 1 child table by @wangjiaming0909 in #22301
• docs: add upgrade notes to releases page by @danielclow in #22354
• merge 3.0 to TD-22970 by @cadem in #22355
• feature: optimize interval with limit by @wangjiaming0909 in #22165
• open split vgroup case by @hzcheng in #22335
• fix: update assert issue by @hzcheng in #22364
• docs: fix connection param in taosws in python connector by @sunpe in #22368
• docs: fix connection param in taosws in python connector by @sunpe in #22367
• test：fix windows cases by @tomchon in #22352
• fix/TD-24937: alter ttlChangeOnWrite note info by @LiShunGang in #22336
• fix: mktime on windows platform by @kailixu in #22342
• fix: reset rowsize since it is set during blockDataAppendColInfo by @shenglian-zhou in #22362
• enhance: subquery can use expr primary key +/- value as primary key by @shenglian-zhou in #22206
• other: merge fix from 3.0 to main. by @hjxilinx in #22357
• add CI test case for ts-3479 by charles by @flyingangel2013 in #22281
• fix(stream): avoid launching check downstream by @hjxilinx in #22376
• Update 05-insert.md 中文括号问题 by @CityChen81 in #22377
• udpate user_privilege_show test case and add it to cases.task by charles by @flyingangel2013 in #22369
• fix: restore stt/block merge back by @shenglian-zhou in #22374
• rm duplicate para by @yihaoDeng in #22379
• fix taosd cannot quit by @yihaoDeng in #22372
• enh: check if disk space sufficient at primary dir with tfs by @bgzhao66 in #22370
• avoid removing taosx and taos-explorer while uninstall taosd by @xiaopingcs in #22382
• docs: Rename 27-index.md to 27-indexing.md by @danielclow in #22385
• test:fix comatibility case by @tomchon in #22373
• fix: add max_speed as keywordw by @dapan1121 in #22387
• fix(stream): use streamId&taskId to identify a stream task by @hjxilinx in #22380
• fix: timezone and qsort for windows by @kailixu in #22383
• other: merge main. by @hjxilinx in #22388
• merge 3.0 to feat/TD-22970 by @cadem in #22394
• fix mem leak by @54liuyao in #22393
• fix: sma option for show create table by @kailixu in #22392
• fix(stream): execute the stream task directly by @hjxilinx in #22395
• enh: remove timeline dependence of certain functions by @glzhao89 in #22365
• update release version on main branch by @xiaopingcs in #22398
• fix:offset error in tmq & add test cases by @wangmm0220 in #22384
• docs: update for clusher cfg by @LiShunGang in #22403
• docs: update 06-stream.md to correct sample sql statement by @danielclow in #22386
• fix: add time window boundary check before interpolation by @glzhao89 in #22402
• refactor: refactor the transfer state procedure. by @hjxilinx in #22413
• fix: infinite tomb data sync loop by @hzcheng in #22407
• fix:offset error in tmq & add test cases by @wangmm0220 in #22405
• Update 08-taos-shell.md by @DuanKuanJun in #22414
• test: add build by @DuanKuanJun in #22150
• fix: dup read lock on windows by @kailixu in #22404
• test：update base version 3.1.1.0 by @tomchon in #22418
• Update cases.task by @tomchon in #22425
• fix: set max_binary_display_width can not show all text by @DuanKuanJun in #22422
• refactor: exec directly not asynchnoized. by @hjxilinx in #22424
• feat:[TD-24559]support geomety type in schemaless by @wangmm0220 in #22358
• fix:tmq interface & remove snapshot code by @wangmm0220 in #22432
• fix: remove ins_modules table by @dapan1121 in #22406
• opti:wal logic by @wangmm0220 in #22417
• fix: use taos_static for tmq_sim on windows by @kailixu in #22430
• fix: make kill query work for sysscanoperator by @wangjiaming0909 in #22408
• merge fix/retry_resolve_fqdn to main by @cadem in #22440
• fix:tmq interface & remove snapshot code by @wangmm0220 in #22442
• feat(tsdb/cos): s3 migration by @stephenkgu in #22327
• fix(stream): continue process when met with trans-state msg. by @hjxilinx in #22439
• enhance: tag scan optimization by @shenglian-zhou in #22410
• rebuild index at tag0 by @yihaoDeng in #22427
• enh: disable stream/udf on windows by @kailixu in #22445
• fix: set precision of interval by table scan node by @kailixu in #22449
• feat: optimize select agg_func partition by tag slimit by @wangjiaming0909 in #22390
• feat: add irate distributed execution by @glzhao89 in #22438
• docs:modify format & add logic for dot in schemaless by @wangmm0220 in #22452
• other: merge main. by @hjxilinx in #22450
• fix/retry_resolve_fqdn by @cadem in #22274
• merge 3.0 to feat/TD-22970 by @cadem in #22456
• fix: memory leak when commit by @hzcheng in #22457
• refactor: do some internal refactcor by @hjxilinx in https://github.com/taosdata/TDengine/pull/2246...

3.1.1.4

Fixed bugs:

1. core dump when selecting ins_tables
2. replica data size is much bigger than expected when executing split vgroup
3. wrongly removing other components in install.sh and rmtaos

What's Changed

• update file name by @xiaopingcs in #22839
• fix: coverity issues by @wangjiaming0909 in #22837
• fix: special taos-ws-py version in py test by @sunpe in #22807
• test: lock start_timestamp and interval by @jiajingbin in #22792
• fix/TD-26210 by @cadem in #22830
• test: increase timeout 60s of replica 3to1 by @tomchon in #22845
• fix(stream): fix stream bugs. by @hjxilinx in #22847
• fix: neighbor block overlap judgement by @kailixu in #22832
• enh: decrease the libtaos.so size from cos by @kailixu in #22848
• fix: remove incorrect assert by @dapan1121 in #22835
• fix chkp transfer crash by @yihaoDeng in #22760
• Fix/xsren/ts 3957/read line on windows 3.1 by @facetosea in #22871
• fix(stream): merge fix from main to 3.1 by @hjxilinx in #22867
• TD-23722: add case for TMQ unsubscribe with taosAdapter by @xiaopingcs in #22742
• refactor: do some internal refactor. by @hjxilinx in #22877
• fix: join condition with single param operator by @dapan1121 in #22874
• fix: add system table ins_columns privilege test case by @dapan1121 in #22887
• doc: update doc for show vnodes by @bgzhao66 in #22883
• fix/TS-3944: tColDataCalcSMA add support for geometry by @LiShunGang in #22893
• fix:return TSDB_CODE_PAR_VALUE_TOO_LONG if data value is longer than … by @wangmm0220 in #22901
• add test case for join by @xiaopingcs in #22909
• test:increase timeout of win testcase by @tomchon in #22903
• enh: ignore compact req during restoring by @bgzhao66 in #22906
• fix: delete error by @hzcheng in #22911
• case: add delete fix bug case by @DuanKuanJun in #22928
• case: add option keepcolumnname case by @DuanKuanJun in #22933
• fix:[TD-26323]add macro to control tmq assert & make subscribe transa… by @wangmm0220 in #22939
• stream partition ignore stream_get_all by @54liuyao in #22936
• fix:core in race condition for pTq->pExecStore & return if poll too long & fix test cases if submit empty by @wangmm0220 in #22953
• fix:return in progress in drop consumer group by @wangmm0220 in #22959
• keep taosx and explorer service when installing taosd by @xiaopingcs in #22967
• fix: snapshot wrong compression option by @hzcheng in #22964
• merge stable sort intead of qsort as insert unordered data by @facetosea in #22935
• fix: query tbname from systables memory corruption by @wangjiaming0909 in #22975

Full Changelog: ver-3.1.1.1...ver-3.1.1.4

3.1.1.1

Fixed bugs found on ARM64 and Kylin OS

What's Changed

• doc: delete cluster and storage from website by @gccgdb1234 in #22698
• fix(stream): add null ptr check. by @hjxilinx in #22704
• test: add stream cases to 3.1 by @jiajingbin in #22731
• fix: fix last()/last_row() return MD5 hashed column name by @glzhao89 in #22726
• fix(tdb): fix tdb coverity warning by @stephenkgu in #22733
• fix/TD-22062 by @cadem in #22732
• fix:support length function for varbinary by @wangmm0220 in #22720
• update jdbc version by @xiaopingcs in #22747
• fix: use int64_t to record num of rows in taos shell by @shenglian-zhou in #22729
• fix: select tags from child table error by @shenglian-zhou in #22716
• test:replace clock_gettime in cases for win by @tomchon in #22750
• fix/TD-25996: tdbBtcDelete release pages before modifying pBtc->pPage by @LiShunGang in #22771
• test:replace clock_gettime in cases for win by @tomchon in #22779
• Fix/TD-26133-3.1.1.0 by @hzcheng in #22740
• fix: coverity found issues by @dapan1121 in #22775
• fix: fix coverity scan issue by @shenglian-zhou in #22756
• fix: 1. select tag from meters partition by tag limit returned wrong … by @wangjiaming0909 in #22765
• fix/TD-25445: search memory in ttlMgrFindExpired by @LiShunGang in #22773
• Fix/TD-25218: adjust the error code returned when db does not exist by @LiShunGang in #22796
• fix: fix diff not support unsigned type by @glzhao89 in #22783
• fix: break potential infinite loop in tfsMkdirRecurAt by @bgzhao66 in #22758
• stack overflow by @facetosea in #22789
• fix: remove db dead lock issue by @dapan1121 in #22806
• fix: missed one row for fill desc by @wangjiaming0909 in #22723
• fix: next merger iter of tombs in loop of tsdbSnapWriteTombRecord by @bgzhao66 in #22803
• fix:[TS-3922] make SStreamObj->->currentTick aligned by 8 by @wangmm0220 in #22801
• fix:send delete subscribe info to vnode if drop consumer by @wangmm0220 in #22777
• other: merge fix from main. by @hjxilinx in #22819

Full Changelog: ver-3.1.1.0...ver-3.1.1.1

3.1.1.0

New Features/Improvements

• Stream processing can be used in database with 3 replica
• Join performance optimization
• Performance improvement for interval + limit
• Audit log (TDengine Pro only)

What's Changed

• docs: supplement r language connnector note by @sangshuduo in #22340
• delete atomic_exchange_64 by @54liuyao in #22311
• update packaging script by @xiaopingcs in #22344
• fix: memory leak by @hzcheng in #22345
• fix: fix tsort crash caused by not enough disk space by @glzhao89 in #22333
• fix: ins_indexes vgroup_id using null value instead of -1 for invalid by @glzhao89 in #22331
• fix(stream): commit the update to make sure the new state of tasks will be persistent to disk. by @hjxilinx in #22353
• fix: snapshot invalid read by @hzcheng in #22346
• docs: add upgrade notes to releases page by @danielclow in #22354
• open split vgroup case by @hzcheng in #22335
• fix: update assert issue by @hzcheng in #22364
• docs: fix connection param in taosws in python connector by @sunpe in #22368
• test：fix windows cases by @tomchon in #22352
• fix: reset rowsize since it is set during blockDataAppendColInfo by @shenglian-zhou in #22362
• other: merge fix from 3.0 to main. by @hjxilinx in #22357
• fix(stream): avoid launching check downstream by @hjxilinx in #22376
• Update 05-insert.md 中文括号问题 by @CityChen81 in #22377
• fix: restore stt/block merge back by @shenglian-zhou in #22374
• rm duplicate para by @yihaoDeng in #22379
• fix taosd cannot quit by @yihaoDeng in #22372
• avoid removing taosx and taos-explorer while uninstall taosd by @xiaopingcs in #22382
• docs: Rename 27-index.md to 27-indexing.md by @danielclow in #22385
• test:fix comatibility case by @tomchon in #22373
• fix: add max_speed as keywordw by @dapan1121 in #22387
• fix(stream): use streamId&taskId to identify a stream task by @hjxilinx in #22380
• fix mem leak by @54liuyao in #22393
• fix: sma option for show create table by @kailixu in #22392
• fix(stream): execute the stream task directly by @hjxilinx in #22395
• update release version on main branch by @xiaopingcs in #22398
• fix:offset error in tmq & add test cases by @wangmm0220 in #22384
• docs: update 06-stream.md to correct sample sql statement by @danielclow in #22386
• fix: add time window boundary check before interpolation by @glzhao89 in #22402
• refactor: refactor the transfer state procedure. by @hjxilinx in #22413
• fix: infinite tomb data sync loop by @hzcheng in #22407
• Update 08-taos-shell.md by @DuanKuanJun in #22414
• test: add build by @DuanKuanJun in #22150
• fix: set max_binary_display_width can not show all text by @DuanKuanJun in #22422
• refactor: exec directly not asynchnoized. by @hjxilinx in #22424
• opti:wal logic by @wangmm0220 in #22417
• merge fix/retry_resolve_fqdn to main by @cadem in #22440
• fix:tmq interface & remove snapshot code by @wangmm0220 in #22442
• fix(stream): continue process when met with trans-state msg. by @hjxilinx in #22439
• docs:modify format & add logic for dot in schemaless by @wangmm0220 in #22452
• fix/retry_resolve_fqdn by @cadem in #22274
• fix: memory leak when commit by @hzcheng in #22457
• refactor: do some internal refactcor by @hjxilinx in #22461
• fix: tsdb snapshot bug by @hzcheng in #22460
• fix: modify column length for super table by @kailixu in #22468
• fix: refine example demo.c by @sangshuduo in #22473
• docs: fix taos_init() return type by @sangshuduo in #22475
• fix: important fix for compact file corruption by @hzcheng in #22474
• fix:set terrno = 0 to avoid affect next fetch msg by @wangmm0220 in #22459
• fix: document issues by @dapan1121 in #22483
• fix(stream): fix memory leak and do some internal refactor. by @hjxilinx in #22484
• docs: fix link in grafana doc by @danielclow in #22489
• docs: refine c connector docs by @sangshuduo in #22491
• docs: taos api description by @kailixu in #22493
• fix: get systable cols error by @wangjiaming0909 in #22471
• docs: add current_user() in function by @sangshuduo in #22496
• fix: fill last group data between groups by @wangjiaming0909 in #22485
• Update cases.task by @tomchon in #22248
• update installation instruction by @xiaopingcs in #22504
• fix:do not send unsubscribe msg to taosd if subscribe failed by @wangmm0220 in #22508
• release 3.1.0.2 by @xiaopingcs in #22506
• fix: global data sink manager issue by @dapan1121 in #22520
• fix: assign flags during subscribe by @kailixu in #22521
• fix: alter stt_trigger bug by @hzcheng in #22527
• update packaging script by @xiaopingcs in #22510
• fix: query failed return time from websocket is last successful time by @DuanKuanJun in #22535
• docs: add note to csharp connector docs by @sangshuduo in #22541
• reload semi session state by @54liuyao in #22531
• feat(driver): add committed assignment API for jdbc by @huolibo in #22544
• mem leak by @54liuyao in #22547
• fix: fill operator with desc ts order returned 1 more rows by @wangjiaming0909 in #22532
• fix(stream): continue check wal when meeting empty delete block msg. by @hjxilinx in #22558
• fix(parser): update the key words for disk io throttling. by @hjxilinx in #22563
• fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no… by @wangmm0220 in #22561
• fix: specify utf-8 in jdbc example pom.xml by @sangshuduo in #22565
• mem leak by @54liuyao in #22555
• Update 06-taosdump.md dot replace with '-Q' (English) by @DuanKuanJun in #22574
• Update 06-taosdump.md dot replace with '-Q' by @DuanKuanJun in #22573
• fix: taosCompressFile mem leak by @shenglian-zhou in #22571
• undo remove operation for taosx when building taosd by @xiaopingcs in #22567
• fix: improve upgrade speed by @hzcheng in #22577
• docs: kill query command need quote around id by @sangshuduo in #22588
• release 3.1.0.3 by @xiaopingcs in #22582
• fix:[TD-258900]modify tmq trans conflict to db level by @wangmm0220 in #22534
• release(driver): jdbc release 3.2.5 version by @huolibo in #22593
• fix: fix non-root users cannot create log files even if they have write by @glzhao89 in #22458
• enhance: fix buffer size overflow by @shenglian-zhou in #22595
• fix(stream): release tasks. by @hjxilinx in #22602
• fix: wrong start key for...

3.1.0.3

Fixed bugs

• It took too long when upgrading from lower versions to 3.1.0.2 in some cases
• Some query issues

What's Changed

• docs: add current_user() in function by @sangshuduo in #22496
• fix: fill last group data between groups by @wangjiaming0909 in #22485
• Update cases.task by @tomchon in #22248
• update installation instruction by @xiaopingcs in #22504
• fix:do not send unsubscribe msg to taosd if subscribe failed by @wangmm0220 in #22508
• release 3.1.0.2 by @xiaopingcs in #22506
• fix: global data sink manager issue by @dapan1121 in #22520
• fix: assign flags during subscribe by @kailixu in #22521
• fix: alter stt_trigger bug by @hzcheng in #22527
• update packaging script by @xiaopingcs in #22510
• fix: query failed return time from websocket is last successful time by @DuanKuanJun in #22535
• docs: add note to csharp connector docs by @sangshuduo in #22541
• reload semi session state by @54liuyao in #22531
• feat(driver): add committed assignment API for jdbc by @huolibo in #22544
• mem leak by @54liuyao in #22547
• fix: fill operator with desc ts order returned 1 more rows by @wangjiaming0909 in #22532
• fix(stream): continue check wal when meeting empty delete block msg. by @hjxilinx in #22558
• fix(parser): update the key words for disk io throttling. by @hjxilinx in #22563
• fix:[TD-25651] reset epoch if consumer changed to avoid consumeing no… by @wangmm0220 in #22561
• fix: specify utf-8 in jdbc example pom.xml by @sangshuduo in #22565
• mem leak by @54liuyao in #22555

Full Changelog: ver-3.1.0.2...ver-3.1.0.3

3.1.0.2

Fixed Bugs

• taosd crash in some query scenarios
• data subscription: position() get same offset after two pols() with data
• interp: data out of specified time range is returned
• show create table: additional "sma()" is returned in the SQL
• alter the length of VARCHAR failed

What's Changed

• rm duplicate para by @yihaoDeng in #22379
• fix taosd cannot quit by @yihaoDeng in #22372
• avoid removing taosx and taos-explorer while uninstall taosd by @xiaopingcs in #22382
• docs: Rename 27-index.md to 27-indexing.md by @danielclow in #22385
• test:fix comatibility case by @tomchon in #22373
• fix: add max_speed as keywordw by @dapan1121 in #22387
• fix(stream): use streamId&taskId to identify a stream task by @hjxilinx in #22380
• fix mem leak by @54liuyao in #22393
• fix: sma option for show create table by @kailixu in #22392
• fix(stream): execute the stream task directly by @hjxilinx in #22395
• update release version on main branch by @xiaopingcs in #22398
• fix:offset error in tmq & add test cases by @wangmm0220 in #22384
• docs: update 06-stream.md to correct sample sql statement by @danielclow in #22386
• fix: add time window boundary check before interpolation by @glzhao89 in #22402
• refactor: refactor the transfer state procedure. by @hjxilinx in #22413
• fix: infinite tomb data sync loop by @hzcheng in #22407
• Update 08-taos-shell.md by @DuanKuanJun in #22414
• test: add build by @DuanKuanJun in #22150
• fix: set max_binary_display_width can not show all text by @DuanKuanJun in #22422
• refactor: exec directly not asynchnoized. by @hjxilinx in #22424
• opti:wal logic by @wangmm0220 in #22417
• merge fix/retry_resolve_fqdn to main by @cadem in #22440
• fix:tmq interface & remove snapshot code by @wangmm0220 in #22442
• fix(stream): continue process when met with trans-state msg. by @hjxilinx in #22439
• docs:modify format & add logic for dot in schemaless by @wangmm0220 in #22452
• fix/retry_resolve_fqdn by @cadem in #22274
• fix: memory leak when commit by @hzcheng in #22457
• refactor: do some internal refactcor by @hjxilinx in #22461
• fix: tsdb snapshot bug by @hzcheng in #22460
• fix: modify column length for super table by @kailixu in #22468
• fix: refine example demo.c by @sangshuduo in #22473
• docs: fix taos_init() return type by @sangshuduo in #22475
• fix: important fix for compact file corruption by @hzcheng in #22474
• fix:set terrno = 0 to avoid affect next fetch msg by @wangmm0220 in #22459
• fix: document issues by @dapan1121 in #22483
• fix(stream): fix memory leak and do some internal refactor. by @hjxilinx in #22484
• docs: fix link in grafana doc by @danielclow in #22489
• docs: refine c connector docs by @sangshuduo in #22491
• docs: taos api description by @kailixu in #22493
• fix: get systable cols error by @wangjiaming0909 in #22471

Full Changelog: ver-3.1.0.1...ver-3.1.0.2

3.1.0.0

Note: Once you upgrade to this release, you can't go back to old version
Note: Please must drop streams before upgrading

1. New Features & Improvements

• Performance improvement for Join
• Performance improvement for order by non-primary key + limit
• Performance and memory usage improvement for stable order by primary key + limit
• Performance improvement for counting out of order data
• Improved fault tolerance when disk is broken
• New data type: Geometry
• Stream with fill history can be paused/resumed
• Load balance among level 0 disks (Enterprise only)
• Performance improvement in high cardinality case (Enterprise only)
• Compacting data doesn't block writing (Enterprise only)
• Data retention in multi-level storage doesn't block writing (Enterprise only)

2. Fixed Bugs

• Fixed some bugs found in previous releases

What's Changed

• support fill history by @yihaoDeng in #21747
• fix: ttl compatibility for 3.0 by @LiShunGang in #21906
• update nas server ip by @xiaopingcs in #21918
• release 3.0.6.0 by @xiaopingcs in #21919
• update 3.0 version by @xiaopingcs in #21924
• enh: improve walScanLogGetLastVer by @bgzhao66 in #21891
• docs: update python document by @sunpe in #21928
• enh: support random execution node by @dapan1121 in #21926
• set Trim as true for GEOSWKTWriter to resolve geomTest failed if using geos3.12.0 by @dinglezhang in #21929
• fix asan error by @glzhao89 in #21917
• chore: upgarde libgeos 3.12.0 by @sangshuduo in #21932
• enh: check failure of tfsMkdirRecurAt by @bgzhao66 in #21936
• feat:subscribe only meta info by @wangmm0220 in #21934
• build: upgrade taospy version by @sunpe in #21941
• enh: tfsRename in the reverse order of levels with tiered storages by @bgzhao66 in #21949
• refactor: refactor the fill history operation by @hjxilinx in #21735
• refactor: do some internal refactor. by @hjxilinx in #21959
• fix(stream): fix error for extract msg from inputQ by @hjxilinx in #21960
• docs: fix example in python document by @sunpe in #21965
• docs: fix-example-in-python-document by @sunpe in #21968
• fix/TD-25074 by @LiShunGang in #21939
• enh(tdb/recycle): first round implemenation of page recycling by @stephenkgu in #21699
• feature: get last timestamp before create sma index by @wangjiaming0909 in #21915
• refine select interval from sys table error msg by @wangjiaming0909 in #21971
• fix(stream): fix error during transferring executor state by @hjxilinx in #21980
• Docs/3.0/td 25142 by @huolibo in #21990
• docs(driver): jdbc 3.2.4 description by @huolibo in #21991
• fix(tdb/recycling): delay freedb's own page recycling until balance done by @stephenkgu in #21983
• fix(tdb/recycling): delay freedb's own page recycling until balance done by @stephenkgu in #21982
• docs:add info for INS_SUBSCRIPTIONS by @wangmm0220 in #21986
• enh: add procedures for udf scalar function in nested queries where outer query is constant table by @glzhao89 in #21975
• docs: add info for ttlChangeOnWrite by @LiShunGang in #22005
• release 3.0.7.0 by @xiaopingcs in #22019
• fix/TD-24473 by @LiShunGang in #21963
• test: update tmqParamTest.py by @jiajingbin in #22010
• enh: remove wal_roll_period/wal_segment_size from commands output by @glzhao89 in #22014
• enh: exclude tk_log from timeseries check by @kailixu in #22017
• feat: 1. add limit for diskBasedBuf by @wangjiaming0909 in #22028
• feat/TS-3239/TS-3596: port 'keepTimeOffset' from 2.6 to 3.0 by @LiShunGang in #22034
• enh: add show create database command for system dbs by @glzhao89 in #22031
• docs: update python doc catalog by @sunpe in #22050
• fix(stream): fix concurrent bug in save task meta. by @hjxilinx in #22024
• feat: add new syntax for show tags/index/table tags by @glzhao89 in #22048
• enh: unify handling of vnode primary dir for vnd, tsdb and sma by @bgzhao66 in #22045
• docs(driver): java seek desc by @huolibo in #22030
• chore: make jenkins happy by @kailixu in #22057
• other: merge main by @hjxilinx in #22020
• docs(driver): kafka connector add tmq by @huolibo in #22055
• enh: rsma stream state adaption by @kailixu in #21969
• fix:windows compile error by @wangmm0220 in #22058
• chore: enable sysInfo update by @kailixu in #22061
• fix: reset interpolation buffer after last valid row for interval + fill(next) by @glzhao89 in #22060
• Correct some typos in string literals by @sunsided in #22062
• sma not support multiple replicas by @54liuyao in #22063
• fix coverity scan problem by @yihaoDeng in #22067
• fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables by @LiShunGang in #22059
• fix/TD-25215: ttlMgrDeleteTtl should ignore ttl 0 tables for main by @LiShunGang in #22066
• 3.0: release 3.0.7.1 docs by @xiaopingcs in #22080
• main: release 3.0.7.1 docs by @xiaopingcs in #22079
• docs: update readme-cn.md by @sangshuduo in #22086
• fix: state/session/event window with order by _wstart/_wend has no effect by @wangjiaming0909 in #22070
• add test create sma index case to ci by @DuanKuanJun in #22074
• test:add testcase of rolling upgdade by @tomchon in #22064
• docs: update connector feature matrix by @sangshuduo in #22065
• fix: create sma index for us/ns database failed by @wangjiaming0909 in #22076
• enh: dm monitor refactor by @kailixu in #22081
• fix: add sma option when show create table for stb/ntb by @kailixu in #22096
• fix/TD-25232: alter dnode keeptimeoffset err by @LiShunGang in #22092
• fix packaging issue by @xiaopingcs in #22099
• fix:[TD-25222] error in drop topic if topic num is too long by @wangmm0220 in #22094
• docs:add configuration of tmqMaxTopicNum by @wangmm0220 in #22078
• docs:add configuration of tmqMaxTopicNum by @wangmm0220 in #22077
• fix: fix interval in nested query filter not applied by @glzhao89 in #22100
• fix/TD-25179 by @cadem in #22101
• test: add tmq seek case by @plum-lihui in #22103
• fix Windows packaging issue by @xiaopingcs in #22102
• test:add testcase of rolling upgdade by @tomchon in #22104
• fix:add sdbFetchCancel to release hash node by @wangmm0220 in #22095
• fix/TD-25232: alter keeptimeoffset by 'k v' or 'k' 'v' by @LiShunGang in #22107
• test: check topic name len case by @plum-lihui in #22108
• reset state key memory by @54liuyao in #22110
• fix(stream): set downstream task ready state. by @hjxilinx in #22112
• test: del db and max topics invalid by @plum-lihui in #22115
• feat: distribute vnode primary dirs among disks of level 0 by @bgzhao66 in #22085
• enh: ttlMgrFlush adjust log l...