stonedb-5.7-v1.0.4-alpha

[Nliver]

Release Notes for stonedb-5.7-v1.0.4-alpha

• Version Number: 5.7-v1.0.4-alpha
• Release Date: 2023-06-30

Stability:

1. Fixed a crash caused by incremental data when importing data bug: Incremental data causing instance crash. #1805
2. Fixed a crash caused by the result set of the union all clause, bug: The instance is crashed when extracting data from the union all result set of decimal and integer. #1875
3. Fixed a crash caused by using aggregate functions in large data scenarios, bug: The instance is crashed if the aggregate function out of bounds #1855

New features

2.1. Support for update ignore syntax feature.

When updating tianmu, records with primary key conflicts will be skipped and subsequent update operations will be performed.
For example:

CREATE TABLE t1  (id int(11) NOT NULL auto_increment,  parent_id int(11) DEFAULT '0' NOT NULL,  level tinyint(4)
DEFAULT '0' NOT NULL, PRIMARY KEY (id)) engine=tianmu;
INSERT INTO t1 VALUES (3,1,1),(4,1,1);

Executing the update ignore t1 set id=id+1; statement will ignore the update of PK=3, because the updated primary key will conflict with PK=4. Then continue to execute the update of pk=4, and the updated PK=5.

mysql>  CREATE TABLE t1  (id int(11) NOT NULL auto_increment,  parent_id int(11) DEFAULT '0' NOT NULL,  level tinyint(4)
         -> DEFAULT '0' NOT NULL, PRIMARY KEY (id)) engine=tianmu;
Query OK, 0 rows affected (0.01 sec)

mysql>   INSERT INTO t1 VALUES (3,1,1),(4,1,1);
Query OK, 2 rows affected (0.01 sec)
Records: 2  Duplicates: 0  Warnings: 0

mysql> update t1 set id=id+1;
ERROR 1062 (23000): Duplicate entry '4' for key 'PRIMARY'
mysql> select * from t1; 
+----+-----------+-------+
| id | parent_id | level |
+----+-----------+-------+
|  3 |         1 |     1 |
|  4 |         1 |     1 |
+----+-----------+-------+
2 rows in set (0.00 sec)

mysql> update ignore t1 set id=id+1;
Query OK, 2 rows affected (0.00 sec)
Rows matched: 2  Changed: 2  Warnings: 0

mysql> select * from t1; 
+----+-----------+-------+
| id | parent_id | level |
+----+-----------+-------+
|  3 |         1 |     1 |
|  5 |         1 |     1 |
+----+-----------+-------+
2 rows in set (0.00 sec)

2.2 Support row format for “load data” statement.

When stonedb is used as the primary database, the load statement will be executed on the backup database in the form of “insert into”.

2.3 Support AggregatorGroupConcat function

mysql> select GROUP_CONCAT(t.id) from sequence t;
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GROUP_CONCAT(t.id)                                                                                                                                                                         |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 3000000000010000,3000000000010001,3000000000010002,3000000000010003,3000000000010004,3000000000010005,3000000000010006,3000000000010007,3000000000010008,3000000000010009,3000000000010010 |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.01 sec)

2.4 Support using select 111 or select 111 from dual scenarios in uion/union all

mysql>  select id from tt union all select 2222 c1 from dual;
+------+
| id   |
+------+
| 1111 |
| 2222 |
+------+

mysql>  select id from tt union all select 2222 ;
+------+
| id   |
+------+
| 1111 |
| 2222 |
+------+
-- PS：select 111(from dual) appears in a position other than that of the first clause

Others Bug fixs

1. Fix the default value problem of adding columns in the master and slave scenarios. bug: (Primary/Secondary)After an integer column is added,InnoDB defaults to 0, but tianmu defaults to null. #1187
2. Fix the incorrect result set problem when using case…when in derived table. bug: result of querying a value from an empty derived table have select case is not consistent with innodb #1784
3. Fix the incorrect result problem caused by precision loss when performing bit operations when the type is time. bug: Bit Operators and Functions problems #1173
4. Fix the incorrect query result problem caused by overflow when the type is bigint. bug: bigint type, return wrong result; #1564
5. Fix the incorrect result problem when the filter condition is hexadecimal. bug: When using where to filter hexadecimal formate data, return incorrect #1625
6. Fix the problem that the default value on the table did not take effect when importing data using the “load data” command. bug: load data , the default value of the field does not take effect #1865
7. Modify the default field separator of the load command to make it consistent with mysql behavior. bug: load data return error #1609
8. Fix the query error caused by abnormal metadata. bug: Error 1030 occurred in the query. #1822
9. Improve MTR stability on github.

What's Changed

• docs(downlaod)：update the docs of download(docs: update the docs of Download #1453) by @Nliver in docs(downlaod)：update the docs of download(#1453) #1454
• fix(mtr):Resolve the nightly run error problem(bug: nightly run error #1458) by @konghaiya in fix(mtr):Resolve the nightly run error problem(#1458) #1459
• fix(workflow): fix can not run lcov in workflow by @RingsC in fix(workflow): fix can not run lcov in workflow #1396
• feat(tianmu):New configuration parameters: "tianmu_mandatory" and "tianmu_no_key_error (Add parameters of tianmu_mandatory and tianmu_no_key_error #1462)" by @konghaiya in feat(tianmu):New configuration parameters: "tianmu_mandatory" and "tianmu_no_key_error (#1462)" #1466
• fix(tianmu):(Primary/Secondary)Error 1032 occasionally occurs during … by @konghaiya in fix(tianmu):(Primary/Secondary)Error 1032 occasionally occurs during … #1469
• test(mtr): add integer/unsigned/in subquery/create temporary testcases and update escape.test(feature: add MTR test cases for StoneDB #1196) by @davidshiz in test(mtr): add integer/unsigned/in subquery/create temporary testcases and update escape.test(#1196) #1471
• fix(stonedb): Corrected errors in the documentation and updated the script of the official website(docs: Update the documentation for version 1.0.3 #1494) by @Nliver in fix(stonedb): Corrected errors in the documentation and updated the script of the official website(#1494) #1500
• fix(website): fix Baidu statistics script(bug: fix Baidu statistics script #1502) by @Nliver in fix(website): fix Baidu statistics script(#1502) #1503
• test(mtr): Optimize parallel scheduling to execute more innodb engine testcases, add date type and std func testcase(feature: add MTR test cases for StoneDB #1196) by @davidshiz in test(mtr): Optimize parallel scheduling to execute more innodb engine testcases, add date type and std func testcase(#1196) #1504
• fix(tianmu): fix crash when the aggregated element was decimal (bug: Multithread aggregation occur crash when has decimal #1402) by @adofsauron in fix(tianmu): fix crash when the aggregated element was decimal (#1402) #1506
• build(deps): bump nth-check and unist-util-select in /website by @dependabot in build(deps): bump nth-check and unist-util-select in /website #741
• docs(stonedb): update the docs by @Nliver in docs(stonedb): update the docs #1509
• fix(workflow): remove dup lines in git workflow(bug: Duplicate lines in nightly.yml and pull_reqests.yml #1517) by @zzzz-vincent in fix(workflow): remove dup lines in git workflow(#1517) #1531
• feat(tianmu): mv func from public to protected(feature: mv function from public to protected #1501) by @zzzz-vincent in feat(tianmu): mv func from public to protected(#1501) #1527
• fix(tianmu):Resolve DDL and insert inot select Possible space inflation issues(bug: alter table cause engine crash #366) by @konghaiya in fix(tianmu):Resolve DDL and insert inot select Possible space inflation issues(#366)  #1497
• fix(tianmu):The myloader cann't work if the autocommit is closed. (bug: The myloader cann't work if the autocommit is closed.  #1510) by @konghaiya in fix(tianmu):The myloader cann't work if the autocommit is closed. (#1510) #1524
• fix(core): fix bug: The instance occasionally crashes if both fields … by @wisehead in fix(core): fix bug: The instance occasionally crashes if both fields … #1528
• fix: page hover font style by @Agility6 in fix: page hover font style #1535
• feat(mtr): To fix the mtr usage by @RingsC in feat(mtr): To fix the mtr usage #1537
• fix(tianmu):The mysqld is crashed when you are starting replication.(bug: The mysqld is crashed when you are starting replication. #1523) by @konghaiya in fix(tianmu):The mysqld is crashed when you are starting replication.(#1523) #1540
• fix(optmizer):fix the crashes when the right table of hash join is in parallel(bug: The instance occasionally crashes when the parallel degree is enabled of the right table #1538) by @wisehead in fix(optmizer):fix the crashes when the right table of hash join is in parallel(#1538) #1541
• feat(tianmu): To support volcano framwork by @RingsC in feat(tianmu): To support volcano framwork #1543
• docs(quickstart): add stonedb-8.0 compiling guide docs: add stonedb-8.0 compiling and running guide #1449 by @Double0101 in docs(quickstart): add stonedb-8.0 compiling guide #1449 #1514
• fix(website): fix website error docs: add stonedb-8.0 compiling and running guide #1449 by @Double0101 in fix(website): fix website error #1449 #1548
• feat(tianmu): support volcano framewrok by @RingsC in feat(tianmu): support volcano framewrok #1546
• fix(tianmu): revert code, mv ret value from try block back to catch block. (bug: revert code, mv ret value from try block back to catch block #1532) by @Dysprosium0626 in fix(tianmu): revert code, mv ret value from try block back to catch block. (#1532) #1555
• feat(tiamnu): hard code in defs.h (feature: hard code in defs.h #1481) by @zzzz-vincent in feat(tiamnu): hard code in defs.h (#1481) #1533
• docs:update the compile guides docs: fix some errors and add more details to complie guide #1562 by @chenshengjiang in docs:update the compile guides #1562 #1565
• test(mtr): add more innodb testcases and tianmu range testcase(feature: add MTR test cases for StoneDB #1196) by @davidshiz in test(mtr): add more innodb testcases and tianmu range testcase(#1196) #1569
• fix(tianmu):Remove excess log printing and add some code comments(bug: A large table is executed by ddl,the tianmu.log will print a large number of error. #1545) by @konghaiya in fix(tianmu):Remove excess log printing and add some code comments(#1545) #1547
• fix(tianmu): fix mysqld crash when exec query with AggregateRough, assert failed on i < m_idx.size() at tianmu_attr.h:387, msg: [bad dpn index 0/0] (bug: mysqld crash when exec query with AggregateRough, assert failed on i < m_idx.size() at tianmu_attr.h:387, msg: [bad dpn index 0/0] #1580) by @adofsauron in fix(tianmu): fix mysqld crash when exec query with AggregateRough, assert failed on i < m_idx.size() at tianmu_attr.h:387, msg: [bad dpn index 0/0] (#1580) #1582
• docs(webstie): update the latest website content by @Nliver in docs(webstie): update the latest website content #1589
• feat(tianmu): support volcano framework by @RingsC in feat(tianmu): support volcano framework #1554
• fix: max-width navbar search style by @Agility6 in fix: max-width navbar search style #1600
• feat(website): Update site dependencies and fix some issues by @Nliver in feat(website): Update site dependencies and fix some issues #1606
• fix(tianmu):The instance occasionally crashes when the memory leak. (bug: The instance occasionally crashes when the memory leak. #1549) by @konghaiya in fix(tianmu):The instance occasionally crashes when the memory leak. (#1549) #1598
• fix(website): fix the wrong QR code(bug: fix the wrong community QR code #1624) by @Nliver in fix(website): fix the wrong QR code(#1624) #1634
• fix(tianmu):assert failed on oldv <= dpn_->max_i at pack_int.cpp:337 (bug: assert failed on oldv <= dpn_->max_i at pack_int.cpp:337 #1610) by @konghaiya in fix(tianmu):assert failed on oldv <= dpn_->max_i at pack_int.cpp:337 (#1610) #1627
• fix(tianmu): fix mysqld crash when query where JOIN::propagate_dependencies… (bug: mysqld crash when query where JOIN::propagate_dependencies #1628) by @adofsauron in fix(tianmu): fix mysqld crash when query where JOIN::propagate_dependencies… (#1628) #1639
• fix(tianmu): fix MySQL server has gone away when exec query (bug: ERROR 2006 (HY000): MySQL server has gone away when exec query #1641 bug: ERROR 1105 (HY000): Unknown error when query #1640) by @adofsauron in fix(tianmu): fix MySQL server has gone away when exec query (#1641 #1640) #1642
• fix(tianmu):Support insert ignore syntax (feature: Support insert ignore syntax #1637) by @konghaiya in fix(tianmu):Support insert ignore syntax (#1637) #1643
• fix(tianmu): fix query input variables wrong result (bug: When subqueries are associated with input variables and compare with decimal, wrong result.  #1647) by @adofsauron in fix(tianmu): fix query input variables wrong result (#1647) #1660
• fix(tianmu): fix result of the query using the subquery derived table is incorrect (bug: result of the query using the subquery derived table is incorrect #1662) by @adofsauron in fix(tianmu): fix result of the query using the subquery derived table is incorrect (#1662) #1688
• fix(tianmu): fix results of two queries using a derived table and a custom face change are incorrect (bug: results of two queries using a derived table and a custom face change are incorrect #1696) by @adofsauron in fix(tianmu): fix results of two queries using a derived table and a custom face change are incorrect (#1696) #1697
• feat(tianmu): Test cases that supplement custom variables (feature: Test cases that supplement custom variables #1703) by @adofsauron in feat(tianmu): Test cases that supplement custom variables (#1703) #1705
• fix(tianmu): fix mysqld crash when assigning return values using both custom variables and derived tables (bug: mysqld crash when assigning return values using both custom variables and derived tables  #1707) by @adofsauron in fix(tianmu): fix mysqld crash when assigning return values using both custom variables and derived tables (#1707) #1744
• fix(tianmu): Insert ignore can insert duplicate values.(bug: Insert ignore can insert duplicate values. #1699) by @konghaiya in fix(tianmu): Insert ignore can insert duplicate values.(#1699) #1746
• fix(tianmu): fix error occurred in the union all query result (bug: An error occurred in the union all query result. When one of the sets was empty, the entire query result was overwritten by the null value #1599) by @adofsauron in fix(tianmu): fix error occurred in the union all query result (#1599) #1750
• feat(sql): code refactor for misleading-indentation(feature: rm useless code in sql_optimizer.cc #1542) by @zzzz-vincent in feat(sql): code refactor for misleading-indentation(#1542) #1646
• docs(quickstart): add stonedb-8.0 compiling guide for CentOS 7.x by @xxq-xu in docs(quickstart): add stonedb-8.0 compiling guide for CentOS 7.x #1756
• fix(tianmu):Even if a primary key is defined, duplicate data may be imported.(bug: Even if a primary key is defined, duplicate data may be imported. #1648) by @konghaiya in fix(tianmu):Even if a primary key is defined, duplicate data may be imported.(#1648) #1766
• feat: add delete/drop into tianmu log stat by @duanjr in feat: add delete/drop into tianmu log stat #1747
• fix(tianmu): fix Error result set of the IN subquery with semi join (bug: Error result set of the IN subquery with semi join #1764) by @adofsauron in fix(tianmu): fix Error result set of the IN subquery with semi join (#1764) #1770
• doc(develop-guide): modify method for compile stonedb using docker by @Dysprosium0626 in doc(develop-guide): modify method for compile stonedb using docker #1768
• docs: add docker compile guide of stonedb8.0.(docs: add docker compile guide of stonedb8.0 #1780) by @chenshengjiang in docs: add docker compile guide of stonedb8.0.(#1780) #1783
• feat(tianmu): remove DBUG_OFF and repalce DEBUG_ASSERT with assert by @duanjr in feat(tianmu): remove DBUG_OFF and repalce DEBUG_ASSERT with assert #1751
• fix(tianmu): fix storage of DT type by @duanjr in fix(tianmu): fix storage of DT type #1752
• fix(tinmu): fix tianmu crash when set varchar to num when order by by @adofsauron in fix(tinmu): fix tianmu crash when set varchar to num when order by #1807
• docs(website): update the documentation for Compile StoneDB 8.0 in Docker(docs: update the documentation for Compile StoneDB 8.0 in Docker #1823) by @davidshiz in docs(website): update the documentation for Compile StoneDB 8.0 in Docker(#1823) #1825
• fix(tianmu): fix up the incompatible type by @RingsC in fix(tianmu): fix up the incompatible type #1824
• fix(tianmu): Fix up the unknown exception after instance killed randomly by @RingsC in fix(tianmu): Fix up the unknown exception after instance killed randomly #1841
• fix(tianmu): fix up the incorrect meta-info leads unexpected behavior by @RingsC in fix(tianmu): fix up the incorrect meta-info leads unexpected behavior #1840
• fix(workflow): nightly build failed bug: nightly failed #1830 by @hustjieke in fix(workflow): nightly build failed #1830 #1836
• feat(tianmu): revert assert() --> debug_assert() feature: backport to tainmu, remove DBUG_OFF and DBUG #1551 by @hustjieke in feat(tianmu): revert assert() --> debug_assert() #1551 #1842
• feat(tianmu): fixup the default delimeter for load data by @RingsC in feat(tianmu): fixup the default delimeter for load data #1843
• fix(tianmu): revert PR fix(tianmu): Fix up the unknown exception after instance killed randomly #1841. by @RingsC in fix(tianmu): revert PR #1841. #1850
• fix(tianmu): fix up mtr test case for delim of load data command by @RingsC in fix(tianmu): fix up mtr test case for delim of load data command #1854
• fix(tianmu): fix up the group_concat function in tianmu by @RingsC in fix(tianmu): fix up the group_concat function in tianmu #1852
• fix(tianmu): To fixup the instance crashed if the result of aggregate is out of boundary by @RingsC in fix(tianmu): To fixup the instance crashed if the result of aggregate is out of boundary #1856
• docs(developer-guide): update the compiling guide of StoneDB 8.0 for CentOS 7.x docs(developer-guide): update the compiling guide of StoneDB 8.0 for CentOS 7.x  #1817 by @xxq-xu in docs(developer-guide): update the compiling guide of StoneDB 8.0 for CentOS 7.x #1817 #1834
• fix(tianmu): Fixup the mem leakage of aggregation function by @RingsC in fix(tianmu): Fixup the mem leakage of aggregation function #1867
• fix(tianmu): fix UNION of non-matching columns and express with aggregation (bug: 包含内连接和外连接及派生表和子查询的查询结果错误 #1861 feature: ERROR 1105 (HY000): The query includes syntax that is not supported by the storage engine. Tianmu: UNION of non-matching columns (column no 0) . #1864 bug: 当存在decimal数据类型时且派生表中包含union all的查询语句不支持 #1873 bug: UNION clause return error: UNION of non-matching columns (column no 0) #1870) by @adofsauron in fix(tianmu): fix UNION of non-matching columns and express with aggregation (#1861 #1864 #1873 #1870) #1881
• test(tianmu): add order by sentence in the mtr case various_join.test by @xxq-xu in test(tianmu): add order by sentence in the mtr case various_join.test #1886
• test(mtr): add more test cases for tianmu(feature: add MTR test cases for StoneDB #1196) by @davidshiz in test(mtr): add more test cases for tianmu(#1196) #1888
• test(mtr): add order by sentence in the mtr case various_join.test by @xxq-xu in test(mtr): add order by sentence in the mtr case various_join.test #1891
• ci(codecov): update the config by @Nliver in ci(codecov): update the config #1898
• fix(tianmu): To suuport ignore option for update statement by @RingsC in fix(tianmu): To suuport ignore option for update statement #1884
• ci(codecov): update the codecov congfig by @Nliver in ci(codecov): update the codecov congfig #1899
• docs(intro): update the support for 8.0 by @Nliver in docs(intro): update the support for 8.0 #1901
• workflow(codecov): Filter out excess code files by @Nliver in workflow(codecov): Filter out excess code files #1905
• workflow(coverage): Update the lcov running logic(WorkFlow: Optimize the CI/CD for Codecov code coverage detection #1908)(#bug: Two WokFlows failed under Actions #1592) by @Nliver in workflow(coverage): Update the lcov running logic(#1908)(##1592) #1909
• fix(tianmu): default value of the field take unaffect in load bug: load data , the default value of the field does not take effect #1865 by @Double0101 in fix(tianmu): default value of the field take unaffect in load #1865 #1896
• fix(tianmu): To support union(all) the statement which is without from clause by @RingsC in fix(tianmu): To support union(all) the statement which is without from clause #1887
• fix(tianmu): To remove unnessary optimization in tianmu by @RingsC in fix(tianmu): To remove unnessary optimization in tianmu #1911
• fix(tianmu): hotfix corruption in ValueOrNull under multi-thread by @RingsC in fix(tianmu): hotfix corruption in ValueOrNull under multi-thread #1869
• fix(tianmu): incorrect result when using where expr and args > bigint_max bug: bigint type, return wrong result; #1564 by @Double0101 in fix(tianmu): incorrect result when using where expr and args > bigint_max #1564 #1902
• fix(tianmu): add TIME_to_ulonglong_time_round process and fix up precision loss problem (bug: Bit Operators and Functions problems #1173) by @xxq-xu in fix(tianmu): add TIME_to_ulonglong_time_round process and fix up precision loss problem (#1173) #1895

New Contributors

• @zzzz-vincent made their first contribution in fix(workflow): remove dup lines in git workflow(#1517) #1531
• @Agility6 made their first contribution in fix: page hover font style #1535
• @Dysprosium0626 made their first contribution in fix(tianmu): revert code, mv ret value from try block back to catch block. (#1532) #1555
• @xxq-xu made their first contribution in docs(quickstart): add stonedb-8.0 compiling guide for CentOS 7.x #1756
• @duanjr made their first contribution in feat: add delete/drop into tianmu log stat #1747

Full Changelog: 5.7-v1.0.3-GA...5.7-v1.0.4-alpha

---

This discussion was created from the release stonedb-5.7-v1.0.4-alpha.