Skip to content

Releases: apache/shardingsphere

5.4.1

21 Oct 06:31
Compare
Choose a tag to compare

New Features

  1. Proxy: Supports dbcp and c3p0 connection pools
  2. Metadata: Standalone mode adapts to metadata new structure
  3. Governance: Governance supports register instance level data source

Enhancements

  1. Mode: Improve Standalone mode JDBC type impl reset data on initialization
  2. Scaling: Isolate ShardingSphereDataSource Standalone repository in pipeline
  3. Scaling: Disable system-schema-metadata-enabled in pipeline
  4. JDBC: Move jdbc core META-INF/services/java.sql.Driver from test to main
  5. Scaling: Add algorithm columns in SHOW MIGRATION CHECK ALGORITHMS DistSQL result
  6. Scaling: Add type_aliaes column in SHOW MIGRATION CHECK ALGORITHMS DistSQL result
  7. Encrypt: Add duplicate name check for derived columns and logical columns
  8. Encrypt: Deny DDL for cipher columns in Proxy
  9. Encrypt: Add the default type for derived columns to varchar(4000)

Bug Fixes

  1. Scaling: Fix get inventory position not correctly on breakpoint resuming when table names are similar
  2. Scaling: Fix CDC importer not start on breakpoint resuming when first inventory task is finished
  3. Single Table: Fix not switched active version when CREATE/DROP table modifies the Single rule configuration
  4. JDBC: Fix JDBC memory leak with MySQL in the 5.4.0 version

Change Log

  1. MILESTONE

5.4.0

08 Jul 07:27
Compare
Choose a tag to compare

API Changes

  1. Metadata: Change sharding broadcast tables to global broadcast tables
  2. JDBC: Remove exclamation mark (!) for global rules
  3. DistSQL: Simplify keywords ASSISTED_QUERY, LIKE_QUERY in encrypt DistSQL
  4. DistSQL: Optimize SQL_PARSER rule syntax
  5. Encrypt: Adjust encryption yaml API to distinguish between encrypt, like, and assisted query configurations
  6. Encrypt: Remove plain column and queryWithCipherColumn configuration in encrypt feature
  7. Readwrite-splitting: Refactor read/write splitting api
  8. Proxy: Remove property proxy-instance-type configuration
  9. Proxy: Remove property proxy-backend-executor-suitable
  10. Proxy: Remove property proxy-mysql-default-version
  11. Scaling: Refactor commit rollback streaming to drop streaming
  12. Sharding: Merge ShardingCacheRule into ShardingRule (Experimental)

New Features

  1. DistSQL: New syntax to manage SQL_FEDERATION rule
  2. Proxy: Support Unix Domain Socket

Enhancements

  1. Scaling: CDC supports pure incremental mode
  2. Scaling: CDC supports exporting data by transaction
  3. Scaling: CDC supports MySQL and PostgreSQL
  4. Scaling: CDC supports single table
  5. Scaling: CDC supports all openGauss data types
  6. Scaling: CDC supports replication reconnection
  7. Scaling: Remove DataConsistencyCalculateAlgorithmChooser
  8. Scaling: Improve performance of integer unique key table inventory data splitting
  9. Scaling: Adjust process configuration default value to reduce resource consumption
  10. Scaling: Auto refresh table metadata for migration
  11. Scaling: Compatible with openGauss existing replication slot reuse when database not existing
  12. Scaling: Show data consistency check status result should be empty when it's not completed
  13. Scaling: Enable concurrent CRC32 match on source and target
  14. Scaling: Pipeline job compatible with sharding rule audit strategy
  15. Metadata: Refactor metadata persistence structure
  16. Metadata: Optimize the process of loading single table metadata
  17. Metadata: Support MySQL/PostgreSQL/openGauss system tables empty query
  18. DistSQL: Add support for transactionalReadQueryStrategy for read/write splitting rule
  19. DistSQL: Enhanced algorithm properties check
  20. Transaction: Add privilege check
  21. Transaction: Remove the TransactionTypeHolder and only create the current transaction manager
  22. Parser: Support MySQL LOAD DATA and LOAD XML statement with single table or broadcast table
  23. Parser: Improve the parsing support of high-priority SQL statements in the test results of the MySQL test program
  24. Parser: Oracle dialect parser now supports Chinese comma
  25. Encrypt: Support query of encrypt column in projection subquery when use encrypt feature
  26. Kernel: Adds table existence metadata check for INSERT, DELETE, UPDATE and SELECT statements
  27. JDBC: Implement batch execution for ShardingSphereStatement
  28. Proxy: Frontend supports SSL/TLS
  29. Proxy: Support Flush message for PostgreSQL/openGauss Proxy
  30. Proxy: Support data type bit, bool for PostgreSQL Proxy

Bug Fixes

  1. Scaling: Fix pipeline job failure status persistence and usage
  2. Scaling: Fix CDC DELETE event Record.beforeList is null
  3. Scaling: Fix openGauss mppdb decoding plugin single quote issue
  4. Scaling: Fix execute engine not closed after job stopping
  5. Scaling: Fix stop job before task starting
  6. Metadata: Fix case sensitive issue when loading schema meta data with H2 database
  7. Metadata: Fix "object not found" exception when config PostgreSQL/openGauss schema name as database name
  8. DistSQL: Fix wrong result of check_table_metadata_enabled when execute SHOW DIST VARIABLE
  9. Encrypt: Fix SQL rewrite exception when use PostgreSQL/openGauss encrypt like feature
  10. Sharding: Support null sharding condition pass to sharding algorithm to allow user control null value route
  11. Parser: Support BETWEEN AND expression parsing in MySQL Projection
  12. Mask: Fix wrong mask result when config same value of from-x and to-y with KEEP_FROM_X_TO_Y
  13. Infra: Fix ClassNotFoundException may occur when missing pgjdbc
  14. Proxy: Fix MySQL packet out of order when client sending pipelining requests

Change Log

  1. MILESTONE

5.3.2

30 Mar 09:56
5.3.2
a0a1f25
Compare
Choose a tag to compare

API Changes

  1. Proxy: Add property system-log-level, support dynamic change of log level by DistSQL.
  2. DistSQL: Remove Hint-related DistSQL, users can use SQL Hint instead

New Features

  1. Scaling: Support any type of column unique key table

Enhancements

  1. Scaling: Use stream query for inventory dump and data consistency check
  2. Scaling: Compatible with VARBINARY column type in MySQL binlog parsing
  3. Scaling: Refactor AbstractSimplePipelineJob.execute to blocking
  4. Scaling: Improve table records count calculation
  5. Scaling: Support proxy sharding rule absent for migration job
  6. Scaling: Add useServerPrepStmts=false for pipeline job on MySQL
  7. Scaling: Improve datetime/time parsing for MySQL binlog
  8. Scaling: Add global status for prepare stage
  9. Scaling: Add netTimeoutForStreamingResults for pipeline job on MySQL
  10. Authority: Support specifying password authentication method
  11. Authority: Add md5 authentication support for openGauss protocol
  12. Agent: Add more metrics for JDBC
  13. Kernel: ShardingSphere Driver configuration supports Apollo
  14. Kernel: Adjust SKIP_ENCRYPT_REWRITE SQL Hint to SKIP_SQL_REWRITE to support more scenarios
  15. Kernel: Support openGauss EXPLAIN PERFORMANCE
  16. Encrypt: Like supports concat function

Bug Fixes

  1. Scaling: Fix unicode char and special char decoding for PostgreSQL incremental task
  2. Scaling: Fix Migration not support PostgreSQL json type
  3. DistSQL: CREATE SHARDING TABLE RULE supports NONE strategy
  4. Kernel: Fix use system database error when data sources are empty
  5. Kernel: Fix set worker-id does not take effect with Standalone mode
  6. Kernel: Clear storage node information when delete readwrite-splitting and database discovery rules
  7. Kernel: Fix the abnormal problem of Column index out of range in single table complex query
  8. Kernel: Fix PostgreSQL like lower case failed.
  9. Kernel: Fixed the exception of built-in metabase data collection when the front and back database types were inconsistent
  10. Kernel: Fix the problem of routing error reporting under certain table names
  11. Kernel: Fix MySQL create procedure parse error
  12. Kernel: Fix union extract table name NPE
  13. Kernel: Fix upper case table constraint not rewrite error
  14. Kernel: Fix failed to parse PostgreSQL / openGauss SQL contains money type
  15. Kernel: Fix PostgreSQL / openGauss positional parameter rule
  16. Kernel: Fix PostgreSQL / openGauss failed to parse const with type cast
  17. Kernel: Fix Chinese characters encode exception when execute select with sql federation engine
  18. Kernel: Fix IndexOutOfBoundsException when execute set variable statement int jdbc adapter
  19. Kernel: Fix index does not exist exception when execute drop index statement
  20. Proxy: Properly handle number sign in MySQL Proxy binary protocol
  21. Proxy: Fix PostgreSQL Proxy failed to handle bytea data type
  22. Proxy: Fix PostgreSQL Proxy failed to parse time value with microseconds
  23. Proxy: Fix PostgreSQL protocol codec for date type in binary format
  24. Proxy: Fix possible CCE PostgreSQLInt2BinaryProtocolValue
  25. Proxy: Fix possible error when client pass quoted charset to PostgreSQL/openGauss Proxy

Change Log

  1. MILESTONE

5.3.1

10 Jan 03:23
Compare
Choose a tag to compare

New Features

  1. Kernel: Add new data masking, dynamic data masking features, and built-in data masking algorithms
  2. Scaling: Basic support of CDC feature
  3. DistSQL: Add masking rule related DistSQL

Enhancements

  1. Kernel: Cluster mode avoids secondary refresh of metadata
  2. Kernel: SHOW COMPUTE NODES supports displaying the version number of each instance
  3. Kernel: System database add cluster information table
  4. Kernel: Standalone mode persistent metadata supports MySQL
  5. Kernel: SQL HINT performance improvement
  6. Kernel: Restore routing to the specified database with Hint
  7. Encrypt: Supports underscore wildcards for Encrypt CharDigestLikeEncryptAlgorithm
  8. Kernel: Support SQL federation SELECT NULLS LAST/FIRST statement
  9. Kernel: Refactor encrypt integration test logic and add more test cases
  10. Kernel: Add salt props for MD5MaskAlgorithm, MD5EncryptAlgorithm
  11. Kernel: Refactor ShardingConditionEngine to support SPI configuration
  12. DistSQL: Support defining column level QUERY_WITH_CIPHER_COLUMN when CREATE ENCRYPT RULE
  13. DistSQL: Add algorithm type check for CREATE SHARDING TABLE RULE

Bug Fixes

  1. Fix the problem of ZooKeeper cluster error reporting when ShardingSphere connects to Kubernetes
  2. Kernel: Fix use Consul in cluster mode start up failure
  3. DB Discovery: Close heartbeat job when drop discovery rule
  4. Kernel: Fix wrong decide result when execute same sharding condition subquery with SQL federation
  5. Kernel: Fix priority problem of UNION, INTERSECT, EXCEPT set operation in SQL Federation for PostgreSQL and openGuass dialect
  6. Kernel: Fix create view index out of range exception when view contains set operator
  7. Kernel: Add XA resource exceeds length check
  8. Kernel: Fix transaction support for spring requires_new
  9. Encrypt: Fix AESEncryptAlgorithm decrypt exception when config char type with PostgreSQL and openGauss
  10. Encrypt: Fix abnormal expansion result for shorthand when encrypt subquery contains an alias
  11. Kernel: Fix unsigned flag of column metadata was not serialized
  12. Kernel: Fix PostgreSQL / openGauss select fetch parsing issue to support federation execution engine
  13. Proxy: Fix packet sequence ID may be incorrect if error occurred in MySQL Proxy
  14. Proxy: Fix error occur in Proxy when using PostgreSQL composite type
  15. Proxy: Set proper column definition flag for MySQL COM_STMT_PREPARE
  16. Proxy: When querying PG metadata through Proxy and the result set is empty, the labels are lost

Change Log

  1. MILESTONE

5.3.0

08 Jan 01:26
91e191a
Compare
Choose a tag to compare

API Changes

  1. DistSQL: Refactor syntax API, please refer to the user manual
  2. Proxy: Change the configuration style of global rule, remove the exclamation mark
  3. Proxy: Allow zero-configuration startup, enable the default account root/root when there is no Authority configuration
  4. Proxy: Remove the default logback.xml and use API initialization
  5. JDBC: Remove the Spring configuration and use Driver + YAML configuration instead

Enhancements

  1. DistSQL: New syntax REFRESH DATABASE METADATA, refresh logic database metadata
  2. Kernel: Support DistSQL REFRESH DATABASE METADATA to load configuration from the governance center and rebuild MetaDataContext
  3. Support postgresql/openGauss setting transaction isolation level
  4. Scaling: Increase inventory task progress update frequency
  5. Scaling: DATA_MATCH consistency check support breakpoint resume
  6. Scaling: Support drop consistency check job via DistSQL
  7. Scaling: Rename column from sharding_total_count to job_item_count in job list DistSQL response
  8. Scaling: Add sharding column in incremental task SQL to avoid broadcast routing
  9. Scaling: Sharding column could be updated when generating SQL
  10. Scaling: Improve column value reader for DATA_MATCH consistency check
  11. DistSQL: Encrypt DistSQL syntax optimization, support like query algorithm
  12. DistSQL: Add properties value check when REGISTER STORAGE UNIT
  13. DistSQL: Remove useless algorithms at the same time when DROP RULE
  14. DistSQL: EXPORT DATABASE CONFIGURATION supports broadcast tables
  15. DistSQL: REGISTER STORAGE UNIT supports heterogeneous data sources
  16. Encrypt: Support Encrypt LIKE feature
  17. Automatically start distributed transactions when executing DML statements across multiple shards
  18. Kernel: Support client \d for PostgreSQL and openGauss
  19. Kernel: Support select group by, order by statement when column contains null values
  20. Kernel: Support parse RETURNING clause of PostgreSQL/openGauss Insert
  21. Kernel: SQL HINT performance improvement
  22. Kernel: Support mysql case when then statement parse
  23. Kernel: Supporting data source level heterogeneous database gateway
  24. (Experimental) Sharding: Add sharding cache plugin
  25. Proxy: Support more PostgreSQL datetime formats
  26. Proxy: Support MySQL COM_RESET_CONNECTION
  27. Scaling: Improve MySQLBinlogEventType.valueOf to support unknown event type
  28. Kernel: Support case when for federation

Bug Fix

  1. Scaling: Fix barrier node created at job deletion
  2. Scaling: Fix part of columns value might be ignored in DATA_MATCH consistency check
  3. Scaling: Fix jdbc url parameters are not updated in consistency check
  4. Scaling: Fix tables sharding algorithm type INLINE is case-sensitive
  5. Scaling: Fix incremental task on MySQL require mysql system database permission
  6. Proxy: Fix the NPE when executing select SQL without storage node
  7. Proxy: Support DATABASE_PERMITTED permission verification in unicast scenarios
  8. Kernel: Fix the wrong value of worker-id in show compute nodes
  9. Kernel: Fix route error when the number of readable data sources and weight configurations of the Weight algorithm are not equal
  10. Kernel: Fix multiple groups of readwrite-splitting refer to the same load balancer name, and the load balancer fails problem
  11. Kernel: Fix can not disable and enable compute node problem
  12. JDBC: Fix data source is closed in ShardingSphereDriver cluster mode when startup problem
  13. Kernel: Fix wrong rewrite result when part of logical table name of the binding table is consistent with the actual table name, and some are inconsistent
  14. Kernel: Fix startup exception when use SpringBoot without configuring rules
  15. Encrypt: Fix null pointer exception when Encrypt value is null
  16. Kernel: Fix oracle parsing does not support varchar2 specified type
  17. Kernel: Fix serial flag judgment error within the transaction
  18. Kernel: Fix cursor fetch error caused by wasNull change
  19. Kernel: Fix alter transaction rule error when refresh metadata
  20. Encrypt: Fix EncryptRule cast to TransparentRule exception that occurs when the call procedure statement is executed in the Encrypt scenario
  21. Encrypt: Fix exception which caused by ExpressionProjection in shorthand projection
  22. Proxy: Fix PostgreSQL Proxy int2 negative value decoding incorrect
  23. Proxy: PostgreSQL/openGauss support describe insert returning clause
  24. Proxy: Fix gsql 3.0 may be stuck when connecting Proxy
  25. Proxy: Fix parameters are missed when checking SQL in Proxy backend
  26. Proxy: Enable MySQL Proxy to encode large packets
  27. Kernel: Fix oracle parse comment without whitespace error
  28. DistSQL: Fix show create table for encrypt table

Refactor

  1. Scaling: Reverse table name and column name when generating SQL if it's SQL keyword
  2. Scaling: Improve increamental task failure handling
  3. Kernel: Governance center node adjustment, unified hump to underscore

Change Log

  1. MILESTONE

5.2.1

18 Oct 07:45
28d18bb
Compare
Choose a tag to compare

New Feature

  1. Add ShardingSphere default system database to support global metadata management
  2. Support asynchronous data consistency check
  3. Added support for Consul governance center
  4. Added support for Nacos governance center
  5. Added support for the view function in the governance center

Enhancement

  1. SQL Federation engine adds ADVANCED executor and adapts to openGauss database
  2. Support ShardingSphere Proxy startup after read-write splitting read database is disabled
  3. SQL HINT supports force sharding route
  4. Show processlist supports showing Proxy connections (sleep, active)
  5. Optimized ShardingSphere-JDBC data source configuration error message
  6. ShardingSphere-JDBC supports SpringBoot 3.x version
  7. Support load MySQL, PostgreSQL, openGauss and SQLServer view metadata
  8. Update Snakeyaml to 1.33 and open YAML 3MB limit
  9. Reuse cached connections as possible when unicast sharding
  10. Support Parsing ALTER ROLE in Oracle
  11. Add support of ALTER RESOURCE COST for Oracle
  12. Support parsing Drop Materialized View in Oracle
  13. Support parsing DROP LIBRARY in Oracle
  14. Support parsing DROP JAVA in Oracle
  15. Support parsing DROP PLUGGABLE DATABASE in Oracle
  16. Support parsing DROP INDEX TYPE in Oracle
  17. Support Parsing ALTER PACKAGE in openGauss
  18. Support openGauss select offset, count statement parse and remove useless syntax in PostgreSQL grammar
  19. Add max_size to openGauss syntax
  20. Optimize alter view/drop view parse logic and fix alter view refresher bug
  21. Add sql parser error detail to ParseCancellationException
  22. Add support for parse OptOnConflict for postgres
  23. Enhance support for ALTER TABLE and ALTER VIEW in PostgreSQL
  24. Add a missing keyword in PostgreSQL Declare Statement
  25. Add json function support to mysql parser
  26. ShardingSphere-Proxy automatically adapts to cgroup memory limits in Docker environment
  27. Show migration status DistSQL respond new added error_message column
  28. Show migration status respond new added processed_records_count column
  29. Support MySQL 8 caching_sha2_password authentication in incremental dump
  30. Improve drop pipeline process configuration
  31. Support unique key table migration
  32. Support migrate table to new name table
  33. Improve thread pool usage in pipeline task and runner
  34. Support cancelable data consistency check
  35. DistSQL: When creating or altering readwrite-splitting rule, check duplicate write or read resources
  36. DistSQL: Add validity check for ALTER SHARDING BINDING TABLE RULES
  37. Standalone mode H2 support persistent metadata
  38. Fix openGauss cursor execution in xa transaction
  39. Added transaction related exceptions

Bug Fix

  1. Generate proper placeholder for PostgreSQL when rewriting
  2. Fix opengauss update set parse exception
  3. Fix parse exception when execute insert statement with negative value
  4. Fix wrong connectDescriptorUrlPattern in OracleDataSourceMetaData
  5. Fix insert SQL garbled after sharding rewrote in special rules
  6. Fix exception when execute select * from information_schema.tables
  7. Fix exception when execute alter view rename
  8. Fix PostgreSQL check data source permission when using rolsuper
  9. DistSQL: fix NPE for REFRESH TABLE METADATA when there is no resource
  10. Fix Unmodified table metadata when modify rules
  11. Fix database discovery
  12. The MySQL.NORMAL_REPLICATION algorithm cannot find primary node"
  13. Fixed using etcd to build a cluster event not aware
  14. Fix NPE occurred when transaction management is not created
  15. Fix routing exception that occurs when the sharding value of the InlineShardingAlgorithm algorithm exceeds Integer

API Changes

  1. SQL HINT syntax format adjust to SQL-style format
  2. DistSQL: Remove syntax COUNT DATABASE RULES
  3. ShardingSphere mode remove overwrite configuration
  4. Agent: Optimize configuration of agent.yaml

Change Log

  1. MILESTONE

5.2.0

08 Sep 11:40
Compare
Choose a tag to compare

New Feature

  1. Support SQL audit for sharding feature
  2. Support MySQL show processlist and kill process list id feature
  3. Scaling: Add dedicated DistSQL for data migration
  4. Scaling: Basic support migrate data to heterogeneous database
  5. DistSQL: New syntax CREATE MIGRATION PROCESS CONFIGURATION
  6. DistSQL: New syntax ALTER MIGRATION PROCESS CONFIGURATION
  7. DistSQL: New syntax SHOW MIGRATION PROCESS CONFIGURATION
  8. DistSQL: New syntax ADD MIGRATION SOURCE RESOURCE
  9. DistSQL: New syntax SHOW SQL_TRANSLATOR RULE
  10. DistSQL: New syntax CREATE SHARDING AUDITOR
  11. DistSQL: New syntax ALTER SHARDING AUDITOR
  12. DistSQL: New syntax SHOW SHARDING AUDIT ALGORITHMS

Enhancement

  1. Support column visible feature for MySQL, Oracle, SQLServer and H2
  2. Support cartesian product configuration for read write splitting
  3. Support spring namespace and spring boot usage for sql translator
  4. Support JSR-310 Year and Month in IntervalShardingAlgorithm
  5. Support broadcast table update/delete limit statement
  6. Support create index on table(column) statement rewrite when config encrypt
  7. Support openGauss cursor, fetch, move, close statement for sharding, readwrite-splitting
  8. Support encrypt column rewrite when execute column is null in predicate
  9. Support encrypt show create table return logic columns
  10. Support create table with index statement rewrite when config encrypt
  11. Support PostgreSQL create operator statement parse
  12. Support PostgreSQL create materialized view statement parse
  13. Support PostgreSQL nested comments parse
  14. Support PostgreSQL alter subscription statement parse
  15. Support PostgreSQL create group statement parse
  16. Support PostgreSQL alter statictics statement parse
  17. Support PostgreSQL create foreign table statement parse
  18. Support PostgreSQL alter server statement parse
  19. Support PostgreSQL create foreign data wrapper statement parse
  20. Support PostgreSQL create event trigger statement parse
  21. Support PostgreSQL security label statement parse
  22. Support PostgreSQL reindex statement parse
  23. Support PostgreSQL reassign owned statement and refresh materialized view statement parse
  24. Support PostgreSQL prepare transaction statement parse
  25. Support PostgreSQL create collation statement parse
  26. Support PostgreSQL lock statement parse
  27. Support PostgreSQL alter rule statement parse
  28. Support PostgreSQL notify statement parse
  29. Support PostgreSQL unlisten statement parse
  30. Support Oracle alter function and alter hierarchy statement parse
  31. Support Oracle alter pluggable database statement parse
  32. Support Oracle alter materialized view log statement parse
  33. Support Oracle alter diskgroup statement parse
  34. Support Oracle alter operator statement parse
  35. Support oracle alter cluster statement parse
  36. Support oracle alter audit policy statement parse
  37. Support Oracle alter index type statement parse
  38. Support Oracle lock table statement parse
  39. Support Oracle alter java statement parse
  40. Support Oracle inline constraint statement parse
  41. Support openGauss geometric operator statement parse
  42. Optimize MySQL visible/invisible parse of create/alter table statements
  43. Support scope of variable prefixed with @@ in MySQL SET statement parse
  44. Support MySQL create procedure with create view parse
  45. Support column segments parse in create index on table statement
  46. Support openGauss cursor, fetch, move, close statement for sharding, readwrite-splitting
  47. Support encrypt column rewrite when execute column is null in predicate
  48. Support encrypt show create table return logic columns
  49. Support create table with index statement rewrite when config encrypt
  50. Support parsing ALTER LOCKDOWN PROFILE in Oracle
  51. Support parsing ALTER MATERIALIZED VIEW in Oracle
  52. Support parsing ALTER MATERIALIZED ZONEMAP in Oracle
  53. Support parsing ALTER LIBRARY in Oracle
  54. Support parsing ALTER INMEMORY JOIN GROUP in Oracle
  55. Support parsing DROP OPERATOR in Oracle
  56. Support parsing DROP RESTORE POINT in Oracle
  57. Support parsing CREATE RESTORE POINT in Oracle
  58. Support parsing DROP INMEMORY JOIN GROUP in Oracle
  59. Support parsing create_bit_xor_table in MySQL
  60. Support parsing MySQL DO statement
  61. Support parsing DropServer in openGauss
  62. Support parsing CREATE AGGREGATE In openGauss
  63. Support parsing ALTER ROUTINE in PostgreSQL
  64. Add PostgreSQL Create Cast Statement
  65. Add PostgreSQL Create Aggregate Statement
  66. Support fetch/move/close cursor statement in PostgreSQL
  67. Support Parsing ALTER PUBLICATION in PostgreSQL
  68. Add PostgreSQL Create Access Method Statement
  69. Support Parsing ALTER POLICY in PostgreSQL
  70. Support parsing ALTER OPERATOR in PostgreSQL
  71. Add PostgreSQL Copy Statement
  72. Add PostgreSQL Comment Statement
  73. Support listen statement in postgreSQL
  74. Support DECLARE cursor statement
  75. Add default serverConfig in helm charts
  76. Assemble openGauss JDBC Driver into Proxy distribution
  77. ShardingSphere-Proxy listen on specified IP addresses
  78. Support COM_STMT_SEND_LONG_DATA in MySQL Proxy
  79. SELECT VERSION() support alias in MySQL Proxy
  80. Fix openGauss Proxy could not be connected if no resource defined
  81. Support using JRE defined in JAVA_HOME in ShardingSphere-Proxy's startup script
  82. Avoid client blocked when OOM occurred in ShardingSphere-Proxy
  83. Support using c3p0 in ShardingSphere-JDBC
  84. Support SET NAMES with value quoted by double-quote
  85. Connection.prepareStatement with columns arguments is available in ShardingSphere-JDBC
  86. Scaling: Improve MySQL connect and reconnect
  87. Scaling: Fix MySQL json column may cause leak at incremental task
  88. Scaling: Add permission check for PostgreSQL data sources
  89. Scaling: Incremental migration support for MySQL MGR mode
  90. Scaling: Improve job progress persistence
  91. Scaling: Start job DistSQL execute and return synchronously
  92. Scaling: Inventory migration support table has primary key and unique key
  93. Scaling: Close unerlying ElasticJob when stopping job
  94. Scaling: Improve logical replication slot name generation for PostgreSQL and openGauss
  95. Scaling: Make query DistSQL could be executed when no database selected
  96. DistSQL: Add worker_id to the result set of SHOW INSTANCE LIST & SHOW INSTANCE INFO
  97. DistSQL: Improve the result of EXPORT DATABASE CONFIG
  98. DistSQL: Support more databases for FORMAT SQL
  99. DistSQL: Optimize the execution logic of CREATE TRAFFIC RULE
  100. DistSQL: Add paramter writeDataSourceQueryEnabled for RDL READWRITE_SPLITTING RULE.
  101. DistSQL: Support assistEncryptor for Encrypt RDL
  102. DistSQL: Add sharding algorithm type check when CREATE SHARDING TABLE RULE
  103. Support database discovery to configure multiple groups of high availability under the same logic database
  104. Support ShardingSphere-Proxy to start up under empty logic library
  105. Support for isolating EventBus events by instance
  106. Support the database to detect changes in the master node and restart the detection heartbeat task
  107. Support ShardingSphere-Proxy to generate new worker-id when re-registering in cluster mode
  108. Thrown exception when inserting expression value in shadow column on executing insert
  109. Support distributed transactions across multiple logical databases
  110. Support executing truncate in XA & PostgreSQL
  111. Support alter local transaction rule with DistSQL
  112. Support global transaction manager
  113. Delete support for branch transaction on proxy

Bug Fix

  1. Fix single table metadata refresh error caused by filtering DataSourceContainedRule
  2. Fix parsing exception caused by the null value of MySQL blob type
  3. Fix PostgreSQL/openGauss reset statement parse error
  4. Fix wrong parameter rewrite when use sharding and encrypt
  5. Fix the failed conversion of Month related classes on IntervalShardingAlgorithm
  6. Fix NullPointerException when execute select union statement contains subquery
  7. Fix wrong encrypt rewrite result due to incorrect order of metadata
  8. Fix MySQL trim function parse error
  9. Fix MySQL insert values with _binary parse error
  10. Fix MySQL syntax error cannot be thrown to client
  11. Avoid EventLoop blocked because of closing JDBC resources
  12. Correct server status flags returned by MySQL Proxy
  13. Fix a possible connection leak issue if Proxy client disconnected in transaction
  14. Fixed a possible consistency issue with the statement being executed when the Proxy client is disconnected
  15. Avoid pooled connection polluted by executing SET statements
  16. Make SHOW TABLES FROM work in ShardingSphere-Proxy
  17. Fix PostgreSQL DDL could not be executed by Extended Query
  18. Fix SHOW VARIABLES could not be executed in PostgreSQL Proxy without resource
  19. Fix FileNotFoundException when use ShardingSphere Driver with SpringBoot fatjar
  20. Scaling: Fix the problem that the table contains both primary key and unique index at inventory migration
  21. Scaling: Improve incremental migration, support the latest position in the middle of batch insert event
  22. Scaling: Fix the error caused by null field value in openGauss incremental migration
  23. DistSQL: Fix incorrect strategy name in result of SHOW SHARDING TABLE RULES
  24. DistSQL: Fix current rule config is modified in advance when ALTER SHARDING TABLE RULE
  25. DistSQL: Fix connection leak when ALTER RESOURCE
  26. DistSQL: Fix CREATE TRAFFIC RULE failed when load balance algorithm is null
  27. Fix that the monitoring heartbeat task was not stopped when the database was discovered and the logical library was deleted
  28. Fix cluster mode ShardingSphere-JDBC load all logic database
  29. Fix worker-id generated by SnowflakeKeyGenerateAlgorithm in cluster mode may exceed the maximum value
  30. Fix DistSQL adding shadow algorithm exception without shadow data source
  31. Fix cross-database data source confusion caused by same data source name in multiple logical databases
    1...
Read more

5.1.2

17 Jun 10:21
5.1.2
97d0d59
Compare
Choose a tag to compare

New Feature

  1. Kernel: Alpha version to support SQL dialect translate for MySQL and PostgreSQL
  2. Kernel: Support custom schema for PostgreSQL and openGauss
  3. Kernel: Support create/alter/drop view statement for PostgreSQL and openGauss
  4. Kernel: Support openGauss cursor statement
  5. Kernel: Support use customize system database
  6. Kernel: Support get openGauss and MySQL create SQL
  7. Kernel: Support get postgres create SQL
  8. Proxy: Official support for quickly deploying a ShardingSphere-Proxy cluster with a ZooKeeper cluster in Kubernetes using Helm
  9. JDBC: Support ShardingSphere JDBC Driver
  10. Scaling: Support PostgreSQL auto create table
  11. Scaling: Support scaling for table with customized schema in PostgreSQL and openGauss
  12. Scaling: Support scaling for table with text primary key and without integer primary key
  13. Mode: Registry center supports PG/openGauss three-level structure
  14. Mode: Registry center supports database-level distributed lock

Enhancement

  1. Kernel: Support copy statement for PostgreSQL and openGauss
  2. Kernel: Support alter/drop index statement for PostgreSQL
  3. Kernel: Support update force index statement for MySQL
  4. Kernel: Support create/alter/drop schema for openGauss
  5. Kernel: Optimize RoundRobinReplicaLoadBalanceAlgorithm and RoundRobinTrafficLoadBalanceAlgorithm logic
  6. Kernel: Optimize metadata loading logic when frontendDatabaseType and backendDatabaseType are different
  7. Kernel: Refactor meta data load logic
  8. Kernel: Optimize show processlist statement
  9. Kernel: Improve performance about large tables loaded
  10. Kernel: Support execute comment statement
  11. Kernel: Support view in sharding rule
  12. Kernel: Support parsing CREATE ROLLBACK SEGMENT in Oracle
  13. Kernel: Support Parsing DROP TYPE in openGauss
  14. Kernel: Support Parsing ALTER TYPE in openGauss
  15. Kernel: Support parsing DROP DISKGROUP in Oracle
  16. Kernel: Support parsing CREATE DISKGROUP in Oracle
  17. Kernel: Support parsing DROP FLASHBACK ARCHIVE in Oracle
  18. Kernel: Support Parsing CHECKPOINT in openGauss
  19. Kernel: Support parsing CREATE FLASHBACK ARCHIVE in Oracle
  20. Kernel: Add PostgreSQL Close Statement
  21. Kernel: Support Parsing DROP CAST in openGauss
  22. Kernel: Support parsing CREATE CAST in openGauss
  23. Kernel: Support parsing CREATE CONTROL FILE in Oracle
  24. Kernel: Support Parsing DROP DIRECTORY in openGauss
  25. Kernel: Support parsing ALTER DIRECTORY in openGauss
  26. Kernel: Support parsing CREATE DIRECTORY in openGauss
  27. Kernel: Add PostgreSQL Checkpoint Statement
  28. Kernel: Support parsing DROP SYNONYM in openGauss
  29. Kernel: Support parsing CREATE SYNONYM in openGauss
  30. Kernel: Support parsing ALTER SYNONYM in openGauss
  31. Kernel: Add PostgreSQL CALL Statement
  32. Kernel: Support parsing CREATE PFILE in Oracle
  33. Kernel: Support parsing CREATE SPFILE in Oracle
  34. Kernel: Support parsing ALTER SEQUENCE in Oracle
  35. Kernel: Support parsing CREATE CONTEXT in Oracle
  36. Kernel: Support Parsing ALTER PACKAGE in oracle
  37. Kernel: Support parsing CREATE SEQUENCE in Oracle
  38. Kernel: Support parsing ALTER ATTRIBUTE DIMENSION in Oracle
  39. Kernel: Support parsing ALTER ANALYTIC VIEW in Oracle
  40. Kernel: Use ShardingSphere SPI in SQLVisitorFacade
  41. Kernel: Use ShardingSphere SPI in DatabaseTypedSQLParserFacade
  42. Kernel: Support parsing ALTER OUTLINE in Oracle
  43. Kernel: Support parsing DROP OUTLINE in Oracle
  44. Kernel: Support parsing drop edition in oracle
  45. Kernel: Support WITH Common Table Expression of SQLServer
  46. Kernel: Exclude parenthesis from SubquerySegment's start and stop index in withClause
  47. Kernel: Refactor JoinTableSegment
  48. Kernel: Support parsing DROP SYNONYM in Oracle
  49. Kernel: Support parsing CREATE DIRECTORY in Oracle
  50. Kernel: Support parsing CREATE SYNONYM in Oracle
  51. Kernel: Support for XmlNamespaces Clause of SQLServer SELECT Statement
  52. Kernel: Support parsing Alter Database Dictionary in Oracle
  53. Kernel: Support FOR Clause of SQLServer SELECT Statement
  54. Kernel: Support Parsing ALTER DATABASE LINK in Oracle
  55. Kernel: Support CREATE EDITION Parsing in Oracle
  56. Kernel: Support parsing ALTER TRIGGER in Oracle
  57. Kernel: Add SQLServer REVERT Statement
  58. Kernel: Support Parsing DROP TEXT SEARCH in PostgreSQL
  59. Kernel: Add drop server for PostgreSQL
  60. Kernel: Support Parsing ALTER VIEW in Oracle
  61. Kernel: Add drop access method for PostgreSQL
  62. Kernel: Support Parsing DROP ROUTINE in PostgreSQL
  63. Kernel: Proofread SQLServer DROP USER Statement
  64. Kernel: Support parsing DROP TRIGGER in Oracle
  65. Kernel: Support parsing Drop subscription in PostgreSQL
  66. Kernel: Add drop operator class for PostgreSQL
  67. Kernel: Support parsing DROP PUBLICATION in PostgreSQL
  68. Kernel: Support Parsing DROP VIEW in Oracle
  69. Kernel: Support Parsing DROP TRIGGER in PostgreSQL
  70. Kernel: Support Parsing DROP DIRECTORY in Oracle
  71. Kernel: Support Parsing DROP STATISTICS for PostgreSQL
  72. Kernel: Add drop type SQL parser for PostgreSQL
  73. Kernel: Support Parsing DROP RULE in PostgreSQL
  74. Kernel: Proofread SQLServer ALTER LOGIN Statement
  75. Kernel: Support parsing PostgreSQL DROP FOREIGN DATA WRAPPER
  76. Kernel: Small changes to PostgreSQL DROP EVENT TRIGGER statement
  77. Proxy: ShardingSphere-Proxy MySQL supports receiving MySQL packet more than 16 MB
  78. Proxy: Supports netty parameter ChannelOption.SO_BACKLOG configurable in ShardingSphere-Proxy
  79. Proxy: Optimize so-reuseaddr in netty to solve the problem of port occupied
  80. Proxy: Docker image of ShardingSphere-Proxy supports aarch64 platform
  81. Proxy: Make server version configurable in ShardingSphere-Proxy MySQL
  82. Proxy: Supports more character sets in ShardingSphere-Proxy PostgreSQL/openGauss
  83. Proxy: Make default port configurable in ShardingSphere-Proxy
  84. Scaling: Compatible with HA ports for openGauss:3.0 when thread_pool enabled
  85. Scaling: Optimize ZooKeeper event handling in PipelineJobExecutor to avoid blocking ZooKeeper events
  86. Scaling: Make table name case-insensitive in whole process
  87. Scaling: Improve replication slot cleanup for PostgreSQL and openGauss
  88. Scaling: Improve lock protection for job preparation
  89. Scaling: Support PostgreSQL insert on conflict do update
  90. Scaling: Do not cache data source in GlobalDataSourceRegistry to avoid possible shared resource close issue
  91. Scaling: Reuse data source pool as more as possible to reduce working database connections
  92. DistSQL: REFRESH TABLE METADATA supports specifying PostgreSQL's schema
  93. DistSQL: ALTER SHARDING TABLE RULE add validation of binding table
  94. Mode: ShardingSphere-JDBC supports configuring database connection name
  95. Distributed Transaction: DistSQL is prohibited from executing within a transaction
  96. Distributed Transaction: autocommit = 0, DDL part of DML will automatically open the transaction

Bug Fix

  1. Kernel: Fix parsing error about show statement for PostgreSQL and openGauss
  2. Kernel: Fix parsing error about time extract function for for PostgreSQL and openGauss
  3. Kernel: Fix parsing error about select mod function for for PostgreSQL and openGauss
  4. Kernel: Fix PSQLException when execute join statement with multi schema in readwrite scenario
  5. Kernel: Fix wrong route result when execute create schema statement in encrypt scenario
  6. Kernel: Fix npe when execute drop schema if exist statement
  7. Kernel: Fix wrong route result when execute SELECT LAST_INSERT_ID() AS id; statement
  8. Kernel: Fix npe when execute use database when database doesn't contains datasource
  9. Kernel: Fix create function with set var
  10. Proxy: Fix NPE caused by column's case unmatched in PostgreSQLComDescribeExecutor
  11. Proxy: Complete command tags for schema DDL in ShardingSphere-Proxy PostgreSQL / openGauss
  12. Scaling: Fix MySQL unsigned type null value cause error during increment task
  13. Scaling: Fix resource leak caused by error occurred when creating DataSource in ShardingSphere-Scaling
  14. Scaling: Fix ShardingSphereDataSource creation ignoring other rules
  15. Scaling: Fix on preparation job could not be stopped
  16. Scaling: Fix data source property url and jdbcUrl compatibility
  17. Scaling: Fix openGauss logical replication slot creation, avoid possible incremental data loss
  18. Scaling: Update local job status before persisting job status to registry center, make sure it won't be overwritten later
  19. Scaling: Handling null value in TestDecodingPlugin for PostgreSQL
  20. DistSQL: Fix SET VARIABLE modification not taking effect in stand-alone and memory mode
  21. DistSQL: Fix the inconsistency between SHOW INSTANCE LIST display data and actual data
  22. DistSQL: Fix capitalization sensitivity in sharding DistSQL
  23. Mode: Fix the new version metadata lost data after the Scaling changes the table sharding rules
  24. Distributed Transaction: Fix getIndexInfo with catalog

API Changes

  1. DistSQL: Change EXPORT SCHEMA CONFIG to EXPORT DATABASE CONFIG
  2. DistSQL: Change IMPORT SCHEMA CONFIG to IMPORT DATABASE CONFIG
  3. DistSQL: Change SHOW SCHEMA RESOURCES to SHOW DATABASE RESOURCES
  4. DistSQL: Change COUNT SCHEMA RULES to COUNT DATABASE RULES
  5. Mode: Adjust db-discovery algorithm configuration
  6. Authority: Authority provider ALL_PRIVILEGES_PERMITTED updated to ALL_PERMITTED
  7. Authority: Authority provider SCHEMA_PRIVILEGES_PERMITTED updated to DATABASE_PERMITTED

Refactor

  1. Scaling: Refactor JobConfiguration, prepare for different types of jobs reuse and extension
  2. Mode: Optimize compute node structure of the registry center
  3. Mode: Use uuid instead of ip@port as instance id

Change Log

  1. MILESTONE

5.1.1

14 Apr 11:08
11df594
Compare
Choose a tag to compare

New Feature

  1. Kernel: support alter materialized view for PostgreSQL
  2. Kernel: support declare for PostgreSQL
  3. Kernel: support discard for PostgreSQL
  4. Kernel: Add mode to parser to support $$ in PostgreSQL
  5. Kernel: Support MySQL create tablespace statement parse
  6. Scaling: Implement stop source writing and restore source writing
  7. Scaling: Support partial tables scale-out
  8. DistSQL: New DistSQL syntax: SHOW UNUSED RESOURCES
  9. Mode: Added persistent XA Recovery Id to Governance Center
  10. Mode: Database discovery adds delayed master-slave delay function
  11. Distributed Transaction: Add savepoint support for ShardingSphere proxy
  12. Distributed Transaction: Support auto rollback when report exception in transaction block for PostgreSQL and openGauss
  13. Distributed Transaction: Make it is easy to use with Narayana
  14. Distributed Transaction: Add savepoint support for ShardingSphere-JDBC

Enhancement

  1. Kernel: Refactor kernel to improve performance
  2. Proxy: Reduce Docker image size of ShardingSphere-Proxy
  3. Proxy: ShardingSphere-Proxy supports set names statements
  4. Proxy: ShardingSphere-Proxy MySQL supports multi statements
  5. Scaling: Only one proxy node could do data consistency check in proxy cluster
  6. Scaling: Replace scaling input and output config fields type from int to Integer
  7. Scaling: Update MySQL checksum SQL
  8. Scaling: Improve scaling job progress deletion in reset and progress check before starting job
  9. Scaling: Improve FinishCheckJob data consistency check when target tables already have the same data as source tables
  10. Scaling: Break scaling job ASAP when there is unsupported table since primary key
  11. Scaling: Reuse ClusterPersistRepository of proxy in PipelineAPIFactory
  12. Scaling: Update jobId generation algorithm, and make it support idempotency
  13. DistSQL: Support configuration data type and length when CREATE/ALTER ENCRYPT RULE
  14. DistSQL: Unify the display results of SHOW ALL VARIABLES and SHOW VARIABLE
  15. DistSQL: Remove the effect of binding order when DROP BINDING TABLE RULES
  16. DistSQL: Add column mode_type in the result of SHOW INSTANCE LIST
  17. DistSQL: Add validation to the mode when ENABLE/DISABLE INSTANCE
  18. DistSQL: Check if the rule is in used when DROP READWRITE_SPLITTING RULE
  19. DistSQL: Check duplicate resource names when CREATE READWRITE_SPLITTING RULE
  20. DistSQL: Add column delay_time to the result of SHOW READWRITE_SPLITTING READ RESOURCES
  21. DistSQL: Support IF EXISTS when DROP RULE
  22. DistSQL: Optimize the prompt information of connection failure when ADD/ALTER RESOURCE
  23. Mode: Add schema-level global distributed locks
  24. Mode: Add schema version number to support batch execution of DistSQL
  25. Mode: Persistent metadata optimization in cluster mode
  26. Mode: The database discovery add the schemaName identifier when create a JOB

Refactor

  1. Kernel: Refactor test case for encrypt
  2. Kernel: Refactor metadata to support PostgreSQL database and schema
  3. Scaling: Remove HikariCP dependency in pipeline modules
  4. Mode: Refactor governance center storage node structure
  5. Mode: Refactor governance center meta data structure
  6. Mode: Adjust the database discovery MGR module to MySQL module

Bug Fix

  1. Kernel: Fix function with no parameter
  2. Kernel: Fix InsertValueContext.getValue cast exception
  3. Kernel: Fix aggregate distinct column error
  4. Kernel: Fix NPE when rewrite parameter with schema
  5. Kernel: Fix NPE caused by GeneratedKeysResultSet not return columnName in read-write splitting
  6. Kernel: Fix show tables statement loses part of the single table
  7. Kernel: Fix ModShardingAlgorithm wrong route result when exist same suffix table
  8. Kernel: Fix sql parse error when contains key in assignment clause and optimize index parse
  9. Kernel: Fix NumberFormatException when sharding algorithm config number props
  10. Kernel: Fix wrong metadata when config single dataSource for read-write splitting
  11. Kernel: Fix statement close exception when use BatchPreparedStatementExecutor
  12. Kernel: Fix rewrite lowercase logic when sql contains shorthand projection
  13. Kernel: Fix NullPointerException when start up proxy with memory mode
  14. Proxy: Fix literals may be replaced by mistake in PostgreSQL/openGauss protocol
  15. Proxy: Fix ShardingSphere-Proxy PostgreSQL with multi-schema cannot be connected by PostgreSQL JDBC Driver 42.3.x
  16. Proxy: Fix timestamp nanos inaccurate in ShardingSphere-Proxy MySQL
  17. Proxy: Complete ShardingSphere-Proxy PostgreSQL codec for numeric in binary format
  18. Proxy: Potential performance issue and risk of OOM in ShardingSphere-JDBC
  19. Proxy: Fix Operation not allowed after ResultSet closed occasionally happens in ShardingSphere-Proxy MySQL
  20. Proxy: Fix NPE causes by ShardingSphere-JDBC executeBatch without addBatch
  21. Scaling: Fix failed or stopped job could not be started by DistSQL except restarting proxy
  22. DistSQL: Fix parsing exception for inline expression when CREATE SHARDING TABLE RULE
  23. DistSQL: Fix parsing exception when password is keyword password in ADD RESOURCE statement
  24. Mode: Fixed loss of compute nodes due to ZooKeeper session timeout
  25. Mode: Fixed the case of the table name in the governance center
  26. Mode: DistSQL enable disable instance refresh in-memory compute node status
  27. Mode: Fixed database discovery unable to create Rule through DistSQL

Change Log

  1. MILESTONE

5.1.0

16 Feb 02:35
Compare
Choose a tag to compare

New feature

  1. Support SQL hint
  2. New DistSQL syntax: SHOW AUTHORITY RULE
  3. New DistSQL syntax: SHOW TRANSACTION RULE
  4. New DistSQL syntax: ALTER TRANSACTION RULE
  5. New DistSQL syntax: SHOW SQL_PARSER RULE
  6. New DistSQL syntax: ALTER SQL_PARSER RULE
  7. New DistSQL syntax: ALTER DEFAULT SHARDING STRATEGY
  8. New DistSQL syntax: DROP DEFAULT SHARDING STRATEGY
  9. New DistSQL syntax: CREATE DEFAULT SINGLE TABLE RULE
  10. New DistSQL syntax: SHOW SINGLE TABLES
  11. New DistSQL syntax: SHOW SINGLE TABLE RULES
  12. New DistSQL syntax: SHOW SHARDING TABLE NODES
  13. New DistSQL syntax: CREATE/ALTER/DROP SHARDING KEY GENERATOR
  14. New DistSQL syntax: SHOW SHARDING KEY GENERATORS
  15. New DistSQL syntax: REFRESH TABLE METADATA
  16. New DistSQL syntax: PARSE SQL, Output the abstract syntax tree obtained by parsing SQL
  17. New DistSQL syntax: SHOW UNUSED SHARDING ALGORITHMS
  18. New DistSQL syntax: SHOW UNUSED SHARDING KEY GENERATORS
  19. New DistSQL syntax: CREATE/DROP SHARDING SCALING RULE
  20. New DistSQL syntax: ENABLE/DISABLE SHARDING SCALING RULE
  21. New DistSQL syntax: SHOW SHARDING SCALING RULES
  22. New DistSQL syntax: SHOW INSTANCE MODE
  23. New DistSQL syntax: COUNT SCHEMA RULES
  24. Scaling: Add rateLimiter configuration and QPS TPS implementation
  25. Scaling: Add DATA_MATCH data consistency check
  26. Scaling: Add batchSize configuration to avoid possible OOME
  27. Scaling: Add streamChannel configuration and MEMORY implementation
  28. Scaling: Support MySQL BINARY data type
  29. Scaling: Support MySQL YEAR data type
  30. Scaling: Support PostgreSQL BIT data type
  31. Scaling: Support PostgreSQL MONEY data type
  32. Database discovery adds support for JDBC Spring Boot
  33. Database discovery adds support for JDBC Spring Namespace
  34. Database discovery adds support for openGauss
  35. Shadow DB adds support for logical data source transfer
  36. Add data type validator for column matching shadow algorithm
  37. Add support for xa start/end/prepare/commit/recover in encrypt case with only one data source

API Change

  1. Redesign the database discovery related DistSQL syntax
  2. In DistSQL, the keyword GENERATED_KEY is adjusted to KEY_GENERATE_STRATEGY
  3. Native authority provider is marked as deprecated and will be removed in a future version
  4. Scaling: Move scaling configuration from server.yaml to config-sharding.yaml
  5. Scaling: Rename clusterAutoSwitchAlgorithm SPI to completionDetector and refactor method parameter
  6. Scaling: Data consistency check API method rename and return type change
  7. Database discovery module API refactoring
  8. Readwrite-splitting supports static and dynamic configuration
  9. Shadow DB remove the enable configuration
  10. Shadow algorithm type modified

Enhancement

  1. Improve load multi single table performance
  2. Remove automatically added order by primary key clause
  3. Optimize binding table route logic without sharding column in join condition
  4. Support update sharding key when the sharding routing result keep the same
  5. Optimize rewrite engine performance
  6. Support select union/union all ... statements by federation engine
  7. Support insert on duplicate key update sharding column when route context keep same
  8. Use union all to merge sql route units for simple select to improve performance
  9. Supports autocommit in ShardingSphere-Proxy
  10. ShardingSphere openGauss Proxy supports sha256 authentication method
  11. Remove property java.net.preferIPv4Stack=true from Proxy startup script
  12. Remove the verification of null rules for JDBC
  13. Optimize performance of executing openGauss batch bind
  14. Disable Netty resource leak detector by default
  15. Supports describe prepared statement in PostgreSQL / openGauss Proxy
  16. Optimize performance of executing PostgreSQL batched inserts
  17. Add instance_id to the result of SHOW INSTANCE LIST
  18. Support to use instance_id to perform operations when enable/disable a proxy instance
  19. Support auto creative algorithm when CREATE SHARDING TABLE RULE, reducing the steps of creating rule
  20. Support specifying an existing KeyGenerator when CREATE SHARDING TABLE RULE
  21. DROP DATABASE supports IF EXISTS option
  22. DATANODES in SHARDING TABLE RULE supports enumerated inline expressions
  23. CREATE/ALTER SHARDING TABLE RULE supports complex sharding algorithm
  24. SHOW SHARDING TABLE NODES supports non-inline scenarios (range, time, etc.)
  25. When there is only one read data source in the readwrite-splitting rule, it is not allowed to be disabled
  26. Scaling: Add basic support of chunked streaming data consistency check
  27. Shadow algorithm decision logic optimization to improve performance

Refactor

  1. Refactor federation engine scan table logic
  2. Avoid duplicated TCL SQL parsing when executing prepared statement in Proxy
  3. Scaling: Add pipeline modules to redesign scaling
  4. Scaling: Refactor several job configuration structure
  5. Scaling: Precalculate tasks splitting and persist in job configuration
  6. Scaling: Add basic support of pipeline-core code reuse for encryption job
  7. Scaling: Add basic support of scaling job and encryption job combined running
  8. Scaling: Add input and output configuration, including workerThread and rateLimiter
  9. Scaling: Move blockQueueSize into streamChannel
  10. Scaling: Change jobId type from integer to text
  11. Optimize JDBC to load only the specified schema
  12. Optimize meta data structure of the registry center
  13. Rename Note shadow algorithm to HINT shadow algorithm

Bug Fix

  1. Support parsing function
  2. Fix alter table drop constrain
  3. Fix optimize table route
  4. Support Route resource group
  5. Support parsing binlog
  6. Support postgreSql/openGauss '&' and '|' operator
  7. Support parsing openGauss insert on duplicate key
  8. Support parse postgreSql/openGauss union
  9. Support query which table has column contains keyword
  10. Fix missing parameter in function
  11. Fix sub query table with no alias
  12. Fix utc timestamp function
  13. Fix alter encrypt column
  14. Support alter column with position encrypt column
  15. Fix delete with schema for postgresql
  16. Fix wrong route result caused by oracle parser ambiguity
  17. Fix projection count error when use sharding and encrypt
  18. Fix npe when using shadow and readwrite_splitting
  19. Fix wrong metadata when actual table is case insensitive
  20. Fix encrypt rewrite exception when execute multiple table join query
  21. Fix encrypt rewrite wrong result with table level queryWithCipherColumn
  22. Fix parsing chinese
  23. Fix encrypt exists sub query
  24. Fix full route caused by the MySQL BINARY keyword in the sharding condition
  25. Fix getResultSet method empty result exception when using JDBCMemoryQueryResult processing statement
  26. Fix incorrect shard table validation logic when creating store function/procedure
  27. Fix null charset exception occurs when connecting Proxy with some PostgreSQL client
  28. Fix executing commit in prepared statement cause transaction status incorrect in MySQL Proxy
  29. Fix client connected to Proxy may stuck if error occurred in PostgreSQL with non English locale
  30. Fix file not found when path of configurations contains blank character
  31. Fix transaction status may be incorrect cause by early flush
  32. Fix the unsigned datatype problem when query with PrepareStatement
  33. Fix protocol violation in implementations of prepared statement in MySQL Proxy
  34. Fix caching too many connections in openGauss batch bind
  35. Fix the problem of missing data in SHOW READWRITE_SPLITTING RULES when db-discovery and readwrite-splitting are used together
  36. Fix the problem of missing data in SHOW READWRITE_SPLITTING READ RESOURCES when db-discovery and readwrite-splitting are used together
  37. Fix the NPE when the CREATE SHARDING TABLE RULE statement does not specify the sub-database and sub-table strategy
  38. Fix NPE when PREVIEW SQL by schema.table
  39. Fix DISABLE statement could disable readwrite-splitting write data source in some cases
  40. Fix DIABLE INSTANCE could disable the current instance in some cases
  41. Fix the issue that user may query the unauthorized logic schema when the provider is SCHEMA_PRIVILEGES_PERMITTED
  42. Fix NPE when authority provider is not configured
  43. Scaling: Fix DB connection leak on XA initialization which triggered by data consistency check
  44. Scaling: Fix PostgreSQL replication stream exception on multiple data sources
  45. Scaling: Fix migrating updated record exception on PostgreSQL incremental phase
  46. Scaling: Fix MySQL 5.5 check BINLOG_ROW_IMAGE option failure
  47. Scaling: Fix PostgreSQL xml data type consistency check
  48. Fix database discovery failed to modify cron configuration
  49. Fix single read data source use weight loadbalance algorithm error
  50. Fix create redundant data souce without memory mode
  51. Fix column value matching shadow algorithm data type conversion exception

Change Log

  1. MILESTONE