Release 2.15.0: Release branch #6889
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This release contains performance improvements and bug fixes since the 2.14.2 release. We recommend that you upgrade at the next available opportunity. In addition, it includes these noteworthy features: * Support `time_bucket` with `origin` and/or `offset` on Continuous Aggregate * Compression improvements: - Improve expression pushdown - Add minmax sparse indexes when compressing columns with btree indexes - Make compression use the defaults functions - Vectorize filters in WHERE clause that contain text equality operators and LIKE expressions **Deprecation warning** * Starting on this release will not be possible to create Continuous Aggregate using `time_bucket_ng` anymore and it will be completely removed on the upcoming releases. * Recommend users to [migrate their old Continuous Aggregate format to the new one](https://docs.timescale.com/use-timescale/latest/continuous-aggregates/migrate/) because it support will be completely removed in next releases prevent them to migrate. * This is the last release supporting PostgreSQL 13. **For on-premise users and this release only**, you will need to run [this SQL script](https://github.com/timescale/timescaledb-extras/blob/master/utils/2.15.X-fix_hypertable_foreign_keys.sql) after running `ALTER EXTENSION`. More details can be found in the pull request [timescale#6786](timescale#6797). **Features** * timescale#6382 Support for time_bucket with origin and offset in CAggs * timescale#6696 Improve defaults for compression segment_by and order_by * timescale#6705 Add sparse minmax indexes for compressed columns that have uncompressed btree indexes * timescale#6754 Allow DROP CONSTRAINT on compressed hypertables * timescale#6767 Add metadata table `_timestaledb_internal.bgw_job_stat_history` for tracking job execution history * timescale#6798 Prevent usage of deprecated time_bucket_ng in CAgg definition * timescale#6810 Add telemetry for access methods * timescale#6811 Remove no longer relevant timescaledb.allow_install_without_preload GUC * timescale#6837 Add migration path for CAggs using time_bucket_ng * timescale#6865 Update the watermark when truncating a CAgg **Bugfixes** * timescale#6617 Fix error in show_chunks * timescale#6621 Remove metadata when dropping chunks * timescale#6677 Fix snapshot usage in CAgg invalidation scanner * timescale#6698 Define meaning of 0 retries for jobs as no retries * timescale#6717 Fix handling of compressed tables with primary or unique index in COPY path * timescale#6726 Fix constify cagg_watermark using window function when querying a CAgg * timescale#6729 Fix NULL start value handling in CAgg refresh * timescale#6732 Fix CAgg migration with custom timezone / date format settings * timescale#6752 Remove custom autovacuum setting from compressed chunks * timescale#6770 Fix plantime chunk exclusion for OSM chunk * timescale#6789 Fix deletes with subqueries and compression * timescale#6796 Fix a crash involving a view on a hypertable * timescale#6797 Fix foreign key constraint handling on compressed hypertables * timescale#6816 Fix handling of chunks with no contraints * timescale#6820 Fix a crash when the ts_hypertable_insert_blocker was called directly * timescale#6849 Use non-orderby compressed metadata in compressed DML * timescale#6867 Clean up compression settings when deleting compressed cagg * timescale#6869 Fix compressed DML with constraints of form value OP column * timescale#6870 Fix bool expression pushdown for queries on compressed chunks **Thanks** * @brasic for reporting a crash when the ts_hypertable_insert_blocker was called directly * @bvanelli for reporting an issue with the jobs retry count * @djzurawsk For reporting error when dropping chunks * @Dzuzepppe for reporting an issue with DELETEs using subquery on compressed chunk working incorrectly. * @hongquan For reporting a 'timestamp out of range' error during CAgg migrations * @kevcenteno for reporting an issue with the show_chunks API showing incorrect output when 'created_before/created_after' was used with time-partitioned columns. * @mahipv For starting working on the job history PR * @rovo89 For reporting constify cagg_watermark not working using window function when querying a CAgg
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## 2.15.x #6889 +/- ##
=========================================
Coverage ? 80.74%
=========================================
Files ? 198
Lines ? 37187
Branches ? 9720
=========================================
Hits ? 30027
Misses ? 3200
Partials ? 3960 ☔ View full report in Codecov by Sentry. |
svenklemm
approved these changes
May 6, 2024
antekresic
approved these changes
May 7, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
2d0ed64 Release 2.15.0
d8057c4 Fix policy refresh window too small
bc644f7 Release notes header 2.15.0
e298ecd Don't reuse job id
fc46eab Introduce release notes header template
acc73b9 Fix bool expression pushdown for queries on compressed chunks
23a2963 Remove TimevalInfinity enum
396dd0c Fix compressed DML with constraints of form value OP column
a7890e6 Clean up compression settings when deleting compressed cagg
183d309 Update the watermark when truncating a CAgg
e4846c7 Mark variable with PG_USED_FOR_ASSERTS_ONLY
f888991 Add migration for CAggs using time_bucket_ng
d7c9527 Update changed homebrew path
3ad9481 Remove MN leftover create distributed hypertable
a41e5b8 Remove
relation_oidduplicated function1072c73 Remove pg12 version check in prove tests
1a53706 Remove conditional for trusted in control file
ae7a73a Change error message for disabled feature flags
6b4e6c9 Remove unused ts_chunk_oid_cmp function
668e6a2 Update outdated CAgg error hint
e91e591 Use proper macros to check for invalid objects
1a3c2cb Use non-orderby compressed metadata in compressed DML
95b4e24 Remove stray comment missed in 0b23bab
8703497 Fix handling of timezone attr in job scheduler
d55957a Fix missing pid in job execution history
866ffba Migrate missing job info to history table
0f1983e Add ts_stat_statements callbacks
66c0702 Refactor job execution history table
e02a473 Allow changing real-time flag on deprecated CAggs
069ccbe Correctly determine relation type of OSM chunk as standalone table (#6840)
f4ec0f4 Fix plantime chunk exclusion for OSM chunk
67bd5a8 Remove CAgg watermark cache
07bf49a Modify hypertable catalog update API calls
ecf6bea Fix FK constraints for compressed chunks
f6b2215 Bump pgspot version used in CI
4bd73f5 Fix backport script when PR references an issue from another repo (#6824)
4420561 Treat segmentby columns same as compressed columns with default value (#6817)
6e7b6e9 vectorized aggregation as separate plan node (#6784)
610db31 Don't copy compressed slot to compressed batch struct (#6806)
971e6c3 Use ignore words file with codespell
8347621 Check for trigger context before accessing data
c4ebdf6 Fix handling of chunks with no contraints
ea22843 Add telemetry for access methods
7ffdd07 Reduce locking on decompress_chunk to allow reads
626975f Prevent usage of time_bucket_ng in CAgg definition
2a30ca4 Remove restrict from const objects (#6791)
25af8f4 Improve found attribute handling in release builds
9b6175a Remove allow_install_without_preload GUC
a54a280 Add ensure calls to CAgg validation function
20f422b Remove broken_tables test
8d9b062 Support for CAgg with origin/offset parameter
52094a3 Track job execution history
034d577 Switch to official Slack API
a9a0334 Fix a crash involving a view on a hypertable
2f1b27c Remove unneeded pg_locale.h include
a3d03ea Vectorize text equality and LIKE (#6189)
ea5c7f1 Fix deletes with subqueries and compression
6b06c60 Add wait_for_job_to_run to testsupport.sql
24552be Fully recompress unordered compressed chunks
5715029 Improve chunks status modification for consistency
9f39241 Fix uploading Postgres log on Windows CI
8beee08 Exclude OSM chunks from enabling autovaccum
c05d730 Refactor parameter of invalidation_state_init
50cc8e3 Don't show osm chunk via show_chunks
ebb2556 Make compression use the defaults functions
8a40e55 Remove stats update from incremental recompression
ae9b83b Allow up to INT16_MAX rows per batch (#6734)
b28c8b3 Build release builds with debug info
95c7d48 Remove multinode reference
95baf1e Unify dimension min handling
5ac0224 Move cagg_invalidation to solo tests
8dcb6ee Populate CAgg bucket catalog table for all CAggs
8433e3b Exclude is_sparse_index_type in non assert builds
3ec04e1 Make CAgg error message more clear
8e6994b Log CAgg refresh details in BGW
06f08c5 Convert max materializations setting to GUC
e306991 Add minmax sparse indexes when compressing columns with btree indexes (#6705)
3bb3318 Allow DROP CONSTRAINT on compressed hypertables
67ad085 Remove autovacuum setting from compressed chunks
20a6b0a Fix JSON format for message
6b819de Fix error in show_chunks
a8666d0 Fix URL reference for event
c07decf Check for missing memory context switch back
e5b5e43 Fix security issue notification
898f18b Add handler functions for Datum/Bools arrays
30d4bc0 Remove unused multi-node related error codes
7d6173b Simplification and cleanup of decompression planning (#6731)
119d541 Use INVALID_HYPERTABLE_ID constant when necessary
dcb68ce Refactor returning time dimension MINIMUM value
b87aada Remove unused enable_async_append GUC
8a9ba06 Allow multi-commit PRs with squash auto-merge (#6733)
b719787 Disable homebrew automatic dependency upgrades
c0a3369 Fix CAgg migration with custom settings
2858110 Fix NULL start value handling in CAgg refresh
a1cd7c4 Fix constify cagg_watermark using window functions
9f2d4e9 Remove obsolete update test files
c87be4a Remove get_chunk_colstats and get_chunk_relstats
5d63aea Remove debug_optimizer_flags
fe06edd Refactor update test
7548a06 Increase PG startup time on windows
c288efa Fix handling of compressed tables in COPY path
d120885 Updated reviewer list for pull-review bot
452c64d Fix bgw_launcher flakiness when dropping DB
d9b6505 Retry telemetry HTTP request on response error
5547a99 Fix ABI backwards test for PG16
ece6d43 Add write permissions for the backport workflow
e898f15 Update workflow and badge URLs
b0b08ab Optimize the order of compressed chunk metadata columns (#6664)
a7e274c Fix missing varlen header in DimensionInfo
c81ddeb Reduce unnecessary scanner lock during read
671633c Fix flaky transparent_decompress_chunk test
11b8290 Make bgw_db_scheduler test more predictable
ec332e2 Add missing schedule trigger for i386 test
3ea1417 Define meaning of 0 retries for jobs as no retries
e1676ce Remove multinode options from issue template
fdf3aa3 Use NULL in CAgg bucket function catalog table
17d424f Vectorize cross-datatype timestamp comparisons (#6587)
2a5f8e1 Add tests for bitnami-repmgr docker images
94ac2bd Add test for "compressed data is corrupt" in float8 compression (#6689)
402c1c3 Use compressed chunk tupdesc to check which metadata columns we have (#6663)
b039465 Add test for the docker images we build
59a2640 Fix branch prediction in Ensure
0d48019 Fix snapshot usage in CAgg invalidation scanner
9eff077 Make isolation tests more robust
ea9503b Add extension namespace macro
72992d0 Fix limit restriction in ts_scanner_scan_one
a058950 2.14.2 post release
d0e07a4 Release 2.14.2
e978619 Use data inheritance from VirtualTupleTableSlot in compressed batch (#6615)
677809d Replace memcpy on NameData with namestrcpy
57e6750 Grant write permissions to pr handling workflow
23b2665 Don't try to compress osm chunks
7d6332e Fix passed parameter to system catalog
1f217ed Fix refresh on empty CAgg with variable bucket
b01c8e7 Unify handling of CAgg bucket_origin
ab7a09e Make CAgg time_bucket catalog table more generic
ba21904 Fix typo in coccinele script
5a359ac Remove metadata when dropping chunk
89af50d Add coccinele checking for AttrNumberGetAttrOffset
aa4dac1 Add windows package test for pg16
95bf434 Fix misleading watermark threshold error message
8d8f158 2.14.1 post release
7ab0566 Fix segfault in cagg_validate_query
265ec17 Update GitHub actions to Node.js 20
59f50f2 Release 2.14.1
e44e0ad Avoid excessive reallocation in row compressors (#6638)
8743016 Fix downgrade script to make backports easier
fc0e41c Fix DecompressChunk path generation with per chunk settings
a4bd6f1 Remove multinode related GUC
1dc3efe Use "unlikely" with Ensure
cc26424 Reset sequence numbers on non-rollup compression
1fb62b5 Remove function mattablecolumninfo_addinternal
90d6121 Remove function ts_number_of_continuous_aggs
916e14e Bump PG versions used in CI
ea6d826 Add compression settings informational view
fa5c0a9 Fix update script for tables with dropped columns
550ba17 Add existence check to CAgg catalog find function
4f912f7 Disable default indexscan for compression
2265c18 Report the PG version and path before complaining it's incorrect (#6634)
00f2f01 Remove unused function get_vacuum_options
ba3ccc4 Post-release fixes for 2.14.0
d93aa5c Log internal program errors to CI database (#6598)
96aa7e0 Fix rpm package test workflow
e734433 Adjust pg_dump_unprivileged test to only run on versions with fixed pg_dump
1765c82 Remove distributed CAgg leftovers
505b427 Release 2.14.0
e2d55cd Make transparent_decompress_chunk test less flaky
Disable-check: force-changelog-file