2024.5.1

What's Changed

• DM-42810: Extend Qserv integration test to support the HTTP-based front-end
• DM-43282: HTTP-based simple ingest service for fully-replicated tables in Qserv
• DM-44281: Add support for base64 encoding for the binary column data in the HTTP frontend of Qserv
• Updated Arrow and Parquet libraries to version 16

Full Changelog: 2024.4.1-rc1...2024.5.1-rc5

2024.4.1

What's Changed

• Upgraded Log4cxx to release v1.1.0
• Added HTTP frontend for submitting user queries: https://confluence.lsstcorp.org/display/DM/HTTP+frontend+of+Qserv
• Improved algorithm for “booting” long-running queries at workers
• Improved monitoring of the worker queries on the Dashboard
• Fixed the state transition bug on the sync HTTP interface

Full Changelog: 2024.3.1-rc2...2024.4.1-rc1

2024.3.1

What's Changed

• Qserv build and run containers now based on almalinux 9
• Dashboard improvements including configuration display, query state, progress monitoring, and partial result file status
• Ingest seatbelt added against TEXT/BLOB columns in director tables
• Fix for mysql connector problem which was causing worker crashes
• arrow and parquet libs updated to version 15
• Per-build documentation auto-upload fixed, and docs updated to latest Rubin style
• Migration of Qserv control plane to HTTP
• Removal of legacy XRootD SSI result streaming code
• Fix for race condition in qhttp module which was causing intermittent unit test failures
• Fix for temporary message table cleanup issue triggered by SQL COMMIT user queries

Full Changelog: 2023.10.1-rc1...2024.3.1-rc2

2023.10.1

What's Changed

• New file-based results delivery configuration option
• Large-result query early termination fixes
• Web Dashboard extensions to allow monitoring of activities at czar and worker nodes
• Full-text index on query metadata table has been removed (was found to be cause of long startup times)
• Fix for director index column match case-sensitivity issue

Full Changelog: 2023.7.1-rc3...2023.10.1-rc1

2023.7.1

What's Changed

• Fixes to folder-creation logic at replication controller launch
• Support for director indices with non-unique primary keys
• Error checking to prevent attempts to create director indices for non-published tables

Full Changelog: 2023.6.1-rc1...2023.7.1-rc3

2023.6.1

What's Changed

• The jemalloc memory allocator was re-enabled
• Fixes for excessive memory use by the administrative web dashboard
• Partitioner now supports parquet file inputs (thanks, @hellebore74!)
• Non-local director index ingest option is no longer supported
• Global query completion/cancellation protocol enhancement

Full Changelog: 2023.5.1-rc1...2023.6.1-rc1

2023.5.1

What's Changed

• Use templatized queries at workers to reduce memory allocation
• Fixes for extreme slowdowns when cancelling broad subchunk queries
• Eliminated false-positive error messages for missing optional ingest config parameters
• Fixed some issues with transaction state counters and colors on web dashboard
• Upgrades of package dependencies (XRootD, lsst/log, and lsst/sphgeom)

Full Changelog: 2023.4.1-rc1...2023.5.1-rc1

2023.4.1

What's Changed

• Fix for proxy stalls seen in Rubin DP0.2 when given a queries with very wide ObjectId restrictions; director index restrictors are now created only for director column expressions involving operators = and IN.
• Additional timers and statistics including worker buffer fill and czar merge times are available in admin dashboard.
• Chunk queries are now templatized on chunk IDs to reduce memory usage.

Full Changelog: 2023.2.1-rc2...2023.4.1-rc1

2023.2.1

What's Changed

• Extend lifetime of temporary subchunk tables (fix for worker lock-up issue)
• Additional query life-cycle states and czar status elements exposed in the administrative dashboard

Full Changelog: 2023.1.1-rc2...2023.2.1-rc2

2023.1.1

• Stability fixes to mitigate worker lock-ups seen on full-sky triple JOIN queries
• Many monitoring dashboard additions, including new histogram views
• Replication / ingest API moves to v17

Full Changelog: 2022.12.1-rc2...2023.1.1-rc2