Releases: lsst-dm/prompt_processing
3.0.0
This release is based on Science Pipelines w_2024_20
and rubin-env 8.0.0. It bundles together breaking changes to the Butler, APDB, and Alerts schemas; there is no incompatibility with old nextVisit
messages.
This release is compatible with:
- Next Visit Fan Out v2.x
- APDB schema 1.0.0 to 1.1.x, and ApdbSql 0.1.x
- Butler repositories with dimensions-config versions
daf_butler
6 to 7.
This release distributes alerts with schema 7.0.
What's Changed
- DM-43316: Use atomic chain operations where appropriate in Prompt Processing by @kfindeisen in #156
- DM-44096: Migrate Prompt Processing to external APDB configs by @kfindeisen in #157
- DM-43949: Require Butler dimensions-config 6+ in Prompt Processing by @kfindeisen in #158
- Clarify how minor versions work for APDB. by @kfindeisen in #159
- DM-44189: Remove ccdVisitId from Prompt Processing by @kfindeisen in #160 and #163
- DM-43948: Create region/time dataset in Prompt Processing by @kfindeisen in #161
- DM-44393: Prompt Processing does not transfer visit definitions by @kfindeisen in #166
- DM-43913: Make tester upload_hsc_rc2.py work with LATISS/LSSTComCamSim by @hsinfang in #154
Full Changelog: 2.6.0...3.0.0
Service Image
2.6.0
This release is based on Science Pipelines w_2024_16 and rubin-env 8.0.0. It was published to include new Science Pipelines features and fixes. This release distributes alerts with schema 6.1.
This release is compatible with:
- Next Visit Fan Out v2.x
- APDB schema 0.1.x and ApdbSql 0.1.x
- Butler repositories with dimensions-config versions daf_butler 3 to 7.
What's Changed
- Add missing config override to register-dataset-types call. by @kfindeisen in #152
- Update Release Management docs by @kfindeisen in #150
- DM-42825: Prompt Processing does slow calib queries against /repo/embargo by @kfindeisen in #153
Full Changelog: 2.5.0...2.6.0
2.5.0
This release is based on Science Pipelines w_2024_14
and rubin-env 8.0.0. It was published to deploy fixes for DM-43590 (too aggressive timeouts in alert producer) and DM-43674 (corrected distortion model for ComCamSim), along with other Science Pipelines features.
This release is compatible with:
- Next Visit Fan Out v2.x
- APDB schema 0.1.x and ApdbSql 0.1.x
- Butler repositories with dimensions-config versions
daf_butler
3 to 7.
This release distributes alerts with schema 6.1.
What's Changed
- DM-43414: Update playbook to use apdb-cli in place of make_apdb.py by @andy-slac in #151
New Contributors
- @andy-slac made their first contribution in #151
Full Changelog: 2.4.0...2.5.0
Service Image
2.4.0
This release is based on Science Pipelines d_2024_03_29
and rubin-env 8.0.0, and includes fixes for several critical bugs in w_2024_13
. It was published for use in Ops Rehearsal 3.
This release is compatible with:
- Next Visit Fan Out v2.x
- APDB schema 0.1.x and ApdbSql 0.1.x
- Butler repositories with dimensions-config versions
daf_butler
3 to 7.
This release distributes alerts with schema 6.1.
What's Changed
- DM-43584: Add an option to turn off caching entirely by @kfindeisen in #149
Full Changelog: 2.3.0...2.4.0
Service Image
2.3.0
This release is based on Science Pipelines d_2024_03_26
and rubin-env 8.0.0. Its primary purpose is to allow testing of alert distribution ahead of Ops Rehearsal 3.
This release is compatible with:
- Next Visit Fan Out v2.x
- APDB schema 0.1.x and ApdbSql 0.1.x
- Butler repositories with dimensions-config versions
daf_butler
3 to 6.
This release distributes alerts with schema 6.1.
What's Changed
- DM-43445: Camera load in Prompt Processing assumes a single unbounded collection by @kfindeisen in #141
- DM-43502: Prompt Processing should get expId from ingest, not file path by @kfindeisen in #145
- DM-42739: Configure Prompt Processing production service for Sasquatch upload by @kfindeisen in #142
- DM-43488: Concurrency errors in chain handling interrupt processing by @kfindeisen in #146
- Tickets DM-40415: Add doPackageAlerts and doProduceAlerts to ApPipe.yaml by @bsmartradio in #137
- DM-43557: Export dimensions from Prompt Processing only if they are undefined by @kfindeisen in #147
New Contributors
- @bsmartradio made their first contribution in #137
Full Changelog: 2.2.2...2.3.0
2.2.2
This release is based on Science Pipelines w_2024_12
and rubin-env 8.0.0. It fixes a compatibility bug with version 6 Butler repositories in versions 2.2.0 and 2.1.0.
This release is compatible with:
- Next Visit Fan Out v2.x
- APDB schema 0.1.x and ApdbSql 0.1.x
- Butler repositories with dimensions-config versions
daf_butler
3 to 6.
What's Changed
- DM-43472: Prompt Processing version 2 not compatible with Butler dimensions-config 6 by @kfindeisen in #144
Full Changelog: 2.2.1...2.2.2
Service Image
2.2.1
This release is based on Science Pipelines w_2024_12
and rubin-env 8.0.0. It attempts to fix a compatibility bug with version 6 Butler repositories in versions 2.2.0 and 2.1.0, but the fix is incorrect and should not be used.
This release is compatible with:
- Next Visit Fan Out v2.x
- APDB schema 0.1.x and ApdbSql 0.1.x
- Butler repositories with dimensions-config versions
daf_butler
3 to 6.
What's Changed
- DM-43472: Prompt Processing version 2 not compatible with Butler dimensions-config 6 by @kfindeisen in #143
Full Changelog: 2.2.0...2.2.1
Service Image
2.2.0
This release is based on Science Pipelines w_2024_12 stack and rubin-env 8.0.0. New instrument LSSTComCamSim
is now supported. This release is intended for integration testing ahead of Ops Rehearsal 3.
This release is compatible with:
- Next Visit Fan Out v2.x
- APDB schema 0.1.x and ApdbSql 0.1.x
- Butler repositories with dimensions-config versions daf_butler 3 to 6. [Known issue when working with version 6; fixed on 2.2.2]
What's Changed
- DM-43205: Calibs fail to locally certify in Prompt Processing by @kfindeisen in #135
- DM-42726: Implement upload.py LSSTComCamSim for dev test by @hsinfang in #131
- DM-43317: Use prompt-service as sole package for Prompt Processing by @kfindeisen in #138
- DM-43188: Add a nightly chained collection to Prompt Processing output by @kfindeisen in #136
- DM-43394: Set up AP pipeline variant that omits forced-source loading by @kfindeisen in #139
Full Changelog: 2.1.0...2.2.0
2.1.0
This release is based on Science Pipelines w_2024_10
stack and rubin-env 8.0.0. The Science Pipelines changes since d_2024_02_23
include switching to the CalibrateImage
task and butler dimensions-config version 6 that supports group and day_obs as dimensions. The prompt-service has not used the butler dimensions-config version 6 features yet.
This release is compatible with:
- Next Visit Fan Out v2.x
- APDB schema 0.1.x and ApdbSql 0.1.x
- Butler repositories with dimensions-config versions daf_butler 3 to 6. [Known issue when working with version 6; fixed on 2.2.2]
What's Changed
- DM-41915: Preload calls to queryDatasetAssociations take almost a minute each by @kfindeisen in #129
- DM-42997: Separate APDBs for different instruments in Prompt Processing by @kfindeisen in #130
- DM-40388: Switch AP pipelines to use new CalibrateImageTask by @parejkoj in #127
- DM-43200: Prompt processing unit tests don't work with group dimensions by @kfindeisen in #133
- DM-43182: Prompt Processing GitHub Actions don't account for test-only PRs by @kfindeisen in #134
Full Changelog: 2.0.0...2.1.0
2.0.0
This is the first Prompt Processing release created with the mature release management GitHub action; it consolidates the many changes since v1.0.0. The most important change is requiring instrument
and startTime
in incoming nextVisit
messages, which breaks compatibility with version 1 of Next Visit Fan Out.
This release is based on Science Pipelines d_2024_02_23
and rubin-env 8.0.0. The Science Pipelines changes since d_2023_12_19
include real/bogus analysis, APDB versioning, and efficiency improvements.
This release is compatible with:
- Next Visit Fan Out v2.x
- APDB schema 0.1.x and
ApdbSql
0.1.x - Butler repositories with dimensions-config versions
daf_butler
3 to 5
What's Changed Since prompt-service:w_2024_08
- DM-42725: Make ApPipe run with LSSTComCamSim by @hsinfang in #124
- Add compatibility guidelines to release process by @kfindeisen in #128
What Else Has Changed Since v1.0.0
- DM-42469: Update testers and fan-out for the nextVisit schema change by @hsinfang in #114
- DM-42227: Switch from datetime to astropy.time in MiddlewareInterface by @kfindeisen in #116
- DM-33453: Update pipeline references in response to RFC-775. by @erinleighh in #117
- DM-40823: Explore methods for calculating Prompt Processing preload timing by @kfindeisen in #107
- DM-42710: Change to use goodSeeingCoadd as the LATISS templates by @hsinfang in #118
- DM-42809: Add more detailed logging of calib preload by @kfindeisen in #121
- DM-41154: Do not skip missing files silently in Butler transfers by @kfindeisen in #122
- DM-40418: Release Management GitHub Action by @dspeck1 in #115
- Formatting fixes to Playbook by @kfindeisen in #123
- DM-41241: Create a new dev butler central repo in s3://rubin-pp-dev-users and move there by @hsinfang in #120
- DM-42220: Incorporate ModelPackage Butler datasets into Prompt Processing by @kfindeisen in #125
- DM-42618: Add startTime to the nextVisit schema in prompt processing by @hsinfang in #126
New Contributors
- @erinleighh made their first contribution in #117
- @dspeck1 made their first contribution in #115
Full Changelog: v1.0.0...2.0.0