Skip to content

Releases: lsst-dm/prompt_processing

3.0.0

20 May 18:07
0ba5ec0
Compare
Choose a tag to compare

This release is based on Science Pipelines w_2024_20 and rubin-env 8.0.0. It bundles together breaking changes to the Butler, APDB, and Alerts schemas; there is no incompatibility with old nextVisit messages.

This release is compatible with:

  • Next Visit Fan Out v2.x
  • APDB schema 1.0.0 to 1.1.x, and ApdbSql 0.1.x
  • Butler repositories with dimensions-config versions daf_butler 6 to 7.

This release distributes alerts with schema 7.0.

What's Changed

  • DM-43316: Use atomic chain operations where appropriate in Prompt Processing by @kfindeisen in #156
  • DM-44096: Migrate Prompt Processing to external APDB configs by @kfindeisen in #157
  • DM-43949: Require Butler dimensions-config 6+ in Prompt Processing by @kfindeisen in #158
  • Clarify how minor versions work for APDB. by @kfindeisen in #159
  • DM-44189: Remove ccdVisitId from Prompt Processing by @kfindeisen in #160 and #163
  • DM-43948: Create region/time dataset in Prompt Processing by @kfindeisen in #161
  • DM-44393: Prompt Processing does not transfer visit definitions by @kfindeisen in #166
  • DM-43913: Make tester upload_hsc_rc2.py work with LATISS/LSSTComCamSim by @hsinfang in #154

Full Changelog: 2.6.0...3.0.0

Service Image

prompt-service@970b408

2.6.0

19 Apr 20:27
Compare
Choose a tag to compare

This release is based on Science Pipelines w_2024_16 and rubin-env 8.0.0. It was published to include new Science Pipelines features and fixes. This release distributes alerts with schema 6.1.

This release is compatible with:

  • Next Visit Fan Out v2.x
  • APDB schema 0.1.x and ApdbSql 0.1.x
  • Butler repositories with dimensions-config versions daf_butler 3 to 7.

What's Changed

  • Add missing config override to register-dataset-types call. by @kfindeisen in #152
  • Update Release Management docs by @kfindeisen in #150
  • DM-42825: Prompt Processing does slow calib queries against /repo/embargo by @kfindeisen in #153

Full Changelog: 2.5.0...2.6.0

2.5.0

04 Apr 17:22
4186d63
Compare
Choose a tag to compare

This release is based on Science Pipelines w_2024_14 and rubin-env 8.0.0. It was published to deploy fixes for DM-43590 (too aggressive timeouts in alert producer) and DM-43674 (corrected distortion model for ComCamSim), along with other Science Pipelines features.

This release is compatible with:

  • Next Visit Fan Out v2.x
  • APDB schema 0.1.x and ApdbSql 0.1.x
  • Butler repositories with dimensions-config versions daf_butler 3 to 7.

This release distributes alerts with schema 6.1.

What's Changed

  • DM-43414: Update playbook to use apdb-cli in place of make_apdb.py by @andy-slac in #151

New Contributors

Full Changelog: 2.4.0...2.5.0

Service Image

prompt-service@287b5bb

2.4.0

29 Mar 19:15
Compare
Choose a tag to compare

This release is based on Science Pipelines d_2024_03_29 and rubin-env 8.0.0, and includes fixes for several critical bugs in w_2024_13. It was published for use in Ops Rehearsal 3.

This release is compatible with:

  • Next Visit Fan Out v2.x
  • APDB schema 0.1.x and ApdbSql 0.1.x
  • Butler repositories with dimensions-config versions daf_butler 3 to 7.

This release distributes alerts with schema 6.1.

What's Changed

  • DM-43584: Add an option to turn off caching entirely by @kfindeisen in #149

Full Changelog: 2.3.0...2.4.0

Service Image

prompt-service@454de5c

2.3.0

28 Mar 23:37
Compare
Choose a tag to compare

This release is based on Science Pipelines d_2024_03_26 and rubin-env 8.0.0. Its primary purpose is to allow testing of alert distribution ahead of Ops Rehearsal 3.

This release is compatible with:

  • Next Visit Fan Out v2.x
  • APDB schema 0.1.x and ApdbSql 0.1.x
  • Butler repositories with dimensions-config versions daf_butler 3 to 6.

This release distributes alerts with schema 6.1.

What's Changed

  • DM-43445: Camera load in Prompt Processing assumes a single unbounded collection by @kfindeisen in #141
  • DM-43502: Prompt Processing should get expId from ingest, not file path by @kfindeisen in #145
  • DM-42739: Configure Prompt Processing production service for Sasquatch upload by @kfindeisen in #142
  • DM-43488: Concurrency errors in chain handling interrupt processing by @kfindeisen in #146
  • Tickets DM-40415: Add doPackageAlerts and doProduceAlerts to ApPipe.yaml by @bsmartradio in #137
  • DM-43557: Export dimensions from Prompt Processing only if they are undefined by @kfindeisen in #147

New Contributors

Full Changelog: 2.2.2...2.3.0

2.2.2

24 Mar 16:02
Compare
Choose a tag to compare

This release is based on Science Pipelines w_2024_12 and rubin-env 8.0.0. It fixes a compatibility bug with version 6 Butler repositories in versions 2.2.0 and 2.1.0.

This release is compatible with:

  • Next Visit Fan Out v2.x
  • APDB schema 0.1.x and ApdbSql 0.1.x
  • Butler repositories with dimensions-config versions daf_butler 3 to 6.

What's Changed

  • DM-43472: Prompt Processing version 2 not compatible with Butler dimensions-config 6 by @kfindeisen in #144

Full Changelog: 2.2.1...2.2.2

Service Image

prompt-service@87ceee2

2.2.1

23 Mar 17:33
Compare
Choose a tag to compare

This release is based on Science Pipelines w_2024_12 and rubin-env 8.0.0. It attempts to fix a compatibility bug with version 6 Butler repositories in versions 2.2.0 and 2.1.0, but the fix is incorrect and should not be used.

This release is compatible with:

  • Next Visit Fan Out v2.x
  • APDB schema 0.1.x and ApdbSql 0.1.x
  • Butler repositories with dimensions-config versions daf_butler 3 to 6.

What's Changed

  • DM-43472: Prompt Processing version 2 not compatible with Butler dimensions-config 6 by @kfindeisen in #143

Full Changelog: 2.2.0...2.2.1

Service Image

prompt-service@81dabd2

2.2.0

21 Mar 21:23
Compare
Choose a tag to compare

This release is based on Science Pipelines w_2024_12 stack and rubin-env 8.0.0. New instrument LSSTComCamSim is now supported. This release is intended for integration testing ahead of Ops Rehearsal 3.

This release is compatible with:

  • Next Visit Fan Out v2.x
  • APDB schema 0.1.x and ApdbSql 0.1.x
  • Butler repositories with dimensions-config versions daf_butler 3 to 6. [Known issue when working with version 6; fixed on 2.2.2]

What's Changed

  • DM-43205: Calibs fail to locally certify in Prompt Processing by @kfindeisen in #135
  • DM-42726: Implement upload.py LSSTComCamSim for dev test by @hsinfang in #131
  • DM-43317: Use prompt-service as sole package for Prompt Processing by @kfindeisen in #138
  • DM-43188: Add a nightly chained collection to Prompt Processing output by @kfindeisen in #136
  • DM-43394: Set up AP pipeline variant that omits forced-source loading by @kfindeisen in #139

Full Changelog: 2.1.0...2.2.0

2.1.0

07 Mar 17:53
Compare
Choose a tag to compare

This release is based on Science Pipelines w_2024_10 stack and rubin-env 8.0.0. The Science Pipelines changes since d_2024_02_23 include switching to the CalibrateImage task and butler dimensions-config version 6 that supports group and day_obs as dimensions. The prompt-service has not used the butler dimensions-config version 6 features yet.

This release is compatible with:

  • Next Visit Fan Out v2.x
  • APDB schema 0.1.x and ApdbSql 0.1.x
  • Butler repositories with dimensions-config versions daf_butler 3 to 6. [Known issue when working with version 6; fixed on 2.2.2]

What's Changed

  • DM-41915: Preload calls to queryDatasetAssociations take almost a minute each by @kfindeisen in #129
  • DM-42997: Separate APDBs for different instruments in Prompt Processing by @kfindeisen in #130
  • DM-40388: Switch AP pipelines to use new CalibrateImageTask by @parejkoj in #127
  • DM-43200: Prompt processing unit tests don't work with group dimensions by @kfindeisen in #133
  • DM-43182: Prompt Processing GitHub Actions don't account for test-only PRs by @kfindeisen in #134

Full Changelog: 2.0.0...2.1.0

2.0.0

01 Mar 00:32
Compare
Choose a tag to compare

This is the first Prompt Processing release created with the mature release management GitHub action; it consolidates the many changes since v1.0.0. The most important change is requiring instrument and startTime in incoming nextVisit messages, which breaks compatibility with version 1 of Next Visit Fan Out.

This release is based on Science Pipelines d_2024_02_23 and rubin-env 8.0.0. The Science Pipelines changes since d_2023_12_19 include real/bogus analysis, APDB versioning, and efficiency improvements.

This release is compatible with:

  • Next Visit Fan Out v2.x
  • APDB schema 0.1.x and ApdbSql 0.1.x
  • Butler repositories with dimensions-config versions daf_butler 3 to 5

What's Changed Since prompt-service:w_2024_08

What Else Has Changed Since v1.0.0

  • DM-42469: Update testers and fan-out for the nextVisit schema change by @hsinfang in #114
  • DM-42227: Switch from datetime to astropy.time in MiddlewareInterface by @kfindeisen in #116
  • DM-33453: Update pipeline references in response to RFC-775. by @erinleighh in #117
  • DM-40823: Explore methods for calculating Prompt Processing preload timing by @kfindeisen in #107
  • DM-42710: Change to use goodSeeingCoadd as the LATISS templates by @hsinfang in #118
  • DM-42809: Add more detailed logging of calib preload by @kfindeisen in #121
  • DM-41154: Do not skip missing files silently in Butler transfers by @kfindeisen in #122
  • DM-40418: Release Management GitHub Action by @dspeck1 in #115
  • Formatting fixes to Playbook by @kfindeisen in #123
  • DM-41241: Create a new dev butler central repo in s3://rubin-pp-dev-users and move there by @hsinfang in #120
  • DM-42220: Incorporate ModelPackage Butler datasets into Prompt Processing by @kfindeisen in #125
  • DM-42618: Add startTime to the nextVisit schema in prompt processing by @hsinfang in #126

New Contributors

Full Changelog: v1.0.0...2.0.0

Service Image

prompt_processing@cf2523a