Release v18.1.0 (#3501)

* Release v18.1.0 * increase timeout reduce failure
nasa · Oct 25, 2023 · 8428a02 · 8428a02
1 parent 32ea6d7
commit 8428a02
Show file tree

Hide file tree

Showing 279 changed files with 12,895 additions and 355 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -6,6 +6,8 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 ## Unreleased
 
+## [v18.1.0] 2023-10-25
+
 ### MIGRATION notes
 
 #### Rules API Endpoint Versioning
@@ -38,9 +40,6 @@ Users/clients that do not make use of these endpoints will not be impacted.
 - **CUMULUS-3095**
   - Added `PATCH` rules endpoint to update rule which works as the existing `PUT` endpoint.
   - Updated `PUT` rules endpoint to replace rule.
-  - Updated `@cumulus/api-client/rules` to have`replaceRule` and `updateRule` methods.
-  - Updated mapping for rule Elasticsearch records to prevent dynamic field for keys under
-    `meta` and `payload`, and fixed `rule` field mapping.
 
 ### Added
 
@@ -49,23 +48,19 @@ Users/clients that do not make use of these endpoints will not be impacted.
   - Added `max_download_time` column to PostgreSQL `providers` table
   - Updated `@cumulus/ingest/lock` to check expired locks based on `provider.maxDownloadTime`
 
-### Fixed
-
-- **CUMULUS-3427**
-  - fixed issue where some lambda and task memory sizes and timeouts were not configurable
-  - changed the naming conventions for memory size and timeouts configuration to simply the lambda name
-- **@aws-sdk upgrade**
-  - Fixed TS compilation error on aws-client package caused by @aws-sdk/client-dynamodb 3.433.0 upgrade
-
 ### Changed
 
+- **CUMULUS-3095**
+  - Updated `@cumulus/api-client/rules` to have`replaceRule` and `updateRule` methods.
+  - Updated mapping for rule Elasticsearch records to prevent dynamic field for keys under
+    `meta` and `payload`, and fixed `rule` field mapping.
 - **CUMULUS-3351**
   - Updated `constructOnlineAccessUrls()` to group CMR online access URLs by link type.
-- **CUMULUS-3392**
-  - Modify cloudwatch rule by deleting `custom`
 - **CUMULUS-3377**
   - Added configuration option to cumulus-tf/terraform.tfvars to include sns:Subscribe access policy for
     executions, granules, collections, and PDRs report topics.
+- **CUMULUS-3392**
+  - Modify cloudwatch rule by deleting `custom`
 - **CUMULUS-3434**
   - Updated `@cumulus/orca-recovery-adapter` task to output both input granules and recovery output.
   - Updated `example/cumulus-tf/orca.tf` to use v9.0.0.
@@ -83,6 +78,11 @@ Users/clients that do not make use of these endpoints will not be impacted.
   - Updated mapping for collection Elasticsearch records to prevent dynamic field for keys under `meta`.
 - **CUMULUS-3393**
   - Fixed `PUT` collection endpoint to update collection configuration in S3.
+- **CUMULUS-3427**
+  - Fixed issue where some lambda and task memory sizes and timeouts were not configurable
+  - Changed the naming conventions for memory size and timeouts configuration to simply the lambda name
+- **@aws-sdk upgrade**
+  - Fixed TS compilation error on aws-client package caused by @aws-sdk/client-dynamodb 3.433.0 upgrade
 
 ## [v18.0.0] 2023-08-28
 
@@ -7414,7 +7414,8 @@ Note: There was an issue publishing 1.12.0. Upgrade to 1.12.1.
 
 ## [v1.0.0] - 2018-02-23
 
-[unreleased]: https://github.com/nasa/cumulus/compare/v18.0.0...HEAD
+[unreleased]: https://github.com/nasa/cumulus/compare/v18.1.0...HEAD
+[v18.1.0]: https://github.com/nasa/cumulus/compare/v18.0.0...v18.1.0
 [v18.0.0]: https://github.com/nasa/cumulus/compare/v17.0.0...v18.0.0
 [v17.0.0]: https://github.com/nasa/cumulus/compare/v16.1.1...v17.0.0
 [v16.1.1]: https://github.com/nasa/cumulus/compare/v16.0.0...v16.1.1

diff --git a/docs/tasks.md b/docs/tasks.md
@@ -80,6 +80,24 @@ Move granule files from staging to final location
 
 ---
 
+### [@cumulus/orca-copy-to-archive-adapter](https://github.com/nasa/cumulus/tree/master/tasks/orca-copy-to-archive-adapter)
+
+Adapter to invoke orca copy-to-archive lambda
+
+- Schemas: See this module's [schema definitions](https://github.com/nasa/cumulus/tree/master/tasks/orca-copy-to-archive-adapter/schemas).
+- Resources: [npm](https://npmjs.com/package/@cumulus/orca-copy-to-archive-adapter) | [source](https://github.com/nasa/cumulus) | [web](https://github.com/nasa/cumulus/tree/master/tasks/orca-copy-to-archive-adapter)
+
+---
+
+### [@cumulus/orca-recovery-adapter](https://github.com/nasa/cumulus/tree/master/tasks/orca-recovery-adapter)
+
+Adapter to invoke orca recovery workflow
+
+- Schemas: See this module's [schema definitions](https://github.com/nasa/cumulus/tree/master/tasks/orca-recovery-adapter/schemas).
+- Resources: [npm](https://npmjs.com/package/@cumulus/orca-recovery-adapter) | [source](https://github.com/nasa/cumulus) | [web](https://github.com/nasa/cumulus/tree/master/tasks/orca-recovery-adapter)
+
+---
+
 ### [@cumulus/parse-pdr](https://github.com/nasa/cumulus/tree/master/tasks/parse-pdr)
 
 Download and Parse a given PDR
@@ -134,6 +152,15 @@ Add workflow to the queue
 
 ---
 
+### [@cumulus/send-pan](https://github.com/nasa/cumulus/tree/master/tasks/send-pan)
+
+Sends a PAN response after parsing a PDR.
+
+- Schemas: See this module's [schema definitions](https://github.com/nasa/cumulus/tree/master/tasks/send-pan/schemas).
+- Resources: [npm](https://npmjs.com/package/@cumulus/send-pan) | [source](https://github.com/nasa/cumulus) | [web](https://github.com/nasa/cumulus/tree/master/tasks/send-pan)
+
+---
+
 ### [@cumulus/sf-sqs-report](https://github.com/nasa/cumulus/tree/master/tasks/sf-sqs-report)
 
 Sends an incoming Cumulus message to SQS

diff --git a/example/data-persistence-tf/variables.tf b/example/data-persistence-tf/variables.tf
@@ -105,6 +105,6 @@ variable "lambda_timeouts" {
   description = "Configurable map of timeouts for lambdas"
   type = map(number)
   default = {
-    ProvisionPostgresDatabase = 100 # data-persistence
+    ProvisionPostgresDatabase = 600 # data-persistence
   }
 }
diff --git a/example/lambdas/asyncOperations/package.json b/example/lambdas/asyncOperations/package.json
@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/test-async-operations",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "AsyncOperations Test Lambda",
   "main": "index.js",
   "private": true,

diff --git a/example/lambdas/ftpPopulateTestLambda/package.json b/example/lambdas/ftpPopulateTestLambda/package.json
@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/ftp-populate-test-lambda",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "FTP Population Utility Lambda",
   "main": "index.js",
   "private": true,
@@ -19,12 +19,12 @@
     "access": "private"
   },
   "dependencies": {
-    "@cumulus/api": "18.0.0",
-    "@cumulus/api-client": "18.0.0",
-    "@cumulus/common": "18.0.0",
-    "@cumulus/integration-tests": "18.0.0",
-    "@cumulus/logger": "18.0.0",
-    "@cumulus/test-data": "18.0.0",
+    "@cumulus/api": "18.1.0",
+    "@cumulus/api-client": "18.1.0",
+    "@cumulus/common": "18.1.0",
+    "@cumulus/integration-tests": "18.1.0",
+    "@cumulus/logger": "18.1.0",
+    "@cumulus/test-data": "18.1.0",
     "aws-sdk": "^2.585.0",
     "fs-extra": "^9.0.0",
     "jsftp": "https://github.com/jkovarik/jsftp.git#add_288",

diff --git a/example/lambdas/lzardsClientTest/package.json b/example/lambdas/lzardsClientTest/package.json
@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/test-lzards-api-lambda",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "LZARDS API Client Test Lambda",
   "private": true,
   "engines": {
@@ -20,7 +20,7 @@
   "author": "Cumulus Authors",
   "license": "Apache-2.0",
   "dependencies": {
-    "@cumulus/logger": "18.0.0",
-    "@cumulus/lzards-api-client": "18.0.0"
+    "@cumulus/logger": "18.1.0",
+    "@cumulus/lzards-api-client": "18.1.0"
   }
 }
diff --git a/example/lambdas/python-processing/package.json b/example/lambdas/python-processing/package.json
@@ -1,7 +1,7 @@
 {
   "name": "@cumulus/python-process-activity",
   "private": true,
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "Python reference activity",
   "homepage": "https://github.com/nasa/cumulus/tree/master/example/lambdas/python-reference-activity",
   "repository": {

diff --git a/example/lambdas/python-reference-activity/package.json b/example/lambdas/python-reference-activity/package.json
@@ -1,7 +1,7 @@
 {
   "name": "@cumulus/python-reference-activity",
   "private": true,
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "Python reference activity",
   "homepage": "https://github.com/nasa/cumulus/tree/master/example/lambdas/python-reference-activity",
   "repository": {

diff --git a/example/lambdas/python-reference-task/package.json b/example/lambdas/python-reference-task/package.json
@@ -1,7 +1,7 @@
 {
   "name": "@cumulus/python-reference-task",
   "private": true,
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "Python reference task",
   "main": "index.js",
   "homepage": "https://github.com/nasa/cumulus/tree/master/example/lambdas/python-reference-task",

diff --git a/example/lambdas/s3AccessTest/package.json b/example/lambdas/s3AccessTest/package.json
@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/test-s3-access",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "S3 Access Test Lambda",
   "main": "index.js",
   "private": true,

diff --git a/example/lambdas/snsS3Test/package.json b/example/lambdas/snsS3Test/package.json
@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/test-sns-s3",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "SNS to S3 Test Lambda",
   "main": "index.js",
   "private": true,

diff --git a/example/lambdas/versionUpTest/package.json b/example/lambdas/versionUpTest/package.json
@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/test-version-up",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "Version Up Test Lambda",
   "main": "index.js",
   "private": true,

diff --git a/example/package.json b/example/package.json
@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/cumulus-integration-tests",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "Cumulus Integration Test Deployment",
   "private": true,
   "main": "index.js",
@@ -44,32 +44,32 @@
     ]
   },
   "dependencies": {
-    "@cumulus/api": "18.0.0",
-    "@cumulus/api-client": "18.0.0",
-    "@cumulus/async-operations": "18.0.0",
-    "@cumulus/aws-client": "18.0.0",
-    "@cumulus/checksum": "18.0.0",
-    "@cumulus/cmr-client": "18.0.0",
-    "@cumulus/cmrjs": "18.0.0",
-    "@cumulus/common": "18.0.0",
-    "@cumulus/discover-granules": "18.0.0",
-    "@cumulus/discover-pdrs": "18.0.0",
-    "@cumulus/files-to-granules": "18.0.0",
-    "@cumulus/hello-world": "18.0.0",
-    "@cumulus/ingest": "18.0.0",
-    "@cumulus/integration-tests": "18.0.0",
-    "@cumulus/message": "18.0.0",
-    "@cumulus/move-granules": "18.0.0",
-    "@cumulus/parse-pdr": "18.0.0",
-    "@cumulus/pdr-status-check": "18.0.0",
-    "@cumulus/post-to-cmr": "18.0.0",
-    "@cumulus/queue-granules": "18.0.0",
-    "@cumulus/queue-pdrs": "18.0.0",
-    "@cumulus/sf-sqs-report": "18.0.0",
-    "@cumulus/sync-granule": "18.0.0",
-    "@cumulus/test-processing": "18.0.0"
+    "@cumulus/api": "18.1.0",
+    "@cumulus/api-client": "18.1.0",
+    "@cumulus/async-operations": "18.1.0",
+    "@cumulus/aws-client": "18.1.0",
+    "@cumulus/checksum": "18.1.0",
+    "@cumulus/cmr-client": "18.1.0",
+    "@cumulus/cmrjs": "18.1.0",
+    "@cumulus/common": "18.1.0",
+    "@cumulus/discover-granules": "18.1.0",
+    "@cumulus/discover-pdrs": "18.1.0",
+    "@cumulus/files-to-granules": "18.1.0",
+    "@cumulus/hello-world": "18.1.0",
+    "@cumulus/ingest": "18.1.0",
+    "@cumulus/integration-tests": "18.1.0",
+    "@cumulus/message": "18.1.0",
+    "@cumulus/move-granules": "18.1.0",
+    "@cumulus/parse-pdr": "18.1.0",
+    "@cumulus/pdr-status-check": "18.1.0",
+    "@cumulus/post-to-cmr": "18.1.0",
+    "@cumulus/queue-granules": "18.1.0",
+    "@cumulus/queue-pdrs": "18.1.0",
+    "@cumulus/sf-sqs-report": "18.1.0",
+    "@cumulus/sync-granule": "18.1.0",
+    "@cumulus/test-processing": "18.1.0"
   },
   "devDependencies": {
-    "@cumulus/test-data": "18.0.0"
+    "@cumulus/test-data": "18.1.0"
   }
 }
diff --git a/example/rds-cluster-tf/variables.tf b/example/rds-cluster-tf/variables.tf
@@ -90,6 +90,6 @@ variable "lambda_timeouts" {
   description = "Configurable map of timeouts for lambdas"
   type = map(number)
   default = {
-    ProvisionPostgresDatabase = 100 # cumulus-rds-tf
+    ProvisionPostgresDatabase = 600 # cumulus-rds-tf
   }
 }
diff --git a/example/scripts/generate_ingest/package.json b/example/scripts/generate_ingest/package.json
@@ -1,7 +1,7 @@
 {
   "name": "@cumulus/generate_ingest",
   "private": true,
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "Script to generate test data for scaled ingest",
   "keywords": [
     "GIBS",
@@ -22,8 +22,8 @@
     "directory": "packages/types"
   },
   "dependencies": {
-    "@cumulus/aws-client": "18.0.0",
-    "@cumulus/common": "18.0.0"
+    "@cumulus/aws-client": "18.1.0",
+    "@cumulus/common": "18.1.0"
   },
   "author": "Cumulus Authors",
   "license": "Apache-2.0"

diff --git a/example/scripts/lib/package.json b/example/scripts/lib/package.json
@@ -1,7 +1,7 @@
 {
   "name": "@cumulus/example-lib",
   "private": true,
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "example project libs",
   "homepage": "https://github.com/nasa/cumulus/tree/master/example/scripts/lib",
   "engines": {

diff --git a/lambdas/db-migration/package.json b/lambdas/db-migration/package.json
@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/db-migration-lambda",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "A Lambda function used for deploying DB migrations",
   "license": "Apache-2.0",
   "engines": {
@@ -20,7 +20,7 @@
     "tsc:listEmittedFiles": "../../node_modules/.bin/tsc --listEmittedFiles"
   },
   "dependencies": {
-    "@cumulus/db": "18.0.0",
+    "@cumulus/db": "18.1.0",
     "knex": "2.4.1",
     "pg": "~8.10"
   }

diff --git a/lambdas/db-provision-user-database/package.json b/lambdas/db-provision-user-database/package.json
@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/db-provision-user-database-lambda",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "A Lambda function used for provisioning user databases",
   "engines": {
     "node": ">=16.19.0"
@@ -26,8 +26,8 @@
     "timeout": "2m"
   },
   "dependencies": {
-    "@cumulus/common": "18.0.0",
-    "@cumulus/db": "18.0.0",
+    "@cumulus/common": "18.1.0",
+    "@cumulus/db": "18.1.0",
     "knex": "2.4.1",
     "pg": "~8.10"
   },

diff --git a/lambdas/sqs-message-remover/package.json b/lambdas/sqs-message-remover/package.json
@@ -1,6 +1,6 @@
 {
   "name": "@cumulus/sqs-message-remover-lambda",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "description": "Remove processed messages from SQS queues",
   "main": "src/index.js",
   "private": true,
@@ -37,10 +37,10 @@
   "author": "Cumulus Authors",
   "license": "Apache-2.0",
   "dependencies": {
-    "@cumulus/aws-client": "18.0.0",
-    "@cumulus/common": "18.0.0",
-    "@cumulus/ingest": "18.0.0",
-    "@cumulus/logger": "18.0.0",
+    "@cumulus/aws-client": "18.1.0",
+    "@cumulus/common": "18.1.0",
+    "@cumulus/ingest": "18.1.0",
+    "@cumulus/logger": "18.1.0",
     "lodash": "^4.17.21"
   }
 }
diff --git a/lerna.json b/lerna.json
@@ -1,6 +1,6 @@
 {
   "lerna": "3.20.2",
-  "version": "18.0.0",
+  "version": "18.1.0",
   "packages": [
     "example",
     "example/lambdas/*",