Release checklist 2.14 (and 2.14.1)

[devincowan]

Issues in Release

• Enforce file quota #5228 by @devincowan
• Limit funding agencies to USA and explore performance enhancements #5404 by @devincowan

Related issues

These will be closed as resolved or no longer relevant

• iRods microservice does not catch ibun (zip/unzip) actions #5418 by @devincowan
• Duration to delete directory increases exponentially based on # of files #5235 by @devincowan
• Only send quota emails if confident that quota sizes are correct #5441 by @devincowan
• iRods microservice updates #5384 by @devincowan
• Migrate iRODS quota microservice to Python API #5195 by @devincowan
• Explicitly specify rule engine on irule invocations #5286 by @devincowan

Beta Deployment

• Diff RC to master to identify and manually make changes in the following files:
  • hsctl
  • config/hydroshare-config.yaml
  • nginx/config-files/hydroshare-ssl-nginx.conf.template
  • scripts/templates/docker-compose.template
• Changes in hydroshare/local_settings.py need to be coordinated for manual update
• Smoke test active worker before swap, note whether maintenance will be needed (make sure that you check the active worker AFTER the db migrations have run)
• Add any management commands necessary for the deploy to the notes section
• Deployed to Beta
• Review the search and discovery pages
• Create a new user and update profile
• Create iROD account, test connection and delete iROD account
• Create a new resource, check sharing/permission settings, delete new resource
• Developers test around issues
• Hsclient tests pass when targeting beta
• QA testing around issues
• Stakeholders approval

Production Deployment

• Snapshot the DB and iRods VM before deploy
• Deployed to Production
  • Make manual changes to files identified in Beta Deployment
• Review the search and discovery pages
• Create a new user and update profile
• Create iROD account, test connection and delete iROD account
• Create a new resource, check sharing/permission settings, delete new resource
• Developers test around issue

Notes relevant to deployment

1. Users over quota need to be contacted
2. Includes migrations, snapshots should be taken
3. Will require ~1hr downtime to run a management command to migrate quota holder info from irods to django migrate_quota_holder_from_irods
4. All management commands listed here must complete before the quotas will be accurate
5. Userzone AVUs should be reset to ensure accuracy
6. Quota enforcement will still be turned off after the deployment. It can be toggled on using the admin panel
7. Quota messages should be checked and updated in the admin panel.
8. Disable the datazone microservices on prod (to avoid the overhead)

Diff

2.13.10...rc-2.14

[devincowan]

beta migration
https://new-hs-ci.hydroshare.org/view/02-Deployment/job/Beta%20deployment/job/beta-hsctl-command/600/console

[devincowan]

hsclient tests running here:
https://github.com/hydroshare/hsclient/actions/runs/9021714222

[devincowan]

quota_reset running here: https://new-hs-ci.hydroshare.org/view/02-Deployment/job/Beta%20deployment/job/beta-hsctl-command/602/console

[devincowan]

dump_user_quota user_quota_050924_beta.csv --exceeded --expand_held_resources
https://new-hs-ci.hydroshare.org/view/02-Deployment/job/Beta%20deployment/job/beta-hsctl-command/605/parameters/

[devincowan]

reset_file_size_system_metadata --update --refreshed_weeks 52
https://new-hs-ci.hydroshare.org/view/02-Deployment/job/Beta%20deployment/job/beta-hsctl-command/606/console

[devincowan]

I found an issue in the rc

likely due to bootstrap upgrade

[devincowan]

deploy fails with

REBUILD SOLR INDEX:
  - docker exec hydroshare python manage.py rebuild_index --noinput
System check identified some issues:

WARNINGS:
?: (debug_toolbar.W006) At least one DjangoTemplates TEMPLATES configuration needs to have APP_DIRS set to True.
	HINT: Use APP_DIRS=True for at least one django.template.backends.django.DjangoTemplates backend configuration.
Removing all documents from your index because you said so.
System check identified some issues:

WARNINGS:
?: (debug_toolbar.W006) At least one DjangoTemplates TEMPLATES configuration needs to have APP_DIRS set to True.
	HINT: Use APP_DIRS=True for at least one django.template.backends.django.DjangoTemplates backend configuration.
All documents removed.
System check identified some issues:

WARNINGS:
?: (debug_toolbar.W006) At least one DjangoTemplates TEMPLATES configuration needs to have APP_DIRS set to True.
	HINT: Use APP_DIRS=True for at least one django.template.backends.django.DjangoTemplates backend configuration.
[ERROR/MainProcess] Error updating hs_core using default 
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/django/db/backends/utils.py", line 84, in _execute
    return self.cursor.execute(sql, params)
psycopg2.errors.UndefinedColumn: column hs_core_genericresource.quota_holder_id does not exist
LINE 1: ...d", "hs_core_genericresource"."spam_allowlisted", "hs_core_g...