New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Process file events in the import batch #4840

Closed

imsdu opened this issue Apr 5, 2024 · 0 comments

Assignees

Labels

delta migration

Contributor

imsdu commented Apr 5, 2024 •

edited

Motivation
This ticket allows to add the processing of file events.

The physical files are already present in a S3 bucket at a path matching their previous location in local storage / GPFS

Acceptance criteria

All files are pushed to the default S3 storage via a S3 copy operation
Checksums are updated to match the checksum in S3
An error that is not related to the fact that the event has already been processed should end the batch
Auditing data is preserved.

Implementation notes

The idea would be to have the batch responsible for copying the file to its final destination and then use the operation created in Allow to create/update a file which is already in S3 #4839 to register the file in Nexus

imsdu added delta migration labels

olivergrabinski self-assigned this

imsdu mentioned this issue

Patch file paths when importing them #4890

Closed

imsdu closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment