Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Persitent archiving of images and/or recipes #78

Open
pauleve opened this issue Aug 15, 2020 · 2 comments
Open

Persitent archiving of images and/or recipes #78

pauleve opened this issue Aug 15, 2020 · 2 comments
Assignees

Comments

@pauleve
Copy link
Contributor

pauleve commented Aug 15, 2020

In addition to mirror on github packages, we should consider persistent archiving of images.

Currently, I see two approaches:

  • backup the full images on Zenodo: quite easy to realize (docker can export the full image as a tar file), although I'm not sure how to automatize that. We can then add an option to the colomoto-docker program to fetch an image from zenodo
  • alternatively/in parallel, ensuring that all images can be built over time (Periodic testing for building old images #76) sounds more lightweight (note that zenodo allows up to 50GB per record, so we are far from this limit). The main issue is then to have a persistent backup of conda packages, as they may be deleted or moved to other labels by their maintainers. A first step would be to have a colomoto-history conda channel and copy all packages there to ensure we can fetch them later. But then, I don't know how reliable is anaconda.org over time.
@pauleve
Copy link
Contributor Author

pauleve commented Aug 15, 2020

Here is the doc to automate the upload on zenodo: https://developers.zenodo.org/#quickstart-upload
I can implement that during September, it sounds the most straightforward way to reliably archive our images.

@aurelien-naldi
Copy link
Contributor

Archiving on zenodo sounds like a great idea!
Maybe we should tag some images as "long term" to reduce a bit the load?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants