Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/progress #1335

Draft
wants to merge 2 commits into
base: develop
Choose a base branch
from
Draft

Feat/progress #1335

wants to merge 2 commits into from

Conversation

PGijsbers
Copy link
Collaborator

  • Adds a progress bar to MinIO downloads
  • When download_all_files=True, only download the files which do not yet exist in cache. Overwriting is no longer necessary, as it was a crutch that was built before force_refresh_cache was added to the get_dataset method. This means we now can also avoid re-downloading image datasets over and over again.

WIP:

  • add/update test for cache behavior
  • update release notes

There is now a way to force a cache clear, so always redownloading
is not useful anymore.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant