Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make it easy to discover and load datasets #131

Open
CarloLucibello opened this issue May 20, 2022 · 5 comments
Open

make it easy to discover and load datasets #131

CarloLucibello opened this issue May 20, 2022 · 5 comments

Comments

@CarloLucibello
Copy link
Member

CarloLucibello commented May 20, 2022

We could provide some convenience functions like list_datasets() and `load_dataset("mnist").

@lorenzoh
Copy link
Contributor

Have you seen https://github.com/lorenzoh/FeatureRegistries.jl? In FastAI.jl, it's used to create such a list, make it easier to search for datasets and handle the downloading: https://fluxml.ai/FastAI.jl/dev/references/FastAI.Registries.datasets

@johnnychen94
Copy link
Member

Curiously, what's the relationship between FastAI.Datasets and MLDatasets -- are they going to duplicate each other, or will they be merged into one eventually?

@lorenzoh
Copy link
Contributor

FastAI.jl will allow loading datasets from MLDatasets.jl. If MLDatasets.jl wants to include a feature registry for datasets, I'd also be happy to merge additional datasets currently in FastAI.jl into MLDatasets.jl (i.e. everything here: https://course.fast.ai/datasets)

@Dsantra92
Copy link
Collaborator

We should also consider adding license and citing information with each dataset/datahub.

@lorenzoh
Copy link
Contributor

How about using FeatureRegistries.jl for this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants