Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

initial data pipeline setup #1

Open
colinkcurtis opened this issue Mar 10, 2021 · 0 comments
Open

initial data pipeline setup #1

colinkcurtis opened this issue Mar 10, 2021 · 0 comments
Labels
enhancement New feature or request
Projects
numerati

Comments

@colinkcurtis
Copy link
Collaborator

to train models, we need data

we know that numer.ai provides weekly data dumps

create a system which will do the following for the numer.ai data sets:

  • transfer to storage
  • validate format/content
  • maintain and keep available for our use
@colinkcurtis colinkcurtis added the enhancement New feature or request label Mar 10, 2021
@colinkcurtis colinkcurtis added this to To do in numerati Mar 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
numerati
To do
Milestone
No milestone
Development

No branches or pull requests
1 participant
@colinkcurtis