Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get training and inference datasets from S3 #51

Open
momegas opened this issue Dec 4, 2022 · 0 comments
Open

Get training and inference datasets from S3 #51

momegas opened this issue Dec 4, 2022 · 0 comments
Labels
enhancement New feature or request

Comments

@momegas
Copy link
Member

momegas commented Dec 4, 2022

Is your feature request related to a problem? Please describe.
At the moment, whitebox only accepts the training dataset and inferences through the API. In order to load data faster, users should be able to define how whitebox can retrieve this data from an SQL database.

Describe the solution you'd like
In the UI / API / SDK the user should be able to choose a source for the model training dataset and inferences. A possible flow is the following:

  1. Create the model (either through UI or SDK)
  2. Go to settings and select where the data will be coming from (S3, in the future SQL, etc)
  3. Add the required credentials for S3 bucket and the corresponding file

Describe alternatives you've considered
At the moment, whitebox only accepts the training dataset and inferences through the API. This is an alternative but we need to extend it.

Additional context
Here is an exmaple of how Aporia does something similar: https://docs.aporia.com/introduction/quickstart

@momegas momegas added enhancement New feature or request needs analysis This issue needs analysis labels Dec 4, 2022
@momegas momegas changed the title Get training and inference datasets from SQL Get training and inference datasets from S3 Feb 28, 2023
@momegas momegas removed the needs analysis This issue needs analysis label Feb 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant