Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to upload data as file, including csv as binary #22

Open
SamGRosen opened this issue Jul 19, 2021 · 0 comments
Open

Add ability to upload data as file, including csv as binary #22

SamGRosen opened this issue Jul 19, 2021 · 0 comments

Comments

@SamGRosen
Copy link
Member

SamGRosen commented Jul 19, 2021

A major motivation of the project was to allow researchers to avoid uploading potentially sensitive data to a remote server. We need to support the ability to upload data using the file input type. In addition, when uploading CSVs, it can be very wasteful to upload them as standard ascii files, i.e. a float with 7 decimal places will be represented by 9 or more bytes instead of 1. We need to consider a util for building csvs as binary files (such as in python, and then reading them in properly in javascript, potentially using FileReader.

Some libraries that may help could be Apache Arrow or flatbuffer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant