Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support larger databases #43

Open
paulfitz opened this issue Jul 19, 2021 · 2 comments
Open

Support larger databases #43

paulfitz opened this issue Jul 19, 2021 · 2 comments
Labels

Comments

@paulfitz
Copy link
Member

Some UI features are only practical for medium-sized databases. We could do a better job of supporting essential operations on larger documents.

@fulldecent
Copy link
Sponsor

A great test for addressing this issue is at:

#901 (comment)

And our required performance metrics might be:

  • Use a Docker container with 512 MB RAB
  • Use web UI upload to load a 1 GB CSV database
  • Use 10 simultaneous visitors to view random pages of that database

@rswgnu
Copy link

rswgnu commented Apr 29, 2024

Excel has a limit of 1 million rows in a sheet. Business users are processing much larger datasets these days. So one motivation to use your tool would be efficient loading and processing of larger datasets, maybe using Polars under the hood.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants