Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hitting memory capacity #14

Open
bweedop opened this issue Mar 14, 2018 · 2 comments
Open

Hitting memory capacity #14

bweedop opened this issue Mar 14, 2018 · 2 comments
Assignees
@willpearse
Labels
bug

Comments

@bweedop
Copy link
Member

bweedop commented Mar 14, 2018

Currently, loading some of the data in downloads.R can cause issues with system memory if other tasks are being performed. We may need to consider different data structures (e.g. data tables vs. data frames) and combining functions that use the same data sets to reduce stress on system memory.
@willpearse willpearse self-assigned this Mar 30, 2018
@willpearse willpearse added the bug label Mar 30, 2018
@willpearse
Copy link
Member

Confirmed by @mrhelmus. I'm moving this to a "bug", because if Matt can't load the files then that's clearly a problem. As wonderful as it is to have a demonstration of the power of Linux, this isn't very helpful behavior...

@willpearse
Copy link
Member

Hey past Will, it's Will From The Future - a related problem is that some of these functions take a very long time to download because they're grabbing so much data (e.g., biotime.2018). You need to write something that flags these (and, in so-doing, would solve the memory problem in a stupid way).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@willpearse willpearse

Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@willpearse @bweedop