Call gc
during _alt
forecast download function used for forecast eval pipeline
#662
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The
forecast-eval
pipeline is running out of memory. Try adding in somegc()
s to free memory.Note: There are other places that could be useful to call
gc()
, e.g. during scoring, during truth data fetch, but they would also impact non-forecast eval use. Given that callinggc()
is a crude fix for OOM issues and that it would be nice for forecast eval to move away fromevalcast
, I don't want to go deep on this change. This is just an easy intervention on a "private" function.