Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for multiple forecasters in evalcast::get_predictions() #535

Open
kjytay opened this issue Apr 29, 2021 · 0 comments
Open

Add support for multiple forecasters in evalcast::get_predictions() #535

kjytay opened this issue Apr 29, 2021 · 0 comments

Comments

@kjytay
Copy link
Contributor

kjytay commented Apr 29, 2021

Right now, evalcast::get_predictions() downloads data from covidcast, then applies a single forecaster to the data.

When doing forecast development, it is common to try out many different forecasters on the same set of data. get_predictions() is too slow for this at the moment as it has to download the same set of data for each forecaster, and downloading of the data takes up a significant chunk of the runtime. (This is because we have to download several months worth of data to make corrections.)

It would be great if we only have to download the data once for multiple forecasters. I think there are (at least) two ways to do this:

  1. Modify get_predictions() so that it can take in a list of forecasters.
  2. Break get_predictions() into two functions: one that gets the relevant data, and one that gets predictions with the data from the first function as input.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant