Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Estimate time of fit/simulate #524

Open
dmey opened this issue Nov 12, 2020 · 3 comments
Open

Estimate time of fit/simulate #524

dmey opened this issue Nov 12, 2020 · 3 comments

Comments

@dmey
Copy link

dmey commented Nov 12, 2020

When working with large data, the fitting or simulation process may take several hours/days to complete. Are there any plans to add some time estimates? I do not know how complex it is to estimate the time required based on configurations etc (I guess quite), but perhaps just adding some logging info based on the iteration (e.g. iteration_number/total number of iterations) may be enough.

@tvatter
Copy link
Collaborator

tvatter commented Nov 12, 2020

We haven't really thought of that. We could achieve this by improving what is displayed when using show_trace. We could either add some additional logging info as the fit/simulation progresses or some kind of progress bar. Any thoughts?

@dmey
Copy link
Author

dmey commented Nov 12, 2020

I don't have a particular preference about this and I think simply showing the progress bar would be good enough, at least to start with. One thing though, given that you provide binaries for Python and R, it would be great if we can keep this as a state or return a counter that can be used by other libraries as well rather than just printing the status bar in C.

As a separate note, I think that when I tried using show_trace for the fitting the process took considerably longer -- Could this happen -- I may be wrong about this but.

@tnagler
Copy link
Collaborator

tnagler commented Nov 12, 2020

Yeah printing the trace to the terminal can be very slow for large models. We should think about an optionfor logging to a file and more compressed output for large models.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants