Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can we resume training from the epoch we got interruption #241

Open
sun-peach opened this issue Jul 31, 2020 · 4 comments
Open

Can we resume training from the epoch we got interruption #241

sun-peach opened this issue Jul 31, 2020 · 4 comments

Comments

@sun-peach
Copy link

Hi, my computer's power was down and the experiment was interrupted at epoch 13. Can we resume the training from where it was interrupted?

Thank you.

@TParcollet
Copy link
Collaborator

Well, yes. The model is stored each epoch. So if the training stops at epoch 13 (let's say at 50%) then it should restart at epoch 13 0%

@sun-peach
Copy link
Author

Thank you. But do we need to set some flag to do that or pytorch kaldi will do it automatically? @TParcollet

@mravanelli
Copy link
Owner

mravanelli commented Mar 16, 2021 via email

@sun-peach
Copy link
Author

@mravanelli I have already noted that. I am doing research on that. Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants