New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feats] dataset continue pretrain and repeat #2414

Closed

1 of 4 tasks

Mddct opened this issue Mar 16, 2024 · 0 comments

Closed

1 of 4 tasks

[feats] dataset continue pretrain and repeat #2414

Mddct opened this issue Mar 16, 2024 · 0 comments

Assignees

Labels

enhancement future plan Stale

Collaborator

Mddct commented Mar 16, 2024 •

edited

断点续训的时候，从断点处对应的数据开始
- raw，真实的wav对应的indices
- shard，从对应tar开始
repeat(epoch), [dataset] support repeat #2415
- large data step 更合理些
- uneven data 只有最后会mode.join/ time out (deepspeed/fsdp)

Mddct self-assigned this

Mddct added future plan enhancement labels

Mddct mentioned this issue

[dataset] support repeat #2415

Merged

1 task

github-actions bot added the Stale label

github-actions bot closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment