Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

啥时候支持sparse模型? #425

Open
starkeisntein opened this issue Jan 22, 2022 · 0 comments
Open

啥时候支持sparse模型? #425

starkeisntein opened this issue Jan 22, 2022 · 0 comments

Comments

@starkeisntein
Copy link

starkeisntein commented Jan 22, 2022

Limitations and Future Plans
BytePS does not support pure CPU training for now. One reason is that the cheap PS assumption of BytePS do not hold for CPU training. Consequently, you need CUDA and NCCL to build and run BytePS.

We would like to have below features, and there is no fundamental difficulty to implement them in BytePS architecture. However, they are not implemented yet:

Sparse model training
Fault-tolerance
Straggler-mitigation

readme这里所写的计划,Sparse model training,应该是指广告推荐模型那类模型吧?这一点计划什么支持?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant