Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pytorch BC/RL Implementations for BridgeData V2 #12

Open
Stardust-hyx opened this issue Sep 19, 2023 · 1 comment
Open

Pytorch BC/RL Implementations for BridgeData V2 #12

Stardust-hyx opened this issue Sep 19, 2023 · 1 comment

Comments

@Stardust-hyx
Copy link

Stardust-hyx commented Sep 19, 2023

Distributed training code (based on deepspeed) for BridgeData is now available!
See https://github.com/Stardust-hyx/Bridge-Torch
Since most open-source LLMs are implemented with Pytorch and require memory-efficient distributed training frameworks to fine-tune on, we believe our repository can greatly facilitate the application of Multimodal LLMs on this field.

We provide implementations for the following methods:

  • Goal-conditioned BC
  • Goal-condtioned IQL (TODO)

By the way, a novel generative VLM-based BC method is under development by us. Stay tuned.

@Stardust-hyx
Copy link
Author

Stardust-hyx commented Sep 20, 2023

A checkpoint for GCBC as well as a torch-version of eval.py is also provided in https://github.com/Stardust-hyx/Bridge-Torch. We will be grateful if you can help check the validity of the checkpoint by trying it out. @HomerW
Thanks in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant