Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add IRIS #30882

Open
2 tasks done
RUFFY-369 opened this issue May 17, 2024 · 0 comments · May be fixed by #30883
Open
2 tasks done

Add IRIS #30882

RUFFY-369 opened this issue May 17, 2024 · 0 comments · May be fixed by #30883

Comments

@RUFFY-369
Copy link

Model description

IRIS (Imagination with auto-Regression over an Inner Speech) is a Reinforcement learning agent trained in the imagination of a world model composed of a discrete autoencoder and an autoregressive Transformer. IRIS learns behaviors by accurately simulating millions of trajectories.

The approach presented in the paper casts dynamics learning as a sequence modeling problem, where an autoencoder builds a language of image tokens and a Transformer composes that language over time.

The agent is introduced in the paper titled TRANSFORMERS ARE SAMPLE-EFFICIENT WORLD MODELS.

There is also a medium blog post to understand how the algorithm works.

Open source status

  • The model implementation is available
  • The model weights are available

Provide useful links for the implementation

The model is adapted from the official code repository of the paper.

The officially released weights can be found on this Github repository

@RUFFY-369 RUFFY-369 linked a pull request May 17, 2024 that will close this issue
5 tasks
@RUFFY-369 RUFFY-369 changed the title Add Iris Add IRIS May 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant