Skip to content
This repository has been archived by the owner on Feb 25, 2022. It is now read-only.

Release Pretrained Models
Compare
Choose a tag to compare
@sdtblck sdtblck released this 21 Mar 20:00
· 118 commits to master since this release
v1.0
67c4079

We're proud to release two pretrained GPT-Neo models trained on The Pile, the weights and configs can be freely downloaded from the-eye.eu.

1.3B: https://the-eye.eu/eleuther_staging/gptneo-release/GPT3_XL/

2.7B: https://the-eye.eu/eleuther_staging/gptneo-release/GPT3_2-7B/

For more information on how to get these set up, see the colab notebook, or read through the rest of the readme.

This repository will be (mostly) archived as we move focus to our GPU training repo, GPT-Neox

Assets 2