Skip to content
This repository has been archived by the owner on Feb 25, 2022. It is now read-only.

Releases: EleutherAI/gpt-neo

v1.1.1

06 Oct 01:51
7fbd31b
Compare
Choose a tag to compare
Update README.md

Fixed vulnerabilities

28 Aug 01:26
d741ddf
Compare
Choose a tag to compare

Vulnerabilities have been found in tensorflow which are patched in the most recent version. This release updates the codebase to use the secure version of tensorflow.

This release also fixes a small but significant bug in how documents are loaded. For details, see #230

Release Pretrained Models

21 Mar 20:00
Compare
Choose a tag to compare

We're proud to release two pretrained GPT-Neo models trained on The Pile, the weights and configs can be freely downloaded from the-eye.eu.

1.3B: https://the-eye.eu/eleuther_staging/gptneo-release/GPT3_XL/

2.7B: https://the-eye.eu/eleuther_staging/gptneo-release/GPT3_2-7B/

For more information on how to get these set up, see the colab notebook, or read through the rest of the readme.

This repository will be (mostly) archived as we move focus to our GPU training repo, GPT-Neox