Popular repositories

1. petals petals Public

   🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

   Python 8.7k 460

2. promptsource promptsource Public

   Toolkit for creating, sharing and using natural language prompts.

   Python 2.5k 335

3. Megatron-DeepSpeed Megatron-DeepSpeed Public

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 1.2k 205

4. bigscience bigscience Public

   Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

   Shell 938 99

5. xmtf xmtf Public

   Crosslingual Generalization through Multitask Finetuning

   Jupyter Notebook 494 36

6. t-zero t-zero Public

   Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)

   Python 448 52