BigScience Workshop
Research workshop on large language models - The Summer of Language Models 21
Popular repositories
-
promptsource
promptsource PublicToolkit for creating, sharing and using natural language prompts.
-
Megatron-DeepSpeed
Megatron-DeepSpeed PublicOngoing research training transformer language models at scale, including: BERT & GPT-2
-
bigscience
bigscience PublicCentral place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
Repositories
Showing 10 of 35 repositories
-
-
- Megatron-DeepSpeed Public
Ongoing research training transformer language models at scale, including: BERT & GPT-2
-
- bigscience Public
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
-
- massive-probing-framework Public Forked from AIRI-Institute/Probing_framework
Framework for BLOOM probing
-