The listing is in no particular order other than the year.
- BigScience pre-BLOOM 108B training experiments (2021): chronicles | the full spec and discussions
-
BigScience BLOOM-176B (2022): chronicles-prequel | chronicles | the full spec and discussions
-
THUDM GLM-130B (2022): en logbook | Mandarin version
-
HuggingFace m4 80B multimodal (Flamingo repro) (2023): Learning log | Training Logbook
-
BloombergGPT 50B LLM - section C in BloombergGPT: A Large Language Model for Finance