Release v0.5.0

What's Changed

• Fix mssg check by @Muennighoff in #174
• Add MiniChat-1.5-3B to AlpacaEval and Fix MiniChat-3B by @GeneZC in #176
• Add 01-ai/Yi-34B-Chat to AlpacaEval by @HyperdriveHustle in #175
• feat: add way to verify results by @YannDubs in #177
• show img in readme by @YannDubs in #178
• Add PairRM best-of-16 to AlpacaEval by @jdf-prog in #181
• Verify Yi by @YannDubs in #182
• chore: add phi-2 sft by @lxuechen in #184
• add cut-13b by @wwxu21 in #186
• chore: add phi-2 dpo by @lxuechen in #185
• Support phi2, Support SOLAR 10.7B LMCocktail by @yhyu13 in #183
• Update openai.py by @Muennighoff in #188
• chore: add link for phi-2-sft by @lxuechen in #190
• chore: fix links by @lxuechen in #191
• Add deita-7b-v1.0 model by @VPeterV in #192
• [ENH] Azure OAI client & more general way of switching between client configs by @YannDubs in #193
• [ENH] Weighted win rates by @YannDubs in #189
• [ENH] new models: Gemini / claude2.1 / mistral / mixtral / .. by @YannDubs in #195
• [ENH] alpaca_eval 2.0 by @YannDubs in #196

New Contributors

• @Muennighoff made their first contribution in #174
• @HyperdriveHustle made their first contribution in #175
• @jdf-prog made their first contribution in #181
• @lxuechen made their first contribution in #184
• @wwxu21 made their first contribution in #186
• @yhyu13 made their first contribution in #183
• @VPeterV made their first contribution in #192

Full Changelog: v0.3.6...v0.5.0