Skip to content

No labels!

There aren’t any labels for this repository quite yet.

benchmark dataset request
benchmark dataset request
Request to add a new benchmark dataset
bug
bug
Something isn't working
documentation
documentation
Improvements or additions to documentation
enhancement
enhancement
New feature or request
good first issue
good first issue
Good for newcomers
large model (>7B)
large model (>7B)
This model has more than 7B parameters, requiring more than an RTX 4090 GPU to evaluate.
macos
macos
Use this label when creating PRs to run MacOS tests
model evaluation request
model evaluation request
Request to evaluate a model and add it to the leaderboard(s)
needed-for-upcoming-release
needed-for-upcoming-release
This change needs to be implemented before next release.
small model (<7B)
small model (<7B)
This model has less than 7B parameters, so can be evaluated on an RTX 4090 GPU or smaller.
tests
tests
Adding or changing unit tests