Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Section on evaluation frameworks #1

Closed
sepiatone opened this issue May 19, 2024 · 3 comments · Fixed by #2
Closed

Section on evaluation frameworks #1

sepiatone opened this issue May 19, 2024 · 3 comments · Fixed by #2
Labels
documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed

Comments

@sepiatone
Copy link
Contributor

Would it be useful to have a "frameworks" section? This would include links to evaluation frameworks like lm-eval from EleutherAI adn crfm-helm from Stanford.
@jas-ho
Copy link
Member

jas-ho commented May 20, 2024 •
edited

thanks for the suggestion, definitely! if you wanted to do a PR for this, that'd be grand!

@jas-ho jas-ho added documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed labels May 20, 2024
@sepiatone
Copy link
Contributor Author

@jas-ho Will submit one!

@jas-ho
Copy link
Member

jas-ho commented May 20, 2024 via email

@sepiatone sepiatone mentioned this issue May 23, 2024
Merged
@jas-ho jas-ho closed this as completed in #2 May 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

addition of a evaluation frameworks section with lm-eval and helm sepiatone/evaluations-starter
2 participants
@jas-ho @sepiatone