Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ranking task type #561

Open
wants to merge 27 commits into
base: main
Choose a base branch
from
Open

Add ranking task type #561

wants to merge 27 commits into from

Conversation

ntlind
Copy link
Collaborator

@ntlind ntlind commented Apr 23, 2024

Improvements

  • Adds a new task type, RANKING, along with seven metrics discussed in this doc :
    • Mean Reciprocal Rank
    • Precision @ k
    • Average Precision @ k
    • Mean Average Precision @ k
    • Recall @ k
    • Average Recall @ k
    • Mean Average Recall @ k

Notes

  • Does not yet include a) NDCG, b) ranking predictions based on embeddings, or c) an example notebook. Planning to work on all of these items by next week.

TODOs

Check feedback from Eric via slack.

@ntlind ntlind self-assigned this Apr 23, 2024
@ntlind ntlind marked this pull request as ready for review May 1, 2024 06:35
@ntlind ntlind added the feature label May 1, 2024
docs/index.md Outdated Show resolved Hide resolved
Co-authored-by: Eric O. Korman <eric.korman@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants