You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If the retriever is operating at passage / chunk-level and hence the retrieved results can have duplicate IDs as shown below:
Top-10 retrieval list for each of the queries:
If the retriever is operating at passage / chunk-level and hence the retrieved results can have duplicate IDs as shown below:
Top-10 retrieval list for each of the queries:
Encoding them into a dictionary results in:
where qrels could be:
Considering above scenario, the
precision@10
would yield very low score, even though it is not the case. How can we fix this issue?The text was updated successfully, but these errors were encountered: