Extending XPQA to add cross lingual evaluation

[wissam-sib]

The current XPQA was multilingual but it can be extended to be cross lingual.

• I have tested that the dataset runs with the mteb package.
• I have run the following models on the task (adding the results to the pr). These can be run using the mteb run -m {model_name} -t {task_name} command.
  • sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
  • intfloat/multilingual-e5-small
• I have checked that the performance is neither trivial (both models gain close to perfect scores) nor random (both models gain close to random scores).
• I have filled out the metadata object in the dataset file (find documentation on it here).
• Run tests locally to make sure nothing is broken using make test.
• Run the formatter to format the code using make lint.
• I have added points for my submission to the points folder using the PR number as the filename (e.g. 438.jsonl).

[KennethEnevoldsen]

@imenelydiaker I am going through PRs. Will you have the time to finish up this PR?

[imenelydiaker]

@imenelydiaker I am going through PRs. Will you have the time to finish up this PR?

Yes I'm on it 🙂

[KennethEnevoldsen]

Wonderful thanks!

[imenelydiaker]

Please add points @wissam-sib, thank you for this additon! 🙂