Add new dataset: GermanGovServiceRetrieval

[malteos]

GermanGovServiceRetrieval: LHM-Dienstleistungen-QA is a German question answering dataset for government services of the Munich city administration. It associates questions with a textual context containing the answer

Checklist for adding MMTEB dataset

Reason for dataset addition: Domain-specific retrieval dataset for German

• I have tested that the dataset runs with the mteb package.
• I have run the following models on the task (adding the results to the pr). These can be run using the mteb run -m {model_name} -t {task_name} command.
  • sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
  • intfloat/multilingual-e5-small
• I have checked that the performance is neither trivial (both models gain close to perfect scores) nor random (both models gain close to random scores).
• If the dataset is too big (e.g. >2048 examples), considering using self.stratified_subsampling() under dataset_transform()
• I have filled out the metadata object in the dataset file (find documentation on it here).
• Run tests locally to make sure nothing is broken using make test.
• Run the formatter to format the code using make lint.
• I have added points for my submission to the points folder using the PR number as the filename (e.g. 438.jsonl).

[malteos]

Do you have time to review? @guenthermi @Muennighoff @PhilipMay

[KennethEnevoldsen]

I think everything looks good. Feel free to add points. You might also consider using ndcg_5 instead of 10 since the dataset is quite small.

[malteos]

I think everything looks good. Feel free to add points. You might also consider using ndcg_5 instead of 10 since the dataset is quite small.

Good point. I changed the main metric.

[PhilipMay]

Do you have time to review? @guenthermi @Muennighoff @PhilipMay

Hey @malteos . I have almost no knowledge with MTEB. Never implemented anything here. Sorry.
Maybe @rasdani could have a look?

[KennethEnevoldsen]

Have enabled auto-merge and updated the points. Let me know if you disagree. Thanks for the addition!