Addition of : Thai, Romanian, Hebrew, Korean, Burmese, Nigerian (Multilingual) Datasets

[Art3mis0707]

Checklist for adding MMTEB dataset

Addition of :

• Thai Restaurant Reviews Dataset - WongnaiReviewsClassification
• Hebrew Sentiment Analysis Dataset - HebrewSentimentAnalysis
• Korean Financial Sentiment Analysis Dataset - KorFin
• Burmese News Classification Dataset - MyanmarNews
• Romanian News Classification Dataset - Moroco
• Nigerian (Multilingual) Twitter Sentiment Analysis Dataset - NaijaSenti

Reason for dataset addition:
All the datasets (except Korean) are low resource datasets, and were present mostly only in the multilingual datasets. Having monolingual datasets in low resource languages will enrich the diversity of the benchmark.

• I have tested that the dataset runs with the mteb package.
• I have run the following models on the task (adding the results to the pr). These can be run using the mteb run -m {model_name} -t {task_name} command.
  • sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
  • intfloat/multilingual-e5-small
• I have checked that the performance is neither trivial (both models gain close to perfect scores) nor random (both models gain close to random scores).
• If the dataset is too big (e.g. >2048 examples), considering using self.stratified_subsampling() under dataset_transform()
• I have filled out the metadata object in the dataset file (find documentation on it here).
• Run tests locally to make sure nothing is broken using make test.
• Run the formatter to format the code using make lint.
• I have added points for my submission to the points folder using the PR number as the filename (e.g. 438.jsonl).

[imenelydiaker]

Thanks for this addition! Below my comments.
Also please rename files with underscores by removing it (e.g., Thai_Restaurant_Reviews.json -> ThaiRestaurantReviews.json)

[KranthiGV]

(In the interest of quick merging, I'd recommend not adding a new dataset after significant reviewing is done in the same PR.
Would be better to start a new PR)

[Art3mis0707]

I've made all changes @KranthiGV @imenelydiaker
Please let me know if there's anything else I need to do
Thanks!

[Art3mis0707]

I have also created a jsonl file and added points...2 for @imenelydiaker and @KranthiGV for reviewing and 12 for myself (6x2).

[imenelydiaker]

LGTM! Can you please add you name and affiliation here and run linting?

[Art3mis0707]

LGTM! Can you please add you name and affiliation here and run linting?

I've done it.
Please check, thanks

[imenelydiaker]

LGTM, thank you for your contribution! Let's merge 🙂