This is an ASR corpus for Bemba language. It contains read speech from diverse publicly available Bemba sources; Literature Books, Radio/TV shows transcripts, Youtube Video transcripts, Online sources. The corpus has 14, 438 utterances culminating into over 24 hours of speech.
This repository highlights the LLMs reasoning capabilities of ✨ Mistral / LLaMA-3 / Phi-3 / Gemma / Flan-T5 / GPT-4o ✨ in Targeted Sentiment Analysis in Russian / Translated to English mass-media 📊
Repo associated with the forthcoming paper 'Instruct-global: aligning language models to follow instructions in low-resource languages'. Instruct-global automates the process of generating instruction datasets in low-resource languages (LRLs).
Teaching Large Language Models an Unseen Language on the Fly
GlotLID: Language Identification with Support for More Than 2000 Labels (EMNLP 2023).
GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
Resources for conservation, development, and documentation of low resource (human) languages.
HausaHate is a benchmark dataset for Hausa hate speech detection task. it was extracted from West African Facebook pages and comprises 2,000 comments annotated according to a binary class (offensive and non-offensive) and hate speech targets (race, gender and none).
A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.
QuantHaLL: Quantifying Hallucination in machine translation for Low-resource Languages
GlotSparse: Building Corpora in Under-Resourced Languages
ZaBantu is a fleet of light-weight Masked Language Models for Southern Bantu Languages
The Ede Python library automates the generations of instruction fine-tuning datasets in low-resource languages.
The following repository contains data and data preparation tools for a Polish-Kashubian translator.
The following repository contains model training and BLEU calculation tools for a Polish-Kashubian translator.
This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages" published in Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021.
LLMs for Low Resource Languages in Multilingual, Multimodal and Dialectal Settings
A set of frameworks for creating the AI/ML building blocks for low-resource languages.
Children StoryBooks for 180 langauges.
Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.
Add a description, image, and links to the low-resource-languages topic page so that developers can more easily learn about it.
To associate your repository with the low-resource-languages topic, visit your repo's landing page and select "manage topics."