Language modeling is the task of predicting the next word or character in a document.
| Model | Paper / Source | Code |
|---|---|---|
| Zen 2.0: Continue training and adaption for n-gram enhanced text encoders | ZEN | Official |
| hULMonA: The Universal Language Model in Arabic | hULMonA | Official |
| AraBERT: Transformer-based Model for Arabic Language Understanding | AraBERT | Official |