View on GitHub


Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

Language modeling

Language modeling is the task of predicting the next word or character in a document.

Model Paper / Source Code
Zen 2.0: Continue training and adaption for n-gram enhanced text encoders ZEN Official
hULMonA: The Universal Language Model in Arabic hULMonA Official
AraBERT: Transformer-based Model for Arabic Language Understanding AraBERT Official