View on GitHub

NLP-progress

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

Language modeling is the task of predicting the next word or character in a document.

Model	Paper / Source	Code
Zen 2.0: Continue training and adaption for n-gram enhanced text encoders	ZEN	Official
hULMonA: The Universal Language Model in Arabic	hULMonA	Official
AraBERT: Transformer-based Model for Arabic Language Understanding	AraBERT	Official