View on GitHub


Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

Named entity recognition

Named entity recognition (NER) is the task of tagging entities in text with their corresponding type. Approaches typically use BIO notation, which differentiates the beginning (B) and the inside (I) of entities. O is used for non-entity tokens.


Mark Watney visited Mars

(NER definition taken from english/


The CANTEMIST-NER 2020 task consists of Spanish oncology clinical reports corpus tagged with one entity type (MORFOLOGIA_NEOPLASIA). Models are evaluated based on span-based F1 on the test set: see evaluation scripts.

The CANTEMIST shared task contains as well an entity linking subtrack (CANTEMIST-NORM) and a document indexing subtrack (CANTEMIST-CODING).

Data link: Zenodo

Model F1 Paper / Source Code
MRC mBERT-MLP (Xiong et al., 2020) 87.0 A Joint Model for Medical Named Entity Recognition and Normalization Official
BETO-SciBERT (Garcia-Pablos et al., 2020) 86.9 Vicomtech at CANTEMIST 2020  
BiLSTM-CRF+GloVe+SME+CWE (López-Úbeda et al., 2020) 85.5 Extracting Neoplasms Morphology Mentions in Spanish Clinical Cases through Word Embeddings  
Biaffine Classifier (Lange et al., 2020) 85.3 NLNDE at CANTEMIST: Neural Sequence Labeling and Parsing Approaches for Clinical Concept Extraction  
BETO (Han et al., 2020) 85.0 Pre-trained Language Model for CANTEMIST Named Entity Recognition  
BiLSTM-CRF+FasText+Char (Carreto Fidalgo et al., 2020) 84.5 Recognai’s Working Notes for CANTEMIST-NER Track Official
BiLSTM-BiLSTM-CRF+FasText+PoS+Char (Santamaria Carrasco et al., 2020) 83.4 Using Embeddings and Bi-LSTM+CRF Model to Detect Tumor Morphology Entities in Spanish Clinical Cases Official

Go back to the README