posted by organizer: krallinger || 8784 views || tracked by 4 users: [display]

CodiEsp (eHealth CLEF 2020) 2020 : CLEF-2020 CodiEsp: clinical text classification, indexing and explainable AI Task (eHealth CLEF 2020)


When Sep 22, 2020 - Sep 25, 2020
Where Thessaloniki, Greece
Submission Deadline May 3, 2020
Final Version Due Jun 28, 2020
Categories    machine learning   natural language processing   data mining   medical informatics

Call For Papers

CLEF-2020 CodiEsp: clinical text classification, indexing and explainable AI Task (eHealth CLEF 2020)

*** Call for Participation CodiEsp: Clinical Case Coding Task (eHealth CLEF 2020) ***

CodiEsp (eHealth CLEF– Multilingual Information Extraction) Shared Task on automatic assignment of ICD10 codes (procedures, diagnosis) track at CLEF 2020

Plan TL Award for the CodiEsp Track

The CodiEsp sub-tracks:

1.CodiEsp Diagnosis Coding sub-task (CodiEsp-D): will require automatic ICD10-CM [CIE10 Diagnóstico] code assignment.
2.CodiEsp Procedure Coding sub-task (CodiEsp-P): will require automatic ICD10-PCS [CIE10 Procedimiento] code assignment.
3.CodiEsp Explainable AI Subtask (CodiEsp-X). Systems are required to submit the reference to the predicted codes (both ICD10-CM and ICD10-PCS).

Task description
Clinical coding consists in the transformation (or classification) of medical texts written by clinicians into a structured or coded format using internationally recognized class codes.
These codes describe a patient’s diagnosis or treatment. This process is critical for standardizing clinical records; enable aetiology studies, monitor health trends, epidemiology studies, clinical and biomedical research, decision-making or even re-imbursement.

Due to the importance of this process, there are now even specialized education programs and professional occupations of persons employed as clinical coders or medical records technicians.

As part of the eHealth CLEF ( Multilingual Information Extraction Shared Task we organize CodiEsp: Clinical Case Coding Task ( This task will address the automatic extraction and assigment of clinical coding (diagnosis and procedures) to clinical cases in Spanish.

In addition data in Spanish we will also release training, development and test set document translations into English.

Participant systems have to automatically assign ICD10 codes (CIE-10, in Spanish) to clinical case documents, being evaluated against manually generated ICD10 codifications.

In addition to the Spanish data we will also include training, development and test set documents automatically translated into English.

Following the success of previous eHealth CLEF efforts or medical text mining tasks like MEDDOCAN or PharmaCoNER, we foresee that this task will be influential not only in terms of determining the most competitive approaches which might range from sophisticated term look-up to multi-class document classification systems using machine learning approaches.

Participation and useful info
1. CodiEsp web, info & detailed description:
2. Registration for CodiEsp (Multilingual Information Extraction eHealth track):
3. Training and development set:
4. Additional training resources:

Main CodiEsp Track organizers
• Martin Krallinger, Barcelona Supercomputing Center.
• Antonio Miranda, Barcelona Supercomputing Center.
• Aitor Gonzalez-Agirre, Barcelona Supercomputing Center.
• Marta Villegs, Barcelona Supercomputing Center.
• Jordi Armengol, Barcelona Supercomputing Center.

Important Dates
Jan 13 Train, development and additional training resources set release (Spanish)
February 12 Train, development set release (English machine translation)
April 28 Task setting discussion workshop at MIE2020 (Geneva)
May 3 End of evaluation
May 5 Results notified
May 24 Paper submission
Jun 28 Camera-ready paper submission
Sep 22-25 CLEF 2020 Conference (Thessaloniki, Greece)

Related Resources

CLEF 2024   Conference and Labs of the Evaluation Forum - Information Access Evaluation meets Multilinguality, Multimodality, and Visualization
Ei/Scopus-AACIP 2024   2024 2nd Asia Conference on Algorithms, Computing and Image Processing (AACIP 2024)-EI Compendex
JOKER 2024   JOKER @ CLEF 2024: Automatic Humour Analysis
ICDM 2024   IEEE International Conference on Data Mining
CMIDFORUM 2024   Clinical Microbiology and Infectious Diseases
AAAI 2025   The 39th Annual AAAI Conference on Artificial Intelligence
HEALTHINFO 2024   The Ninth International Conference on Informatics and Assistive Technologies for Health-Care, Medical Support and Wellbeing
IEEE-Ei/Scopus-SGGEA 2024   2024 Asia Conference on Smart Grid, Green Energy and Applications (SGGEA 2024) -EI Compendex
CMID 2024   2024 3rd International Symposium on Clinical Medicine and Intelligent Devices
CRPS 2024   2nd International Conferences in Clinical Research and Pharmaceutical Sciences