posted by organizer: krallinger || 8112 views || tracked by 4 users: [display]

CodiEsp (eHealth CLEF 2020) 2020 : CLEF-2020 CodiEsp: clinical text classification, indexing and explainable AI Task (eHealth CLEF 2020)


When Sep 22, 2020 - Sep 25, 2020
Where Thessaloniki, Greece
Submission Deadline May 3, 2020
Final Version Due Jun 28, 2020
Categories    machine learning   natural language processing   data mining   medical informatics

Call For Papers

CLEF-2020 CodiEsp: clinical text classification, indexing and explainable AI Task (eHealth CLEF 2020)

*** Call for Participation CodiEsp: Clinical Case Coding Task (eHealth CLEF 2020) ***

CodiEsp (eHealth CLEF– Multilingual Information Extraction) Shared Task on automatic assignment of ICD10 codes (procedures, diagnosis) track at CLEF 2020

Plan TL Award for the CodiEsp Track

The CodiEsp sub-tracks:

1.CodiEsp Diagnosis Coding sub-task (CodiEsp-D): will require automatic ICD10-CM [CIE10 Diagnóstico] code assignment.
2.CodiEsp Procedure Coding sub-task (CodiEsp-P): will require automatic ICD10-PCS [CIE10 Procedimiento] code assignment.
3.CodiEsp Explainable AI Subtask (CodiEsp-X). Systems are required to submit the reference to the predicted codes (both ICD10-CM and ICD10-PCS).

Task description
Clinical coding consists in the transformation (or classification) of medical texts written by clinicians into a structured or coded format using internationally recognized class codes.
These codes describe a patient’s diagnosis or treatment. This process is critical for standardizing clinical records; enable aetiology studies, monitor health trends, epidemiology studies, clinical and biomedical research, decision-making or even re-imbursement.

Due to the importance of this process, there are now even specialized education programs and professional occupations of persons employed as clinical coders or medical records technicians.

As part of the eHealth CLEF ( Multilingual Information Extraction Shared Task we organize CodiEsp: Clinical Case Coding Task ( This task will address the automatic extraction and assigment of clinical coding (diagnosis and procedures) to clinical cases in Spanish.

In addition data in Spanish we will also release training, development and test set document translations into English.

Participant systems have to automatically assign ICD10 codes (CIE-10, in Spanish) to clinical case documents, being evaluated against manually generated ICD10 codifications.

In addition to the Spanish data we will also include training, development and test set documents automatically translated into English.

Following the success of previous eHealth CLEF efforts or medical text mining tasks like MEDDOCAN or PharmaCoNER, we foresee that this task will be influential not only in terms of determining the most competitive approaches which might range from sophisticated term look-up to multi-class document classification systems using machine learning approaches.

Participation and useful info
1. CodiEsp web, info & detailed description:
2. Registration for CodiEsp (Multilingual Information Extraction eHealth track):
3. Training and development set:
4. Additional training resources:

Main CodiEsp Track organizers
• Martin Krallinger, Barcelona Supercomputing Center.
• Antonio Miranda, Barcelona Supercomputing Center.
• Aitor Gonzalez-Agirre, Barcelona Supercomputing Center.
• Marta Villegs, Barcelona Supercomputing Center.
• Jordi Armengol, Barcelona Supercomputing Center.

Important Dates
Jan 13 Train, development and additional training resources set release (Spanish)
February 12 Train, development set release (English machine translation)
April 28 Task setting discussion workshop at MIE2020 (Geneva)
May 3 End of evaluation
May 5 Results notified
May 24 Paper submission
Jun 28 Camera-ready paper submission
Sep 22-25 CLEF 2020 Conference (Thessaloniki, Greece)

Related Resources

CLEF 2022   13th Conference and Labs of the Evaluation Forum
ICDM 2022   22nd IEEE International Conference on Data Mining
JOKER 2022   Shared Task JOKER@CLEF: Automatic Wordplay and Humour Translation Task
NeurIPS 2022   Thirty-sixth Conference on Neural Information Processing Systems
SI:ISCCRPM 2022   SENSORS Special Issue on Intelligent Systems for Clinical Care and Remote Patient Monitoring
MLDM 2023   18th International Conference on Machine Learning and Data Mining
HBU@ICPR 2022   12th International Workshop on Human Behavior Understanding (HBU)
ICMLA 2022   IEEE International conference on Machine Learning and Applications
CLPSYCH 2022   The Eighth Workshop on Computational Linguistics and Clinical Psychology: Mental Health in the Face of Change
MEN 2022   5th International Conference on Mechanical Engineering