posted by organizer: krallinger || 932 views || tracked by 3 users: [display]

1st CFP MedProcNER at BioASQ/CLEF 2023 : 1st CFP MedProcNER track: Automatic detection of Medical procedures in text (at BioASQ/CLEF2023)


When Sep 18, 2023 - Sep 21, 2023
Where Thessaloniki, Greece
Abstract Registration Due May 15, 2023
Submission Deadline Jun 5, 2023
Notification Due Jun 23, 2023
Final Version Due Jul 7, 2023
Categories    NLP   named entity recognition   clinical   language technologies

Call For Papers

1st CFP MedProcNER track: Automatic detection of Medical procedures in text (BioASQ/CLEF2023)

MedProcNER (Medical Procedure Named Entity Recognition & Linking)


- Web:
- Corpus:
- Guidelines:
- Registration:


The recent use and exploitation of large language models (LLMs) and transformer-based technologies have resulted in considerable improvements in clinical NLP & health data processing systems, in particular for content in English, but also increasingly for other languages. Efficient semantic annotation strategies/named entity recognition of key clinical concepts, such as diseases, medications or adverse events are critical for medical text mining applications, including QA, information extraction, predictive modeling or even generative AI.

Despite being at the core of clinical practice and healthcare, only limited attempts focussed on the automatic detection and normalization of medical procedures from texts. These were often restricted to very specialized types of procedures (e.g. medical imaging). Some efforts like the Merlot corpus included medical procedures, but were not exclusively focused on this key clinical concept type.

Thus, there is a clear need to foster the development of concept recognition systems for medical procedures, being essential to characterize existing treatment options, diagnostic procedures of patients as well as analyzing key aspects of therapeutic or preventive techniques associated with patient care. Procedures are also relevant for clinical coding efforts of electronic health records.

To promote the development, evaluation and use of clinical concept recognition systems of medical procedure from clinical texts we organize the MedProcNER task as part of the BioASQ/CLEF 2023 evaluation initiative.

For this track a large Gold Standard corpus of clinical case texts in Spanish manually annotated through a collaborative effort between clinicians, clinical coding experts and linguists will be released. Additionally a multilingual Silver Standard version of the MedProcNER corpus in English and other languages including French, Italian or Portuguese will be published as well as cross-mappings to ICD-10 and MeSH codes.

Aligned with different practical end user scenarios three subtasks will be posed:

1. Procedure-NER (Clinical Procedure Recognition) subtask: requires the automatic detection of all clinical procedures mentioned in clinical case documents (their start and end character positions).

2. Procedure-Norm (Clinical Procedure Normalization) subtask: requires the automatic detection of all clinical procedures mentioned in clinical case documents (their start and end character positions) together with their corresponding SNOMED CT concept code.

3. Procedure-Indexing (Clinical Procedure-based Document Indexing) subtask: similar to semantic indexing or clinical coding tasks, this subtask requires teams to automatically assign to each document their corresponding list of clinical procedure SNOMED CT codes.

- Train set release Procedure-NER: April 11th, 2023
- Train set release Procedure-Norm/Indexing & : April 21st, 2023
- Test set release (start of evaluation period): April 24th, 2023
- End of evaluation period (system submissions): May 15th, 2023
- Working papers submission: June 5th, 2023
- Notification of acceptance (peer-reviews): June 23rd, 2023
- Camera-ready system descriptions: July 7th, 2023
- BioASQ workshop at CLEF 2023: Thessaloniki, Greece, September 18th-21st, 2023 (

Publications & conference

Following previous BioASQ/CLEF efforts, participating teams will be invited to contribute a short systems description paper for the CLEF 2023 proceedings, and to give a short presentation of their approach at the BioASQ workshop at the CLEF 2023 conference (18-21 September, Thessaloniki, Greece)


Martin Krallinger, Barcelona Supercomputing Center, Spain
Salvador Lima, Barcelona Supercomputing Center, Spain
Eulàlia Farré, Barcelona Supercomputing Center, Spain
Luis Gascó, Barcelona Supercomputing Center, Spain
Anastasios Nentidis, National Center for Scientific Research Demokritos, Greece
Anastasia Krithara, National Center for Scientific Research Demokritos, Greece

Related Resources

CFP-CIPCV-EI/SCOPUS 2024   2024 2nd International Conference On Intelligent Perception And Computer Vision
Ei/Scopus-AACIP 2024   2024 2nd Asia Conference on Algorithms, Computing and Image Processing (AACIP 2024)-EI Compendex
DSAA 2024   IEEE DSAA'2024 CFP to Research, Application, Journal tracks
IEEE Big Data - MMAI 2024   IEEE Big Data 2024 Workshop on Multimodal AI (Hybrid)
COLA - Lua Special Issue 2024   CFP: Journal of Computer Languages - Special Issue Celebrating 30 Years of the Lua Programming Language
MEN 2024   7th International Conference on Mechanical Engineering
JICS 2024   CfP: ALMA MATER - Journal of Interdisciplinary Cultural Studies
NLAI 2024   5th International Conference on NLP & Artificial Intelligence Techniques
CVPR&ML 2024   CFP - Special Issue New Trends in Computer Vision, Pattern Recognition and Machine Learning
SEMIT 2024   5th International Conference on Software Engineering and Managing Information Technology