posted by user: peak || 1522 views || tracked by 2 users: [display]

CRAC-corefud 2022 : CRAC 2022 Shared Task on Multilingual Coreference Resolution

FacebookTwitterLinkedInGoogle

Link: https://ufal.mff.cuni.cz/corefud/crac22
 
When Oct 16, 2022 - Oct 17, 2022
Where Gyeongju, Republic of Korea
Submission Deadline Jul 8, 2022
Notification Due Aug 22, 2022
Categories    NLP   coreference resolution
 

Call For Papers

CALL FOR PARTICIPATION

We are excited to announce the CRAC 2022 Shared Task on Multilingual Coreference Resolution! The task will be held at COLING 2022 on October 16–17.

TASK DESCRIPTION

The focus of the task is learning models for prediction of coreference across a range of typologically different languages: Catalan, Czech, English, French, German, Hungarian, Lithuanian, Polish, Russian, and Spanish. Both identification of mentions and clustering of mentions that refer to the same entity are included. Only identity coreference is considered in this shared task, i.e., more complex coreference-related phenomena such as bridging anaphora are not considered. Submissions by participants will be ranked according to a scoring criterion based on standard coreference evaluation metrics.

BACKGROUND

Recently, inspired by the Universal Dependencies initiative (UD), the coreference community has started discussions on establishing a universal annotation scheme and using it to harmonize existing corpora. The discussions at the CRAC 2020 workshop led to proposing the Universal Anaphora initiative. One of the lines of effort related to Universal Anaphora resulted in CorefUD, which is a multilingual collection of coreference data resources harmonized under a common scheme. The public edition of CorefUD 1.0 contains 13 datasets for 10 languages, all of which are included in the CRAC 2022 shared task.

EXPECTED TIMELINE

Development Phase:

* March 3, 2022 – train+dev data release, start of the development phase
* March 17, 2022 – baseline system release, evaluation script release

Evaluation Phase:

* June 1, 2022 – start of evaluation phase, test evaluation via CodaLab
* June 8, 2022 (AoE) – end of evaluation phase

Presentation Phase:

* July 11, 2022 – submission of system description papers to CRAC 2022
* August 22, 2022 – notification of acceptance
* October 16-17, 2022 – the CRAC 2022 workshop at COLING 2022

Please visit the website for more details: https://ufal.mff.cuni.cz/corefud/crac22

Related Resources

Abu Dhabi, UAE 2025   The First Workshop and Shared Task on Multilingual Counterspeech Generation
IEEE Big Data - MMAI 2024   IEEE Big Data 2024 Workshop on Multimodal AI
CRAC 2024   Workshop on Reference, Anaphora and Coreference at EMNLP 2024
BIBC 2024   5th International Conference on Big Data, IOT and Blockchain
COLING 2025   [2nd CFP] The 1st Workshop and Shared Task on Multilingual Counterspeech Generation
CEU 2025   8th International Conference on Civil Engineering and Urban Planning
GEM shared task 2024   GEM 2024 multilingual data-to-text and summarization shared task
DPPR 2024   14th International Conference on Digital Image Processing and Pattern Recognition
MLSP 2024   Multilingual Lexical Simplification Pipeline (MLSP) Shared Task @ 19th Workshop on Innovative Use of NLP for Building Educational Applications
GermEval2024 GerMS-Detect 2024   GermEval2024 Shared Task GerMS-Detect -- Sexism Detection and Annotator Disagreement Prediction in German Online News Fora @Konvens 2024