posted by user: peak || 1319 views || tracked by 2 users: [display]

CRAC-corefud 2022 : CRAC 2022 Shared Task on Multilingual Coreference Resolution

FacebookTwitterLinkedInGoogle

Link: https://ufal.mff.cuni.cz/corefud/crac22
 
When Oct 16, 2022 - Oct 17, 2022
Where Gyeongju, Republic of Korea
Submission Deadline Jul 8, 2022
Notification Due Aug 22, 2022
Categories    NLP   coreference resolution
 

Call For Papers

CALL FOR PARTICIPATION

We are excited to announce the CRAC 2022 Shared Task on Multilingual Coreference Resolution! The task will be held at COLING 2022 on October 16–17.

TASK DESCRIPTION

The focus of the task is learning models for prediction of coreference across a range of typologically different languages: Catalan, Czech, English, French, German, Hungarian, Lithuanian, Polish, Russian, and Spanish. Both identification of mentions and clustering of mentions that refer to the same entity are included. Only identity coreference is considered in this shared task, i.e., more complex coreference-related phenomena such as bridging anaphora are not considered. Submissions by participants will be ranked according to a scoring criterion based on standard coreference evaluation metrics.

BACKGROUND

Recently, inspired by the Universal Dependencies initiative (UD), the coreference community has started discussions on establishing a universal annotation scheme and using it to harmonize existing corpora. The discussions at the CRAC 2020 workshop led to proposing the Universal Anaphora initiative. One of the lines of effort related to Universal Anaphora resulted in CorefUD, which is a multilingual collection of coreference data resources harmonized under a common scheme. The public edition of CorefUD 1.0 contains 13 datasets for 10 languages, all of which are included in the CRAC 2022 shared task.

EXPECTED TIMELINE

Development Phase:

* March 3, 2022 – train+dev data release, start of the development phase
* March 17, 2022 – baseline system release, evaluation script release

Evaluation Phase:

* June 1, 2022 – start of evaluation phase, test evaluation via CodaLab
* June 8, 2022 (AoE) – end of evaluation phase

Presentation Phase:

* July 11, 2022 – submission of system description papers to CRAC 2022
* August 22, 2022 – notification of acceptance
* October 16-17, 2022 – the CRAC 2022 workshop at COLING 2022

Please visit the website for more details: https://ufal.mff.cuni.cz/corefud/crac22

Related Resources

GEM shared task 2024   GEM 2024 multilingual data-to-text and summarization shared task
ACM-Ei/Scopus-CCISS 2024   2024 International Conference on Computing, Information Science and System (CCISS 2024)
MLSP 2024   Multilingual Lexical Simplification Pipeline (MLSP) Shared Task @ 19th Workshop on Innovative Use of NLP for Building Educational Applications
AISC 2024   12th International Conference on Artificial Intelligence, Soft Computing
CRAC 2024   the Sixth Workshop on Computational Models of Reference, Anaphora and Coreference
DEPLING 2023   International Conference on Dependency Linguistics
KONVENS-ST/T/WS 2024   Call for Shared Task, Workshop and Tutorial Proposals @ KONVENS 2024
SMM4H 2024   The 9th Social Media Mining for Health Research and Applications Workshop and Shared Tasks — Large Language Models (LLMs) and Generalizability for Social Media NLP
TSD 2024   Twenty-seventh International Conference on Text, Speech and Dialogue
IberLEF 2024   Call for Task Proposals - IberLEF 2024