posted by user: cmkumar87 || 7815 views || tracked by 6 users: [display]

CL-SciSumm @SIGIR 2019 : [CfP] CL-SciSumm @SIGIR 2019: 5th Computational Linguistics Scientific Document Summarization Shared Task


When Jun 25, 2019 - Jun 25, 2019
Where Paris, France
Abstract Registration Due Mar 31, 2019
Submission Deadline May 24, 2019
Notification Due May 31, 2019
Final Version Due Jul 7, 2019
Categories    natural language processing   information retrieval   summarization   citation

Call For Papers

You are invited to participate in the 5th Computational Linguistics (CL) Scientific Summarization Shared Task, sponsored by SRI International and Chan-Zuckerberg Initiative (CZI), to be held as part of 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2019) in Paris, France on 25th July 2019. This task follows up on the successful CL-SciSumm 2018 @ SIGIR 2018 and three previous editions. In this task, a training corpus CL research papers are released. Participants are invited to enter their systems in a task-based evaluation on a blind test set.

The CLSciSumm19 corpus is expected to be of interest to a broad community including those working in computational linguistics and natural language processing, text summarization, discourse structure in scholarly discourse, paraphrase, textual entailment and text simplification. The task constitutes automatic scientific paper summarization in the Computational Linguistics (CL) domain. The output summaries will be of two types: faceted summaries of the traditional self-summary (the abstract) and the community summary (the collection of citation sentences ‘citances’). We also propose to group the citances by the facets of the text that they refer to.

This is the 5th edition of the Shared Task, 3rd at SIGIR, following the 2nd edition at JCDL‘16 and a successful Pilot task at TAC ‘14 at NIST, USA.

=== Important Dates ===
Training Set Release: Already Online
Deadline for Registration and Short System Descriptions - March 30, 2019
Test Set Release: Already Online
System Runs Due: May 24, 2019
Preliminary System Reports Due: June 9, 2019
Camera Ready Contributions: July 7, 2019
Participants present at BIRNDL 2019 workshop: July 25, 2019 in Paris, France

=== The CL-SciSumm Corpus ===
The CL-SciSumm corpus is created by randomly sampling documents from the ACL Anthology corpus and selecting their citing papers. Citing paper may include papers from outside the Anthology.

The manually annotated training set of 40 reference papers and citing papers is already available for download and can be used by participants to pilot their systems. Further, this year we have introduced 1000 documents sets that were automatically annotated to be used as training data. This training data was generated following Nomoto,2018.Further, for Task 2 one thousand summaries that were released as part of the SciSummNet (Yasunaga et al., 2019) have been included as human summaries to train on.

The training set of articles is available for download at GitHub ( and can be used by participants to pilot their systems.

The test set (input documents with blind ground truth) of 20 articles is available in

The system outputs from the test set should be submitted to the task organizers, for the collation of the final results to be presented at the workshop.

=== Registration ===
Teams that wish to participate in the CL Shared Task track at BIRNDL 2019 are invited to register on EasyChair with a title and a tentative abstract describing their approach at

Participants are advised to register as soon as possible in order to receive timely access to evaluation resources, including development and testing data. Registration for the task does not commit you to participation - but is helpful to know for planning. All participants who submit system runs are welcome to present their system at the BIRNDL Workshop in the poster session, while the best performing system will be invited to present their paper in the main session. Dissemination of CL-SciSumm work and results other than in the workshop proceedings is welcomed, but the conditions of participation specifically preclude any advertising claims based on these results. Any questions about conference participation may be sent to the organizers mentioned below.

=== Organising Committee ===
- Muthu Kumar Chandrasekaran, SRI International,, (
- Michihiro Yasunaga, Yale, (
- Dayne Freitag, SRI International, (
- Dragomir Radev, Yale, (
- Kokil Jaidka, Nanyang Technological University, (
- Min-Yen Kan, National University of Singapore, (

Related Resources

CL-LLRPHM 2024   Special Issue of the Computational Linguistics journal on Language Learning, Representation, and Processing in Humans and Machines
IEEE Xplore-Ei/Scopus-CSPIT 2023   2023 Asia Conference on Communications, Signal Processing and Information Technology (CSPIT 2023) -EI Compendex
DGfS-CL 2023   Computational Linguistics poster session at the 46th Annual Meeting of the German Linguistic Society
IEEE Xplore-Ei/Scopus-DMCSE 2023   2023 International Conference on Data Mining, Computing and Software Engineering (DMCSE 2023) -EI Compendex
ICICV 2023   5th International Conference on Intelligent Communication Technologies and Virtual Mobile Networks
ISEEIE 2024   2024 4th International Symposium on Electrical, Electronics and Information Engineering (ISEEIE 2024)
SDMPR 2023   2023 Asia Conference on Statistics, Data Mining and Pattern Recognition (SDMPR 2023)
CCCIoT 2024   5th International Conference on Cloud Computing and IoT
NLP 2023   12th International Conference on Natural Language Processing
MathSJ 2023   Applied Mathematics and Sciences: An International Journal