posted by organizer: siddhantagarwal || 2101 views || tracked by 3 users: [display]

PerAnsSumm Shared Task @ CL4Health NAACL 2025 : Shared Task on Perspective-aware Healthcare Answer Summarization at CL4Health Workshop [NAACL 2025]

FacebookTwitterLinkedInGoogle

Link: https://peranssumm.github.io
 
When May 3, 2025 - May 4, 2025
Where Albuquerque, New Mexico
Submission Deadline Feb 1, 2025
Final Version Due Feb 25, 2025
Categories    shared task   natural language processing   clinical nlp
 

Call For Papers

We invite you to participate in the Perspective-Aware Healthcare Answer Summarization (PerAnsSumm) Shared Task, focusing on creating perspective-aware summaries from healthcare community question-answering (CQA) forums.

The results will be presented at the CL4Health Workshop, co-located with the NAACL 2025 conference in Albuquerque, New Mexico. The publication venue for system descriptions will be the proceedings of the CL4Health workshop, also co-published in the ACL anthology.

== TASK DESCRIPTION ==
Healthcare CQA forums provide diverse user perspectives, from personal experiences to factual advice and suggestions. However, traditional summarization approaches often overlook this richness by focusing on a single best-voted answer. The PerAnsSumm shared task seeks to address this gap with two main challenges:

* Task A: Identifying and classifying perspective-specific spans in CQA answers.
* Task B: Generating structured, perspective-specific summaries for the entire question-answer thread.

This task aims to build tools that provide users with concise summaries catering to varied informational needs.

== DATA ==
Participants will be provided with:
* Training and validation datasets, accessible via CodaBench.
* A separate test set for evaluation. (Unseen)
A starter code is also available to make it easier for participants to get started.

== EVALUATION ==
System submissions will be evaluated based on automatic metrics, with a focus on the accuracy and relevance of the summaries. Further details can be found on the task website: https://peranssumm.github.io/
CodaBench Competition Page: https://www.codabench.org/competitions/4312/

== PRIZES ==
* 1st Place: $100
* 2nd Place: $50

== TIMELINE ==
* Second call for participation: 5th December, 2024
* Release of task data (training, validation): 12th November, 2024
* Release of test data: 25th January, 2025
* Results submission deadline: 1st February, 2025
* Release of final results: 5th February, 2025
* System papers due: 25th February, 2025
* Notification of acceptance: 7th March, 2025
* Camera-ready papers due: TBC
* CL4Health Workshop: 3rd or 4th May, 2025

== PUBLICATION ==
We encourage participants to submit a system description paper to the CL4Health Workshop at NAACL 2025. Accepted papers will be included in the workshop proceedings and co-published in the ACL Anthology. All papers will be reviewed by the organizing committee. Upon paper publication, we encourage you to share models, code, fact sheets, extra data, etc., with the community through GitHub or other repositories.

== ORGANIZERS ==
Shweta Yadav, University of Illinois Chicago, USA
Md Shad Akhtar, Indraprastha Institute of Information Technology Delhi, India
Siddhant Agarwal, University of Illinois Chicago, USA

== CONTACT ==
Please join the Google group at https://groups.google.com/g/peranssumm-shared-task-2025 or email us at peranssumm@gmail.com with any questions or clarifications.

Related Resources

CL4Health 2026   Third Workshop on Patient-Oriented Language Processing
Ei/Scopus-DMNLP 2026   2026 3rd International Conference on Data Mining and Natural Language Processing (DMNLP 2026)
Ei/Scopus-DSSE 2026   2026 International Conference on Data Science and Software Engineering (DSSE 2026)
IJITCS 2026   International Journal of Information Technology Convergence and services
NeTCoM 2026   18th International Conference on Networks & Communications
CiVEJ 2026   Civil Engineering and Urban Planning: An International Journal
EMNLP 2026   The 2026 Conference on Empirical Methods in Natural Language Processing
DMA 2026   12th International Conference on Data Mining and Applications
SCDD 2026   4th International Conference on Soft Computing, Data mining and Data Science
SPM 2026   13th International Conference on Signal, Image Processing and Multimedia