posted by user: grupocole || 1033 views || tracked by 3 users: [display]

NLPerspectives 2024 : The 3rd Workshop on Perspectivist Approaches to NLP


When May 21, 2024 - May 21, 2024
Where Torino (Italy)
Submission Deadline Feb 23, 2024
Notification Due Mar 29, 2024
Final Version Due Apr 12, 2024
Categories    NLP   computational linguistics   artificial intelligence

Call For Papers

NLPerspectives: The 3rd Workshop on Perspectivist Approaches to NLP


Until recently, the dominant paradigm in natural language processing (and other areas of artificial intelligence) has been to resolve observed label disagreement into a single “ground truth” or “gold standard” via aggregation, adjudication, or statistical means. However, in recent years, the field has increasingly focused on subjective tasks, such as abuse detection or quality estimation, in which multiple points of view may be equally valid, and a unique ‘ground truth’ label may not exist (Plank, 2022). At the same time, as concerns have been raised about bias and fairness in AI, it has become increasingly apparent that an approach which assumes a single “ground truth” can erase minority voices.

Strong perspectivism in NLP (Cabitza et al., 2023) pursues the spirit of recent initiatives such as Data Statements (Bender and Friedman, 2018), extending their scope to the full NLP pipeline, including the aspects related to modelling, evaluation and explanation.

In line with the first and second editions, the third NLPerspectives (Perspectivist Approaches to Disagreement in NLP) workshop will explore current and ongoing work on: the collection and labelling of non-aggregated datasets; and approaches to modelling and including these perspectives in NLP pipelines, as well as evaluation and applications of multi-perspective Machine Learning models. We also welcome opinion pieces and literature reviews, e.g., fairness and inclusion in a perspectivist framework.

Following our previous workshops, a key outcome of the third edition will be to continue the work begun at to create a repository of perspectivist datasets with non-aggregated labels for use by researchers in perspectivist NLP modelling.

Authors are, therefore, invited to share their LRs (data, tools, services, etc.) and provide essential information about resources (i.e., also technologies, standards, evaluation kits, etc.) that have been used for the work or are a result of their research. In addition, authors will be required to adhere to ethical research policies on AI and may include an ethics statement in their papers.

The NLPerspectives workshop will be co-located with the 14th edition of LREC-COLING 2024 in Torino, Italy, in May 20-25, 2024.


The papers should be submitted as a PDF document, conforming to the formatting guidelines provided in the call for papers of LREC-COLING conference: authors-kit

We accept three types of submissions:

Regular research papers;

Non-archival submissions: like research papers, but will not be included in the proceedings;

Research communications: 4-page abstracts summarising relevant research published elsewhere.

Research papers (archival or non-archival) may consist of up to 8 pages of content. Research communications may consist of up to 4 pages of content. More details will be up soon.


We invite original research papers from a wide range of topics, including but not limited to:

Non-aggregated data collection and annotation frameworks

Descriptions of corpora collected under the perspectivist paradigm

Multi-perspective Modelling and Machine Learning

Evaluation of multi-perspective models/ models of disagreement

Multi-perspective disagreement as applied to NLP evaluation

Fairness and inclusive modelling

Perspectivist approaches for social good

Applications of multi-perspective modelling

Computing with (dis)agreement

Perspectivist Natural Language Generation

Foundational aspects of perspectivism

Opinion pieces and reviews on perspectivist approaches to NLP

Submissions are open to all, and are to be submitted anonymously (and must conform to the instructions for double-blind review). All papers will be refereed through a double-blind peer review process by at least three reviewers, with final acceptance decisions made by the workshop organisers. Scientific papers will be evaluated based on relevance, significance of contribution, impact, technical quality, scholarship, and quality of presentation.


At least one author of each accepted paper is required to participate in the conference and present the work.

Important Dates

* Friday February 23, 2024: Paper submission

* Friday March 29, 2024: Notification of acceptance

* Friday April 12, 2024: Camera-ready papers due

* Tuesday May 21, 2024: Workshop

Workshop organisers:

Gavin Abercrombie, Heriot-Watt University

Valerio Basile, University of Turin

Davide Bernardi, Amazon Alexa

Shiran Dudy, Northeastern University

Simona Frenda, University of Turin

Lucy Havens, University of Edinburgh

Sara Tonelli, Fondazione Bruno Kessler

Contact us at if you have any questions.


Related Resources

Ei/Scopus-AACIP 2024   2024 2nd Asia Conference on Algorithms, Computing and Image Processing (AACIP 2024)-EI Compendex
LaCATODA 2024   The Ninth Linguistic and Cognitive Approaches to Dialog Agents
IEEE Big Data - MMAI 2024   IEEE Big Data 2024 Workshop on Multimodal AI
IEEE-Ei/Scopus-ACEPE 2024   2024 IEEE Asia Conference on Advances in Electrical and Power Engineering (ACEPE 2024) -Ei Compendex
NLE Special Issue 2024   Natural Language Engineering- Special issue on NLP Approaches for Computational Analysis of Social Media Texts for Online Well-being and Social Order
Philosophical Approaches to Games and Ga 2024   Call For Papers - Philosophical Approaches to Games and Gamification: Ethical, Aesthetic, Technological and Political Perspectives
IEEE-Ei/Scopus-SGGEA 2024   2024 Asia Conference on Smart Grid, Green Energy and Applications (SGGEA 2024) -EI Compendex
Dialogical Approaches to the Sphere ‘in 2024   Call For Papers - Dialogical Approaches to the Sphere ‘in-between’ Self and Other: The Methodological Meaning of Listening
NovelIQA 2024   Novel Approaches to Image Quality Assessment
AISC 2024   12th International Conference on Artificial Intelligence, Soft Computing