posted by organizer: StephanieGross || 633 views || tracked by 3 users: [display]

GermEval2024 GerMS-Detect 2024 : GermEval2024 Shared Task GerMS-Detect -- Sexism Detection and Annotator Disagreement Prediction in German Online News Fora @Konvens 2024


When Apr 20, 2024 - Sep 10, 2024
Where Online & Vienna
Submission Deadline Jun 25, 2024
Categories    artificial intelligence   machine learning   computational linguistics

Call For Papers


We are pleased to announce the GermEval Shared Task GerMS-Detect on Sexism Detection and Annotator Disagreement Prediction in German Online News Fora collocated with Konvens 2024.

Important Dates

Trial phase: April 20 - April 29, 2024
Development phase: May 1 - June 5, 2024
Competition phase: June 7 - June 25, 2024
Paper submission due: July 1, 2024
Camera ready due: July 20, 2024
Shared Task @KONVENS: 10 September, 2024

Task description

This shared task is not just about the detection of sexism/misogyny in comments posted in (mostly) German language to the comment section of an Austrian online newspaper: many of the texts to be classified contain ambiguous language, very subtle ways to express misogyny or sexism or lack important context. For these reasons, there can be quite some disagreement between annotators on the appropriate label. In many cases, there is no single correct label. For this reason the shared task is not just about correctly predicting a single label chosen from all the labels assigned by human annotators, but about models which can predict the level of disagreement, the range of labels assigned by annotators or the distribution of labels to expect for a specific group of annotators. For details see the Competition Website (


The task is organized by the Austrian Research Institute for Artificial Intelligence (OFAI).

Organizing team:

Brigitte Krenn (brigitte.krenn (AT)
Johann Petrak (johann.petrak (AT)
Stephanie Gross (stephanie.gross (AT)

Related Resources

Ei/Scopus-AACIP 2024   2024 2nd Asia Conference on Algorithms, Computing and Image Processing (AACIP 2024)-EI Compendex
GEM shared task 2024   GEM 2024 multilingual data-to-text and summarization shared task
IEEE-Ei/Scopus-SGGEA 2024   2024 Asia Conference on Smart Grid, Green Energy and Applications (SGGEA 2024) -EI Compendex
MLSP 2024   Multilingual Lexical Simplification Pipeline (MLSP) Shared Task @ 19th Workshop on Innovative Use of NLP for Building Educational Applications
IEEE ICA 2022   The 6th IEEE International Conference on Agents
GenChal@INLG 2024   Generation Challenges 2024
IEEE Big Data - MMAI 2024   IEEE Big Data 2024 Workshop on Multimodal AI (Hybrid)
KONVENS-ST/T/WS 2024   Call for Shared Task, Workshop and Tutorial Proposals @ KONVENS 2024
IberLEF 2024   Call for Task Proposals - IberLEF 2024
ICMLA 2024   23rd International Conference on Machine Learning and Applications