2st CALL FOR PARTICIPATION

We are pleased to announce the GermEval Shared Task GerMS-Detect on Sexism Detection and Annotator Disagreement Prediction in German Online News Fora collocated with Konvens 2024.

Important Dates
---------------

Trial phase: April 20 - April 29, 2024
Development phase: May 1 - June 5, 2024
Competition phase: June 7 - June 25, 2024
Paper submission due: July 1, 2024
Camera ready due: July 20, 2024
Shared Task @KONVENS: 10 September, 2024

Task description
----------------

This shared task is not just about the detection of sexism/misogyny in comments posted in (mostly) German language to the comment section of an Austrian online newspaper: many of the texts to be classified contain ambiguous language, very subtle ways to express misogyny or sexism or lack important context. For these reasons, there can be quite some disagreement between annotators on the appropriate label. In many cases, there is no single correct label. For this reason the shared task is not just about correctly predicting a single label chosen from all the labels assigned by human annotators, but about models which can predict the level of disagreement, the range of labels assigned by annotators or the distribution of labels to expect for a specific group of annotators. For details see the Competition Website (https://ofai.github.io/GermEval2024-GerMS/).

Organizers
----------

The task is organized by the Austrian Research Institute for Artificial Intelligence (OFAI).

Organizing team:

Brigitte Krenn (brigitte.krenn (AT) ofai.at)
Johann Petrak (johann.petrak (AT) ofai.at)
Stephanie Gross (stephanie.gross (AT) ofai.at)