posted by organizer: lukas_chr || 1021 views || tracked by 2 users: [display]

MuSe 2023 : The 4th International Multimodal Sentiment Analysis Challenge and Workshop @ ACM Multimedia 2023, Ottawa, Canada


When Oct 29, 2023 - Nov 3, 2023
Where Ottawa, Canda
Submission Deadline Jul 7, 2023
Notification Due Jul 30, 2023
Final Version Due Aug 5, 2023
Categories    affective computing   machine learning   multimedia   artificial intelligence

Call For Papers

The Multimodal Sentiment Analysis Challenge (MuSe) 2023 is dedicated to multimodal sentiment and emotion recognition in different scenarios:

This year's edition features three different sub-challenges:

== Sub-Challenges, Datasets & Features ==

1. Emotional Mimicry Sub-challenge (MuSe-Mimic)
Predicting 3 discrete emotions (Approval, Uncertainty, Disappointment) from videos of mimicked emotional expressions. This sub-challenge utilises the novel Hume-Mimic dataset provided by Hume AI ( It contains over 32 hours of audiovisual recordings of 557 different subjects, including transcripts.

2. Cross-Lingual Humor Detection Sub-challenge (MuSe-Humor)
Predicting the presence of humour in audio-visual recordings of football press conferences. In this sub-challenge, a cross-lingual setting is provided, where the training data comprises German recordings, while the test data is composed of English press conferences. Overall, more than 17 hours of data (audio, video, transcripts) are provided.

3. Personalisation Sub-challenge (MuSe-Personalisation)
Predicting emotional valence and psycho-physiological arousal signals from audio-visual recordings. In order to facilitate personalisation, parts of each test subject's labels are made available. MuSe-Personalisation uses the Ulm-TSST data set that includes audio, video, textual transcriptions and physiological signals (respiratory rate, ECG, BPM).

For the baseline paper see here:

== How to Participate ==
Instructions are available at Data and features are available upon registration. Links to the baseline code and the preliminary baseline paper are also provided on the homepage (

== Organisers ==
Shahin Amiriparian (University of Augsburg, GER)
Lukas Christ (University of Augsburg, GER)
Andreas König (University of Passau, GER)
Alan Cowen (Hume AI, USA)
Eva-Maria Meßner (University of Ulm, GER)
Erik Cambria (Nanyang Technological University/ SenticNet, SG)
Björn W. Schuller (Imperial College London/ audEERING, UK)

Related Resources

JCRAI 2023-Ei Compendex & Scopus 2023   2023 International Joint Conference on Robotics and Artificial Intelligence (JCRAI 2023)
DVU 2023   Deep Video Understanding Grand Challenge, ACM MM 2023
JCICE 2024   2024 International Joint Conference on Information and Communication Engineering(JCICE 2024)
SUMAC 2023   5th ACM International workshop on analysis, understanding and promotion of heritage contents
ICDM 2023   International Conference on Data Mining
IEEE/ACM ASONAM 2023   The 2023 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining
IEEE Xplore-Ei/Scopus-CCCAI 2023   2023 International Conference on Communications, Computing and Artificial Intelligence (CCCAI 2023) -EI Compendex
WASSA 2023   13th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis
ICSE 2024   The IEEE/ACM International Conference on Software Engineering (Second Round)
CFMAI 2023   2023 5th International Conference on Frontiers of Mathematics and Artificial Intelligence (CFMAI 2023)