posted by user: bairdali || 2388 views || tracked by 2 users: [display]

MuSe 2021 2021 : The 2nd International Multimodal Sentiment Analysis in Real-life Media Challenge and Workshop @ ACM Multimedia 2021, October 2021, Chengdu, China


When Oct 20, 2021 - Oct 24, 2021
Where Chengdu, China
Submission Deadline Aug 5, 2021
Notification Due Aug 26, 2021
Final Version Due Sep 2, 2021
Categories    affective computing   machine learning   sentiment analysis

Call For Papers

MuSe 2021 focuses on multimodal sentiment/ emotion recognition of user-generated content and in stress-induced situations: This year, we focus on audio-visual and textual, as well as biological signals (inc. heart rate and galvanic skin response).

1. Multimodal Continuous Emotions in-the-Wild Sub-challenge (MuSe-Wilder)
Predicting the level of emotional dimensions (arousal, valence) in a time-continuous manner from audio-visual recordings.
2. Multimodal Sentiment Sub-challenge (MuSe-Sent)
Predicting advanced intensity classes of emotions based on valence and arousal for segments of audio-visual recordings.
3. Multimodal Emotional Stress Sub-challenge (MuSe-Stress)
Predicting the level of emotional arousal and valence in a time-continuous manner from audio-visual recordings.
4. Multimodal Physiological-Arousal Sub-challenge (MuSe-Physio)
Predicting the level of psycho-physiological arousal from a) human annotations fused with b) galvanic skin response (also known as Electrodermal Activity (EDA)) signals from the stressed people as a regression task. Audio-visual recordings, as well as other biological signals (heart rate and respiration), are offered for modelling.

== Datasets ==
- MuSe-CaR: The MuSe-Wilder and MuSe-Sent sub-challenges use the MuSe-CAR database. It is a large (~40h), a multimodal dataset that has been gathered in-the-wild with the intention of further understanding Multimodal Sentiment Analysis, e.g., the emotional engagement that takes place during product reviews (i.e., automobile reviews) where sentiment is linked to a topic or entity.
- Ulm-TSST: For MuSe-Physio and MuSe-Stress, the novel Ulm-TSST database provides a multimodal dataset of emotion and mental well-being. It includes biological recordings, such as Electrocardiogram (ECG), Electrodermal Activity (EDA), Respiration, and Heart Rate (BPM) as well as continuous arousal and valence annotations. With 105 participants aged between 18 and 39 years, a total of 10 hours were accumulated.
The test set labels are held back by the organizers for evaluation.

== Features ==
Besides the raw data, video (Facial Action Units, VGGFace, Xception), audio (VGGish, EGeMAPS, DeepSpectrum), and text (BERT) features are provided.

== How to Participate ==
Instructions are available at
Data, features and baseline model (code, weights) are available and described in a preliminary paper.

== Organisers ==
Björn W. Schuller (Imperial College London/ audEERING, UK)
Eva-Maria Meßner (University of Ulm, GER)
Erik Cambria (Nanyang Technological University/ SenticNet, SG)
Guoying Zhao (University of Oulu)
Lukas Stappen (University of Augsburg/ BMW Group, GER)

Related Resources

MuSe 2024   The 5th International Multimodal Sentiment Analysis Challenge and Workshop
ICMLA 2024   23rd International Conference on Machine Learning and Applications
NLE Special Issue 2024   Natural Language Engineering- Special issue on NLP Approaches for Computational Analysis of Social Media Texts for Online Well-being and Social Order
Ei/Scopus-AACIP 2024   2024 2nd Asia Conference on Algorithms, Computing and Image Processing (AACIP 2024)-EI Compendex
DARLI-AP 2024   8th International Workshop on Data Analytics Solutions for Real-Life Applications
ICDM 2024   IEEE International Conference on Data Mining
ICIEM 2024   5th International Conference on Intelligent Engineering and Management
IEEE-Ei/Scopus-SGGEA 2024   2024 Asia Conference on Smart Grid, Green Energy and Applications (SGGEA 2024) -EI Compendex
AASDS 2024   Special Issue on Applications and Analysis of Statistics and Data Science
DSIT 2024   2024 7th International Conference on Data Science and Information Technology (DSIT 2024)