posted by user: aggarwalpiush || 460 views || tracked by 2 users: [display]

LIMO2024@KONVENS 2024 : 2nd workshop on Linguistic Insights from and for Multimodal Language Processing @KONVENS 2024


When Sep 13, 2024 - Sep 13, 2024
Where Vienna, Austria
Submission Deadline Jun 14, 2024
Notification Due Aug 2, 2024
Final Version Due Aug 12, 2024
Categories    linguistic insights   multimodal   natural language processing   computational linguistics

Call For Papers

Processing multimodal information (like visual representations of the environment, auditory cues, images, gestures, gaze etc.) and integrating them is a constant and effortless process in human language processing. Recent progress in the area of language & vision, large-scale visually grounded language models, and multimodal learning (e.g. CLIP (Radford et al., 2021), VILBERT (Lu et al., 2019) etc,) have led to breakthroughs in challenging multimodal NLP applications like image–text retrieval, image captioning (Cornia et al., 2020) or visual question answering (Antol et al., 2015). Yet, modeling the semantics and pragmatics of situated language understanding and generation and, generally, language processing beyond the linguistic context, i.e. in combination with multiple other modalities, is still one of the biggest challenges in NLP and Computational Linguistics (Bisk et al., 2020).

Recent efforts in understanding complex multimodal phenomena in language and dialogue have explored a variety of aspects of multimodality and produced a substantial amount of valuable multimodal datasets and models that include various types of text (from short and informal social media comments to more formal news, instructions/manuals and legal documents, they are also usually accompanied by an image, meme, animation or video) and dialogue (from reference games, instruction dialogues to fully situated interaction with agents and robots). The variety in this wide problem space and the downstream tasks also require variety in the approaches to tackle them. As a result, Multimodal Language Processing is approached by many different sub-areas of Computational Linguistics and NLP---in computational semantics and pragmatics, dialogue modeling, language modeling, and grounding, multimodal and crossmodal learning, and beyond, including physical or robotic actions.

While there have been recent venues and workshops targeting multimodal representation learning and large-scale Language and Vision models, there is a lack of discussion in the community that focuses on linguistic multimodal phenomena, domain- and task-specific analyses of multimodality and, generally, contributions of computational linguistics to multimodal learning and vice versa (Parcalabescu, et. al 2022). With this workshop, we aim to bring together researchers who work on various linguistic aspects of multimodal language processing to discuss and share the recent advances in this interdisciplinary field.

The main goals of this workshop are to

Discuss various tasks, phenomena, models, and problems in multimodal language processing

Discuss how insights from (computational) linguistics can inform multimodal learning and modeling

Facilitate networking and encourage collaboration between researchers working on different aspects of multimodality in computational linguistics and language processing

Important Dates
Submission deadline: 14 June 2024

Author notification: 2 August 2024

Camera ready: 12 August 2024

Workshop: 13 September 2024

Note: All deadlines are 11:59PM UTC-12:00 ("anywhere on Earth")

Organising Committee
Piush Aggarwal, FernUniversität in Hagen,

Özge Alaçam, Universität Bielefeld,

Carina Silberer, Universität Stuttgart,

Sina Zarrieß, Universität Bielefeld,

Torsten Zesch, FernUniversität in Hagen,

Related Resources

Ei/Scopus-AACIP 2024   2024 2nd Asia Conference on Algorithms, Computing and Image Processing (AACIP 2024)-EI Compendex
ECNLPIR 2024   2024 European Conference on Natural Language Processing and Information Retrieval (ECNLPIR 2024)
SPIE-Ei/Scopus-ITNLP 2024   2024 4th International Conference on Information Technology and Natural Language Processing (ITNLP 2024) -EI Compendex
ISEEIE 2024   2024 4th International Symposium on Electrical, Electronics and Information Engineering (ISEEIE 2024)
MLNLP 2024   2024 7th International Conference on Machine Learning and Natural Language Processing (MLNLP 2024)
CTCNet 2024   2024 Asia Pacific Conference on Computing Technologies, Communications and Networking (CTCNet 2024)
Ei/Scopus-SPCVA 2024   2024 2nd Asia Conference on Signal Processing, Computer Vision and Applications (SPCVA 2024) - EI Compendex
FRUCT 2024   36th IEEE FRUCT conference
NLCA 2024   5th International Conference on Natural Language Computing Advances
Insights 2024   Fifth Workshop on Insights from Negative Results in NLP