posted by user: francescabonin || 1980 views || tracked by 4 users: [display]

Special Issue - JMUI 2013 : From Multimodal Analysis to Real-Time Interactions with Virtual Agents - Special Issue Journal on Multimodal User Interfaces (JMUI)


When N/A
Where N/A
Submission Deadline Apr 7, 2013
Notification Due Jun 7, 2013
Final Version Due Sep 7, 2013

Call For Papers

(Apologies for multiple reminders)


***************Extended Deadline for paper submission: April 7, 2013******************************

Special Issue
From Multimodal Analysis to Real-Time Interactions with Virtual Agents

Guest editors:
Ronald Böck, Otto von Guericke University Magdeburg, Germany (
Francesca Bonin, Trinity College Dublin, Ireland (
Nick Campbell, Trinity College Dublin, Ireland
Jens Edlund, KTH Stockholm, Sweden
Iwan de Kok, University of Twente, The Netherlands (
Ronald Poppe, University of Twente, The Netherlands (
David Traum, USC Institute for Creative Technologies, USA

One of the aims in building multimodal user interfaces is to make the interaction between user and system as natural as possible. Possibly the most natural form of interaction we know is the way we interact with other humans. By building any kind of virtual agents, we aim to recreate this natural form of interaction in human machine interaction.

Development of virtual agent systems that are capable of recreating natural interactions with humans typically involves several steps: record and analyze natural interaction data, extract and recognize relevant multimodal features, craft or learn models from these features, generate the appropriate behavior in real-time based on these models and evaluate the system in a methodologically sound experiment. Each of these steps presents challenges.

The collection of multimodal natural corpora brings the challenges of collecting naturalistic behavior, enhancing the corpus with reliable ground truth annotations and dealing with the inter-personal differences in behavior.

Through multimodal analysis of the corpus, features that need to be extracted in real-time from the recording signals need to be identified. Such features include, but are not limited to, speech and its content, eye gaze, prosodic and paralinguistic features, facial expressions, body movements, or more advanced interpretations of such features such as the affective state, personality, mood or intentions of the user.

By combining these multimodal features and interpretations, the agent needs to reason about, plan and realize the actions it needs to perform in response with the correct timing. These responses include content and paralinguistic features of the speech, appropriate accompanying gestures and facial expressions. Continuous perception, interpretation, reasoning and generation is required to keep the interaction between the user and the virtual agent as natural and fluent as human-human interaction.

The development and evaluation of such complex real-time continuous virtual agent systems also requires new research methodologies in terms of experiment design. Many aspects can influence the evaluation of the system as a whole and individual aspects of the system may require continuous evaluation as well.

For this special issue, we welcome technical, empirical and overview papers that contribute towards the development, evaluation and understanding of real-time interactions with virtual agents.
Topics include:
• Multimodal analysis and annotation of human-human corpora
• Real-time perception and understanding of speech, facial expression and gestures
• Estimation of user affect, mood and personality
• Models for multimodal generation of speech, facial expressions and body movement
• Real-time dialog management
• Real-time interactions with humanoid robots
• Applications of real-time interactions between humans and virtual agents
• Tools, systems and evaluation methods for above
• Comparison of human-human and human-agent interactions

Submission deadline: April 7, 2013 (23.59 UTC-11)
Notification of acceptance: June 7, 2013
Final paper submission: September 7, 2013, (23.59 UTC-11)
Publication: November 2013

Authors Instructions:
Submissions should be 8-12 pages and must not have been previously published, with the exception that substantial extensions of conference and workshop papers (at least 30% new content) can be considered. The authors will be required to follow the Author’s Guide for manuscript submission to the Journal of Multimodal User Interfaces ( published by Springer.
During the submission process, please select “REAL-TIME special issue” as article type.

Related Resources

SI RT-IoT/CPS on ETT (Wiley) 2018   Special Issue on Real-time Internet of Things (IoT) and Cyber-Physical Systems (CPS) for Transactions on Emerging Telecommunications Technologies
Special Issue IEEE-TLT 2018   CfP Special Issue IEEE-TLT: Data Capture and Analysis to Support Learning Engagement
SCSN 2019   International Workshop on Semantic Computing for Social Networks and Organization Sciences: from user information to social knowledge
Special Issue: IJCA 2018   Special Issue【EI】International Journal of Computers and Applications: Computational Intelligence Technologies for Clinical Decision Support-From Prognosis to Prediction
ISMM 2019   International Symposium on Mathematical Morphology and Its Application to Signal and Image Processing
RTCSA 2018   Embedded and Real-Time Computing Systems and Applications
OSPERT 2018   Operating Systems Platforms for Embedded Real-Time applications
Urb-IoT 2018   Urb-IoT 2018 - 3rd EAI International Conference on IoT in Urban Space
MMVE 2018   International Workshop on Immersive Mixed and Virtual Environment Systems
ERDN 2018   1st Workshop on Efficient Real-time Data Network