posted by user: stenialo || 21003 views || tracked by 3 users: [display]

ARDUOUS 2020 : 4th International Workshop on Annotation of useR Data for UbiquitOUs Systems


When Mar 23, 2020 - Mar 27, 2020
Where Austin, Texas
Submission Deadline Nov 11, 2019
Notification Due Dec 20, 2019
Final Version Due Jan 31, 2020
Categories    annotation   ubiquitous computing   intelligent systems   artificial intelligence

Call For Papers

ARDUOUS: 4th International Workshop on Annotation of useR Data for UbiquitOUs Systems

Call for papers

- Affiliated to IEEE PerCom 2020
- March 23-27, 2020 (day to be confirmed)
- Austin, Texas

Labelling user data is a central part of the design and evaluation of pervasive systems that aim to support the user through situation-aware reasoning. It is essential both in designing and training the system to recognise and reason about the situation, either through the definition of a suitable situation model in knowledge-driven applications, or though the preparation of training data for learning tasks in data-driven models. Hence, the quality of annotations can have a significant impact on the performance of the derived systems. Labelling is also vital for validating and quantifying the performance of applications. With pervasive systems relying increasingly on large datasets for designing and testing models of users’ activities, the process of data labelling is becoming a major concern for the community. This also reflects the increasing need of (semi-)automated annotation tools and knowledge transfer methodologies, which can reduce the manual annotation effort and to improve the annotation performance in large datasets.

To address the problem, this year’s workshop focuses on ethical and privacy challenges associated with providing annotation for pervasive systems. Furthermore, we aim to address the general problems of

1) the role and impact of annotations in designing ubiquitous applications,
2) the process of labelling, and the requirements to produce high quality annotations especially in the context of large datasets, and
3) tools and methods for annotation of data for diverse tasks and settings and such for (semi-)automated annotation of large user datasets and annotation reusability across datasets.

The goal of the workshop is to bring these topics to the attention of researchers from interdisciplinary backgrounds, and to initiate a reflection on possible resolutions of the related problems.

We invite you to submit papers with a maximum of 6 pages that offer new empirical or theoretical insights on the challenges and innovative solutions associated with labelling of user data, as well as on the impact that labeling choices have on the user and the developed system. The topics of interest include, but are not limited to:

• methods and intelligent tools for annotating user data for pervasive systems;
• influence of interface on annotation;
• processes of and best practices in annotating user data;
• methods towards automation of the annotation process;
• improving and evaluating the quality of annotations;
• ethical and privacy issues concerning the annotation of user data;
• beyond the labels: ontologies for semantic annotation of user data;
• high-quality and re-usable annotation for publicly available datasets;
• impact of annotation on a ubiquitous and intelligent system’s performance;
• building classifier models that are capable of dealing with multiple (noisy) annotations and/or making use of taxonomies/ontologies;
• the potential value of incorporating modelling of the annotators into predictive models.

Maximum of 6 pages including references, in IEEE conference format.

Through the EDAS submission system (

Review process:
The review process will be double blind.

At least one author of each accepted paper must register for the workshop and for at least one day of the conference.

• Kristina Yordanova, University of Rostock, Germany
• Emma Tonkin, University of Bristol, UK

Important dates:

Submission deadline: 11 November 2019
Notification of acceptance: 20 December 2019
Camera ready version: 12 January 2020 (TBC)
Workshop: March 2020 (TBC)

For further information regarding the workshop and paper submission, please visit our webpage (https:// or contact Kristina Yordanova at or Emma Tonkin at

Follow us on Facebook ( or ResearchGate (

Related Resources

ARDUOUS 2021   5th International Workshop on Annotation of useR Data for UbiquitOUs Systems
IJCAI 2021   30th International Joint Conference on Artificial Intelligence
ICSRS--Scopus & EI Compendex 2021   2021 5th International Conference on System Reliability and Safety (ICSRS 2021)--Scopus & EI Compendex
ICAART 2021   13th International Conference on Agents and Artificial Intelligence
DLRS 2021   Call for Papers: Topical Issue on Deep Learning for Recommender Systems
StoryCase 2012   ICCBR-12 Workshop on Stories, Episodes, and Cases (StoryCase)
ISAPEP 2021   5th International Workshop on Intelligent Systems for Agriculture Production and Environment Protection
SC4EDS 2021   Special Session on Soft Computing for Evolving Data Streams: Advances in Real-Time Pattern Recognition
Signal 2021   8th International Conference on Signal and Image Processing