posted by user: stenialo || 15086 views || tracked by 2 users: [display]

ARDUOUS 2021 : 5th International Workshop on Annotation of useR Data for UbiquitOUs Systems


When Mar 22, 2021 - Mar 26, 2021
Where Kassel, Germany
Submission Deadline Nov 9, 2020
Notification Due Jan 5, 2021
Final Version Due Jan 30, 2021
Categories    artificial intelligence   ubiquitous computing   data science   annotation

Call For Papers

ARDUOUS: 5th International Workshop on Annotation of useR Data for UbiquitOUs Systems

Call for papers

- Affiliated to IEEE PerCom 2021
- March 22-26, 2021 (day to be confirmed)
- Kassel, Germany

Labelling user data is a central part of the design and evaluation of pervasive systems that aim to support the user through situation-aware reasoning. It is essential both in designing and training the system to recognise and reason about the situation, either through the definition of a suitable situation model in knowledge-driven applications, or though the preparation of training data for learning tasks in data-driven models. Hence, the quality of annotations can have a significant impact on the performance of the derived systems. Labelling is also vital for validating and quantifying the performance of applications. With pervasive systems relying increasingly on large datasets for designing and testing models of users’ activities, the process of data labelling is becoming a major concern for the community. Even more, with the increase of pervasive applications relying on annotated data, it becomes important to develop standards and normalisation methodologies for transferability of annotated data across different applications.

To address the problem, this year’s workshop focuses on methods for standardisation and normalisation in annotation practices and possible roadmaps and good practices in addressing the associated challenges.

Furthermore, we aim to address the general problems of

1) the role and impact of annotations in designing pervasive applications,
2) the process of labelling, and the requirements to produce high quality annotations for diverse settings and tasks,
3) innovative tools, interfaces and automated methods for annotating user data.

The goal of the workshop is to bring these topics to the attention of researchers from interdisciplinary backgrounds, and to initiate a reflection on possible resolutions of the related problems.

We invite you to submit papers with a maximum of 6 pages that offer new empirical or theoretical insights on the challenges and innovative solutions associated with labelling of user data, as well as on the impact that labelling choices have on the user and the developed system. The topics of interest include, but are not limited to:

- methods and intelligent tools for annotating user data for pervasive systems;
- methods for standardisation and normalisation in annotation practices;
- influence of interface on annotation;
- processes of and best practices in annotating user data;
- methods towards automation of the annotation process;
- improving and evaluating the quality of annotations;
- ethical and privacy issues concerning the annotation of user data;
- beyond the labels: ontologies for semantic annotation of user data;
- high-quality and re-usable annotation for publicly available datasets;
- impact of annotation on a ubiquitous and intelligent system’s performance;
- building classifier models that are capable of dealing with multiple (noisy) annotations and/or making use of taxonomies/ontologies;
- the potential value of incorporating modelling of the annotators into predictive models.

Maximum of 6 pages including references, formatted in accordance with the IEEE Computer Society author guidelines. The IEEE LaTeX and Microsoft Word templates, as well as related information, can be found at the IEEE Computer Society website ( All papers included in the PerCom 2021 Workshops will appear in the conference proceedings published by IEEE.

Through the EDAS submission system (

Review process:
The review process will be double blind.

There will be no separate workshop registration, but one single registration will cover both conference and workshop participation. At least one author of each accepted paper must register for the workshop and for at least one day of the conference.

- Kristina Yordanova, University of Rostock, Germany
- Emma Tonkin, University of Bristol, UK
- Teodor Stoev, University of Rostock, Germany

Important dates:

Submission deadline: 9 November 2020
Notification of acceptance: 5 January 2021
Camera ready version: 30 January 2021 (TBC)
Workshop: March 2021 (TBC)

For further information regarding the workshop and paper submission, please visit our webpage ( or contact Kristina Yordanova at, Emma Tonkin at or Teodor Stoev at

Follow us on Facebook ( or ResearchGate (

Related Resources

MDIS 2024   International Conference on Modelling and Development of Intelligent Systems
JCICE 2024   2024 International Joint Conference on Information and Communication Engineering(JCICE 2024)
ICIIP 2024   2024 13th International Conference on Intelligent Information Processing (ICIIP 2024)
ICDM 2024   24th Industrial Conference on Data Mining
ISD 2024   The 32nd International Conference on Information Systems Development
ICANN 2024   33rd International Conference on Artificial Neural Networks
ARDUOUS 2023   7th International Workshop on Annotation of useR Data for UbiquitOUs Systems
CCVPR 2024   2024 International Joint Conference on Computer Vision and Pattern Recognition (CCVPR 2024)
CoMSE 2024   2024 3rd Conference on Materials Science and Engineering (CoMSE 2024)
IUI 2024   ACM Conference on Intelligent User Interfaces