posted by user: castells || 2704 views || tracked by 7 users: [display]

BARS 2013 : Workshop on Benchmarking Adaptive Retrieval and Recommender Systems


When Aug 1, 2013 - Aug 1, 2013
Where Dublin, Ireland
Submission Deadline Jun 14, 2013
Notification Due Jun 28, 2013
Final Version Due Jul 13, 2013
Categories    evaluation   information retrieval   recommender systems   personalization

Call For Papers

Call for Papers - BARS 2013
International ACM SIGIR Workshop on
Benchmarking Adaptive Retrieval and Recommender Systems
Dublin, Ireland, 1 August 2013

* Submission deadline: 14 June 2013 *

== Motivation ==

In recent years, immense progress has been made in the development of recommendation, retrieval and personalisation techniques. The evaluation of these systems is still based on traditional information retrieval and statistics metrics, e.g. precision, recall and/or RMSE, often not taking the use-case and situation of the system into consideration. However, the rapid evolution of recommender and adaptive IR systems in both their goals and their application domains foster the need for new evaluation methodologies and environments.

The workshop will be followed by a special issue of ACM TiST on Recommender System Benchmarking. Authors of high-quality papers from the workshop will be encouraged to submit extended versions of their work to the journal.

== Submission topics ==

We invite the submission of papers reporting relevant research in the area of benchmarking and evaluation of recommendation and adaptive IR systems. We welcome submissions presenting contributions in this scope, addressing the following topics:

- New metrics and methods for quality estimation of recommender and adaptive IR systems
- Novel frameworks for the user-centric evaluation of adaptive systems
- Validation of off-line methods with online studies
- Comparison of evaluation metrics and methods
- Comparison of recommender and IR approaches across multiple systems and domains
- Measuring technical constraints vs. accuracy
- New datasets for the evaluation of recommender and adaptive IR systems
- Benchmarking frameworks
- Multiple-objective benchmarking

== Submissions ==

We invite the submission of papers reporting original research, studies, advances, or experiences in this area. Two submission types are accepted: long papers of up to 8 pages, and short papers up to 4 pages, in the standard ACM SIG proceedings format. Paper submissions and reviews will be handled electronically.

Each paper will be evaluated by at least two reviewers from the Program Committee. The papers will be evaluated for their originality, contribution significance, soundness, clarity, and overall quality. The interest of contributions will be assessed in terms of technical and scientific findings, contribution to the knowledge and understanding of the problem, methodological advancements, or applicative value.

Submission instructions can be found at

== Important dates ==

Paper submission: June 14, 2013
Notification: June 28th, 2013
Camera ready: July 13th, 2013
Workshop: August 1st, 2013

== Programme Committee ==

M-Dyaa Albakour, University of Glasgow
Leif Azzopardi, University of Glasgow
Alejandro Bellogin, Centrum Wiskunde & Informatica
Nicholas Belkin, Rutgers University
Toine Bogers, Royal School of Library and Information Science
Pia Borlund, Royal School of Library and Information Science
Paolo Cremonesi, Politecnico di Milano
Noriko Kando, National Institute of Informatics, Japan
Alexandros Karatzoglou, Telefonica Research
Bart Knijnenburg, University of California, Irvine
Udo Kruschwitz, University of Essex
Nikos Manouselis, Agro-Know Technologies
Martha Larson, Delft University of Technology
Neal Lathia, University of Cambridge
Ian Ruthven, University of Strathclyde
Domonkos Tikk, Gravity R&D
Ryen White, Microsoft Research
Michelle Zhou, IBM Research

== Organizers ==

Pablo Castells, Universidad Autónoma de Madrid
Frank Hopfgartner, Technische Universität Berlin
Mounia Lalmas, Yahoo! Labs Barcelona
Alan Said, Centrum Wiskunde & Informatica

Contact email:

Related Resources

DLRS 2021   Call for Papers: Topical Issue on Deep Learning for Recommender Systems
ACL-IJCNLP 2021   59t Annual Meeting of the Association for Computational Linguistcs and the 10th International Joint Conference on Natural Language Processing
SIGIR 2021   The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval
SI Algo Bias & Fairness 2020   Special Issue on Algorithmic Bias and Fairness in Search and Recommendation - Information Processing & Management (I.F. 3.892)
UMAP 2020   ACM International Conference on User Modeling, Adaptation and Personalization
IJCSEIT 2020   International Journal of Computer Science, Engineering and Information Technology
Recommender Systems 2020   Data Science for Next-Generation Recommender Systems
IJGCA 2020   International Journal of Grid Computing & Applications
CSTY 2020   6th International Conference on Computer Science and Information Technology
BENCHMARK 2020   PPSN 2020 Workshop - Good Benchmarking Practices for Evolutionary Computation