posted by user: gfaggioli || 505 views || tracked by 1 users: [display]

QPP++ 2022 : QPP++ 2022: Query Performance Prediction and Its Evaluation in New Tasks

FacebookTwitterLinkedInGoogle

Link: http://qpp2022.dei.unipd.it/
 
When Oct 22, 2022 - Oct 22, 2022
Where Atlanta, Georgia, USA
Submission Deadline Sep 2, 2022
Notification Due Sep 27, 2022
Final Version Due Oct 6, 2022
 

Call For Papers

First call for papers

Query Performance Prediction (QPP) is currently primarily used for ad-hoc retrieval tasks. The Information Retrieval (IR) field is reaching new heights thanks to recent advances in large language models and neural networks, as well as emerging new ways of searching, such as conversational search. Such advancements are quickly spreading to adjacent research areas, including QPP, necessitating a reconsideration of how we perform and evaluate QPP.

Important Dates
---------------------
Submission deadline: September 2, 2022
Notification of acceptance: September 27, 2022
Camera ready: October 06, 2022
Conference days: October 17-21, 2022
Workshop day: October 22, 2022

Call for Papers
-------------------
This workshop aims at stimulating discussion on three main aspects concerning the future of QPP:

What are the emerging QPP challenges posed by new methods and technologies, including but not limited to dense retrieval, contextualized embeddings, and conversational search?
How might these new techniques be used to improve the quality of QPP?
Can we claim that the current techniques for evaluating QPP are effective in all arising scenarios? Can we envision new evaluation protocols capable of granting generalizability in new domains?

We plan to foster the discussion via two focus groups led by the workshop's organizers.

The first focus group will identify what possibilities the QPP offers regarding new research models and IR tasks, primary considerations, issues linked to different aspects of the QPP, and the potentialities provided by new tools.

The second focus group will gather the community’s concerns and solutions with respect to the QPP evaluation, especially for what concerns emerging domains.
Themes and Topics

The workshop will focus on the following themes:
Query performance prediction applied to new tasks:
Can existing QPP techniques be exploited, or which new QPP theories and models need to be devised for new tasks, such as passage-retrieval, Q&A, and conversational search?
Query performance prediction exploiting new techniques:
How can new technologies, such as contextualized embeddings, large language models, and neural networks be exploited to improve QPP?
Evaluation of query performance prediction:
How should QPP techniques be evaluated, including best practices, datasets, and resources, and, in particular, should QPP be evaluated the same for different IR tasks?

It is possible to submit three main categories of manuscripts to the workshop:
Full papers: up to 6 pages.
Short papers: up to 3 pages.
Discussion papers: up to 3 pages.

All manuscripts are expected to address the workshop's themes as mentioned above.
Full and short papers should contain innovative ideas and their experimental evaluation. We are also interested in works containing (methodologically sound) preliminary results and incremental endeavours.
Discussion papers should include work with or without preliminary results, position papers, and papers describing failures. Such papers should foster the discussion and thus are not required to contain full-fledged results. In this sense, the experimental evaluation of the submitted discussion paper is appreciated but not required. We are also interested in receiving contributions regarding (methodologically sound) failed experiments; since the workshop will focus on new research directions, we consider it necessary also to discuss the reasons and causes of failures.
Each manuscript will be peer-reviewed by at least two program committee members
Accepted papers will be published online as a volume of the CEUR-WS proceeding series.

Website
--------------
qpp2022.dei.unipd.it

Organizers
--------------
Guglielmo Faggioli, University of Padova, Italy, faggiolidei.unipd.it
Nicola Ferro, University of Padova, Italy, ferrounipd.it
Josiane Mothe, Université de Toulouse, IRIT, France, josiane.motheirit.fr
Fiana Raiber, Yahoo Research, Israel, fianayahooinc.com

----------
Guglielmo Faggioli
Dipartimento di Ingegneria Informatica, University of Padua
Via Gradenigo 6/b, 35138, Padua, Italy

Related Resources

SIGMETRICS / Performance 2024   2024 ACM SIGMETRICS / IFIP Performance
ISC 2025   ISC High Performance 2025
SUM 2024   16th International Conference on Scalable Uncertainty Management
PESARO 2025   The Fifteenth International Conference on Performance, Safety and Robustness in Complex Systems and Applications
UCC 2024   The IEEE/ACM International Conference on Utility and Cloud Computing
HP3C 2025   2025 9th International Conference on High Performance Compilation, Computing and Communications (HP3C 2025)
HPCCT 2025   2025 the 9th High Performance Computing and Cluster Technologies Conference (HPCCT 2025)--ESCI
HPCCT--ESCI 2025   2025 the 9th High Performance Computing and Cluster Technologies Conference (HPCCT 2025)--ESCI
PREDICTION SOLUTIONS 2024   International Conference on Prediction Solutions for Technical and Societal Systems
ACM ICCDE 2025   ACM--2025 11th International Conference on Computing and Data Engineering (ICCDE 2025)