posted by user: sadegh_rk || 1543 views || tracked by 2 users: [display]

RRRR 2022 : Workshop on Reproducibility and Replication of Research Results

FacebookTwitterLinkedInGoogle

Link: https://qcomp.org/rrrr/2022/
 
When Apr 2, 2022 - Apr 2, 2022
Where Munich, Germany
Submission Deadline Feb 1, 2022
Notification Due Mar 1, 2022
Final Version Due Mar 10, 2022
Categories    formal methods   verification   test   software
 

Call For Papers

The First Workshop on Reproducibility and Replication of Research Results (RRRR 2022) is part of ETAPS 2022 in Munich, Germany. It provides a forum to present novel approaches to foster reproducibility of research results, and replication studies of existing work, in the broad area of formal methods research. Its goal is to spread the word on best practices, and reward the work invested in replicating results.

Where reproducible research can be independently confirmed by third parties using artifacts provided by the original authors, replicating a result means to independently obtain it using new measurements, data, or implementations. RRRR will improve the knowledge transfer between the many separate initiatives – like artifact evaluations and tool competitions – that today support reproducibility, and provide a venue to formally publish replication studies, recognising their immense benefit to the scientific community and the hard work involved.
Submissions

RRRR invites submissions in two topics and two formats. All accepted submissions will be collected in informal pre-proceedings. Please submit via EasyChair.
Topics

Submissions are encouraged in, but not limited to, two main topics:

* Novel developments in, or retrospective studies on, reproducibility initiatives. These
should go beyond the pure presentation of an initiative, by e.g. scientifically
discussing the context, comparing with other approaches, and/or justifying the
novelty/expected impact of the contribution.
* Replication studies: Reports on successful or failed attempts at replicating earlier
research results. These reports should precisely describe what could and could not be
replicated, fill in gaps in the original publication if necessary, and eventually come
with a reproducibility package (artifact).

Submissions should be related to research in the broad area of formal methods that would be in scope for one of the ETAPS conferences in principle. It is not required that the earlier work that a replication study is based on has been published at ETAPS.
Submission Types

RRRR accepts two types of submissions:

* Extended abstracts (around 2 pages in LNCS style including references). These may
cover work in progress, or work related to RRRR that has recently been published at a
conference or in a journal.
* Short papers (around 6 pages in LNCS style plus references). These should describe
finished, not-yet-published work.

Short papers will undergo a full reviewing process by at least three PC members. Extended abstracts will be selected by the organisers. We encourage, but do not require, short papers to be accompanied by an artifact for reproduction. Authors of accepted submissions will present their work at the workshop, with equal treatment of extended abstracts and short papers. We encourage demonstrations to be integrated in presentations, in particular for replication studies.
Special Issue in STTT

Authors of accepted short papers will be invited to submit an extended version to a special issue in the International Journal on Software Tools for Technology Transfer (STTT). We expect these extended versions to be accompanied by an artifact for reproduction that will be permanently archived with a DOI upon publication of the journal paper.

Related Resources

HiPEAC SC 2024   HiPEAC Reproducibility Student Challenge
SOEN 2024   9th International Conference on Software Engineering
CPAIOR 2024   International Conference on the Integration of Constraint Programming, Artificial Intelligence, and Operations Research
SOFT 2024   10th International Conference on Software Engineering
Insights 2024   Fifth Workshop on Insights from Negative Results in NLP
FM 2024   Formal Methods
ICAIR 2024   4th International Conference on AI Research (formally the European Conference on the Impact of Artificial Intelligence and Robotics)
SOFT 2024   10th International Conference on Software Engineering
International Conference on Health 2024   Fourteenth International Conference on Health, Wellness & Society- Health, Wellness, and Society Research Network and Malmö University, Malmö, Sweden
SMM4H 2024   The 9th Social Media Mining for Health Research and Applications Workshop and Shared Tasks — Large Language Models (LLMs) and Generalizability for Social Media NLP