posted by user: jwozniak || 697 views || tracked by 1 users: [display]

ERROR 2022 : 2nd Workshop on E-science ReseaRch leading tO negative Results


When Oct 11, 2022 - Oct 14, 2022
Where Salt Lake City, Utah
Submission Deadline Jul 22, 2022
Notification Due Aug 8, 2022
Final Version Due Aug 15, 2022
Categories    escience   workflow   error   negative

Call For Papers

Call for papers:
2nd Workshop on
E-science ReseaRch leading tO negative Results (ERROR)
in conjunction with
eScience 2022
Salt Lake City, Utah, USA
October 11-14, 2022

Escience researchers often invest significant time and effort in open-ended projects that can have unexpected outcomes. When results are obtained that do not fit the established molds expected by publishing venues, these results can be lost. The ERROR Workshop invites research results from computing and computational projects that encounter unexpected or negative results that would be difficult to report on elsewhere.

At the present, novel hardware technologies and machine learning approaches (among others) are rapidly changing approaches, methods, and scale applied in escience domains. Researchers must deal with this novelty in multiple dimensions, many of which are beyond their control. Consequently, it is likely that some of the obtained results will not be of the expected form: they are negative (deviating from initial hypothesis), abnormal (anomalous to results from similar studies), or otherwise not useful in the established sense.

Under normal circumstances, such negative results and why they were obtained are seldom discussed, analyzed and published. Useful lessons are thus lost to the scientific community. Yet ignoring such results and the process by which they were obtained poses a risk of repetition. The fact that other researchers likely face the same situations and the same pitfalls further increases the cost of research, a cost that would have been avoided if the negative results were brought forward and discussed in-depth within and across communities.

List topics for the workshop:
- Unforeseen technology/problem/technique misfits
- Institutional policies (on rejected research)
- Failures and obstacles faced during a successful research work
- Controversial results because of undiscovered technical glitch
- Unconventional results which contradict theoretical expectations
- Discovery of better approaches after significant efforts spent on research
- Inadequate or misconfigured infrastructure
- Abnormal and anomalous results
- Ongoing research with setbacks and lessons learned
- A hypothesis with one or more limiting assumptions found to be incorrect
- Discovery of unexpected behavior in hardware, networks or platforms
- Data size that is too big or too small for the applied technique
- Implementation of simulation tools based on incorrect physical observations
- Defect in software design, architecture and/or user interface
- Software and platform incompatibilities
- Zero defect software policy and its implications
- Other topics relevant to the description above

Keynote Speaker

Brian Van Essen, LLNL :

Proceedings Publication

Accepted papers from the workshop will be published as part of eScience 2022 proceedings to be published by the IEEE Computer Society Press, USA and made available online through the IEEE Digital Library.

Workshop Chair
Ketan Maheshwari, Oak Ridge National Laboratory, USA
Contact address:

Steering Committee

Tristan Glatard, Concordia University, Canada
Daniel S. Katz, University of Illinois at Urbana-Champaign, USA
Rafael Ferreira da Silva, Oak Ridge National Laboratory, USA
Justin M. Wozniak, Argonne National Laboratory and University of Chicago, USA

Paper Submission Guidelines

Authors are invited to submit a maximum of 6-page manuscripts describing original and unpublished work surrounding the aforementioned topics. The format of the paper should be of double column text using single spaced 10 point size on 8.5 x 11 inch pages, as per IEEE 8.5 x 11 manuscript guidelines. Templates are available from

Authors should submit a PDF file that will print on a postscript printer to the easychair conference system at

Important dates

Paper submission deadline: July 8, 2022
Paper acceptance notification: August 8, 2022
Camera ready version: August 15, 2022
Workshop day: October 11, 2022

Related Resources

ERROR 2024   4th Workshop on Escience ReseaRch leading tO negative Results
CPAIOR 2024   International Conference on the Integration of Constraint Programming, Artificial Intelligence, and Operations Research
CSTE--EI 2025   2025 The 7th International Conference on Computer Science and Technologies in Education (CSTE 2025)
DIS 2025   The 8th International Conference on the Dynamics of Information Systems
ICIET--EI 2025   2025 13th International Conference on Information and Education Technology (ICIET 2025)
CSTE 2025   2025 The 7th International Conference on Computer Science and Technologies in Education (CSTE 2025)
DSIT 2024   2024 7th International Conference on Data Science and Information Technology (DSIT 2024)
Insights 2024   Fifth Workshop on Insights from Negative Results in NLP
Ei/Scopus-ACAI 2024   2024 7th International Conference on Algorithms, Computing and Artificial Intelligence´╝łACAI 2024´╝ë
TRS 2025   Transportation Research Symposium