posted by organizer: gfursin || 1459 views || tracked by 5 users: [display]

REPRODUCE 2014 : Workshop on Reproducible Research Methodologies


When Feb 15, 2014 - Feb 15, 2014
Where Orlando, Florida, USA
Submission Deadline Jan 8, 2014
Notification Due Jan 23, 2014
Final Version Due Jan 30, 2014
Categories    reproducible research   computer engineering   computer architecture   optimization

Call For Papers



REPRODUCE: Workshop on Reproducible Research Methodologies
February 15, 2014, Orlando, Florida, USA
(co-located with HPCA 2014)


Computer science and engineering research increasingly rely on
numerous methods to explore research breakthroughs, including
empirical and statistical analysis, modeling, and simulation of
complex computer systems. These ad hoc methods are utilized due
to a variety of factors including cost of designing prototypes,
minimal access to state-of-the-art fabrication plants, problem
complexity and size, and return on investment. However, lack of
a common experimental methodology, and lack of simple and
unified mechanisms, tools and repositories to preserve and
exchange the whole experimental setup (including all past
research artifacts) makes it excessively challenging or even
impossible to accurately reproduce experimental results for
evaluation and future advancement.

This workshop is an interdisciplinary forum for academic,
governmental, and industrial researchers, promoters,
practitioners and developers to discuss ideas, experience,
trustable and reproducible research methodologies, practical
techniques, tools and repositories. Detailed topics of interest
include but are not limited to:

* Techniques for experimental reproducibility
* Fidelity validation of experiments and tools
* Reproducible benchmarking methodologies
* Scientific method for computing experiments
* Techniques to effectively leverage emulation
* Scalable HPC computing in experimentation
* Metrics quantifying performance vs. fidelity
* Reproducible and extensible methodologies
* Data-mining, crowdsourcing analysis methods
* Methods of dissemination of results
* Nomenclature and metadata onthology
* Tool, benchmark, experiment repositories
* Visualization and analysis techniques
* Reproducible simulation environments
* Experimental documentation methods
* Techniques to preserve/share experiments
* Methods to effectively analyze experiments
* Extracting metadata from experiments
* Methods for protecting intellectual property
* Education strategies for reproducible science

Submissions are 2-page extended abstracts for ongoing research,
wild and crazy ideas, position statements, demonstration of
tools for reproducible experiments, etc. Submissions should be
made via EasyChair at

Submission Deadline: January 8, 2014
Notification of Acceptance: January 23, 2014
Final Manuscripts Due: January 30, 2014
Workshop Date: February 15, 2014

Authors may be invited to submit to an IEEE Transactions on
Emerging Topics in Computing (TETC) Special Issue on
Reproducible Research Methodologies.

==== Organizers: ==============================================

Alex Jones,
University of Pittsburgh, Pittsburgh, PA, USA

Grigori Fursin,
INRIA, Saclay, France

Daniel Mosse,
University of Pittsburgh, Pittsburgh, PA, USA

Bruce Childers,
University of Pittsburgh, Pittsburgh, PA, USA

Related Resources

SIGIR 2017   The 40th International ACM SIGIR Conference on Research and Development in Information Retrieval
MathSJ 2016   Applied Mathematics and Sciences: An International Journal
ISMIS 2017   23rd International Symposium on Methodologies for Intelligent Systems
ISCSO 2016   The Sixth International Student Competition in Structural Optimization
CPAIOR 2017   Fourteenth International Conference on Integration of Artificial Intelligence and Operations Research Techniques in Constraint Programming
BigData-FAB 2016   Special Issue on “Big Data and Machine Learning in Finance, Accounting and Business” in Electronic Commerce Research (Springer)
ICSMO 2017   2017 International Conference on System Modeling and Optimization (ICSMO 2017)
EACL SRW 2017   EACL 2017 Student Research Workshop
NFM 2017   The 9th NASA Formal Methods Symposium
ADEIJ 2016   Advances in Engineering: an International Journal