posted by organizer: gfursin || 1848 views || tracked by 5 users: [display]

REPRODUCE 2014 : Workshop on Reproducible Research Methodologies


When Feb 15, 2014 - Feb 15, 2014
Where Orlando, Florida, USA
Submission Deadline Jan 8, 2014
Notification Due Jan 23, 2014
Final Version Due Jan 30, 2014
Categories    reproducible research   computer engineering   computer architecture   optimization

Call For Papers



REPRODUCE: Workshop on Reproducible Research Methodologies
February 15, 2014, Orlando, Florida, USA
(co-located with HPCA 2014)


Computer science and engineering research increasingly rely on
numerous methods to explore research breakthroughs, including
empirical and statistical analysis, modeling, and simulation of
complex computer systems. These ad hoc methods are utilized due
to a variety of factors including cost of designing prototypes,
minimal access to state-of-the-art fabrication plants, problem
complexity and size, and return on investment. However, lack of
a common experimental methodology, and lack of simple and
unified mechanisms, tools and repositories to preserve and
exchange the whole experimental setup (including all past
research artifacts) makes it excessively challenging or even
impossible to accurately reproduce experimental results for
evaluation and future advancement.

This workshop is an interdisciplinary forum for academic,
governmental, and industrial researchers, promoters,
practitioners and developers to discuss ideas, experience,
trustable and reproducible research methodologies, practical
techniques, tools and repositories. Detailed topics of interest
include but are not limited to:

* Techniques for experimental reproducibility
* Fidelity validation of experiments and tools
* Reproducible benchmarking methodologies
* Scientific method for computing experiments
* Techniques to effectively leverage emulation
* Scalable HPC computing in experimentation
* Metrics quantifying performance vs. fidelity
* Reproducible and extensible methodologies
* Data-mining, crowdsourcing analysis methods
* Methods of dissemination of results
* Nomenclature and metadata onthology
* Tool, benchmark, experiment repositories
* Visualization and analysis techniques
* Reproducible simulation environments
* Experimental documentation methods
* Techniques to preserve/share experiments
* Methods to effectively analyze experiments
* Extracting metadata from experiments
* Methods for protecting intellectual property
* Education strategies for reproducible science

Submissions are 2-page extended abstracts for ongoing research,
wild and crazy ideas, position statements, demonstration of
tools for reproducible experiments, etc. Submissions should be
made via EasyChair at

Submission Deadline: January 8, 2014
Notification of Acceptance: January 23, 2014
Final Manuscripts Due: January 30, 2014
Workshop Date: February 15, 2014

Authors may be invited to submit to an IEEE Transactions on
Emerging Topics in Computing (TETC) Special Issue on
Reproducible Research Methodologies.

==== Organizers: ==============================================

Alex Jones,
University of Pittsburgh, Pittsburgh, PA, USA

Grigori Fursin,
INRIA, Saclay, France

Daniel Mosse,
University of Pittsburgh, Pittsburgh, PA, USA

Bruce Childers,
University of Pittsburgh, Pittsburgh, PA, USA

Related Resources

JMIER 2019   Rapid Publication & Free - Journal of Mechanical and Industrial Engineering Research
IEEE TETCI 2018   IEEE Transactions on Emerging Topics in Computational Intelligence Special Issue on Computational Intelligence in Data-Driven Optimization
ISMIS 2018   24th International Symposium on Methodologies for Intelligent Systems
IEIJ 2018   Informatics Engineering, an International Journal
P-RECS 2018   First International Workshop On Practical Reproducible Evaluation of Computer Systems
CAIJ 2018   Computer Applications: An International Journal
IICE 2018   Ireland International Conference on Education
ACM--ICSSE--Ei, Scopus 2018   ACM--2018 the International Conference on Software and Services Engineering(ICSSE 2018)--Ei, ISI and Scopus
CP 2018   Twenty-Fourth Conference on Principles and Practice of Constraint Programming
SIMULTECH 2018   8th International Conference on Simulation and Modeling Methodologies, Technologies and Applications