posted by organizer: gfursin || 1813 views || tracked by 5 users: [display]

REPRODUCE 2014 : Workshop on Reproducible Research Methodologies


When Feb 15, 2014 - Feb 15, 2014
Where Orlando, Florida, USA
Submission Deadline Jan 8, 2014
Notification Due Jan 23, 2014
Final Version Due Jan 30, 2014
Categories    reproducible research   computer engineering   computer architecture   optimization

Call For Papers



REPRODUCE: Workshop on Reproducible Research Methodologies
February 15, 2014, Orlando, Florida, USA
(co-located with HPCA 2014)


Computer science and engineering research increasingly rely on
numerous methods to explore research breakthroughs, including
empirical and statistical analysis, modeling, and simulation of
complex computer systems. These ad hoc methods are utilized due
to a variety of factors including cost of designing prototypes,
minimal access to state-of-the-art fabrication plants, problem
complexity and size, and return on investment. However, lack of
a common experimental methodology, and lack of simple and
unified mechanisms, tools and repositories to preserve and
exchange the whole experimental setup (including all past
research artifacts) makes it excessively challenging or even
impossible to accurately reproduce experimental results for
evaluation and future advancement.

This workshop is an interdisciplinary forum for academic,
governmental, and industrial researchers, promoters,
practitioners and developers to discuss ideas, experience,
trustable and reproducible research methodologies, practical
techniques, tools and repositories. Detailed topics of interest
include but are not limited to:

* Techniques for experimental reproducibility
* Fidelity validation of experiments and tools
* Reproducible benchmarking methodologies
* Scientific method for computing experiments
* Techniques to effectively leverage emulation
* Scalable HPC computing in experimentation
* Metrics quantifying performance vs. fidelity
* Reproducible and extensible methodologies
* Data-mining, crowdsourcing analysis methods
* Methods of dissemination of results
* Nomenclature and metadata onthology
* Tool, benchmark, experiment repositories
* Visualization and analysis techniques
* Reproducible simulation environments
* Experimental documentation methods
* Techniques to preserve/share experiments
* Methods to effectively analyze experiments
* Extracting metadata from experiments
* Methods for protecting intellectual property
* Education strategies for reproducible science

Submissions are 2-page extended abstracts for ongoing research,
wild and crazy ideas, position statements, demonstration of
tools for reproducible experiments, etc. Submissions should be
made via EasyChair at

Submission Deadline: January 8, 2014
Notification of Acceptance: January 23, 2014
Final Manuscripts Due: January 30, 2014
Workshop Date: February 15, 2014

Authors may be invited to submit to an IEEE Transactions on
Emerging Topics in Computing (TETC) Special Issue on
Reproducible Research Methodologies.

==== Organizers: ==============================================

Alex Jones,
University of Pittsburgh, Pittsburgh, PA, USA

Grigori Fursin,
INRIA, Saclay, France

Daniel Mosse,
University of Pittsburgh, Pittsburgh, PA, USA

Bruce Childers,
University of Pittsburgh, Pittsburgh, PA, USA

Related Resources

ETHE Blearning 2017   Blended learning in higher education: research findings
LOPAL 2018   International Conference on Learning and Optimization Algorithms: Theory and Applications
SIGIR 2018   International ACM SIGIR Conference on Research and Development in Information Retrieval
IEIJ 2017   Informatics Engineering, an International Journal
ISMIS 2017   23rd International Symposium on Methodologies for Intelligent Systems
CAIJ 2017   Computer Applications: An International Journal
eCrime 2018   13th Symposium on Electronic Crime Research
IEEE TETCI 2018   IEEE Transactions on Emerging Topics in Computational Intelligence Special Issue on Computational Intelligence in Data-Driven Optimization
IICE 2018   Ireland International Conference on Education
JMIER 2018   Rapid Publication & Free - Journal of Mechanical and Industrial Engineering Research