WSESE@ICSE2018 2018 : 1st International Workshop on Methodological Issues with Empirical Studies involving Human Subjects - An ICSE2018 Workshop
Call For Papers
With the steep increase of empirical studies and the advent of secondary studies (aggregation or meta-study), one main concern raised by recent studies, is the quality of the primary studies (e.g., a single experiment). Concerns about different quality issues have been raised for many years, however, due to the complexity of empirical studies, not all of them seem to be solved. In particular, problems with regard to the appropriate design of experiments and the correct usage of statistical tests are crucial for the trustworthiness of the results. Consequently, we need to better understand the issues and how to mitigate, if not remove them. The workshop focuses on the empirical process, which can be seen as one measure to ensure repeatable quality. It of six consecutive steps: Definition, Design, Implementation, Execution, Analysis, and Reporting. We also address research with regard to methodological issues arising during the execution of the stages of the process. The workshop’s aim is to increase awareness on the importance of the quality and appropriateness of the methods applied during the different stages of empirical studies to get a reliable answer from an empirical study and to disseminate this knowledge to the broader SE community.
Topics of interest include, but are not restricted to:
• Issues with regard to the motivation and definition of appropriate research questions.
• Issues with regard to the operationalization, e.g., missing standard metrics.
• Issues in the selection of appropriate experimental design and its consequences
• Issues in the systematic identification of threats to validity; and how to address them.
• Dealing with perceptions and biases.
• Drawing the appropriate conclusions from the findings and their generalization.
• Issues with replication, families of studies and their aggregation.
• Issues with quantitative, qualitative approaches and combined approaches.
Experience reports (8 pages max) describe the experience with conducting studies over a period of time and lessons learned that would be useful to be added to the methodological body of knowledge.
Technical papers (8 pages max) describe either studies conducted highlighting concrete results and the way they were designed and conducted to overcome challenges. Also expected in these papers are comparisons of the advances made against the state-of-the-art.
Vision / Position papers (4 pages max) are expected to describe new directions to follow in conducting empirical studies. Convincing arguments supported by clear rationale need to be included.
Papers must describe original work not submitted or presented at other forums. Accepted papers will be published in ICSE workshop proceedings. The official publication date of the workshop proceedings is the date the ICSE proceedings are made available in the ACM Digital Library. This date may be up to two weeks prior to the first day of ICSE 2018. The official publication date affects the deadline for any patent filings related to published work.
Keynote speaker and invited talks
Keynote by Per Runeson (U Lund) on “Studying the Human Side of Software Engineering”
Invited talks by Natalia Juristo (UP Madrid) and Dieter Rombach (Uni Kaiserslautern).
Submissions via Easychair (https://easychair.org/conferences/?conf=wsese2018). Papers must be formatted according to ICSE 2018 guidelines (cf. http://www.acm.org/publications/proceedings-template).
Andreas Jedlitschka – Fraunhofer IESE, Germany
Laurie Williams – North Carolina State University, NC, US
Workshops Advisory Board
Natalia Juristo, Univ. Politec. Madrid, Spain
Dieter Rombach, Univ. of Kaiserslautern, Germany
Guilherme H. Travassos, COPPE/UFRJ, Brazil
Claes Wohlin, BTH, Sweden
Abrahão Silvia, Uni. Politec. de Valencia, Spain
Avgeriou Paris, Univ. of Gronningen, The Netherlands
Baldassarre Maria Teresa, Univ. of Bari, Italy
Carver Jeffery, Univ. of Alabahma, US
Daneva Maya, Univ. of Twente, The Netherlands
Franch Xavier, Technical Univ. of Catalunya, Spain
Genero Marcela, Univ. of Castilla-La Mancha, Spain
Heldal Rogardt, Chalmers Univ. of Tech., Sweden
Izuireta Clem, Montana State Univ., US
Jørgensen Magne, Simula Research Labs, Norway
Kalinowski Marcos, PUC-Rio, Brazil
Lassenius Caspar, Aalto Univ., Finland
Männistö Tomi, Univ. of Helsinki, Finland
Mendez Fernandez Daniel, Tech. Univ. Munich, Germany
Pfahl Dietmar, Univ. of Tartu, Estonia
Russo Barbara, Free Univ. of Bolzano-Bozen, Italy
Seaman Carolyn, Univ. of Maryland-Baltimore County, US
Sjøberg Dag, Univ. of Oslo, Norway
Sira Vegas, UP Madrid, Spain
Wagner Stefan, Univ. of Stuttgart, Germany
Experience reports 8 pages
Technical papers 8 pages
Vision / Position papers 4 pages
Submission of papers: February 05, 2018
Notification: March 05, 2018
Camera-ready: March 19, 2018
Workshop: May 29, 2018