IWCT 2017 : 6h International Workshop on Combinatorial Testing
Call For Papers
Combinatorial Testing (CT) is a widely applicable generic methodology and technology for software verification and validation, considered a testing best practice. In a combinatorial test plan, all interactions between parameters up to a certain level are covered. For example, in pairwise testing, for every pair of parameters, every pair of values will appear at least once. Studies show that CT is more efficient and effective than random testing. The IWCT2017 is to be held in conjunction with ICST2017 and will focus on *combinatorial testing*. The workshop welcomes academic research submissions, as well as industrial experience reports.
We invite submissions of high-quality papers presenting original work on both theoretical and experimental aspects of combinatorial testing. We accept both full papers (up to 10 pages) and short papers (up to 4 pages).
*New This Year*: We will also have a poster session, for authors to present their work in an informal and interactive setting. We especially encourage submissions from the industry, where work in progress and important conclusions from practical experience is presented.
In particular, we welcome posters focusing on
* experience reports from integration of CT by industrial organizations
* lessons learned from using CT tools in industrial applications
An extended abstract of the poster (up to 2 pages) should be submitted for review by the submission deadline. Accepted poster abstracts will be included in the proceedings.
Topics of interest for full and short papers include, but are not limited to:
*** Combinatorial testing workflow
o Modeling the input space for CT
o Efficient algorithms to generate t-way test suites, especially involving support of constraints
o Determination of expected system behavior for each test case
o Executing CT test suites
o Combinatorial testing based fault localization
o Implementation of CT with existing testing infrastructures
o Handling changes in test requirements
*** Real-world experience in deployment of combinatorial testing
o Empirical studies and feedback from practical applications of CT
o Evaluation and return of investment metrics to assess the degree of usefulness of CT
o Methodology used for test space modeling and determination of interaction coverage requirements
o Discussion of challenges and open problems in the application of CT in industrial settings
*** Applicability of combinatorial testing
o Comparison and combination of CT with other dynamic verification methods
o Investigation of historical records of failures to determine the kind of CT which may have detected faults
o Combinatorial testing for concurrent and real-time systems
o CT for testing cloud computing systems and use of combinatorial methods in cloud architecture
o Application of CT in other domains, e.g. information security, study of gene regulation and other biotechnology applications, mechanical engineering, etc.
o Combinatorial testing of feature models for software product lines
*** Combinatorial and complementing methods
o Combinatorial analysis of existing test suites
o Test plan reduction and completeness
o CT and coverage metrics – combining the two, and studying the relationship between them