The Care and Feeding of Wild-Caught Mutants

This research was conducted by David Bingham Brown, Michael Vaughn, Ben Liblit, and Thomas Reps. The paper appeared in the 25th ACM SIGSOFT 2017 International Symposium on Foundations of Software Engineering (FSE 2017).

Abstract

Mutation testing of a test suite and a program provides a way to measure the quality of the test suite. In essence, mutation testing is a form of sensitivity testing: by running mutated versions of the program against the test suite, mutation testing measures the suite's sensitivity for detecting bugs that a programmer might introduce into the program. This paper introduces a technique to improve mutation testing that we call wild-caught mutants; it provides a method for creating potential faults that are more closely coupled with changes made by actual programmers. This technique allows the mutation tester to have more certainty that the test suite is sensitive to the kind of changes that have been observed to have been made by programmers in real-world cases.

Full Paper

The full paper is available as a single PDF document. A suggested BibTeX citation record is also available.

Supplemental Material

We are pleased to offer the following supplemental material in support of the main paper: