|
Published Articles >> Table of Contents >> Abstract
Quality Software, Fourth International Conference on (QSIC'04)
pp. 146-153
On the Statistical Properties of the F-measure
Tsong Yueh Chen, Swinburne University of Technology, Australia
Fei-Ching Kuo, Swinburne University of Technology, Australia
Robert Merkel, Swinburne University of Technology, Australia
Full Article Text:
 
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/QSIC.2004.1357955
Send link to a friend
| Abstract |
|
The F-measure - the number of distinct test cases to detect the first program failure - is an effectiveness measure for debug testing strategies. We show that for random testing with replacement, the F-measure will be distributed according to the geometric distribution. A simulation study examines the distribution of two adaptive random testing methods, to study how closely their sampling distributions approximate the geometric distribution, revealing that in the worst case scenario, the sampling distribution for adaptive random testing is very similar to random testing. Our results have provided an answer to a conjecture that adaptive random testing is always a more effective alternative to random testing, with reference to the F-measure. We consider the implications of our findings for previous studies conducted in the area, and make recommendations to future studies.
|
Additional Information
|
Index Terms- F-measure, testing effectiveness metric, quality measurement, adaptive random testing,
random testing, software testing
Citation:
Tsong Yueh Chen, Fei-Ching Kuo, Robert Merkel,
"On the Statistical Properties of the F-measure,"
qsic,
pp. 146-153,
Quality Software, Fourth International Conference on (QSIC'04),
2004
|
|