A framework for statistical testing of software components

Shukla, Rakesh, Strooper, Paul and Carrington, David (2007) A framework for statistical testing of software components. International Journal of Software Engineering And Knowledge Engineering, 17 3: 379-405.


Author Shukla, Rakesh
Strooper, Paul
Carrington, David
Title A framework for statistical testing of software components
Journal name International Journal of Software Engineering And Knowledge Engineering   Check publisher's open access policy
ISSN 0218-1940
Publication date 2007-06
Sub-type Article (original research)
DOI 10.1142/S021819400700329X
Volume 17
Issue 3
Start page 379
End page 405
Total pages 27
Editor Chang, S.K.
Place of publication Singapore
Publisher World Scientific Publ Co Pte Ltd
Collection year 2008
Language eng
Subject 280302 Software Engineering
C1
700102 Application tools and system utilities
Abstract Statistical testing involves the testing of software by selecting test cases from a probability distribution that is intended to represent the software's operational usage. In this paper, we describe and evaluate a framework for statistical testing of software components that incorporates test case execution and output evaluation. An operational profile and a test oracle are essential for the statistical testing of software components because they are used for test case generation and output evaluation respectively. An operational profile is a set of input events and their associated probabilities of occurence expected in actual operation. A test oracle is a mechanism that is used to check the results of test cases. We present four types of operational profiles and three types of test oracles, and empirically evaluate them using the framework by applying them to two software components. The results show that while simple operational profiles may be effective for some components, more sophisticated profiles are needed for others. For the components that we tested, the fault-detecting effectiveness of the test oracles was similar.
Keyword Computer Science, Artificial Intelligence
Computer Science, Software Engineering
Engineering, Electrical & Electronic
software components
statistical testing
operational profile
test oracle
Reliability
Partition
Mutation
Q-Index Code C1
Q-Index Status Confirmed Code

 
Versions
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 0 times in Thomson Reuters Web of Science Article
Scopus Citation Count Cited 0 times in Scopus Article
Google Scholar Search Google Scholar
Access Statistics: 144 Abstract Views  -  Detailed Statistics
Created: Mon, 18 Feb 2008, 15:45:08 EST