Test Case Prioritization for Black Box Testing in Component Based Systems

Only available on StudyMode
  • Download(s) : 186
  • Published : August 12, 2010
Open Document
Text Preview
ABSTRACT

Component based system development offer great flexibility and improvements in large software systems development. Developer of system needs not to start from scratch, but by using Commercial-Off-The-Shelf (COTS) component he can integrate the whole system applying the glue code with component interface. Most of the COTS-components are black box in nature because of source code unavailability, which makes the testing process difficult in development leading to greater testing time and higher cost. Using the test case prioritization technique, we can reduce the cost and time of testing. Most of the test case prioritization techniques proposed in previous works applies source code information as prioritization factors because those are based on OOT technology. In CB-system, it is proved difficult to apply those direct measurement factors for testing. Here, in this paper, I propose test case prioritization technique for component based system. The technique is black box in nature because it incorporates indirect measure of factors, namely; 1) Criticality of the Component (COC) and 2) Fault Proneness of Component (FPcomp). Criticality of the Component is the direct product of Component Dependency Density and Functional Importance of Component. I have proposed “Component Dependency Density (DDcomp) matrix” for the component and it can be measured using Component Dependency Graph. After, prioritization value for each test case can be computed using the “Component Prioritization Value (CPV) matrix”. As a proof of concept I conducted a simulated case study with ATM system and testing process is performed using three different priority schemas. Case study and results prove the usefulness of the technique in reducing cost of testing and improving reliability of system detecting the severe faults at early stage of testing.

Key Words: Component based system, black box testing, Test Case prioritization technique, Criticality of Component, Fault proneness, Component Dependency Density

ACKNOLEDGEMENT

First, I offer my sincerest gratitude to my supervisor, Associate Professor Richard Lai, who has supported me throughout my thesis with his patience and knowledge. In addition, his constant feedback, encouragement, guidance and support at every phase of writing this thesis from the initial to the final level enabled me to develop an in-depth understanding of the research area. Second, I am thankful to Associate Professor Ben Soh, who has encouraged me for this thesis, provided me the guidance in thesis writing and empowered my critical reading and writing skills. Finally, I would like to thank the friendly staff and post graduate students of “Department of Computer Science & Engineering” of La Trobe University for their support and La Trobe University for providing me the opportunity and all the resources to complete my thesis.

KISMAT SOLANKI

TABLE OF CONTENT
ABSTRACT1
ACKNOLEDGEMENT2
LIST OF FIGURES4
LIST OF TABLES5
1.INTRODUCTION6
2.BACKGROUND8
2.1.LIMITATION OF OBJECT ORIENTED TECHNIQUES9
2.2.COMPONENT BASED DEVELOPMENT10
2.3.RELATED WORK12
3.TEST CASE PRIORITIZATION TECHNIQUE AND FACTORS15
3.1.TEST CASE PRIORITIZATION PROBLEM15
3.2.STUDY OF TEST CASE PRIORITIZATION METHODS BASED ON FACTORS APPLIED16
4.COMPLEXITY METRICS FOR COMPONENT BASED SYSTEM21
4.1.INTERACTION METRICS FOR CB- SYSTEM24
5.FAULTPRONENESS: COMPARISON OF METHODS/METRICS27
6.COMPONENT BASED SYSTEM TEST CASE PRIORITIZATION29
6.1.PRIORITIZATION TECHNIQUE FOR BLACKBOX TESTING IN COMPONENT BASED SYSTEM29
6.2.CRITICALITY OF COMPONENT30
6.3.FAULTPRONENESS OF COMPONENT INTERACTION32
7.CASE STUDY34
7.1.SYSTEM UNDER TEST34
7.2.EXPERIMENT SETTING / FACTOR COLLECTION35
7.3.RESULT ANALYSIS40
7.4.THREATS TO VALIDITY44
8.CONCLUSION AND FUTURE WORK45
REFERANCES46
APPENDICES52

LIST OF FIGURES

Figure 1 : Comparison of...
tracking img