Code Quality Evaluation Methodology
CODE QUALITY EVALUATION METHODOLOGY
USING THE ISO/IEC 9126 STANDARD
Yiannis Kanellopoulos1, Panos Antonellis2, Dimitris Antoniou2, Christos
Makris2, Vangelis Theodoridis2, Christos Tjortjis3,4, and Nikos Tsirakis2
1
Software Improvement Group, Amsterdam, the Netherlands
y.kanellopoulos@sig.nl
2
Dept. of Computer Engineering and Informatics, University Of Patras, Greece
{adonel,antonid,makri,theodori,tsirakis}@ceid.upatras.gr
3
Dept. of Engineering Informatics and Telecoms, University of W. Macedonia, Greece
4
Dept. of Computer Science, University of Ioannina, Greece
Christos.Tjortjis@manchester.ac.uk
ABSTRACT
This work proposes a methodology for source code quality and static behaviour evaluation of a software system, based on the standard ISO/IEC-9126. It uses elements automatically derived from source code enhanced with expert knowledge, in the form of quality characteristic rankings, allowing software engineers to assign weights to source code attributes. It is flexible in terms of the set of metrics and source code attributes employed, even in terms of the ISO/IEC-9126 characteristics to be assessed. We applied the methodology to two case studies, involving five open source and one proprietary system.
Results demonstrated that the methodology can capture software quality trends and express expert perceptions concerning system quality in a quantitative and systematic manner.
KEYWORDS
Software Quality Management, Static Analysis, Software Metrics, ISO/IEC 9126
1. I
TRODUCTIO
Software systems are large, complex and beset with maintenance problems, whilst users expect high quality and consistent behaviour [1]. However it is hard to assess and assure quality. The
ISO/IEC 9126 standard has been developed in order to address software quality issues [2], [3],
[4], [5]. It specifies software product quality characteristics and sub-characteristics and proposes metrics for their evaluation. Its main property is that it
USING THE ISO/IEC 9126 STANDARD
Yiannis Kanellopoulos1, Panos Antonellis2, Dimitris Antoniou2, Christos
Makris2, Vangelis Theodoridis2, Christos Tjortjis3,4, and Nikos Tsirakis2
1
Software Improvement Group, Amsterdam, the Netherlands
y.kanellopoulos@sig.nl
2
Dept. of Computer Engineering and Informatics, University Of Patras, Greece
{adonel,antonid,makri,theodori,tsirakis}@ceid.upatras.gr
3
Dept. of Engineering Informatics and Telecoms, University of W. Macedonia, Greece
4
Dept. of Computer Science, University of Ioannina, Greece
Christos.Tjortjis@manchester.ac.uk
ABSTRACT
This work proposes a methodology for source code quality and static behaviour evaluation of a software system, based on the standard ISO/IEC-9126. It uses elements automatically derived from source code enhanced with expert knowledge, in the form of quality characteristic rankings, allowing software engineers to assign weights to source code attributes. It is flexible in terms of the set of metrics and source code attributes employed, even in terms of the ISO/IEC-9126 characteristics to be assessed. We applied the methodology to two case studies, involving five open source and one proprietary system.
Results demonstrated that the methodology can capture software quality trends and express expert perceptions concerning system quality in a quantitative and systematic manner.
KEYWORDS
Software Quality Management, Static Analysis, Software Metrics, ISO/IEC 9126
1. I
TRODUCTIO
Software systems are large, complex and beset with maintenance problems, whilst users expect high quality and consistent behaviour [1]. However it is hard to assess and assure quality. The
ISO/IEC 9126 standard has been developed in order to address software quality issues [2], [3],
[4], [5]. It specifies software product quality characteristics and sub-characteristics and proposes metrics for their evaluation. Its main property is that it