usability model

Topics: Usability, Software engineering, Software quality Pages: 34 (9587 words) Published: March 28, 2014
Software Qual J (2006) 14: 159–178
DOI 10.1007/s11219-006-7600-8
Usability measurement and metrics:
A consolidated model
Ahmed Seffah · Mohammad Donyaee · Rex B. Kline ·
Harkirat K. Padda
Springer Science+Business Media, Inc. 2006
Abstract Usability is increasingly recognized as an important quality factor for interactive software systems, including traditional GUIs-style applications, Web sites, and the large variety of mobile and PDA interactive services. Unusable user interfaces are probably the single largest reasons why encompassing interactive systems – computers plus people, fail in actual use. The design of this diversity of applications so that they actually achieve their intended purposes in term of ease of use is not an easy task. Although there are many individual methods for evaluating usability; they are not well integrated into a single conceptual framework that facilitate their usage by developers who are not trained in the filed of HCI. This is true in part because there are now several different standards (e.g., ISO 9241, ISO/IEC 9126, IEEE Std.610.12) or conceptual models (e.g., Metrics for Usability Standards in Computing [MUSiC]) for usability, and not all of these standards or models describe the same operational definitions and measures. This paper first reviews existing usability standards and models while highlighted the limitations and complementarities of the various standards. It then explains how these various models can be unified into a single consolidated, hierarchical model of usability measurement. This consolidated model is called Quality in Use Integrated Measurement (QUIM). Included in the QUIM model are 10 factors each of which corresponds to a specific facet of usability that is identified in an existing standard or model. These 10 factors are decomposed into a total of 26 sub-factors or measurable criteria that are furtherdecomposed into 127 specific metrics. The paper explains also how a consolidated model, such as QUIM, can help in developing a usability measurement theory.

A. Seffah () . M. Donyaee . H. K. Padda
Human-Centered Software Engineering Group, Department of Computer Science and Software Engineering, 1455 De Maisonneuve Blvd. West, Concordia University, Montreu, Quebec, H3G 1M8, Canada
e-mail: {seffah, donyaee padda}
R. B. Kline
Department of Psychology (PY 151-6), Concordia University, 7141 Sherbrooke St. West, Montreal, Quebec, H4B 1R6, Canada
160 Software Qual J (2006) 14: 159–178
Keywords Usability · Measurement · Metrics · Effectiveness · Efficiency · User satisfaction · Software engineering quality models
1. Introduction
Several studies have reported the benefits of a strong commitment to usability in the software development lifecycle (e.g. Mayhew, 1999; Landauer, 1995). Among the observable benefits of usable user interfaces, one can mention human productivity and performance, safety and commercial viability. Usability is important not only to increase the speed and accuracy of the range of tasks carried out by a range of users of a system, but also to ensure the safety of the user (Repetitive Strain Injury etc.). Productivity is also imperative where the software is used to control dangerous processes. Computer magazine software reviews now include ‘usability’ as a ratings category. The success of commercial software may hinge on these reviews, just as the success of any software relies on the attitude of its users. Attitudes can be influenced by abstract factors such as the look and feel of a product, and how the software can be customized by the user (e.g.. colors, fonts, commands).

This explains the increasing numbers of publications in the literature have addressed the problem of how to measure software usability. Several different standards or models for quantifying and assessing usability have been proposed within the Human-Computer Interaction (HCI) and the Software...

References: Ahuja, V. 2000. Building trust in electronic commerce, IT Professional 2: 61–63.
Atif, Y. 2002. Building trust in e-commerce, IEEE Internet Computing 6: 18–24.
Bevan, N. 1995. Measuring usability as quality of use, Software Quality Journal 4: 115–130.
Bevan, N. and Azuma, M. 1997. Quality in Use: Incorporating human factors into the software engineering
lifecycle, Proceedings of the Third IEEE International Symposium and Forum on Software Engineering
Bevan, N. and Macleod, M. 1994. Usability measurement in context, Behavior and Information Technology
13: 132–145.
Bevan, N. and Schoeffel, R. 2001. A proposed standard for consumer product usability, Proceedings of 1st
International Conference on Universal Access in Human Computer Interaction, New Orleans, LA, pp.
J. 1978. Characteristics of Software Quality, New York: North Holland.
Caldwell, B., Chisholm,W., Vanderheiden, G., and White, J. (Eds.), 2004.Web Content Accessibility Guidelines
2.0, W3C Working Draft 30 July 2004, World Wide Web Consortium
Cheskin Research and Studio Archetype/Sapient 1999. e-Commerce trust study. Retrieved June 30, 2005 from
Constantine, L.L. and Lockwood, L.A.D. 1999. Software for Use: A Practical Guide to the Models and
Methods of Usage-Centred Design, New York: Addison-Wesley.
Council of the European Union, 1990. Council Directive 90/270/EEC on the Minimum Safety and Health
Requirements for Work with Display Screen Equipment, Official Journal of the European Communities
Curtis, B., 1980. Measurement and experimentation in software engineering, IEEE Transaction on Software
Engineering 68: 1144–1157.
Fenton, N. E., and Whitty, R., 1995. Software Quality Assurance and Measurement: AWorldwide Perspective,
London: International Thomson Computer Press.
Friedman, B., Kahn, P.H., Jr., and Howe, D.C. 2000. Trust online, ACM Communications, 43: 34–40.
Hyatt, L.E. and Rosenberg, L.H. 1996. A software quality model and metrics for identifying project
risks and assessing software quality
Institute of Electrical and Electronics Engineers, 1990. 610.12-1990, IEEE Standard Glossary of Software
Engineering Terminology, Los Alamitos, CA: Author.
Institute of Electrical and Electronics Engineers, 1998. 1061-1998, Standard for a Software Quality Metrics
Methodology, Los Alamitos, CA: Author.
International Electrotechnical Commission, 2004. IEC 60300-3-9, Ed. 2.0, Dependability Management, Part
3-9: Application Guide, Risk Analysis of Technological Systems, Geneva: Author.
International Organization for Standardization, 1998. ISO 9241-11, Ergonomic Requirements for Office
Work with Visual Display Terminals (VDTs), Part 11: Guidance on Usability, Geneva:
International Organization for Standardization, 1999. ISO 13407:1999, Human-Centered Design Processes
for Interactive Systems, Geneva: Author.
International Organization for Standardization/International Electrotechnical Commission, 1991. ISO/IEC
9126, Information Technology, Software Product Evaluation, Quality Characteristics and Guidelines for
Software Qual J (2006) 14: 159–178 177
International Organization for Standardization/International Electrotechnical Commission, 1995. ISO/IEC
12207, Information Technology, Software Life Cycle Processes Geneva: Author.
International Organization for Standardization/International Electrotechnical Commission, 1999. ISO/IEC
14598-1, Information Technology, Software Product Evaluation, Part 1: General Overview, Geneva: Author.
International Organization for Standardization/International Electrotechnical Commission, 2001. ISO/IEC
9126-1 Standard, Software Engineering, Product Quality, Part 1: Quality Model, Geneva: Author.
International Organization for Standardization/International Electrotechnical Commission, 2001. ISO/IEC
9126-4, Software Engineering, Product Quality, Part 4: Quality in Use Metrics, Geneva:
Ivory, M.Y. and Hearst, M.A. 2001. The state of the art in automating usability evaluation of user interfaces,
ACM Computing Surveys 33: 470–516.
Jarrar, M., Demey, J., and Meersman, R. 2003. On using conceptual data modeling for ontology engineering,
Journal on Data Semantics 2800: 185–207.
John, B.E. and Kieras, D. E. 1996. Using GOMS for user interface design and evaluation: Which technique?
ACM Transactions on Computer-Human Interaction 3: 287–319.
Kirakowski, J. and Corbett, M., 1993. SUMI: The Software Usability Measurement Inventory, British Journal
of Educational Technology 24: 210–212.
Lin, H. X., Choong, Y.-Y., and Salvendy, G., 1997. A proposed index of usability: A method for comparing
the relative usability of different software systems, Behaviour and Information Technology, 16: 267-277.
Macleod, M., 1994. Usability: Practical Methods for testing and Improvement, Proceedings of the Norwegian
Computer Society Software Conference, Sandvika, Norway
Macleod, M., and Rengger, R., 1993. The development of DRUM: A software tool for video-assisted usability
Macleod, M., Bowden, R., Bevan, N. and Curson, I., 1997. The MUSiC performance method, Behaviour and
Information Technology 16: 279-293.
McCall, J. A., Richards, P. K., andWalters, G. F., 1977. Factors in Software Quality, Springfield, VA: National
Technical Information Service.
Nielsen, J., 1993. Usability Engineering, London, UK: Academic Press.
Nunnally, J. C., and Bernstein, I. H., 1994. Psychometric theory (3rd ed.), New York: McGraw-Hill.
Olsina, L., Lafuente, G., and Rossi, G., 2001. Specifying quality characteristics and attributes for websites, in
Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S., and Carey, T. 1994. Human Computer Interaction,
Wokingham, UK: Addison-Wesley.
Rubin, J., 1994. Handbook of Usability Testing, New York: John Wiley.
Schneiderman, B., 1992. Designing the User Interface: Strategies for Effective Human-Computer Interaction
(2nd ed.), Reading, MA: Addison-Wesley.
Schneidewind, N. F., 1992. Methodology for validating software metrics, IEEE Transactions on Software
Engineering 18: 410–422.
Scholtz, J. and Laskowski, S., 1998. Developing usability tools and techniques for designing and testing web
sites, Proceedings of the Fourth Conference on Human Factors & theWeb, Basking Ridge, NJ
July 3, 2005 from
Sears, A., 1995. AIDE: A step toward metric-based interface development tools, Proceedings of the ACM
Symposium on User Interface Software and Technology, New York: ACM Press, pp
Shackel, B., 1991. Usability—Context, framework, definition, design and evaluation, in B. Shackel and S.
Stevens, S. S., 1959. Measurement, psychophysics, and utility, in C. W. Churchman and P. Ratoosh (Eds.),
Measurement: Definitions and Theories, New York: John Wiley, pp.18–63.
Tilson, R., Dong, J., Martin, S., and Kieke, E., 1998. Factors and principles affecting the usability of four
Continue Reading

Please join StudyMode to read the full document

You May Also Find These Documents Helpful

  • Essay on Usability of iPad Apps and Websites
  • Human Computer Interface Usability Essay
  • Usability Prototype Redesign Essay
  • Usability Evaluation Essay
  • Usability Plan Essay
  • E-Commerce Usability Essay
  • Design Issues and Usability Essay
  • Evaluation Usability of Iug Web Portal Essay

Become a StudyMode Member

Sign Up - It's Free