Abstract
Understanding the relation between usability measures seems crucial to deepen our conception of usability and to select the right measures for usability studies. We present a meta-analysis of correlations among usability measures calculated from the raw data of 73 studies. Correlations are generally low: effectiveness measures (e.g., errors) and efficiency measures (e.g., time) has a correlation of .247 ± .059 (Pearson's product-moment correlation with 95% confidence interval), efficiency and satisfaction (e.g., preference) one of .196 ± .064, and effectiveness and satisfaction one of .164 ± .062. Changes in task complexity do not influence these correlations, but use of more complex measures attenuates them. Standard questionnaires for measuring satisfaction appear more reliable than homegrown ones. Measures of users' perceptions of phenomena are generally not correlated with objective measures of the phenomena. Implications for how to measure usability are drawn and common models of usability are criticized.
| Original language | English |
|---|---|
| Title of host publication | Conference on Human Factors in Computing Systems : CHI 2007, Reach beyond. Conference Proceedings |
| Editors | Bo Begole, Stephen Payne, Elizabeth Churchill, Rob St. Amant, David Gilmore, Mary Beth Rosson |
| Publisher | Association for Computing Machinery |
| Publication date | 2007 |
| Pages | 617-626 |
| ISBN (Print) | 9781595935939 |
| DOIs | |
| Publication status | Published - 2007 |
| Event | Conference on Human Factors in Computing Systems - San Jose, Calif., United States Duration: 28 Apr 2007 → 3 May 2007 |
Conference
| Conference | Conference on Human Factors in Computing Systems |
|---|---|
| Country/Territory | United States |
| City | San Jose, Calif. |
| Period | 28/04/2007 → 03/05/2007 |