Distributed usability evaluation: enabling large-scale usability evaluation with user-controlled instrumentation

Lars Christensen, Erik Frøkjær

Abstract

We present DUE (Distributed Usability Evaluation), a technique for collecting and evaluating usability data. The DUE infrastructure involves a client-server network. A client-based tool resides on the workstation of each user, providing a screen video recording, microphone input of voice commentary, and a window for a severity rating. The idea is for the user to work naturalistically, clicking a button when a usability problem or point of uncertainty is encountered, to describe it verbally along with illustrating it on screen, and to rate its severity. These incidents are accumulated on a server, providing access to an evaluator (usability expert) and to product developers or managers who want to review the incidents and analyse them. DUE supports evaluation in the development stages from running prototypes and onwards. A case study of the use of DUE in a corporate environment is presented. The study indicates that the DUE technique is effective in terms of low bias, high efficiency, and clear communication of usability issues among users, evaluators and developers. Further, DUE is supporting long-term evaluations making possible empirical studies of learnability.
Original languageEnglish
Title of host publicationProceedings of the 6th Nordic Conference on Human-Computer Interaction : extending boundaries
Number of pages10
PublisherAssociation for Computing Machinery
Publication date2010
Pages118-127
ISBN (Print)978-1-60558-934-3
DOIs
Publication statusPublished - 2010
Event6th Nordic Conference on Human-Computer Interaction: extending boundaries - Reykjavik, Iceland
Duration: 16 Oct 201020 Oct 2010
Conference number: 6

Conference

Conference6th Nordic Conference on Human-Computer Interaction
Number6
Country/TerritoryIceland
CityReykjavik
Period16/10/201020/10/2010

Keywords

  • Faculty of Science

Cite this