Outliers in usability testing:: how to treat usability problems found for only one test participant?

Asbjørn Følstad; Effie Lai-Chong Law; Kasper Hornbæk

doi:10.1145/2399016.2399056

Outliers in usability testing: how to treat usability problems found for only one test participant?

Asbjørn Følstad, Effie Lai-Chong Law, Kasper Hornbæk

Datalogisk Institut

7 Citationer (Scopus)

Abstract

In usability testing, usability problems are often found for only one test participant. The literature does not help in deciding whether such single-user problems should be accepted or rejected as usability problems. To help us understand how such decisions are made in practical usability testing, 89 practitioners described how they dealt with single-user problems in their latest usability test. Single-user problems was accepted, rejected, or reported as outliers. This decision depended on problem severity, participant profile, sample size, and judgments on whether the problem is an artifact of the test situation.

Originalsprog	Engelsk
Titel	Proceedings of the 7th Nordic Conference on Human-Computer Interaction : making sense through design
Antal sider	4
Forlag	Association for Computing Machinery
Publikationsdato	2012
Sider	257-260
ISBN (Trykt)	978-1-4503-1482-4
DOI	https://doi.org/10.1145/2399016.2399056
Status	Udgivet - 2012
Begivenhed	7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design - Copenhagen, Danmark Varighed: 14 okt. 2012 → 17 okt. 2012 Konferencens nummer: 7

Konference

Konference	7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
Nummer	7
Land/Område	Danmark
By	Copenhagen
Periode	14/10/2012 → 17/10/2012

Emneord

questionnaire survey, single-user problems, usability practitioner, usability testing

Adgang til dokumentet

10.1145/2399016.2399056

Citationsformater

Outliers in usability testing: how to treat usability problems found for only one test participant? / Følstad, Asbjørn; Law, Effie Lai-Chong; Hornbæk, Kasper.

Proceedings of the 7th Nordic Conference on Human-Computer Interaction: making sense through design. Association for Computing Machinery, 2012. s. 257-260.

Publikation: Bidrag til bog/antologi/rapport › Konferencebidrag i proceedings › Forskning › peer review

Følstad, A, Law, EL-C & Hornbæk, K 2012, Outliers in usability testing: how to treat usability problems found for only one test participant? i Proceedings of the 7th Nordic Conference on Human-Computer Interaction: making sense through design. Association for Computing Machinery, s. 257-260, 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design , Copenhagen, Danmark, 14/10/2012. https://doi.org/10.1145/2399016.2399056

@inproceedings{efaf009173394d77ada87493157964cc,

title = "Outliers in usability testing:: how to treat usability problems found for only one test participant?",

abstract = "In usability testing, usability problems are often found for only one test participant. The literature does not help in deciding whether such single-user problems should be accepted or rejected as usability problems. To help us understand how such decisions are made in practical usability testing, 89 practitioners described how they dealt with single-user problems in their latest usability test. Single-user problems was accepted, rejected, or reported as outliers. This decision depended on problem severity, participant profile, sample size, and judgments on whether the problem is an artifact of the test situation.",

keywords = "questionnaire survey, single-user problems, usability practitioner, usability testing",

author = "Asbj{\o}rn F{\o}lstad and Law, {Effie Lai-Chong} and Kasper Hornb{\ae}k",

year = "2012",

doi = "10.1145/2399016.2399056",

language = "English",

isbn = "978-1-4503-1482-4",

pages = "257--260",

booktitle = "Proceedings of the 7th Nordic Conference on Human-Computer Interaction",

publisher = "Association for Computing Machinery",

note = "7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design ; Conference date: 14-10-2012 Through 17-10-2012",

}

TY - GEN

T1 - Outliers in usability testing:

T2 - 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design

AU - Følstad, Asbjørn

AU - Law, Effie Lai-Chong

AU - Hornbæk, Kasper

N1 - Conference code: 7

PY - 2012

Y1 - 2012

N2 - In usability testing, usability problems are often found for only one test participant. The literature does not help in deciding whether such single-user problems should be accepted or rejected as usability problems. To help us understand how such decisions are made in practical usability testing, 89 practitioners described how they dealt with single-user problems in their latest usability test. Single-user problems was accepted, rejected, or reported as outliers. This decision depended on problem severity, participant profile, sample size, and judgments on whether the problem is an artifact of the test situation.

AB - In usability testing, usability problems are often found for only one test participant. The literature does not help in deciding whether such single-user problems should be accepted or rejected as usability problems. To help us understand how such decisions are made in practical usability testing, 89 practitioners described how they dealt with single-user problems in their latest usability test. Single-user problems was accepted, rejected, or reported as outliers. This decision depended on problem severity, participant profile, sample size, and judgments on whether the problem is an artifact of the test situation.

KW - questionnaire survey, single-user problems, usability practitioner, usability testing

U2 - 10.1145/2399016.2399056

DO - 10.1145/2399016.2399056

M3 - Article in proceedings

SN - 978-1-4503-1482-4

SP - 257

EP - 260

BT - Proceedings of the 7th Nordic Conference on Human-Computer Interaction

PB - Association for Computing Machinery

Y2 - 14 October 2012 through 17 October 2012

ER -