Old wine in new bottles or novel challenges? A critical analysis of empirical studies of user experience

Javier A. Bargas-Avila; Kasper Hornbæk

doi:10.1145/1978942.1979336

Old wine in new bottles or novel challenges? A critical analysis of empirical studies of user experience

Javier A. Bargas-Avila, Kasper Hornbæk

Department of Computer Science

315 Citations (Scopus)

Abstract

This paper reviews how empirical research on User Experience (UX) is conducted. It integrates products, dimensions of experience, and methodologies across a systematically selected sample of 51 publications from 2005-2009, reporting a total of 66 empirical studies. Results show a shift in the products and use contexts that are studied, from work towards leisure, from controlled tasks towards open use situations, and from desktop computing towards consumer products and art. Context of use and anticipated use, often named key factors of UX, are rarely researched. Emotions, enjoyment and aesthetics are the most frequently assessed dimensions. The methodologies used are mostly qualitative, and known from traditional usability studies, though constructive methods with unclear validity are being developed and used. Many studies use self-developed questionnaires without providing items or statistical validations. We discuss underexplored research questions and potential improvements of UX research.

Original language	English
Title of host publication	The 29th Annual CHI Conference on Human Factors in Computing Systems : conference proceedings and extended abstracts
Number of pages	10
Publisher	Association for Computing Machinery
Publication date	2011
Pages	2689-2698
ISBN (Print)	978-1-4503-0228-9
DOIs	https://doi.org/10.1145/1978942.1979336
Publication status	Published - 2011
Event	29th Annual CHI Conference on Human Factors in Computing Systems - Vancouver, Canada Duration: 7 May 2011 → 12 May 2011 Conference number: 29

Conference

Conference	29th Annual CHI Conference on Human Factors in Computing Systems
Number	29
Country/Territory	Canada
City	Vancouver
Period	07/05/2011 → 12/05/2011

Access to Document

10.1145/1978942.1979336

Cite this

Old wine in new bottles or novel challenges? A critical analysis of empirical studies of user experience. / Bargas-Avila, Javier A.; Hornbæk, Kasper.

The 29th Annual CHI Conference on Human Factors in Computing Systems: conference proceedings and extended abstracts. Association for Computing Machinery, 2011. p. 2689-2698.

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Bargas-Avila, JA & Hornbæk, K 2011, Old wine in new bottles or novel challenges? A critical analysis of empirical studies of user experience. in The 29th Annual CHI Conference on Human Factors in Computing Systems: conference proceedings and extended abstracts. Association for Computing Machinery, pp. 2689-2698, 29th Annual CHI Conference on Human Factors in Computing Systems, Vancouver, Canada, 07/05/2011. https://doi.org/10.1145/1978942.1979336

@inproceedings{256a9f6f0b554624bf6de762ba9c5b48,

title = "Old wine in new bottles or novel challenges? A critical analysis of empirical studies of user experience",

abstract = "This paper reviews how empirical research on User Experience (UX) is conducted. It integrates products, dimensions of experience, and methodologies across a systematically selected sample of 51 publications from 2005-2009, reporting a total of 66 empirical studies. Results show a shift in the products and use contexts that are studied, from work towards leisure, from controlled tasks towards open use situations, and from desktop computing towards consumer products and art. Context of use and anticipated use, often named key factors of UX, are rarely researched. Emotions, enjoyment and aesthetics are the most frequently assessed dimensions. The methodologies used are mostly qualitative, and known from traditional usability studies, though constructive methods with unclear validity are being developed and used. Many studies use self-developed questionnaires without providing items or statistical validations. We discuss underexplored research questions and potential improvements of UX research.",

keywords = "meta-analysis, review, usability, user experience, ux",

author = "Bargas-Avila, {Javier A.} and Kasper Hornb{\ae}k",

year = "2011",

doi = "10.1145/1978942.1979336",

language = "English",

isbn = "978-1-4503-0228-9",

pages = "2689--2698",

booktitle = "The 29th Annual CHI Conference on Human Factors in Computing Systems",

publisher = "Association for Computing Machinery",

note = "29th Annual CHI Conference on Human Factors in Computing Systems, CHI 2011 ; Conference date: 07-05-2011 Through 12-05-2011",

}

TY - GEN

T1 - Old wine in new bottles or novel challenges? A critical analysis of empirical studies of user experience

AU - Bargas-Avila, Javier A.

AU - Hornbæk, Kasper

N1 - Conference code: 29

PY - 2011

Y1 - 2011

N2 - This paper reviews how empirical research on User Experience (UX) is conducted. It integrates products, dimensions of experience, and methodologies across a systematically selected sample of 51 publications from 2005-2009, reporting a total of 66 empirical studies. Results show a shift in the products and use contexts that are studied, from work towards leisure, from controlled tasks towards open use situations, and from desktop computing towards consumer products and art. Context of use and anticipated use, often named key factors of UX, are rarely researched. Emotions, enjoyment and aesthetics are the most frequently assessed dimensions. The methodologies used are mostly qualitative, and known from traditional usability studies, though constructive methods with unclear validity are being developed and used. Many studies use self-developed questionnaires without providing items or statistical validations. We discuss underexplored research questions and potential improvements of UX research.

AB - This paper reviews how empirical research on User Experience (UX) is conducted. It integrates products, dimensions of experience, and methodologies across a systematically selected sample of 51 publications from 2005-2009, reporting a total of 66 empirical studies. Results show a shift in the products and use contexts that are studied, from work towards leisure, from controlled tasks towards open use situations, and from desktop computing towards consumer products and art. Context of use and anticipated use, often named key factors of UX, are rarely researched. Emotions, enjoyment and aesthetics are the most frequently assessed dimensions. The methodologies used are mostly qualitative, and known from traditional usability studies, though constructive methods with unclear validity are being developed and used. Many studies use self-developed questionnaires without providing items or statistical validations. We discuss underexplored research questions and potential improvements of UX research.

KW - meta-analysis

KW - review

KW - usability

KW - user experience

KW - ux

U2 - 10.1145/1978942.1979336

DO - 10.1145/1978942.1979336

M3 - Article in proceedings

SN - 978-1-4503-0228-9

SP - 2689

EP - 2698

BT - The 29th Annual CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

T2 - 29th Annual CHI Conference on Human Factors in Computing Systems

Y2 - 7 May 2011 through 12 May 2011

ER -

Old wine in new bottles or novel challenges? A critical analysis of empirical studies of user experience

Abstract

Conference

Access to Document

Fingerprint

Cite this