Abstract
Large amounts of data available on the web, for example reviews, tweets, and forum postings, contain user narratives on interaction with products. Finding usability issues in such user narratives offers an interesting alternative to traditional usability testing. To leverage such data for identifying usability issues, we (I) devise a methodology for building automated extraction tools for usability issues; (II) perform empirical assessment of such tools by training a number of classifiers to extract sentences describing usability issues for two digital cameras and a children's tablet; (III) perform quantitative and qualitative comparisons between the usability issues identified by the classifiers and those identified and assessed by two traditional methods: heuristic evaluation and think aloud testing. Our results show that it is possible to build and train algorithms for extracting actionable usability issues, but raise serious concerns about the practical future prospects for supplementing traditional evaluation methods with automated extraction algorithms.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 8th Nordic Conference on Human-Computer Interaction : Fun, Fast, Foundational |
| Number of pages | 10 |
| Publisher | Association for Computing Machinery |
| Publication date | 26 Oct 2014 |
| Pages | 157-166 |
| ISBN (Print) | 978-1-4503-2542-4 |
| DOIs | |
| Publication status | Published - 26 Oct 2014 |
| Event | Nordic Conference on Human-Computer Interaction 2014 - Helsinki, Finland Duration: 26 Oct 2014 → 30 Oct 2014 Conference number: 8 |
Conference
| Conference | Nordic Conference on Human-Computer Interaction 2014 |
|---|---|
| Number | 8 |
| Country/Territory | Finland |
| City | Helsinki |
| Period | 26/10/2014 → 30/10/2014 |