Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction

Mikkel Rønne Jakobsen; Yvonne Jansen; Sebastian Boring; Kasper Hornbæk

doi:10.1007/978-3-319-22698-9_31

Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction

Mikkel Rønne Jakobsen, Yvonne Jansen, Sebastian Boring, Kasper Hornbæk

Department of Computer Science

12 Citations (Scopus)

Abstract

Users can interact with large displays in many ways, including touch and mid-air gestures. However, it remains unclear how these ways compare and when users choose one over the other. In a first experiment, we compare touch and mid-air gestures to identify their relative performance for target acquisition. In a second experiment, participants choose freely between touch and mid-air gestures and we artificially require movement to simulate situations where mid-air is considered beneficial. Results from the first experiment show mid-air to be overall slower than touch depending on the task; in the second experiment, participants mostly chose touch in particular for selecting small targets and they rarely switched between mid-air and touch. Results also show that when faced with an increasing cost of using touch in the form of movement, participants chose mid-air over touch; touch remains as fast as mid-air on average.

Original language	English
Title of host publication	Human-computer interaction – INTERACT 2015 : 15th IFIP TC 13 International Conference, Bamberg, Germany, September 14-18, 2015, Proceedings, Part III
Editors	Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, Marco Winckler
Number of pages	19
Publisher	Springer
Publication date	2015
Pages	455-473
ISBN (Print)	978-3-319-22697-2
ISBN (Electronic)	978-3-319-22698-9
DOIs	https://doi.org/10.1007/978-3-319-22698-9_31
Publication status	Published - 2015
Event	IFIP TC 13 International Conference 2015 - Bamberg, Germany Duration: 14 Sept 2015 → 18 Sept 2015 Conference number: 15

Conference

Conference	IFIP TC 13 International Conference 2015
Number	15
Country/Territory	Germany
City	Bamberg
Period	14/09/2015 → 18/09/2015

Series	Lecture notes in computer science
Volume	9298
ISSN	0302-9743

Access to Document

10.1007/978-3-319-22698-9_31

Cite this

Jakobsen, M. R., Jansen, Y., Boring, S., & Hornbæk, K. (2015). Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction. In J. Abascal, S. Barbosa, M. Fetter, T. Gross, P. Palanque, & M. Winckler (Eds.), Human-computer interaction – INTERACT 2015: 15th IFIP TC 13 International Conference, Bamberg, Germany, September 14-18, 2015, Proceedings, Part III (pp. 455-473). Springer. Lecture notes in computer science Vol. 9298 https://doi.org/10.1007/978-3-319-22698-9_31

Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction. / Jakobsen, Mikkel Rønne; Jansen, Yvonne; Boring, Sebastian et al.

Human-computer interaction – INTERACT 2015: 15th IFIP TC 13 International Conference, Bamberg, Germany, September 14-18, 2015, Proceedings, Part III. ed. / Julio Abascal; Simone Barbosa; Mirko Fetter; Tom Gross; Philippe Palanque; Marco Winckler. Springer, 2015. p. 455-473 (Lecture notes in computer science, Vol. 9298).

Research output: Chapter in Book/Report/Conference proceeding › Book chapter › Research › peer-review

Jakobsen, MR, Jansen, Y, Boring, S & Hornbæk, K 2015, Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction. in J Abascal, S Barbosa, M Fetter, T Gross, P Palanque & M Winckler (eds), Human-computer interaction – INTERACT 2015: 15th IFIP TC 13 International Conference, Bamberg, Germany, September 14-18, 2015, Proceedings, Part III. Springer, Lecture notes in computer science, vol. 9298, pp. 455-473, IFIP TC 13 International Conference 2015, Bamberg, Germany, 14/09/2015. https://doi.org/10.1007/978-3-319-22698-9_31

Jakobsen MR, Jansen Y, Boring S , Hornbæk K. Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction. In Abascal J, Barbosa S, Fetter M, Gross T, Palanque P, Winckler M, editors, Human-computer interaction – INTERACT 2015: 15th IFIP TC 13 International Conference, Bamberg, Germany, September 14-18, 2015, Proceedings, Part III. Springer. 2015. p. 455-473. (Lecture notes in computer science, Vol. 9298). doi: 10.1007/978-3-319-22698-9_31

Jakobsen, Mikkel Rønne ; Jansen, Yvonne ; Boring, Sebastian et al. / Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction. Human-computer interaction – INTERACT 2015: 15th IFIP TC 13 International Conference, Bamberg, Germany, September 14-18, 2015, Proceedings, Part III. editor / Julio Abascal ; Simone Barbosa ; Mirko Fetter ; Tom Gross ; Philippe Palanque ; Marco Winckler. Springer, 2015. pp. 455-473 (Lecture notes in computer science, Vol. 9298).

@inbook{70d857e2969b45d38c23ba8816370814,

title = "Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction",

abstract = "Users can interact with large displays in many ways, including touch and mid-air gestures. However, it remains unclear how these ways compare and when users choose one over the other. In a first experiment, we compare touch and mid-air gestures to identify their relative performance for target acquisition. In a second experiment, participants choose freely between touch and mid-air gestures and we artificially require movement to simulate situations where mid-air is considered beneficial. Results from the first experiment show mid-air to be overall slower than touch depending on the task; in the second experiment, participants mostly chose touch in particular for selecting small targets and they rarely switched between mid-air and touch. Results also show that when faced with an increasing cost of using touch in the form of movement, participants chose mid-air over touch; touch remains as fast as mid-air on average.",

keywords = "Large display, Mid-air, Touch, Freehand gestures, User study",

author = "Jakobsen, {Mikkel R{\o}nne} and Yvonne Jansen and Sebastian Boring and Kasper Hornb{\ae}k",

year = "2015",

doi = "10.1007/978-3-319-22698-9_31",

language = "English",

isbn = "978-3-319-22697-2",

series = "Lecture notes in computer science",

publisher = "Springer",

pages = "455--473",

editor = "Julio Abascal and Simone Barbosa and Mirko Fetter and Tom Gross and Philippe Palanque and Marco Winckler",

booktitle = "Human-computer interaction – INTERACT 2015",

note = "IFIP TC 13 International Conference 2015 ; Conference date: 14-09-2015 Through 18-09-2015",

}

TY - CHAP

T1 - Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction

AU - Jakobsen, Mikkel Rønne

AU - Jansen, Yvonne

AU - Boring, Sebastian

AU - Hornbæk, Kasper

N1 - Conference code: 15

PY - 2015

Y1 - 2015

N2 - Users can interact with large displays in many ways, including touch and mid-air gestures. However, it remains unclear how these ways compare and when users choose one over the other. In a first experiment, we compare touch and mid-air gestures to identify their relative performance for target acquisition. In a second experiment, participants choose freely between touch and mid-air gestures and we artificially require movement to simulate situations where mid-air is considered beneficial. Results from the first experiment show mid-air to be overall slower than touch depending on the task; in the second experiment, participants mostly chose touch in particular for selecting small targets and they rarely switched between mid-air and touch. Results also show that when faced with an increasing cost of using touch in the form of movement, participants chose mid-air over touch; touch remains as fast as mid-air on average.

AB - Users can interact with large displays in many ways, including touch and mid-air gestures. However, it remains unclear how these ways compare and when users choose one over the other. In a first experiment, we compare touch and mid-air gestures to identify their relative performance for target acquisition. In a second experiment, participants choose freely between touch and mid-air gestures and we artificially require movement to simulate situations where mid-air is considered beneficial. Results from the first experiment show mid-air to be overall slower than touch depending on the task; in the second experiment, participants mostly chose touch in particular for selecting small targets and they rarely switched between mid-air and touch. Results also show that when faced with an increasing cost of using touch in the form of movement, participants chose mid-air over touch; touch remains as fast as mid-air on average.

KW - Large display

KW - Mid-air

KW - Touch

KW - Freehand gestures

KW - User study

U2 - 10.1007/978-3-319-22698-9_31

DO - 10.1007/978-3-319-22698-9_31

M3 - Book chapter

SN - 978-3-319-22697-2

T3 - Lecture notes in computer science

SP - 455

EP - 473

BT - Human-computer interaction – INTERACT 2015

A2 - Abascal, Julio

A2 - Barbosa, Simone

A2 - Fetter, Mirko

A2 - Gross, Tom

A2 - Palanque, Philippe

A2 - Winckler, Marco

PB - Springer

T2 - IFIP TC 13 International Conference 2015

Y2 - 14 September 2015 through 18 September 2015

ER -

Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction

Abstract

Conference

Access to Document

Fingerprint

Cite this