Reconsideration of the simulated work task situation: A context instrument for evaluation of information retrieval interaction

TY - GEN

T1 - Reconsideration of the simulated work task situation

T2 - A context instrument for evaluation of information retrieval interaction

AU - Borlund, Pia

AU - Schneider, Jesper Wiborg

PY - 2010

Y1 - 2010

N2 - The present paper reports on the initial study and the preliminary findings of how the concept of simulated work task situation is reported used in the research literature. The overall objective of the study is in a systematic manner to learn how and for what types of evaluations the concept is applied. In particular we are interested to learn whether the recommendations for how to apply simulated work task situations are followed. The preliminary findings indicate a need for clarifications of the recommendations of how to use simulated work task situations. Particularly with respect to ‘realism’ of the simulated work task situations, which is emphasised through the need for tailoring of the simulated work task situations towards the group of study participant to ensure the depicted situations are realistic and interesting from the participants’ point of view. Likewise it seems that the recommendation to involve the study participants’ own information needs (to function as baseline of search interaction) is generally neglected in the reported studies.

AB - The present paper reports on the initial study and the preliminary findings of how the concept of simulated work task situation is reported used in the research literature. The overall objective of the study is in a systematic manner to learn how and for what types of evaluations the concept is applied. In particular we are interested to learn whether the recommendations for how to apply simulated work task situations are followed. The preliminary findings indicate a need for clarifications of the recommendations of how to use simulated work task situations. Particularly with respect to ‘realism’ of the simulated work task situations, which is emphasised through the need for tailoring of the simulated work task situations towards the group of study participant to ensure the depicted situations are realistic and interesting from the participants’ point of view. Likewise it seems that the recommendation to involve the study participants’ own information needs (to function as baseline of search interaction) is generally neglected in the reported studies.

U2 - 10.1145/1840784.1840808

DO - 10.1145/1840784.1840808

M3 - Article in proceedings

SP - 155

EP - 164

BT - IIiX'10 Proceeding of the Third Symposium on Information Interaction in Context, New Brunswick, NJ, USA, August 18-21, 2010

A2 - Belkin, Nicholas J.

A2 - Kelly, Diane

PB - Association for Computing Machinery

CY - New York

ER -