Keynote: Evaluation of interactive information retrieval (IIR) by use of simulated work task situations.

  • Pia Borlund (Speaker)

Activity: Talk or presentation typesLecture and oral contribution

Description

Keynote given at: Joint Workshop on Personalized Information Access (PIA 2014).
Held in conjunction with the 22nd Conference on User Modeling, Adaptation and Personalization (UMAP), Aalborg (Hotel Hvide hus), Denmark, July 7-11, 2014.

Abstract: The talk introduces the test instrument named a "simulated work task situation" that is commonly used in evaluations of interactive information retrieval (IIR). IIR evaluations focus on users’ satisfaction with retrieved information and use of IR systems. The test instrument takes the form of written search task descriptions that are assigned to the test participants. The objective of the use of simulated work task situations is to obtain realistic, reliable, and comparable search and assessment behaviour during testing. The talk presents the concept of simulated work task situation, and the requirements for the use of it as a test instrument. The talk further emphasises the importance tailoring of the simulated work task situations towards the group of test participants by providing illustrative examples of successfully tailored simulated work task situations and less successfully ones.
Period7 Jul 2014
Held atUnknown external organisation