Searchers' relevance judgments and criteria in evaluating Web pages in a learning style perspective

TY - GEN

T1 - Searchers' relevance judgments and criteria in evaluating Web pages in a learning style perspective

AU - Papaeconomou, Chariste

AU - Zijlema, Annemarie F.

AU - Ingwersen, Peter

N1 - Conference code: 2

PY - 2008

Y1 - 2008

N2 - The paper presents the results of a case study of searcher's relevance criteria used for assessments of Web pages in a perspective of learning style. 15 test persons participated in the experiments based on two simulated work tasks that provided cover stories to trigger their information needs. Two learning styles were examined: Global and Sequential learners. The study applied eye-tracking for the observation of relevance hot spots on Web pages, learning style index analysis and post-search interviews to gain more in-depth information on relevance behavior. Findings reveal that with respect to use of graded relevance scores and number of relevance criteria applied per task and test person there are no significant difference between the different styles. Although there differences are detected in the use of relevance criteria between Global and Sequential learners during assessments, they are statistically insignificant. When interviewed in retrospective the resulting profiles tend to become even similar across learning styles but a shift occurs from instant assessments with content features of web pages replacing topicality judgments as predominant relevance criteria.

AB - The paper presents the results of a case study of searcher's relevance criteria used for assessments of Web pages in a perspective of learning style. 15 test persons participated in the experiments based on two simulated work tasks that provided cover stories to trigger their information needs. Two learning styles were examined: Global and Sequential learners. The study applied eye-tracking for the observation of relevance hot spots on Web pages, learning style index analysis and post-search interviews to gain more in-depth information on relevance behavior. Findings reveal that with respect to use of graded relevance scores and number of relevance criteria applied per task and test person there are no significant difference between the different styles. Although there differences are detected in the use of relevance criteria between Global and Sequential learners during assessments, they are statistically insignificant. When interviewed in retrospective the resulting profiles tend to become even similar across learning styles but a shift occurs from instant assessments with content features of web pages replacing topicality judgments as predominant relevance criteria.

KW - Informationssøgning

KW - Søgeadfærd

KW - Websider

KW - Relevanskriterier

KW - Information retrieval

KW - Seeking behaviou

KW - Web collection

KW - Relevance assessments

M3 - Article in proceedings

SN - 978-1-60558-310-5

T3 - ACM International Conference Proceedings Series

SP - 123

EP - 130

BT - Information Interaction in Context

A2 - Borlund, Pia

A2 - Schneider, Jesper

A2 - Lalmas, Mounia

PB - ACM Press

T2 - Second IIiX Symposium on Information Interaction in Context

Y2 - 14 October 2008 through 17 October 2008

ER -