Ranked accuracy and unstructured distributed search

TY - GEN

T1 - Ranked accuracy and unstructured distributed search

AU - Richardson, Sami

AU - Cox, Ingemar J

N1 - Conference code: 35

PY - 2013

Y1 - 2013

N2 - Non-uniformly distributing documents in an unstructured peer-to-peer (P2P) network has been shown to improve both the expected search length and search accuracy, where accuracy is defined as the size of the intersection of the documents retrieved by a constrained, probabilistic search and the documents that would have been retrieved by an exhaustive search, normalized by the size of the latter. However neither metric considers the relative ranking of the documents in the retrieved sets. We therefore introduce a new performance metric, rank-accuracy, that is a rank weighted score of the top-k documents retrieved. By replicating documents across nodes based on their retrieval rate (a function of query frequency), and rank, we show that average rank-accuracy can be improved. The practical performance of rank-aware search is demonstrated using a simulated network of 10,000 nodes and queries drawn from a Yahoo! web search log.

AB - Non-uniformly distributing documents in an unstructured peer-to-peer (P2P) network has been shown to improve both the expected search length and search accuracy, where accuracy is defined as the size of the intersection of the documents retrieved by a constrained, probabilistic search and the documents that would have been retrieved by an exhaustive search, normalized by the size of the latter. However neither metric considers the relative ranking of the documents in the retrieved sets. We therefore introduce a new performance metric, rank-accuracy, that is a rank weighted score of the top-k documents retrieved. By replicating documents across nodes based on their retrieval rate (a function of query frequency), and rank, we show that average rank-accuracy can be improved. The practical performance of rank-aware search is demonstrated using a simulated network of 10,000 nodes and queries drawn from a Yahoo! web search log.

U2 - 10.1007/978-3-642-36973-5_15

DO - 10.1007/978-3-642-36973-5_15

M3 - Article in proceedings

SN - 978-3-642-36972-8

T3 - Lecture notes in computer science

SP - 171

EP - 182

BT - Advances in information retrieval

PB - Springer

T2 - European Conference on IR Research, ECIR 2013

Y2 - 24 March 2013 through 27 March 2013

ER -