Abstract
In this paper we present a formal framework to define and study the properties of utility-oriented measurements of retrieval effectiveness, like AP, RBP, ERR and many other popular IR evaluation measures. The proposed framework is laid in the wake of the representational theory of measurement, which provides the foundations of the modern theory of measurement in both physical and social sciences, thus contributing to explicitly link IR evaluation to a broader context. The proposed framework is minimal, in the sense that it relies on just one axiom, from which other properties are derived. Finally, it contributes to a better understanding and a clear separation of what issues are due to the inherent problems in comparing systems in terms of retrieval effectiveness and what others are due to the expected numerical properties of a measurement.
| Originalsprog | Engelsk |
|---|---|
| Titel | ICTIR 2015 - Proceedings of the 2015 ACM SIGIR International Conference on the Theory of Information Retrieval |
| Antal sider | 10 |
| Forlag | Association for Computing Machinery, Inc. |
| Publikationsdato | 27 sep. 2015 |
| Sider | 21-30 |
| ISBN (Elektronisk) | 9781450338332 |
| DOI | |
| Status | Udgivet - 27 sep. 2015 |
| Begivenhed | 5th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2015 - Northampton, USA Varighed: 27 sep. 2015 → 30 sep. 2015 |
Konference
| Konference | 5th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2015 |
|---|---|
| Land/Område | USA |
| By | Northampton |
| Periode | 27/09/2015 → 30/09/2015 |
| Sponsor | ACM Special Interest Group on Information Retrieval (SIGIR) |