Sequential rank agreement methods for comparison of ranked lists

Claus Thorn Ekstrøm; Thomas Alexander Gerds; Andreas Kryger Jensen

doi:10.1093/biostatistics/kxy017

Sequential rank agreement methods for comparison of ranked lists

Claus Thorn Ekstrøm, Thomas Alexander Gerds, Andreas Kryger Jensen

Section of Biostatistics

3 Citations (Scopus)

Abstract

The comparison of alternative rankings of a set of items is a general and common task in applied statistics. Predictor variables are ranked according to magnitude of association with an outcome, prediction models rank subjects according to the personalized risk of an event, and genetic studies rank genes according to their difference in gene expression levels. We propose a sequential rank agreement measure to quantify the rank agreement among two or more ordered lists. This measure has an intuitive interpretation, it can be applied to any number of lists even if some are partially incomplete, and it provides information about the agreement along the lists. The sequential rank agreement can be evaluated analytically or be compared graphically to a permutation based reference set in order to identify changes in the list agreements. The usefulness of this measure is illustrated using gene rankings, and using data from two Danish ovarian cancer studies where we assess the within and between agreement of different statistical classification methods.

Original language	English
Journal	Biostatistics
Volume	20
Issue number	4
Pages (from-to)	582-598
Number of pages	17
ISSN	1465-4644
DOIs	https://doi.org/10.1093/biostatistics/kxy017
Publication status	Published - 1 Oct 2019

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1093/biostatistics/kxy017

https://arxiv.org/pdf/1508.06803.pdfLicence: Unspecified

Cite this

@article{eb7960d27c0b484fa3db43820092a28d,

title = "Sequential rank agreement methods for comparison of ranked lists",

abstract = "The comparison of alternative rankings of a set of items is a general and common task in applied statistics. Predictor variables are ranked according to magnitude of association with an outcome, prediction models rank subjects according to the personalized risk of an event, and genetic studies rank genes according to their difference in gene expression levels. We propose a sequential rank agreement measure to quantify the rank agreement among two or more ordered lists. This measure has an intuitive interpretation, it can be applied to any number of lists even if some are partially incomplete, and it provides information about the agreement along the lists. The sequential rank agreement can be evaluated analytically or be compared graphically to a permutation based reference set in order to identify changes in the list agreements. The usefulness of this measure is illustrated using gene rankings, and using data from two Danish ovarian cancer studies where we assess the within and between agreement of different statistical classification methods.",

author = "Ekstr{\o}m, {Claus Thorn} and Gerds, {Thomas Alexander} and Jensen, {Andreas Kryger}",

year = "2019",

month = oct,

day = "1",

doi = "10.1093/biostatistics/kxy017",

language = "English",

volume = "20",

pages = "582--598",

journal = "Biostatistics",

issn = "1465-4644",

publisher = "Oxford University Press",

number = "4",

}

TY - JOUR

T1 - Sequential rank agreement methods for comparison of ranked lists

AU - Ekstrøm, Claus Thorn

AU - Gerds, Thomas Alexander

AU - Jensen, Andreas Kryger

PY - 2019/10/1

Y1 - 2019/10/1

N2 - The comparison of alternative rankings of a set of items is a general and common task in applied statistics. Predictor variables are ranked according to magnitude of association with an outcome, prediction models rank subjects according to the personalized risk of an event, and genetic studies rank genes according to their difference in gene expression levels. We propose a sequential rank agreement measure to quantify the rank agreement among two or more ordered lists. This measure has an intuitive interpretation, it can be applied to any number of lists even if some are partially incomplete, and it provides information about the agreement along the lists. The sequential rank agreement can be evaluated analytically or be compared graphically to a permutation based reference set in order to identify changes in the list agreements. The usefulness of this measure is illustrated using gene rankings, and using data from two Danish ovarian cancer studies where we assess the within and between agreement of different statistical classification methods.

AB - The comparison of alternative rankings of a set of items is a general and common task in applied statistics. Predictor variables are ranked according to magnitude of association with an outcome, prediction models rank subjects according to the personalized risk of an event, and genetic studies rank genes according to their difference in gene expression levels. We propose a sequential rank agreement measure to quantify the rank agreement among two or more ordered lists. This measure has an intuitive interpretation, it can be applied to any number of lists even if some are partially incomplete, and it provides information about the agreement along the lists. The sequential rank agreement can be evaluated analytically or be compared graphically to a permutation based reference set in order to identify changes in the list agreements. The usefulness of this measure is illustrated using gene rankings, and using data from two Danish ovarian cancer studies where we assess the within and between agreement of different statistical classification methods.

U2 - 10.1093/biostatistics/kxy017

DO - 10.1093/biostatistics/kxy017

M3 - Journal article

C2 - 29868883

SN - 1465-4644

VL - 20

SP - 582

EP - 598

JO - Biostatistics

JF - Biostatistics

IS - 4

ER -

Sequential rank agreement methods for comparison of ranked lists

Abstract

UN SDGs

Access to Document

Fingerprint

Cite this