Assessment of statistical significance and clinical relevance

M. Kieser, T. Friede, Matthias Gondan

27 Citations (Scopus)

Abstract

In drug development, it is well accepted that a successful study will demonstrate not only a statistically significant result but also a clinically relevant effect size. Whereas standard hypothesis tests are used to demonstrate the former, it is less clear how the latter should be established. In the first part of this paper, we consider the responder analysis approach and study the performance of locally optimal rank tests when the outcome distribution is a mixture of responder and non-responder distributions. We find that these tests are quite sensitive to their planning assumptions and have therefore not really any advantage over standard tests such as the t-test and the Wilcoxon-Mann-Whitney test, which perform overall well and can be recommended for applications. In the second part, we present a new approach to the assessment of clinical relevance based on the so-called relative effect (or probabilistic index) and derive appropriate sample size formulae for the design of studies aiming at demonstrating both a statistically significant and clinically relevant effect. Referring to recent studies in multiple sclerosis, we discuss potential issues in the application of this approach.
Original languageEnglish
JournalStatistics in Medicine
Volume32
Issue number10
Pages (from-to)1707-1719
Number of pages13
ISSN0277-6715
DOIs
Publication statusPublished - 10 May 2013
Externally publishedYes

Fingerprint

Dive into the research topics of 'Assessment of statistical significance and clinical relevance'. Together they form a unique fingerprint.

Cite this