Model criticism based on likelihood-free inference, with an application to protein network evolution

Oliver Ratmann; Christophe Andrieu; Carsten Wiuf; Sylvia Richardson

doi:10.1073/pnas.0807882106

Model criticism based on likelihood-free inference, with an application to protein network evolution

Oliver Ratmann^*, Christophe Andrieu, Carsten Wiuf, Sylvia Richardson

^*Corresponding author af dette arbejde

95 Citationer (Scopus)

Abstract

Mathematical models are an important tool to explain and comprehend complex phenomena, and unparalleled computational advances enable us to easily explore them without any or little understanding of their global properties. In fact, the likelihood of the data under complex stochastic models is often analytically or numerically intractable in many areas of sciences. This makes it even more important to simultaneously investigate the adequacy of these models - in absolute terms, against the data, rather than relative to the performance of other models - but no such procedure has been formally discussed when the likelihood is intractable. We provide a statistical interpretation to current developments in likelihood-free Bayesian inference that explicitly accounts for discrepancies between the model and the data, termed Approximate Bayesian Computation under model uncertainty (ABCμ). We augment the likelihood of the data with unknown error terms that correspond to freely chosen checking functions, and provide Monte Carlo strategies for sampling from the associated joint posterior distribution without the need of evaluating the likelihood. We discuss the benefit of incorporating model diagnostics within an ABC framework, and demonstrate how this method diagnoses model mismatch and guides model refinement by contrasting three qualitative models of protein network evolution to the protein interaction datasets of Helicobacter pylori and Treponema pallidum. Our results make a number of model deficiencies explicit, and suggest that the T. pallidum network topology is inconsistent with evolution dominated by link turnover or lateral gene transfer alone.

Originalsprog	Engelsk
Tidsskrift	Proceedings of the National Academy of Sciences of the United States of America
Vol/bind	106
Udgave nummer	26
Sider (fra-til)	10576-10581
Antal sider	6
ISSN	0027-8424
DOI	https://doi.org/10.1073/pnas.0807882106
Status	Udgivet - 30 jun. 2009
Udgivet eksternt	Ja

Adgang til dokumentet

10.1073/pnas.0807882106

Andre filer og links

Link to publication in Scopus

Citationsformater

Model criticism based on likelihood-free inference, with an application to protein network evolution. / Ratmann, Oliver; Andrieu, Christophe; Wiuf, Carsten et al.

I: Proceedings of the National Academy of Sciences of the United States of America, Bind 106, Nr. 26, 30.06.2009, s. 10576-10581.

Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › peer review

@article{381514aa08d141df9101fb7b54d11bc6,

title = "Model criticism based on likelihood-free inference, with an application to protein network evolution",

abstract = "Mathematical models are an important tool to explain and comprehend complex phenomena, and unparalleled computational advances enable us to easily explore them without any or little understanding of their global properties. In fact, the likelihood of the data under complex stochastic models is often analytically or numerically intractable in many areas of sciences. This makes it even more important to simultaneously investigate the adequacy of these models - in absolute terms, against the data, rather than relative to the performance of other models - but no such procedure has been formally discussed when the likelihood is intractable. We provide a statistical interpretation to current developments in likelihood-free Bayesian inference that explicitly accounts for discrepancies between the model and the data, termed Approximate Bayesian Computation under model uncertainty (ABCμ). We augment the likelihood of the data with unknown error terms that correspond to freely chosen checking functions, and provide Monte Carlo strategies for sampling from the associated joint posterior distribution without the need of evaluating the likelihood. We discuss the benefit of incorporating model diagnostics within an ABC framework, and demonstrate how this method diagnoses model mismatch and guides model refinement by contrasting three qualitative models of protein network evolution to the protein interaction datasets of Helicobacter pylori and Treponema pallidum. Our results make a number of model deficiencies explicit, and suggest that the T. pallidum network topology is inconsistent with evolution dominated by link turnover or lateral gene transfer alone.",

keywords = "Approximate Bayesian computation, Bayesian inference, Intractable likelihoods, Markov chain Monte Carlo, Model uncertainty",

author = "Oliver Ratmann and Christophe Andrieu and Carsten Wiuf and Sylvia Richardson",

year = "2009",

month = jun,

day = "30",

doi = "10.1073/pnas.0807882106",

language = "English",

volume = "106",

pages = "10576--10581",

journal = "Proceedings of the National Academy of Sciences of the United States of America",

issn = "0027-8424",

publisher = "The National Academy of Sciences of the United States of America",

number = "26",

}

TY - JOUR

T1 - Model criticism based on likelihood-free inference, with an application to protein network evolution

AU - Ratmann, Oliver

AU - Andrieu, Christophe

AU - Wiuf, Carsten

AU - Richardson, Sylvia

PY - 2009/6/30

Y1 - 2009/6/30

N2 - Mathematical models are an important tool to explain and comprehend complex phenomena, and unparalleled computational advances enable us to easily explore them without any or little understanding of their global properties. In fact, the likelihood of the data under complex stochastic models is often analytically or numerically intractable in many areas of sciences. This makes it even more important to simultaneously investigate the adequacy of these models - in absolute terms, against the data, rather than relative to the performance of other models - but no such procedure has been formally discussed when the likelihood is intractable. We provide a statistical interpretation to current developments in likelihood-free Bayesian inference that explicitly accounts for discrepancies between the model and the data, termed Approximate Bayesian Computation under model uncertainty (ABCμ). We augment the likelihood of the data with unknown error terms that correspond to freely chosen checking functions, and provide Monte Carlo strategies for sampling from the associated joint posterior distribution without the need of evaluating the likelihood. We discuss the benefit of incorporating model diagnostics within an ABC framework, and demonstrate how this method diagnoses model mismatch and guides model refinement by contrasting three qualitative models of protein network evolution to the protein interaction datasets of Helicobacter pylori and Treponema pallidum. Our results make a number of model deficiencies explicit, and suggest that the T. pallidum network topology is inconsistent with evolution dominated by link turnover or lateral gene transfer alone.

AB - Mathematical models are an important tool to explain and comprehend complex phenomena, and unparalleled computational advances enable us to easily explore them without any or little understanding of their global properties. In fact, the likelihood of the data under complex stochastic models is often analytically or numerically intractable in many areas of sciences. This makes it even more important to simultaneously investigate the adequacy of these models - in absolute terms, against the data, rather than relative to the performance of other models - but no such procedure has been formally discussed when the likelihood is intractable. We provide a statistical interpretation to current developments in likelihood-free Bayesian inference that explicitly accounts for discrepancies between the model and the data, termed Approximate Bayesian Computation under model uncertainty (ABCμ). We augment the likelihood of the data with unknown error terms that correspond to freely chosen checking functions, and provide Monte Carlo strategies for sampling from the associated joint posterior distribution without the need of evaluating the likelihood. We discuss the benefit of incorporating model diagnostics within an ABC framework, and demonstrate how this method diagnoses model mismatch and guides model refinement by contrasting three qualitative models of protein network evolution to the protein interaction datasets of Helicobacter pylori and Treponema pallidum. Our results make a number of model deficiencies explicit, and suggest that the T. pallidum network topology is inconsistent with evolution dominated by link turnover or lateral gene transfer alone.

KW - Approximate Bayesian computation

KW - Bayesian inference

KW - Intractable likelihoods

KW - Markov chain Monte Carlo

KW - Model uncertainty

UR - http://www.scopus.com/inward/record.url?scp=67649819681&partnerID=8YFLogxK

U2 - 10.1073/pnas.0807882106

DO - 10.1073/pnas.0807882106

M3 - Journal article

C2 - 19525398

AN - SCOPUS:67649819681

SN - 0027-8424

VL - 106

SP - 10576

EP - 10581

JO - Proceedings of the National Academy of Sciences of the United States of America

JF - Proceedings of the National Academy of Sciences of the United States of America

IS - 26

ER -

Model criticism based on likelihood-free inference, with an application to protein network evolution

Abstract

Adgang til dokumentet

Andre filer og links

Fingeraftryk

Citationsformater