Show simple item record

dc.contributor.authorHrafnkelsson, Birgir
dc.contributor.authorJóhannesson, Árni V.
dc.contributor.authorSiegert, Stefan
dc.contributor.authorBakka, Haakon
dc.contributor.authorHuser, Raphaël
dc.date.accessioned2019-07-30T11:39:20Z
dc.date.available2019-07-30T11:39:20Z
dc.date.issued2019-07-27
dc.identifier.urihttp://hdl.handle.net/10754/656236
dc.description.abstractWith modern high-dimensional data, complex statistical models are necessary,requiring computationally feasible inference schemes. We introduceMax-and-Smooth, an approximate Bayesian inference scheme for a flexible classof latent Gaussian models (LGMs) where one or more of the likelihood parametersare modeled by latent additive Gaussian processes. Max-and-Smooth consists oftwo-steps. In the first step (Max), the likelihood function is approximated bya Gaussian density with mean and covariance equal to either (a) the maximumlikelihood estimate and the inverse observed information, respectively, or (b)the mean and covariance of the normalized likelihood function. In the secondstep (Smooth), the latent parameters and hyperparameters are inferred andsmoothed with the approximated likelihood function. The proposed method ensuresthat the uncertainty from the first step is correctly propagated to the secondstep. Since the approximated likelihood function is Gaussian, the approximateposterior density of the latent parameters of the LGM (conditional on thehyperparameters) is also Gaussian, thus facilitating efficient posteriorinference in high dimensions. Furthermore, the approximate marginal posteriordistribution of the hyperparameters is tractable, and as a result, thehyperparameters can be sampled independently of the latent parameters. In thecase of a large number of independent data replicates, sparse precisionmatrices, and high-dimensional latent vectors, the speedup is substantial incomparison to an MCMC scheme that infers the posterior density from the exactlikelihood function. The proposed inference scheme is demonstrated on onespatially referenced real dataset and on simulated data mimicking spatial,temporal, and spatio-temporal inference problems. Our results show thatMax-and-Smooth is accurate and fast.
dc.language.isoen
dc.publisherarXiv
dc.relation.urlhttps://arxiv.org/pdf/1907.11969
dc.rightsArchived with thanks to arXiv
dc.titleMax-and-Smooth: a two-step approach for approximate Bayesian inference in latent Gaussian models
dc.typePreprint
dc.contributor.departmentComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
dc.contributor.departmentStatistics
dc.contributor.departmentStatistics Program
dc.eprint.versionPre-print
dc.contributor.institutionUniversity of Iceland
dc.contributor.institutionUniversity of Exeter
dc.contributor.affiliationKing Abdullah University of Science and Technology (KAUST)
pubs.publication-statusSubmitted
dc.identifier.arxividarXiv:1907.11969
kaust.personBakka, Haakon
kaust.personHuser, Raphaël
refterms.dateFOA2019-07-30T11:39:20Z


Files in this item

Thumbnail
Name:
lgms_approx_inference_arxiv.pdf
Size:
542.1Kb
Format:
PDF
Description:
Preprint

This item appears in the following Collection(s)

Show simple item record