Show simple item record

dc.contributor.authorHrafnkelsson, Birgir
dc.contributor.authorSiegert, Stefan
dc.contributor.authorHuser, Raphaël
dc.contributor.authorBakka, Haakon
dc.contributor.authorJohannesson, Arni, V
dc.identifier.citationHrafnkelsson, B., Siegert, S., Huser, R., Bakka, H., & Jóhannesson, Á. V. (2021). Max-and-Smooth: A Two-Step Approach for Approximate Bayesian Inference in Latent Gaussian Models. Bayesian Analysis, 16(2). doi:10.1214/20-ba1219
dc.description.abstractWith modern high-dimensional data, complex statistical models are necessary, requiring computationally feasible inference schemes. We introduce Max-and-Smooth, an approximate Bayesian inference scheme for a flexible class of latent Gaussian models (LGMs) where one or more of the likelihood parameters are modeled by latent additive Gaussian processes. Our proposed inference scheme is a two-step approach. In the first step (Max), the likelihood function is approximated by a Gaussian density with mean and covariance equal to either (a) the maximum likelihood estimate and the inverse observed information, respectively, or (b) the mean and covariance of the normalized likelihood function. In the second step (Smooth), the latent parameters and hyperparameters are inferred and smoothed with the approximated likelihood function. The proposed method ensures that the uncertainty from the first step is correctly propagated to the second step. Because the prior density for the latent parameters is assumed to be Gaussian and the approximated likelihood function is Gaussian, the approximate posterior density of the latent parameters (conditional on the hyperparameters) is also Gaussian, thus facilitating efficient posterior inference in high dimensions. Furthermore, the approximate marginal posterior distribution of the hyperparameters is tractable, and as a result, the hyperparameters can be sampled independently of the latent parameters. We show that the computational cost of Max-and-Smooth is close to being insensitive to the number of independent data replicates, and that it scales well with increased dimension of the latent parameter vector provided that its Gaussian prior density is specified with a sparse precision matrix. In the case of a large number of independent data replicates, sparse precision matrices, and high-dimensional latent vectors, the speedup is substantial in comparison to an MCMC scheme that infers the posterior density from the exact likelihood function. The accuracy of the Gaussian approximation to the likelihood function increases with the number of data replicates per latent model parameter. The proposed inference scheme is demonstrated on one spatially referenced real dataset and on simulated data mimicking spatial, temporal, and spatio-temporal inference problems. Our results show that Max-and-Smooth is accurate and fast.
dc.description.sponsorshipWe would like to acknowledge support from the EPSRC ReCoVer network, UK National Environment Research Council (NERC) and the University of Iceland Research Fund. We thank the Associate Editor and the reviewer for their constructive suggestions.
dc.publisherInstitute of Mathematical Statistics
dc.rightsArchived with thanks to BAYESIAN ANALYSIS
dc.subjectapproximate Bayesian inference
dc.subjectBayesian hierarchical model
dc.subjectlatent Gaussian model
dc.subjectmultivariate link function
dc.subjectspatio-temporal data
dc.titleMax-and-Smooth: A Two-Step Approach for Approximate Bayesian Inference in Latent Gaussian Models
dc.contributor.departmentComputer, Electrical and Mathematical Science and Engineering (CEMSE) Division
dc.contributor.departmentStatistics Program
dc.identifier.journalBAYESIAN ANALYSIS
dc.eprint.versionPublisher's Version/PDF
dc.contributor.institutionUniversity of Iceland, Reykjavik, Iceland
dc.contributor.institutionUniversity of Exeter, Exeter, UK
dc.contributor.institutionUniversity of Oslo, Oslo, Norway
dc.contributor.affiliationKing Abdullah University of Science and Technology (KAUST)
kaust.personHuser, Raphaël

Files in this item

Publisher's version

This item appears in the following Collection(s)

Show simple item record

Archived with thanks to BAYESIAN ANALYSIS
Except where otherwise noted, this item's license is described as Archived with thanks to BAYESIAN ANALYSIS

*Selected version