Bayesian Optimal Experimental Design Using Multilevel Monte Carlo

Handle URI:
http://hdl.handle.net/10754/552705
Title:
Bayesian Optimal Experimental Design Using Multilevel Monte Carlo
Authors:
Ben Issaid, Chaouki ( 0000-0002-4481-8168 )
Abstract:
Experimental design can be vital when experiments are resource-exhaustive and time-consuming. In this work, we carry out experimental design in the Bayesian framework. To measure the amount of information that can be extracted from the data in an experiment, we use the expected information gain as the utility function, which specifically is the expected logarithmic ratio between the posterior and prior distributions. Optimizing this utility function enables us to design experiments that yield the most informative data about the model parameters. One of the major difficulties in evaluating the expected information gain is that it naturally involves nested integration over a possibly high dimensional domain. We use the Multilevel Monte Carlo (MLMC) method to accelerate the computation of the nested high dimensional integral. The advantages are twofold. First, MLMC can significantly reduce the cost of the nested integral for a given tolerance, by using an optimal sample distribution among different sample averages of the inner integrals. Second, the MLMC method imposes fewer assumptions, such as the asymptotic concentration of posterior measures, required for instance by the Laplace approximation (LA). We test the MLMC method using two numerical examples. The first example is the design of sensor deployment for a Darcy flow problem governed by a one-dimensional Poisson equation. We place the sensors in the locations where the pressure is measured, and we model the conductivity field as a piecewise constant random vector with two parameters. The second one is chemical Enhanced Oil Recovery (EOR) core flooding experiment assuming homogeneous permeability. We measure the cumulative oil recovery, from a horizontal core flooded by water, surfactant and polymer, for different injection rates. The model parameters consist of the endpoint relative permeabilities, the residual saturations and the relative permeability exponents for the three phases: water, oil and microemulsions. We also compare the performance of the MLMC to the LA and the direct Double Loop Monte Carlo (DLMC). In fact, we show that, in the case of the aforementioned examples, MLMC combined with LA turns to be the best method in terms of computational cost.
Advisors:
Tempone, Raul ( 0000-0003-1967-4446 )
Committee Member:
Bisetti, Fabrizio ( 0000-0001-5162-7805 ) ; Sun, Ying ( 0000-0001-6703-4270 ) ; Long, Quan ( 0000-0002-0329-9437 )
KAUST Department:
Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Program:
Applied Mathematics and Computational Science
Issue Date:
12-May-2015
Type:
Thesis
Appears in Collections:
Applied Mathematics and Computational Science Program; Theses; Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division

Full metadata record

DC FieldValue Language
dc.contributor.advisorTempone, Raulen
dc.contributor.authorBen Issaid, Chaoukien
dc.date.accessioned2015-05-13T14:09:23Zen
dc.date.available2015-05-13T14:09:23Zen
dc.date.issued2015-05-12en
dc.identifier.urihttp://hdl.handle.net/10754/552705en
dc.description.abstractExperimental design can be vital when experiments are resource-exhaustive and time-consuming. In this work, we carry out experimental design in the Bayesian framework. To measure the amount of information that can be extracted from the data in an experiment, we use the expected information gain as the utility function, which specifically is the expected logarithmic ratio between the posterior and prior distributions. Optimizing this utility function enables us to design experiments that yield the most informative data about the model parameters. One of the major difficulties in evaluating the expected information gain is that it naturally involves nested integration over a possibly high dimensional domain. We use the Multilevel Monte Carlo (MLMC) method to accelerate the computation of the nested high dimensional integral. The advantages are twofold. First, MLMC can significantly reduce the cost of the nested integral for a given tolerance, by using an optimal sample distribution among different sample averages of the inner integrals. Second, the MLMC method imposes fewer assumptions, such as the asymptotic concentration of posterior measures, required for instance by the Laplace approximation (LA). We test the MLMC method using two numerical examples. The first example is the design of sensor deployment for a Darcy flow problem governed by a one-dimensional Poisson equation. We place the sensors in the locations where the pressure is measured, and we model the conductivity field as a piecewise constant random vector with two parameters. The second one is chemical Enhanced Oil Recovery (EOR) core flooding experiment assuming homogeneous permeability. We measure the cumulative oil recovery, from a horizontal core flooded by water, surfactant and polymer, for different injection rates. The model parameters consist of the endpoint relative permeabilities, the residual saturations and the relative permeability exponents for the three phases: water, oil and microemulsions. We also compare the performance of the MLMC to the LA and the direct Double Loop Monte Carlo (DLMC). In fact, we show that, in the case of the aforementioned examples, MLMC combined with LA turns to be the best method in terms of computational cost.en
dc.language.isoenen
dc.subjectbayesian experimental designen
dc.subjectMultilevel Monte Carloen
dc.subjectexpected information gainen
dc.subjectlaplace approximationen
dc.subjectsensor deploymenten
dc.subjectcore floodingen
dc.titleBayesian Optimal Experimental Design Using Multilevel Monte Carloen
dc.typeThesisen
dc.contributor.departmentComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Divisionen
thesis.degree.grantorKing Abdullah University of Science and Technologyen_GB
dc.contributor.committeememberBisetti, Fabrizioen
dc.contributor.committeememberSun, Yingen
dc.contributor.committeememberLong, Quanen
thesis.degree.disciplineApplied Mathematics and Computational Scienceen
thesis.degree.nameMaster of Scienceen
dc.person.id127051en
All Items in KAUST are protected by copyright, with all rights reserved, unless otherwise indicated.