IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v83y2015icp168-181.html

A Monte Carlo approach to quantifying model error in Bayesian parameter estimation

Author

Listed:
  • White, Staci A.
  • Herbei, Radu

Abstract

Quantifying the discrepancy between two distributions is considered, using the concept of ϕ-divergence. The motivation is a Bayesian inference scenario where one is interested in comparing different posterior distributions. Strongly consistent estimators for the ϕ-divergence between two posterior distributions are developed. The proposed estimators alleviate known computational difficulties with estimating normalizing constants. This approach can be used to study the impact that using an approximate likelihood has on the resulting posterior distribution and also to compare the effectiveness of different model approximations. The methodology is applied to two first-order emulator models and an oceanographic application where evaluation of the likelihood function involves the solution to a partial differential equation.

Suggested Citation

  • White, Staci A. & Herbei, Radu, 2015. "A Monte Carlo approach to quantifying model error in Bayesian parameter estimation," Computational Statistics & Data Analysis, Elsevier, vol. 83(C), pages 168-181.
    • Handle: RePEc:eee:csdana:v:83:y:2015:i:c:p:168-181
    DOI: 10.1016/j.csda.2014.10.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947314003004
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2014.10.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Lefebvre, Geneviève & Steele, Russell & Vandal, Alain C., 2010. "A path sampling identity for computing the Kullback-Leibler and J divergences," Computational Statistics & Data Analysis, Elsevier, vol. 54(7), pages 1719-1731, July.
    2. Jones, Galin L. & Haran, Murali & Caffo, Brian S. & Neath, Ronald, 2006. "Fixed-Width Output Analysis for Markov Chain Monte Carlo," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1537-1547, December.
    3. Higdon, Dave & Gattiker, James & Williams, Brian & Rightley, Maria, 2008. "Computer Model Calibration Using High-Dimensional Output," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 570-583, June.
    4. Håvard Rue & Sara Martino & Nicolas Chopin, 2009. "Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 319-392, April.
    5. Marc C. Kennedy & Anthony O'Hagan, 2001. "Bayesian calibration of computer models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 425-464.
    6. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    7. Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
    8. Alison L. Gibbs & Francis Edward Su, 2002. "On Choosing and Bounding Probability Metrics," International Statistical Review, International Statistical Institute, vol. 70(3), pages 419-435, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Yewen & Chang, Xiaohui & Luo, Fangzhi & Huang, Hui, 2023. "Additive dynamic models for correcting numerical model outputs," Computational Statistics & Data Analysis, Elsevier, vol. 187(C).
    2. Won Chang & Murali Haran & Patrick Applegate & David Pollard, 2016. "Calibrating an Ice Sheet Model Using High-Dimensional Binary Spatial Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 57-72, March.
    3. Hubin, Aliaksandr & Storvik, Geir, 2018. "Mode jumping MCMC for Bayesian variable selection in GLMM," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 281-297.
    4. Joshua C.C. Chan & Angelia L. Grant, 2014. "Issues in Comparing Stochastic Volatility Models Using the Deviance Information Criterion," CAMA Working Papers 2014-51, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    5. Carson, Stuart & Mills Flemming, Joanna, 2014. "Seal encounters at sea: A contemporary spatial approach using R-INLA," Ecological Modelling, Elsevier, vol. 291(C), pages 175-181.
    6. McDonald, Cory P. & Urban, Noel R., 2010. "Using a model selection criterion to identify appropriate complexity in aquatic biogeochemical models," Ecological Modelling, Elsevier, vol. 221(3), pages 428-432.
    7. Shota Homma & Daisuke Murakami & Shinya Hosokawa & Koji Kanefuji, 2025. "Introduction risk of fire ants through container cargo in ports: Data integration approach considering a logistic network," PLOS ONE, Public Library of Science, vol. 20(2), pages 1-15, February.
    8. Ali Arab, 2015. "Spatial and Spatio-Temporal Models for Modeling Epidemiological Data with Excess Zeros," IJERPH, MDPI, vol. 12(9), pages 1-13, August.
    9. Timothy Cogley & Argia M. Sbordone, 2006. "Trend inflation and inflation persistence in the New Keynesian Phillips curve," Staff Reports 270, Federal Reserve Bank of New York.
    10. Chan Joshua & Doucet Arnaud & León-González Roberto & Strachan Rodney W., 2025. "Multivariate Stochastic Volatility with Co-Heteroscedasticity," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 29(3), pages 265-300.
    11. Mayer Alvo & Jingrui Mu, 2023. "COVID-19 Data Analysis Using Bayesian Models and Nonparametric Geostatistical Models," Mathematics, MDPI, vol. 11(6), pages 1-13, March.
    12. Coll, M. & Pennino, M. Grazia & Steenbeek, J. & Sole, J. & Bellido, J.M., 2019. "Predicting marine species distributions: Complementarity of food-web and Bayesian hierarchical modelling approaches," Ecological Modelling, Elsevier, vol. 405(C), pages 86-101.
    13. Daniela Silva & Raquel Menezes & Ana Moreno & Ana Teles-Machado & Susana Garrido, 2024. "Environmental Effects on the Spatiotemporal Variability of Sardine Distribution Along the Portuguese Continental Coast," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 29(3), pages 553-575, September.
    14. David Jiménez-Hernández & Víctor González-Calatayud & Ana Torres-Soto & Asunción Martínez Mayoral & Javier Morales, 2020. "Digital Competence of Future Secondary School Teachers: Differences According to Gender, Age, and Branch of Knowledge," Sustainability, MDPI, vol. 12(22), pages 1-16, November.
    15. Rodriguez, Gabriel & Castillo B., Paul & Calero, Roberto & Salcedo Cisneros, Rodrigo & Ataurima Arellano, Miguel, 2024. "Evolution of the exchange rate pass-through into prices in Peru: An empirical application using TVP-VAR-SV models," Journal of International Money and Finance, Elsevier, vol. 142(C).
    16. V. A. Alegana & C. Pezzulo & A. J. Tatem & B. Omar & A. Christensen, 2021. "Mapping out-of-school adolescents and youths in low- and middle-income countries," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 8(1), pages 1-10, December.
    17. Martins, Thiago G. & Simpson, Daniel & Lindgren, Finn & Rue, Håvard, 2013. "Bayesian computing with INLA: New features," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 68-83.
    18. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    19. Massimo Bilancia & Giacomo Demarinis, 2014. "Bayesian scanning of spatial disease rates with integrated nested Laplace approximation (INLA)," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 23(1), pages 71-94, March.
    20. Mabel Morales-Otero & Vicente Núñez-Antón, 2021. "Comparing Bayesian Spatial Conditional Overdispersion and the Besag–York–Mollié Models: Application to Infant Mortality Rates," Mathematics, MDPI, vol. 9(3), pages 1-33, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:83:y:2015:i:c:p:168-181. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.