IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v106y2017icp77-89.html
   My bibliography  Save this article

Extending approximate Bayesian computation methods to high dimensions via a Gaussian copula model

Author

Listed:
  • Li, J.
  • Nott, D.J.
  • Fan, Y.
  • Sisson, S.A.

Abstract

Approximate Bayesian computation (ABC) refers to a family of inference methods used in the Bayesian analysis of complex models where evaluation of the likelihood is difficult. Conventional ABC methods often suffer from the curse of dimensionality, and a marginal adjustment strategy was recently introduced in the literature to improve the performance of ABC algorithms in high-dimensional problems. The marginal adjustment approach is extended using a Gaussian copula approximation. The method first estimates the bivariate posterior for each pair of parameters separately using a 2-dimensional Gaussian copula, and then combines these estimates together to estimate the joint posterior. The approximation works well in large sample settings when the posterior is approximately normal, but also works well in many cases which are far from that situation due to the nonparametric estimation of the marginal posterior distributions. If each bivariate posterior distribution can be well estimated with a low-dimensional ABC analysis then this Gaussian copula method can extend ABC methods to problems of high dimension. The method also results in an analytic expression for the approximate posterior which is useful for many purposes such as approximation of the likelihood itself. This method is illustrated with several examples.

Suggested Citation

  • Li, J. & Nott, D.J. & Fan, Y. & Sisson, S.A., 2017. "Extending approximate Bayesian computation methods to high dimensions via a Gaussian copula model," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 77-89.
  • Handle: RePEc:eee:csdana:v:106:y:2017:i:c:p:77-89
    DOI: 10.1016/j.csda.2016.07.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947316301694
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2016.07.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. C. C. Drovandi & A. N. Pettitt, 2011. "Estimation of Parameters for Macroparasite Population Evolution Using Approximate Bayesian Computation," Biometrics, The International Biometric Society, vol. 67(1), pages 225-233, March.
    2. Chun-Yu Ho & Dan Li, 2014. "A mirror of history: China's bond market, 1921–42," Economic History Review, Economic History Society, vol. 67(2), pages 409-434, May.
    3. Simon Barthelmé & Nicolas Chopin, 2014. "Expectation Propagation for Likelihood-Free Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 315-333, March.
    4. Bortot, P. & Coles, S.G. & Sisson, S.A., 2007. "Inference for Stereological Extremes," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 84-92, March.
    5. Anders Løland & Ragnar Bang Huseby & Nils Lid Hjort & Arnoldo Frigessi, 2013. "Statistical Corrections of Invalid Correlation Matrices," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(4), pages 807-824, December.
    6. Paul Fearnhead & Dennis Prangle, 2012. "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(3), pages 419-474, June.
    7. Koller, Manuel & Stahel, Werner A., 2011. "Sharpening Wald-type inference in robust regression for small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(8), pages 2504-2515, August.
    8. Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504.
    9. Klimenko E. V., 2014. "Social Protection: History Of," Management, Academy of Municipal Administration, vol. 8(1), pages 148-155, February.
    10. Chulapong Panichkriangkrai & Liang Li & Ross Walker & Kozaburo Hachimura, 2014. "Image Analysis for Historical Japanese Book Archives," International Journal of Asian Business and Information Management (IJABIM), IGI Global, vol. 5(2), pages 1-11, April.
    11. Nunes Matthew A & Balding David J, 2010. "On Optimal Selection of Summary Statistics for Approximate Bayesian Computation," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 9(1), pages 1-16, September.
    12. Rayner, G. D. & MacGillivray, H. L., 2002. "Weighted quantile-based estimation for a class of transformation distributions," Computational Statistics & Data Analysis, Elsevier, vol. 39(4), pages 401-433, June.
    13. Drovandi, Christopher C. & Pettitt, Anthony N., 2011. "Likelihood-free Bayesian estimation of multivariate quantile distributions," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2541-2556, September.
    14. Fang, Hong-Bin & Fang, Kai-Tai & Kotz, Samuel, 2002. "The Meta-elliptical Distributions with Given Marginals," Journal of Multivariate Analysis, Elsevier, vol. 82(1), pages 1-16, July.
    15. Ehrlich, Isaac, 1973. "Participation in Illegitimate Activities: A Theoretical and Empirical Investigation," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 521-565, May-June.
    16. ., 2014. "China's urbanization: history and facts," Chapters, in: China’s Urbanization and the World Economy, chapter 1, pages 3-14, Edward Elgar Publishing.
    17. Mark A. Beaumont & Jean-Marie Cornuet & Jean-Michel Marin & Christian P. Robert, 2009. "Adaptive approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 96(4), pages 983-990.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Arbel, Julyan & Crispino, Marta & Girard, Stéphane, 2019. "Dependence properties and Bayesian inference for asymmetric multivariate copulas," Journal of Multivariate Analysis, Elsevier, vol. 174(C).
    2. Nikoloulopoulos, Aristidis K., 2023. "Efficient and feasible inference for high-dimensional normal copula regression models," Computational Statistics & Data Analysis, Elsevier, vol. 179(C).
    3. Rodrigues, G.S. & Prangle, D. & Sisson, S.A., 2018. "Recalibration: A post-processing method for approximate Bayesian computation," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 53-66.
    4. Ong, Victor M.-H. & Nott, David J. & Tran, Minh-Ngoc & Sisson, Scott A. & Drovandi, Christopher C., 2018. "Likelihood-free inference in high dimensions with synthetic likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 271-291.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gael M. Martin & David T. Frazier & Christian P. Robert, 2021. "Approximating Bayes in the 21st Century," Monash Econometrics and Business Statistics Working Papers 24/21, Monash University, Department of Econometrics and Business Statistics.
    2. Brenda N Vo & Christopher C Drovandi & Anthony N Pettitt & Graeme J Pettet, 2015. "Melanoma Cell Colony Expansion Parameters Revealed by Approximate Bayesian Computation," PLOS Computational Biology, Public Library of Science, vol. 11(12), pages 1-22, December.
    3. Creel, Michael & Kristensen, Dennis, 2016. "On selection of statistics for approximate Bayesian computing (or the method of simulated moments)," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 99-114.
    4. Lee, Xing Ju & Hainy, Markus & McKeone, James P. & Drovandi, Christopher C. & Pettitt, Anthony N., 2018. "ABC model selection for spatial extremes models applied to South Australian maximum temperature data," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 128-144.
    5. Silk Daniel & Filippi Sarah & Stumpf Michael P. H., 2013. "Optimizing threshold-schedules for sequential approximate Bayesian computation: applications to molecular systems," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 12(5), pages 603-618, October.
    6. Xing Ju Lee & Christopher C. Drovandi & Anthony N. Pettitt, 2015. "Model choice problems using approximate Bayesian computation with applications to pathogen transmission data sets," Biometrics, The International Biometric Society, vol. 71(1), pages 198-207, March.
    7. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    8. Florian Maire & Nial Friel & Pierre ALQUIER, 2017. "Informed Sub-Sampling MCMC: Approximate Bayesian Inference for Large Datasets," Working Papers 2017-40, Center for Research in Economics and Statistics.
    9. Bobinaite, Viktorija, 2015. "Financial sustainability of wind electricity sectors in the Baltic States," Renewable and Sustainable Energy Reviews, Elsevier, vol. 47(C), pages 794-815.
    10. Menéndez, P. & Fan, Y. & Garthwaite, P.H. & Sisson, S.A., 2014. "Simultaneous adjustment of bias and coverage probabilities for confidence intervals," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 35-44.
    11. Jonathan U Harrison & Ruth E Baker, 2020. "An automatic adaptive method to combine summary statistics in approximate Bayesian computation," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-21, August.
    12. Prangle Dennis & Fearnhead Paul & Cox Murray P. & Biggs Patrick J. & French Nigel P., 2014. "Semi-automatic selection of summary statistics for ABC model choice," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 13(1), pages 67-82, February.
    13. Alexander Buchholz & Nicolas CHOPIN, 2017. "Improving approximate Bayesian computation via quasi Monte Carlo," Working Papers 2017-37, Center for Research in Economics and Statistics.
    14. Buzbas, Erkan O. & Rosenberg, Noah A., 2015. "AABC: Approximate approximate Bayesian computation for inference in population-genetic models," Theoretical Population Biology, Elsevier, vol. 99(C), pages 31-42.
    15. Kobayashi, Genya, 2014. "A transdimensional approximate Bayesian computation using the pseudo-marginal approach for model choice," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 167-183.
    16. Mikael Sunnåker & Alberto Giovanni Busetto & Elina Numminen & Jukka Corander & Matthieu Foll & Christophe Dessimoz, 2013. "Approximate Bayesian Computation," PLOS Computational Biology, Public Library of Science, vol. 9(1), pages 1-10, January.
    17. Warne, David J. & Baker, Ruth E. & Simpson, Matthew J., 2018. "Multilevel rejection sampling for approximate Bayesian computation," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 71-86.
    18. Nakagome Shigeki & Fukumizu Kenji & Mano Shuhei, 2013. "Kernel approximate Bayesian computation in population genetic inferences," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 12(6), pages 667-678, December.
    19. Rodrigues, G.S. & Prangle, D. & Sisson, S.A., 2018. "Recalibration: A post-processing method for approximate Bayesian computation," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 53-66.
    20. Filippi Sarah & Barnes Chris P. & Stumpf Michael P.H. & Cornebise Julien, 2013. "On optimality of kernels for approximate Bayesian computation using sequential Monte Carlo," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 12(1), pages 87-107, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:106:y:2017:i:c:p:77-89. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.