IDEAS home Printed from https://ideas.repec.org/a/jss/jstsof/v067i10.html
   My bibliography  Save this article

Bayesian State-Space Modelling on High-Performance Hardware Using LibBi

Author

Listed:
  • Murray, Lawrence M.

Abstract

LibBi is a software package for state space modelling and Bayesian inference on modern computer hardware, including multi-core central processing units, many-core graphics processing units, and distributed-memory clusters of such devices. The software parses a domain-specific language for model specification, then optimizes, generates, compiles and runs code for the given model, inference method and hardware platform. In presenting the software, this work serves as an introduction to state space models and the specialized methods developed for Bayesian inference with them. The focus is on sequential Monte Carlo (SMC) methods such as the particle filter for state estimation, and the particle Markov chain Monte Carlo and SMC2 methods for parameter estimation. All are well-suited to current computer hardware. Two examples are given and developed throughout, one a linear three-element windkessel model of the human arterial system, the other a nonlinear Lorenz '96 model. These are specified in the prescribed modelling language, and LibBi demonstrated by performing inference with them. Empirical results are presented, including a performance comparison of the software with different hardware configurations.

Suggested Citation

  • Murray, Lawrence M., 2015. "Bayesian State-Space Modelling on High-Performance Hardware Using LibBi," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(i10).
    • Handle: RePEc:jss:jstsof:v:067:i10
    DOI: http://hdl.handle.net/10.18637/jss.v067.i10
    as

    Download full text from publisher

    File URL: https://www.jstatsoft.org/index.php/jss/article/view/v067i10/v67i10.pdf
    Download Restriction: no
    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v067i10/LibBi-1.2.0.tar.gz
    Download Restriction: no
    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v067i10/Lorenz96-1.0.1.tar.gz
    Download Restriction: no
    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v067i10/Windkessel-1.0.1.tar.gz
    Download Restriction: no
    File URL: https://libkey.io/http://hdl.handle.net/10.18637/jss.v067.i10?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ken B. Newman & Carmen Fernández & Len Thomas & Stephen T. Buckland, 2009. "Monte Carlo Inference for State–Space Models of Wild Animal Populations," Biometrics, The International Biometric Society, vol. 65(2), pages 572-583, June.
    2. Craiu, Radu V. & Rosenthal, Jeffrey & Yang, Chao, 2009. "Learn From Thy Neighbor: Parallel-Chain and Regional Adaptive MCMC," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1454-1466.
    3. Paul Fearnhead & Omiros Papaspiliopoulos & Gareth O. Roberts, 2008. "Particle filters for partially observed diffusions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(4), pages 755-777, September.
    4. N. Chopin & P. E. Jacob & O. Papaspiliopoulos, 2013. "SMC-super-2: an efficient algorithm for sequential analysis of state space models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 397-426, June.
    5. Alexandros Beskos & Omiros Papaspiliopoulos & Gareth O. Roberts & Paul Fearnhead, 2006. "Exact and computationally efficient likelihood‐based estimation for discretely observed diffusion processes (with discussion)," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 333-382, June.
    6. Golightly, A. & Wilkinson, D.J., 2008. "Bayesian inference for nonlinear multivariate diffusion models observed with error," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1674-1693, January.
    7. Johansen, Adam M., 2009. "SMCTC: Sequential Monte Carlo in C++," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 30(i06).
    8. Pitt, Michael K. & Silva, Ralph dos Santos & Giordani, Paolo & Kohn, Robert, 2012. "On some properties of Markov chain Monte Carlo simulation methods based on the particle filter," Journal of Econometrics, Elsevier, vol. 171(2), pages 134-151.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sebastian Funk & Anton Camacho & Adam J Kucharski & Rachel Lowe & Rosalind M Eggo & W John Edmunds, 2019. "Assessing the performance of real-time epidemic forecasts: A case study of Ebola in the Western Area region of Sierra Leone, 2014-15," PLOS Computational Biology, Public Library of Science, vol. 15(2), pages 1-17, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gareth W. Peters & Rodrigo S. Targino & Mario V. Wüthrich, 2017. "Bayesian Modelling, Monte Carlo Sampling and Capital Allocation of Insurance Risks," Risks, MDPI, vol. 5(4), pages 1-51, September.
    2. Mamatzakis, Emmanuel C. & Tsionas, Mike G., 2021. "Making inference of British household's happiness efficiency: A Bayesian latent model," European Journal of Operational Research, Elsevier, vol. 294(1), pages 312-326.
    3. Virbickaitė, Audronė & Frey, Christoph & Macedo, Demian N., 2020. "Bayesian sequential stock return prediction through copulas," The Journal of Economic Asymmetries, Elsevier, vol. 22(C).
    4. Hermann Singer, 2011. "Continuous-discrete state-space modeling of panel data with nonlinear filter algorithms," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 95(4), pages 375-413, December.
    5. Shoji, Isao, 2013. "Filtering for partially observed diffusion and its applications," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(20), pages 4966-4976.
    6. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    7. Isambi Mbalawata & Simo Särkkä & Heikki Haario, 2013. "Parameter estimation in stochastic differential equations with Markov chain Monte Carlo and non-linear Kalman filtering," Computational Statistics, Springer, vol. 28(3), pages 1195-1223, June.
    8. Golightly, Andrew & Bradley, Emma & Lowe, Tom & Gillespie, Colin S., 2019. "Correlated pseudo-marginal schemes for time-discretised stochastic kinetic models," Computational Statistics & Data Analysis, Elsevier, vol. 136(C), pages 92-107.
    9. Quentin Clairon & Adeline Samson, 2020. "Optimal control for estimation in partially observed elliptic and hypoelliptic linear stochastic differential equations," Statistical Inference for Stochastic Processes, Springer, vol. 23(1), pages 105-127, April.
    10. Yuan Shen & Dan Cornford & Manfred Opper & Cedric Archambeau, 2012. "Variational Markov chain Monte Carlo for Bayesian smoothing of non-linear diffusions," Computational Statistics, Springer, vol. 27(1), pages 149-176, March.
    11. Mogens Bladt & Samuel Finch & Michael Sørensen, 2016. "Simulation of multivariate diffusion bridges," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(2), pages 343-369, March.
    12. Konstantinos Kalogeropoulos & Gareth O. Roberts & Petros Dellaportas, 2007. "Inference for stochastic volatility models using time change transformations," Papers 0711.1594, arXiv.org.
    13. Giorgos Sermaidis & Omiros Papaspiliopoulos & Gareth O. Roberts & Alexandros Beskos & Paul Fearnhead, 2013. "Markov Chain Monte Carlo for Exact Inference for Diffusions," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(2), pages 294-321, June.
    14. Paul Fearnhead & Vasilieos Giagos & Chris Sherlock, 2014. "Inference for reaction networks using the linear noise approximation," Biometrics, The International Biometric Society, vol. 70(2), pages 457-466, June.
    15. Nicolas Chopin & Sumeetpal S. Singh, 2013. "On the Particle Gibbs Sampler," Working Papers 2013-41, Center for Research in Economics and Statistics.
    16. Paul Fearnhead & Omiros Papaspiliopoulos & Gareth O. Roberts & Andrew Stuart, 2010. "Random‐weight particle filtering of continuous time processes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(4), pages 497-512, September.
    17. Beskos, Alexandros & Kalogeropoulos, Konstantinos & Pazos, Erik, 2013. "Advanced MCMC methods for sampling on diffusion pathspace," Stochastic Processes and their Applications, Elsevier, vol. 123(4), pages 1415-1453.
    18. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    19. Matti Vihola & Jouni Helske & Jordan Franks, 2020. "Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1339-1376, December.
    20. Nina Munkholt Jakobsen & Michael Sørensen, 2015. "Efficient Estimation for Diffusions Sampled at High Frequency Over a Fixed Time Interval," CREATES Research Papers 2015-33, Department of Economics and Business Economics, Aarhus University.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jss:jstsof:v:067:i10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: http://www.jstatsoft.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.