IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v56y2012i6p1808-1828.html
   My bibliography  Save this article

Direct fitting of dynamic models using integrated nested Laplace approximations — INLA

Author

Listed:
  • Ruiz-Cárdenas, Ramiro
  • Krainski, Elias T.
  • Rue, Håvard

Abstract

Inference in state-space models usually relies on recursive forms for filtering and smoothing of the state vectors regarding the temporal structure of the observations, an assumption that is, from our view point, unnecessary if the dataset is fixed, that is, completely available before analysis. In this paper, we propose a computational framework to perform approximate full Bayesian inference in linear and generalized dynamic linear models based on the Integrated Nested Laplace Approximation (INLA) approach. The proposed framework directly approximates the posterior marginals of interest disregarding the assumption of recursive updating/estimation of the states and hyperparameters in the case of fixed datasets and, therefore, enable us to do fully Bayesian analysis of complex state-space models more easily and in a short computational time. The proposed framework overcomes some limitations of current tools in the dynamic modeling literature and is vastly illustrated with a series of simulated as well as well known real-life examples from the literature, including realistically complex models with correlated error structures and models with more than one state vector, being mutually dependent on each other. R code is available online for all the examples presented.

Suggested Citation

  • Ruiz-Cárdenas, Ramiro & Krainski, Elias T. & Rue, Håvard, 2012. "Direct fitting of dynamic models using integrated nested Laplace approximations — INLA," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1808-1828.
  • Handle: RePEc:eee:csdana:v:56:y:2012:i:6:p:1808-1828
    DOI: 10.1016/j.csda.2011.10.024
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947311003999
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2011.10.024?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Arnaud Doucet & Vladislav Tadić, 2003. "Parameter estimation in general state-space models using particle methods," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 55(2), pages 409-422, June.
    2. J. Durbin & S. J. Koopman, 2000. "Time series analysis of non‐Gaussian observations based on state space models from both classical and Bayesian perspectives," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(1), pages 3-56.
    3. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178, Decembrie.
    4. Carter, C.K. & Kohn, R., "undated". "Markov Chain Monte Carlo in Conditionally Gaussian State Space Models," Statistics Working Paper _003, Australian Graduate School of Management.
    5. Håvard Rue & Sara Martino & Nicolas Chopin, 2009. "Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 319-392, April.
    6. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    7. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    8. Petris, Giovanni, 2010. "An R Package for Dynamic Linear Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i12).
    9. Siem Jan Koopman & Neil Shephard & Jurgen A. Doornik, 1999. "Statistical algorithms for models in state space using SsfPack 2.2," Econometrics Journal, Royal Economic Society, vol. 2(1), pages 107-160.
    10. Birgit Schrödle & Leonhard Held & Andrea Riebler & Jürg Danuser, 2011. "Using integrated nested Laplace approximations for the evaluation of veterinary surveillance data from Switzerland: a case‐study," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 60(2), pages 261-279, March.
    11. Dethlefsen, Claus & Lundbye-Christensen, Søren, 2006. "Formulating State Space Models in R with Focus on Longitudinal Regression Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 16(i01).
    12. Andrea Riebler & Leonhard Held & Håvard Rue & Matthias Bopp, 2012. "Gender‐specific differences and the impact of family integration on time trends in age‐stratified Swiss suicide rates," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(2), pages 473-490, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jan van den Brakel & Martijn Souren & Sabine Krieg, 2022. "Estimating monthly labour force figures during the COVID‐19 pandemic in the Netherlands," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(4), pages 1560-1583, October.
    2. S. R. Johnson & S. E. Heaps & K. J. Wilson & D. J. Wilkinson, 2023. "A Bayesian spatio‐temporal model for short‐term forecasting of precipitation fields," Environmetrics, John Wiley & Sons, Ltd., vol. 34(8), December.
    3. Luis A. Barboza & Julien Emile-Geay & Bo Li & Wan He, 2019. "Efficient Reconstructions of Common Era Climate via Integrated Nested Laplace Approximations," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 24(3), pages 535-554, September.
    4. Gressani, Oswaldo & Lambert, Philippe, 2018. "Fast Bayesian inference using Laplace approximations in a flexible promotion time cure model based on P-splines," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 151-167.
    5. Chan, Joshua C.C., 2013. "Moving average stochastic volatility models with application to inflation forecast," Journal of Econometrics, Elsevier, vol. 176(2), pages 162-172.
    6. Bivand, Roger & Gómez-Rubio, Virgilio & Rue, Håvard, 2015. "Spatial Data Analysis with R-INLA with Some Extensions," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 63(i20).
    7. Chiranjit Dutta & Nalini Ravishanker & Sumanta Basu, 2022. "Modeling Multivariate Positive-Valued Time Series Using R-INLA," Papers 2206.05374, arXiv.org, revised Jul 2022.
    8. Gressani, Oswaldo & Lambert, Philippe, 2016. "Fast Bayesian inference in semi-parametric P-spline cure survival models using Laplace approximations," LIDAM Discussion Papers ISBA 2016041, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cabral, Celso Rômulo Barbosa & da-Silva, Cibele Queiroz & Migon, Helio S., 2014. "A dynamic linear model with extended skew-normal for the initial distribution of the state parameter," Computational Statistics & Data Analysis, Elsevier, vol. 74(C), pages 64-80.
    2. Matti Vihola & Jouni Helske & Jordan Franks, 2020. "Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1339-1376, December.
    3. Motta, Anderson C. O. & Hotta, Luiz K., 2003. "Exact Maximum Likelihood and Bayesian Estimation of the Stochastic Volatility Model," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 23(2), November.
    4. Mayer Alvo & Jingrui Mu, 2023. "COVID-19 Data Analysis Using Bayesian Models and Nonparametric Geostatistical Models," Mathematics, MDPI, vol. 11(6), pages 1-13, March.
    5. Koopman, Siem Jan & Jungbacker, Borus & Hol, Eugenie, 2005. "Forecasting daily variability of the S&P 100 stock index using historical, realised and implied volatility measurements," Journal of Empirical Finance, Elsevier, vol. 12(3), pages 445-475, June.
    6. repec:jss:jstsof:16:i01 is not listed on IDEAS
    7. Bhattacharya, Arnab & Wilson, Simon P., 2018. "Sequential Bayesian inference for static parameters in dynamic state space models," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 187-203.
    8. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    9. Kleppe, Tore Selland & Skaug, Hans Julius, 2012. "Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3105-3119.
    10. Siem Jan Koopman & Kai Ming Lee, 2009. "Seasonality with trend and cycle interactions in unobserved components models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 58(4), pages 427-448, September.
    11. Chiranjit Dutta & Nalini Ravishanker & Sumanta Basu, 2022. "Modeling Multivariate Positive-Valued Time Series Using R-INLA," Papers 2206.05374, arXiv.org, revised Jul 2022.
    12. Alzahrani, Naif & Neal, Peter & Spencer, Simon E.F. & McKinley, Trevelyan J. & Touloupou, Panayiota, 2018. "Model selection for time series of count data," Computational Statistics & Data Analysis, Elsevier, vol. 122(C), pages 33-44.
    13. Ledenyov, Dimitri O. & Ledenyov, Viktor O., 2015. "Wave function method to forecast foreign currencies exchange rates at ultra high frequency electronic trading in foreign currencies exchange markets," MPRA Paper 67470, University Library of Munich, Germany.
    14. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    15. Martins, Thiago G. & Simpson, Daniel & Lindgren, Finn & Rue, Håvard, 2013. "Bayesian computing with INLA: New features," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 68-83.
    16. repec:jss:jstsof:39:i02 is not listed on IDEAS
    17. Dani Gamerman & Thiago Rezende Santos & Glaura C. Franco, 2013. "A Non-Gaussian Family Of State-Space Models With Exact Marginal Likelihood," Journal of Time Series Analysis, Wiley Blackwell, vol. 34(6), pages 625-645, November.
    18. Kreuzer, Alexander & Dalla Valle, Luciana & Czado, Claudia, 2023. "Bayesian multivariate nonlinear state space copula models," Computational Statistics & Data Analysis, Elsevier, vol. 188(C).
    19. Djennad, Abdelmajid & Rigby, Robert & Stasinopoulos, Dimitrios & Voudouris, Vlasios & Eilers, Paul, 2015. "Beyond location and dispersion models: The Generalized Structural Time Series Model with Applications," MPRA Paper 62807, University Library of Munich, Germany.
    20. Yuheng Ling, 2022. "Estimating coastal premiums for apartment prices: Towards a new multilevel modelling approach," Environment and Planning B, , vol. 49(1), pages 188-205, January.
    21. DeRossi, G. & Harvey, A., 2006. "Time-Varying Quantiles," Cambridge Working Papers in Economics 0649, Faculty of Economics, University of Cambridge.
    22. Hubin, Aliaksandr & Storvik, Geir, 2018. "Mode jumping MCMC for Bayesian variable selection in GLMM," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 281-297.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:56:y:2012:i:6:p:1808-1828. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.