IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v55y2011i1p199-212.html
   My bibliography  Save this article

Simulation smoothing for state-space models: A computational efficiency analysis

Author

Listed:
  • McCausland, William J.
  • Miller, Shirley
  • Pelletier, Denis

Abstract

Simulation smoothing involves drawing state variables (or innovations) in discrete time state-space models from their conditional distribution given parameters and observations. Gaussian simulation smoothing is of particular interest, not only for the direct analysis of Gaussian linear models, but also for the indirect analysis of more general models. Several methods for Gaussian simulation smoothing exist, most of which are based on the Kalman filter. Since states in Gaussian linear state-space models are Gaussian Markov random fields, it is also possible to apply the Cholesky Factor Algorithm (CFA) to draw states. This algorithm takes advantage of the band diagonal structure of the Hessian matrix of the log density to make efficient draws. We show how to exploit the special structure of state-space models to draw latent states even more efficiently. We analyse the computational efficiency of Kalman-filter-based methods, the CFA, and our new method using counts of operations and computational experiments. We show that for many important cases, our method is most efficient. Gains are particularly large for cases where the dimension of observed variables is large or where one makes repeated draws of states for the same parameter values. We apply our method to a multivariate Poisson model with time-varying intensities, which we use to analyse financial market transaction count data.

Suggested Citation

  • McCausland, William J. & Miller, Shirley & Pelletier, Denis, 2011. "Simulation smoothing for state-space models: A computational efficiency analysis," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 199-212, January.
  • Handle: RePEc:eee:csdana:v:55:y:2011:i:1:p:199-212
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(10)00282-3
    Download Restriction: Full text for ScienceDirect subscribers only.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. McCAUSLAND, William, 2008. "The Hessian Method (Highly Efficient State Smoothing, In a Nutshell)," Cahiers de recherche 2008-03, Universite de Montreal, Departement de sciences economiques.
    2. Sylvia FrüHwirth-Schnatter & Helga Wagner, 2006. "Auxiliary mixture sampling for parameter-driven models of time series of counts with applications to state space modelling," Biometrika, Biometrika Trust, vol. 93(4), pages 827-841, December.
    3. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    4. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    5. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," Review of Economic Studies, Oxford University Press, vol. 65(3), pages 361-393.
    6. Leonhard Knorr-Held, 2002. "On Block Updating in Markov Random Field Models for Disease Mapping," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 29(4), pages 597-614.
    7. Marc P. Giannoni & Jean Boivin, 2005. "DSGE Models in a Data-Rich Environment," Computing in Economics and Finance 2005 431, Society for Computational Economics.
    8. Chris Heaton & Victor Solo, 2004. "Identification of causal factor models of stationary time series," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 618-627, December.
    9. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    10. Song, Juwon & Belin, Thomas R., 2008. "Choosing an appropriate number of factors in factor analysis with incomplete data," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3560-3569, March.
    11. J. Durbin, 2002. "A simple and efficient simulation smoother for state space time series analysis," Biometrika, Biometrika Trust, vol. 89(3), pages 603-616, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chan, Joshua C.C., 2013. "Moving average stochastic volatility models with application to inflation forecast," Journal of Econometrics, Elsevier, vol. 176(2), pages 162-172.
    2. Angelia L. Grant & Joshua C.C. Chan, 2017. "A Bayesian Model Comparison for Trend‐Cycle Decompositions of Output," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 49(2-3), pages 525-552, March.
    3. Joshua C.C. Chan & Eric Eisenstat, 2013. "Gibbs Samplers for VARMA and Its Extensions," ANU Working Papers in Economics and Econometrics 2013-604, Australian National University, College of Business and Economics, School of Economics.
    4. Luis Uzeda, 2016. "State Correlation and Forecasting: A Bayesian Approach Using Unobserved Components Models," ANU Working Papers in Economics and Econometrics 2016-632, Australian National University, College of Business and Economics, School of Economics.
    5. Kastner, Gregor & Frühwirth-Schnatter, Sylvia, 2014. "Ancillarity-sufficiency interweaving strategy (ASIS) for boosting MCMC estimation of stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 408-423.
    6. Chan, Joshua & Strachan, Rodney, 2012. "Estimation in Non-Linear Non-Gaussian State Space Models with Precision-Based Methods," MPRA Paper 39360, University Library of Munich, Germany.
    7. McCausland, William J., 2012. "The HESSIAN method: Highly efficient simulation smoothing, in a nutshell," Journal of Econometrics, Elsevier, vol. 168(2), pages 189-206.
    8. repec:taf:jnlbes:v:35:y:2017:i:1:p:17-28 is not listed on IDEAS
    9. Li, Junye, 2013. "An unscented Kalman smoother for volatility extraction: Evidence from stock prices and options," Computational Statistics & Data Analysis, Elsevier, vol. 58(C), pages 15-26.
    10. repec:eee:ecmode:v:69:y:2018:i:c:p:291-300 is not listed on IDEAS
    11. Joshua C.C. Chan & Angelia L. Grant, 2014. "Issues in Comparing Stochastic Volatility Models Using the Deviance Information Criterion," CAMA Working Papers 2014-51, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    12. Eric Eisenstat & Rodney W. Strachan, 2016. "Modelling Inflation Volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(5), pages 805-820, August.
    13. Chan, Joshua C.C. & Grant, Angelia L., 2016. "Fast computation of the deviance information criterion for latent variable models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 847-859.
    14. Luis Uzeda, 2018. "State Correlation and Forecasting: A Bayesian Approach Using Unobserved Components Models," Staff Working Papers 18-14, Bank of Canada.
    15. Joshua C C Chan & Cody Y L Hsiao, 2013. "Estimation of Stochastic Volatility Models with Heavy Tails and Serial Dependence," CAMA Working Papers 2013-74, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    16. Joshua C.C. Chan & Rodney Strachan, 2014. "The Zero Lower Bound: Implications for Modelling the Interest Rate," Working Paper series 42_14, Rimini Centre for Economic Analysis.
    17. Joshua C. C. Chan, 2017. "The Stochastic Volatility in Mean Model With Time-Varying Parameters: An Application to Inflation Modeling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(1), pages 17-28, January.
    18. Liu, Wei-han, 2016. "A re-examination of maturity effect of energy futures price from the perspective of stochastic volatility," Energy Economics, Elsevier, vol. 56(C), pages 351-362.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:55:y:2011:i:1:p:199-212. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: http://www.elsevier.com/locate/csda .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.