Simulation smoothing for state-space models: A computational efficiency analysis
AbstractSimulation smoothing involves drawing state variables (or innovations) in discrete time state-space models from their conditional distribution given parameters and observations. Gaussian simulation smoothing is of particular interest, not only for the direct analysis of Gaussian linear models, but also for the indirect analysis of more general models. Several methods for Gaussian simulation smoothing exist, most of which are based on the Kalman filter. Since states in Gaussian linear state-space models are Gaussian Markov random fields, it is also possible to apply the Cholesky Factor Algorithm (CFA) to draw states. This algorithm takes advantage of the band diagonal structure of the Hessian matrix of the log density to make efficient draws. We show how to exploit the special structure of state-space models to draw latent states even more efficiently. We analyse the computational efficiency of Kalman-filter-based methods, the CFA, and our new method using counts of operations and computational experiments. We show that for many important cases, our method is most efficient. Gains are particularly large for cases where the dimension of observed variables is large or where one makes repeated draws of states for the same parameter values. We apply our method to a multivariate Poisson model with time-varying intensities, which we use to analyse financial market transaction count data.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Elsevier in its journal Computational Statistics & Data Analysis.
Volume (Year): 55 (2011)
Issue (Month): 1 (January)
Contact details of provider:
Web page: http://www.elsevier.com/locate/csda
State-space models Markov chain Monte Carlo Importance sampling Count data High frequency financial data;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Leonhard Knorr-Held, 2002. "On Block Updating in Markov Random Field Models for Disease Mapping," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics & Finnish Statistical Society & Norwegian Statistical Association & Swedish Statistical Association, vol. 29(4), pages 597-614.
- McCAUSLAND, William, 2008.
"The Hessian Method (Highly Efficient State Smoothing, In a Nutshell),"
Cahiers de recherche
2008-03, Universite de Montreal, Departement de sciences economiques.
- McCAUSLAND, William, 2008. "The Hessian Method (Highly Efficient State Smoothing, In a Nutshell)," Cahiers de recherche 03-2008, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
- Sangjoon Kim, Neil Shephard & Siddhartha Chib, .
"Stochastic volatility: likelihood inference and comparison with ARCH models,"
W26, revised version of W, Economics Group, Nuffield College, University of Oxford.
- Kim, Sangjoon & Shephard, Neil & Chib, Siddhartha, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," Review of Economic Studies, Wiley Blackwell, vol. 65(3), pages 361-93, July.
- Sangjoon Kim & Neil Shephard, 1994. "Stochastic volatility: likelihood inference and comparison with ARCH models," Economics Papers 3., Economics Group, Nuffield College, University of Oxford.
- Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1996. "Stochastic Volatility: Likelihood Inference And Comparison With Arch Models," Econometrics 9610002, EconWPA.
- Song, Juwon & Belin, Thomas R., 2008. "Choosing an appropriate number of factors in factor analysis with incomplete data," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3560-3569, March.
- Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000.
"The Generalized Dynamic-Factor Model: Identification And Estimation,"
The Review of Economics and Statistics,
MIT Press, vol. 82(4), pages 540-554, November.
- Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 1999. "The Generalized Dynamic Factor Model: Identification and Estimation," CEPR Discussion Papers 2338, C.E.P.R. Discussion Papers.
- Mario Forni & Marc Hallin & Lucrezia Reichlin & Marco Lippi, 2000. "The generalised dynamic factor model: identification and estimation," ULB Institutional Repository 2013/10143, ULB -- Universite Libre de Bruxelles.
- Stock, James H. & Watson, Mark W., 1999.
Journal of Monetary Economics,
Elsevier, vol. 44(2), pages 293-335, October.
- Sylvia Fr�Hwirth-Schnatter & Helga Wagner, 2006. "Auxiliary mixture sampling for parameter-driven models of time series of counts with applications to state space modelling," Biometrika, Biometrika Trust, vol. 93(4), pages 827-841, December.
- J. Durbin, 2002. "A simple and efficient simulation smoother for state space time series analysis," Biometrika, Biometrika Trust, vol. 89(3), pages 603-616, August.
- Marc P. Giannoni & Jean Boivin, 2005.
"DSGE Models in a Data-Rich Environment,"
Computing in Economics and Finance 2005
431, Society for Computational Economics.
- Jean Boivin & Marc Giannoni, 2006. "DSGE Models in a Data-Rich Environment," NBER Working Papers 12772, National Bureau of Economic Research, Inc.
- Jean Boivin & Marc Giannoni, 2006. "DSGE Models in a Data-Rich Environment," NBER Technical Working Papers 0332, National Bureau of Economic Research, Inc.
- Boivin, J. & Giannoni, M., 2007. "DSGE Models in a Data-Rich Environment," Working papers 162, Banque de France.
- Chris Heaton & Victor Solo, 2004. "Identification of causal factor models of stationary time series," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 618-627, December.
- Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-62, April.
- Joshua C.C. Chan, 2013.
"Moving Average Stochastic Volatility Models with Application to Inflation Forecast,"
CAMA Working Papers
2013-31, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Chan, Joshua C.C., 2013. "Moving average stochastic volatility models with application to inflation forecast," Journal of Econometrics, Elsevier, vol. 176(2), pages 162-172.
- Joshua C C Chan, 2012. "Moving Average Stochastic Volatility Models with Application to Inflation Forecast," ANU Working Papers in Economics and Econometrics 2012-591, Australian National University, College of Business and Economics, School of Economics.
- Chan, Joshua & Strachan, Rodney, 2012.
"Estimation in Non-Linear Non-Gaussian State Space Models with Precision-Based Methods,"
39360, University Library of Munich, Germany.
- Joshua Chan & Rodney Strachan, 2012. "Estimation in Non-Linear Non-Gaussian State Space Models with Precision-Based Methods," CAMA Working Papers 2012-13, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- McCausland, William J., 2012. "The HESSIAN method: Highly efficient simulation smoothing, in a nutshell," Journal of Econometrics, Elsevier, vol. 168(2), pages 189-206.
- Joshua C C Chan & Cody Y L Hsiao, 2013. "Estimation of Stochastic Volatility Models with Heavy Tails and Serial Dependence," CAMA Working Papers 2013-74, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Joshua C.C. Chan & Angelia L. Grant, 2014. "Fast Computation of the Deviance Information Criterion for Latent Variable Models," CAMA Working Papers 2014-09, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Joshua C.C. Chan & Eric Eisenstat, 2013. "Gibbs Samplers for VARMA and Its Extensions," ANU Working Papers in Economics and Econometrics 2013-604, Australian National University, College of Business and Economics, School of Economics.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.