IDEAS home Printed from https://ideas.repec.org/p/syb/wpbsba/2123-8337.html
   My bibliography  Save this paper

Maximum likelihood estimation of time series models: the Kalman filter and beyond

Author

Listed:
  • Luati, Alessandra
  • Proietti, Tommaso

Abstract

The purpose of this chapter is to provide a comprehensive treatment of likelihood inference for state space models. These are a class of time series models relating an observable time series to quantities called states, which are characterized by a simple temporal dependence structure, typically a first order Markov process. The states have sometimes substantial interpretation. Key estimation problems in economics concern latent variables, such as the output gap, potential output, the non-accelerating-inflation rate of unemployment, or NAIRU, core inflation, and so forth. Time-varying volatility, which is quintessential to finance, is an important feature also in macroeconomics. In the multivariate framework relevant features can be common to different series, meaning that the driving forces of a particular feature and/or the transmission mechanism are the same. The objective of this chapter is reviewing this algorithm and discussing maximum likelihood inference, starting from the linear Gaussian case and discussing the extensions to a nonlinear and non Gaussian framework.

Suggested Citation

  • Luati, Alessandra & Proietti, Tommaso, 2012. "Maximum likelihood estimation of time series models: the Kalman filter and beyond," Working Papers 2012_02, University of Sydney Business School, Discipline of Business Analytics.
  • Handle: RePEc:syb:wpbsba:2123/8337
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/2123/8337
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Pagan, Adrian, 1980. "Some identification and estimation results for regression models with stochastically varying coefficients," Journal of Econometrics, Elsevier, vol. 13(3), pages 341-363, August.
    2. Harvey, Andrew, 2001. "Testing in Unobserved Components Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(1), pages 1-19, January.
    3. Amisano, Gianni & Tristani, Oreste, 2010. "Euro area inflation persistence in an estimated nonlinear DSGE model," Journal of Economic Dynamics and Control, Elsevier, vol. 34(10), pages 1837-1858, October.
    4. Nyblom, Jukka & Harvey, Andrew, 2000. "Tests Of Common Stochastic Trends," Econometric Theory, Cambridge University Press, vol. 16(2), pages 176-199, April.
    5. Creal, Drew & Koopman, Siem Jan & Lucas, André, 2011. "A Dynamic Multivariate Heavy-Tailed Model for Time-Varying Volatilities and Correlations," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(4), pages 552-563.
    6. J. Durbin & S. J. Koopman, 2000. "Time series analysis of non‐Gaussian observations based on state space models from both classical and Bayesian perspectives," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(1), pages 3-56.
    7. Harvey, A., 2010. "Exponential Conditional Volatility Models," Cambridge Working Papers in Economics 1040, Faculty of Economics, University of Cambridge.
    8. George Poyiadjis & Arnaud Doucet & Sumeetpal S. Singh, 2011. "Particle approximations of the score and observed information matrix in state space models with application to parameter estimation," Biometrika, Biometrika Trust, vol. 98(1), pages 65-80.
    9. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107630024, September.
    10. Nigar Hashimzade & Michael A. Thornton (ed.), 2013. "Handbook of Research Methods and Applications in Empirical Macroeconomics," Books, Edward Elgar Publishing, number 14327.
    11. Lars Ljungqvist & Thomas J. Sargent, 2004. "Recursive Macroeconomic Theory, 2nd Edition," MIT Press Books, The MIT Press, edition 2, volume 1, number 026212274x, April.
    12. Marc K. Francke & Siem Jan Koopman & Aart F. De Vos, 2010. "Likelihood functions for state space models with diffuse initial conditions," Journal of Time Series Analysis, Wiley Blackwell, vol. 31(6), pages 407-414, November.
    13. Tommaso Proietti, 2006. "Trend-Cycle Decompositions with Correlated Components," Econometric Reviews, Taylor & Francis Journals, vol. 25(1), pages 61-84.
    14. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    15. Giordani, Paolo & Kohn, Robert & van Dijk, Dick, 2007. "A unified approach to nonlinearity, structural change, and outliers," Journal of Econometrics, Elsevier, vol. 137(1), pages 112-133, March.
    16. R. H. Shumway & D. S. Stoffer, 1982. "An Approach To Time Series Smoothing And Forecasting Using The Em Algorithm," Journal of Time Series Analysis, Wiley Blackwell, vol. 3(4), pages 253-264, July.
    17. Harvey, A C & Jaeger, A, 1993. "Detrending, Stylized Facts and the Business Cycle," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(3), pages 231-247, July-Sept.
    18. Alessandra Luati & Tommaso Proietti, 2010. "Hyper‐spherical and elliptical stochastic cycles," Journal of Time Series Analysis, Wiley Blackwell, vol. 31(3), pages 169-181, May.
    19. S. J. Koopman & J. Durbin, 2000. "Fast Filtering and Smoothing for Multivariate State Space Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 21(3), pages 281-296, May.
    20. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    21. Andrew Harvey & Chia‐Hui Chung, 2000. "Estimating the underlying change in unemployment in the UK," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 163(3), pages 303-309.
    22. Nerlove, Marc & Grether, David M. & Carvalho, José L., 1979. "Analysis of Economic Time Series," Elsevier Monographs, Elsevier, edition 1, number 9780125157506 edited by Shell, Karl.
    23. Drew Creal, 2012. "A Survey of Sequential Monte Carlo Methods for Economics and Finance," Econometric Reviews, Taylor & Francis Journals, vol. 31(3), pages 245-296.
    24. Jean-Francois Richard, 2007. "Efficient High-Dimensional Importance Sampling," Working Paper 321, Department of Economics, University of Pittsburgh, revised Jan 2007.
    25. Doran, Howard E, 1992. "Constraining Kalman Filter and Smoothing Estimates to Satisfy Time-Varying Restrictions," The Review of Economics and Statistics, MIT Press, vol. 74(3), pages 568-572, August.
    26. Jungbacker, B. & Koopman, S.J. & van der Wel, M., 2011. "Maximum likelihood estimation for dynamic factor models with missing data," Journal of Economic Dynamics and Control, Elsevier, vol. 35(8), pages 1358-1368, August.
    27. Ord, J.K. & Koehler, A. & Snyder, R.D., 1995. "Estimation and Prediction for a Class of Dynamic Nonlinear Statistical Models," Monash Econometrics and Business Statistics Working Papers 4/95, Monash University, Department of Econometrics and Business Statistics.
    28. Geweke, John F & Singleton, Kenneth J, 1981. "Maximum Likelihood "Confirmatory" Factor Analysis of Economic Time Series," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 22(1), pages 37-54, February.
    29. Viktor Winschel & Markus Kr‰tzig, 2010. "Solving, Estimating, and Selecting Nonlinear Dynamic Models Without the Curse of Dimensionality," Econometrica, Econometric Society, vol. 78(2), pages 803-821, March.
    30. J. Durbin, 2002. "A simple and efficient simulation smoother for state space time series analysis," Biometrika, Biometrika Trust, vol. 89(3), pages 603-616, August.
    31. Cecilia Frale & Massimiliano Marcellino & Gian Luigi Mazzi & Tommaso Proietti, 2011. "EUROMIND: a monthly indicator of the euro area economic conditions," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 439-470, April.
    32. James C. Morley & Charles R. Nelson & Eric Zivot, 2003. "Why Are the Beveridge-Nelson and Unobserved-Components Decompositions of GDP So Different?," The Review of Economics and Statistics, MIT Press, vol. 85(2), pages 235-243, May.
    33. Barr Rosenberg, 1973. "The Analysis of a Cross Section of Time Series by Stochastically Convergent Parameter Regression," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 2, number 4, pages 399-428, National Bureau of Economic Research, Inc.
    34. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    35. Watson, Mark W., 1986. "Univariate detrending methods with stochastic trends," Journal of Monetary Economics, Elsevier, vol. 18(1), pages 49-75, July.
    36. Peter K. Clark, 1987. "The Cyclical Component of U. S. Economic Activity," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 102(4), pages 797-814.
    37. Sargent, Thomas J, 1989. "Two Models of Measurements and the Investment Accelerator," Journal of Political Economy, University of Chicago Press, vol. 97(2), pages 251-287, April.
    38. Giorgio E. Primiceri, 2005. "Time Varying Structural Vector Autoregressions and Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 821-852.
    39. Harvey, Andrew & Proietti, Tommaso (ed.), 2005. "Readings in Unobserved Components Models," OUP Catalogue, Oxford University Press, number 9780199278695.
    40. Richard, Jean-Francois & Zhang, Wei, 2007. "Efficient high-dimensional importance sampling," Journal of Econometrics, Elsevier, vol. 141(2), pages 1385-1411, December.
    41. James H. Stock & Mark W. Watson, 1989. "New Indexes of Coincident and Leading Economic Indicators," NBER Chapters, in: NBER Macroeconomics Annual 1989, Volume 4, pages 351-409, National Bureau of Economic Research, Inc.
    42. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    43. Nelson, Charles R. & Plosser, Charles I., 1982. "Trends and random walks in macroeconmic time series : Some evidence and implications," Journal of Monetary Economics, Elsevier, vol. 10(2), pages 139-162.
    44. de Jong, Piet & Penzer, Jeremy, 2004. "The ARMA model in state space form," Statistics & Probability Letters, Elsevier, vol. 70(1), pages 119-125, October.
    45. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    46. Shephard, Neil (ed.), 2005. "Stochastic Volatility: Selected Readings," OUP Catalogue, Oxford University Press, number 9780199257201.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ledenyov, Dimitri O. & Ledenyov, Viktor O., 2013. "On the Stratonovich – Kalman - Bucy filtering algorithm application for accurate characterization of financial time series with use of state-space model by central banks," MPRA Paper 50235, University Library of Munich, Germany.
    2. Ledenyov, Dimitri O. & Ledenyov, Viktor O., 2015. "Wave function method to forecast foreign currencies exchange rates at ultra high frequency electronic trading in foreign currencies exchange markets," MPRA Paper 67470, University Library of Munich, Germany.
    3. Luis Uzeda, 2022. "State Correlation and Forecasting: A Bayesian Approach Using Unobserved Components Models," Advances in Econometrics, in: Essays in Honour of Fabio Canova, volume 44, pages 25-53, Emerald Group Publishing Limited.
    4. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    5. Oh, Kum Hwa & Zivot, Eric & Creal, Drew, 2008. "The relationship between the Beveridge-Nelson decomposition and other permanent-transitory decompositions that are popular in economics," Journal of Econometrics, Elsevier, vol. 146(2), pages 207-219, October.
    6. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    7. Alexander Tsyplakov, 2011. "An introduction to state space modeling (in Russian)," Quantile, Quantile, issue 9, pages 1-24, July.
    8. Kum Hwa Oh & Eric Zivot & Drew Creal, 2006. "The Relationship between the Beveridge-Nelson Decomposition andUnobserved Component Models with Correlated Shocks," Working Papers UWEC-2006-16-FC, University of Washington, Department of Economics.
    9. Tsyplakov, Alexander, 2010. "Revealing the arcane: an introduction to the art of stochastic volatility models," MPRA Paper 25511, University Library of Munich, Germany.
    10. Joshua C.C. Chan & Rodney W. Strachan, 2023. "Bayesian State Space Models In Macroeconometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 58-75, February.
    11. Caterina Schiavoni & Siem Jan Koopman & Franz Palm & Stephan Smeekes & Jan van den Brakel, 2021. "Time-varying state correlations in state space models and their estimation via indirect inference," Tinbergen Institute Discussion Papers 21-020/III, Tinbergen Institute.
    12. Tommaso Proietti, 2002. "Some Reflections on Trend-Cycle Decompositions with Correlated Components," Econometrics 0209002, University Library of Munich, Germany.
    13. Blasques, Francisco & van Brummelen, Janneke & Gorgi, Paolo & Koopman, Siem Jan, 2024. "Maximum Likelihood Estimation for Non-Stationary Location Models with Mixture of Normal Distributions," Journal of Econometrics, Elsevier, vol. 238(1).
    14. Mesters, G. & Koopman, S.J., 2014. "Generalized dynamic panel data models with random effects for cross-section and time," Journal of Econometrics, Elsevier, vol. 180(2), pages 127-140.
    15. Thomas Hasenzagl & Filippo Pellegrino & Lucrezia Reichlin & Giovanni Ricco, 2022. "A Model of the Fed's View on Inflation," The Review of Economics and Statistics, MIT Press, vol. 104(4), pages 686-704, October.
    16. Siem Jan Koopman & Rutger Lit & Thuy Minh Nguyen, 2012. "Fast Efficient Importance Sampling by State Space Methods," Tinbergen Institute Discussion Papers 12-008/4, Tinbergen Institute, revised 16 Oct 2014.
    17. Doshi, Hitesh & Jacobs, Kris & Liu, Rui, 2018. "Macroeconomic determinants of the term structure: Long-run and short-run dynamics," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 99-122.
    18. Creal, Drew D. & Wu, Jing Cynthia, 2015. "Estimation of affine term structure models with spanned or unspanned stochastic volatility," Journal of Econometrics, Elsevier, vol. 185(1), pages 60-81.
    19. Tommaso Proietti, 2021. "Predictability, real time estimation, and the formulation of unobserved components models," Econometric Reviews, Taylor & Francis Journals, vol. 40(5), pages 433-454, April.
    20. Juan Antolin-Diaz & Thomas Drechsel & Ivan Petrella, 2017. "Tracking the Slowdown in Long-Run GDP Growth," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 343-356, May.

    More about this item

    Keywords

    non linear models; state space models; missing data;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:syb:wpbsba:2123/8337. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Artem Prokhorov (email available below). General contact details of provider: https://edirc.repec.org/data/sbsydau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.