IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Non-Parametric Estimation of Forecast Distributions in Non-Gaussian, Non-linear State Space Models

Listed author(s):
  • Jason Ng

    ()

  • Catherine S. Forbes

    ()

  • Gael M. Martin

    ()

  • Brendan P.M. McCabe

The object of this paper is to produce non-parametric maximum likelihood estimates of forecast distributions in a general non-Gaussian, non-linear state space setting. The transition densities that define the evolution of the dynamic state process are represented in parametric form, but the conditional distribution of the non-Gaussian variable is estimated non-parametrically. The filtering and prediction distributions are estimated via a computationally efficient algorithm that exploits the functional relationship between the observed variable, the state variable and a measurement error with an invariant distribution. Simulation experiments are used to document the accuracy of the non-parametric method relative to both correctly and incorrectly specified parametric alternatives. In an empirical illustration, the method is used to produce sequential estimates of the forecast distribution of realized volatility on the S&P500 stock index during the recent financial crisis. A resampling technique for measuring sampling variation in the estimated forecast distributions is also demonstrated.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://business.monash.edu/econometrics-and-business-statistics/research/publications/ebs/wp11-11.pdf
Download Restriction: no

Paper provided by Monash University, Department of Econometrics and Business Statistics in its series Monash Econometrics and Business Statistics Working Papers with number 11/11.

as
in new window

Length: 37 pages
Date of creation: 31 Aug 2011
Handle: RePEc:msh:ebswps:2011-11
Contact details of provider: Postal:
PO Box 11E, Monash University, Victoria 3800, Australia

Phone: +61 3 99052489
Fax: +61 3 99055474
Web page: http://business.monash.edu/econometrics-and-business-statistics
Email:


More information through EDIRC

Order Information: Web: http://business.monash.edu/econometrics-and-business-statistics Email:


References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as
in new window


  1. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
  2. Gael M. Martin & Andrew Reidy & Jill Wright, 2009. "Does the option market produce superior forecasts of noise-corrected volatility measures?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(1), pages 77-104.
  3. Yacine Aït-Sahalia & Andrew W. Lo, 1998. "Nonparametric Estimation of State-Price Densities Implicit in Financial Asset Prices," Journal of Finance, American Finance Association, vol. 53(2), pages 499-547, 04.
  4. Adam Clements & Stan Hurn & Scott White, 2006. "Estimating Stochastic Volatility Models Using a Discrete Non-linear Filter. Working paper #3," NCER Working Paper Series 3, National Centre for Econometric Research.
  5. Bauwens, Luc & Veredas, David, 2004. "The stochastic conditional duration model: a latent variable model for the analysis of financial durations," Journal of Econometrics, Elsevier, vol. 119(2), pages 381-412, April.
  6. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
  7. Pascual, Lorenzo & Romo, Juan & Ruiz, Esther, 2005. "Bootstrap prediction intervals for power-transformed time series," International Journal of Forecasting, Elsevier, vol. 21(2), pages 219-235.
  8. De Rossi, Giuliano & Harvey, Andrew, 2009. "Quantiles, expectiles and splines," Journal of Econometrics, Elsevier, vol. 152(2), pages 179-185, October.
  9. Boero, Gianna & Smith, Jeremy & Wallis, Kenneth F., 2011. "Scoring rules and survey density forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 379-393.
  10. Brownlees, C.T. & Gallo, G.M., 2006. "Financial econometric analysis at ultra-high frequency: Data handling concerns," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2232-2245, December.
  11. Bu, Ruijun & McCabe, Brendan, 2008. "Model selection, estimation and forecasting in INAR(p) models: A likelihood-based Markov Chain approach," International Journal of Forecasting, Elsevier, vol. 24(1), pages 151-162.
  12. Geweke, John & Amisano, Gianni, 2010. "Comparing and evaluating Bayesian predictive distributions of asset returns," International Journal of Forecasting, Elsevier, vol. 26(2), pages 216-230, April.
  13. Freeland, R. K. & McCabe, B. P. M., 2004. "Forecasting discrete valued low count time series," International Journal of Forecasting, Elsevier, vol. 20(3), pages 427-434.
  14. Jensen, Mark J. & Maheu, John M., 2010. "Bayesian semiparametric stochastic volatility modeling," Journal of Econometrics, Elsevier, vol. 157(2), pages 306-316, August.
  15. Bauwens, Luc & Giot, Pierre & Grammig, Joachim & Veredas, David, 2004. "A comparison of financial duration models via density forecasts," International Journal of Forecasting, Elsevier, vol. 20(4), pages 589-609.
  16. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
  17. Strickland, Chris M. & Forbes, Catherine S. & Martin, Gael M., 2006. "Bayesian analysis of the stochastic conditional duration model," Computational Statistics & Data Analysis, Elsevier, vol. 50(9), pages 2247-2267, May.
  18. Brendan P. M. McCabe & Gael M. Martin & David Harris, 2011. "Efficient probabilistic forecasts for counts," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(2), pages 253-272, 03.
  19. Monteiro, André A., 2010. "A semiparametric state space model," DES - Working Papers. Statistics and Econometrics. WS ws103418, Universidad Carlos III de Madrid. Departamento de Estadística.
  20. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
  21. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
  22. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 7(2), pages 174-196, Spring.
  23. Ole E. Barndorff-Nielsen & Shephard, 2002. "Econometric analysis of realized volatility and its use in estimating stochastic volatility models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 253-280.
  24. Joyce E. Berg & John Geweke & Thomas A. Rietz, 2010. "Memoirs of an indifferent trader: Estimating forecast distributions from prediction markets," Quantitative Economics, Econometric Society, vol. 1(1), pages 163-186, 07.
  25. Genshiro Kitagawa, 1994. "The two-filter formula for smoothing and an implementation of the Gaussian-sum smoother," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 46(4), pages 605-623, December.
  26. C. Yau & O. Papaspiliopoulos & G. O. Roberts & C. Holmes, 2011. "Bayesian non‐parametric hidden Markov models with applications in genomics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(1), pages 37-57, January.
  27. Durham, Garland B., 2006. "Monte Carlo methods for estimating, smoothing, and filtering one- and two-factor stochastic volatility models," Journal of Econometrics, Elsevier, vol. 133(1), pages 273-305, July.
  28. Alejandro Rodriguez & Esther Ruiz, 2009. "Bootstrap prediction intervals in state-space models," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(2), pages 167-178, 03.
  29. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
  30. Tilmann Gneiting, 2008. "Editorial: Probabilistic forecasting," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 319-321.
  31. Pascual, Lorenzo & Romo, Juan & Ruiz, Esther, 2001. "Effects of parameter estimation on prediction densities: a bootstrap approach," International Journal of Forecasting, Elsevier, vol. 17(1), pages 83-103.
  32. Anthony Tay & Kenneth F. Wallis, 2000. "Density Forecasting: A Survey," Econometric Society World Congress 2000 Contributed Papers 0370, Econometric Society.
  33. Durham, Garland B., 2007. "SV mixture models with application to S&P 500 index returns," Journal of Financial Economics, Elsevier, vol. 85(3), pages 822-856, September.
  34. Andersen, Torben G. & Bollerslev, Tim & Diebold, Francis X. & Ebens, Heiko, 2001. "The distribution of realized stock return volatility," Journal of Financial Economics, Elsevier, vol. 61(1), pages 43-76, July.
  35. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268.
  36. V. L. Martin & G. M. Martin & G. C. Lim, 2005. "Parametric pricing of higher order moments in S&P500 options," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(3), pages 377-404.
  37. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
  38. Maneesoonthorn, Worapree & Martin, Gael M. & Forbes, Catherine S. & Grose, Simone D., 2012. "Probabilistic forecasts of volatility and its risk premia," Journal of Econometrics, Elsevier, vol. 171(2), pages 217-236.
  39. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-359, October.
  40. McCabe, B.P.M. & Martin, G.M., 2005. "Bayesian predictions of low count time series," International Journal of Forecasting, Elsevier, vol. 21(2), pages 315-330.
  41. Rodríguez, Alejandro & Ruiz, Esther, 2012. "Bootstrap prediction mean squared errors of unobserved states based on the Kalman filter with estimated parameters," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 62-74, January.
  42. Mark Broadie & Mikhail Chernov & Michael Johannes, 2007. "Model Specification and Risk Premia: Evidence from Futures Options," Journal of Finance, American Finance Association, vol. 62(3), pages 1453-1490, 06.
  43. Bates, David S., 2000. "Post-'87 crash fears in the S&P 500 futures option market," Journal of Econometrics, Elsevier, vol. 94(1-2), pages 181-238.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2011-11. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dr Xibin Zhang)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.