IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Non-Parametric Estimation of Forecast Distributions in Non-Gaussian, Non-linear State Space Models

  • Jason Ng

    ()

  • Catherine S. Forbes

    ()

  • Gael M. Martin

    ()

  • Brendan P.M. McCabe

The object of this paper is to produce non-parametric maximum likelihood estimates of forecast distributions in a general non-Gaussian, non-linear state space setting. The transition densities that define the evolution of the dynamic state process are represented in parametric form, but the conditional distribution of the non-Gaussian variable is estimated non-parametrically. The filtering and prediction distributions are estimated via a computationally efficient algorithm that exploits the functional relationship between the observed variable, the state variable and a measurement error with an invariant distribution. Simulation experiments are used to document the accuracy of the non-parametric method relative to both correctly and incorrectly specified parametric alternatives. In an empirical illustration, the method is used to produce sequential estimates of the forecast distribution of realized volatility on the S&P500 stock index during the recent financial crisis. A resampling technique for measuring sampling variation in the estimated forecast distributions is also demonstrated.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://business.monash.edu/econometrics-and-business-statistics/research/publications/ebs/wp11-11.pdf
Download Restriction: no

Paper provided by Monash University, Department of Econometrics and Business Statistics in its series Monash Econometrics and Business Statistics Working Papers with number 11/11.

as
in new window

Length: 37 pages
Date of creation: 31 Aug 2011
Date of revision:
Handle: RePEc:msh:ebswps:2011-11
Contact details of provider: Postal:
PO Box 11E, Monash University, Victoria 3800, Australia

Phone: +61 3 99052489
Fax: +61 3 99055474
Web page: http://business.monash.edu/econometrics-and-business-statistics
Email:


More information through EDIRC

Order Information: Web: http://business.monash.edu/econometrics-and-business-statistics Email:


References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
  2. Bu, Ruijun & McCabe, Brendan, 2008. "Model selection, estimation and forecasting in INAR(p) models: A likelihood-based Markov Chain approach," International Journal of Forecasting, Elsevier, vol. 24(1), pages 151-162.
  3. Durham, Garland B., 2006. "Monte Carlo methods for estimating, smoothing, and filtering one- and two-factor stochastic volatility models," Journal of Econometrics, Elsevier, vol. 133(1), pages 273-305, July.
  4. Chris M. Strickland & Catherine S. Forbes & Gael M. Martin, 2003. "Bayesian Analysis of the Stochastic Conditional Duration Model," Monash Econometrics and Business Statistics Working Papers 14/03, Monash University, Department of Econometrics and Business Statistics.
  5. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2001. "Modeling and Forecasting Realized Volatility," Center for Financial Institutions Working Papers 01-01, Wharton School Center for Financial Institutions, University of Pennsylvania.
  6. Alejandro Rodríguez & Esther Ruiz, 2010. "Bootstrap prediction mean squared errors of unobserved states based on the Kalman filter with estimated parameters," Statistics and Econometrics Working Papers ws100301, Universidad Carlos III, Departamento de Estadística y Econometría.
  7. Durham, Garland B., 2007. "SV mixture models with application to S&P 500 index returns," Journal of Financial Economics, Elsevier, vol. 85(3), pages 822-856, September.
  8. Bates, David S., 2000. "Post-'87 crash fears in the S&P 500 futures option market," Journal of Econometrics, Elsevier, vol. 94(1-2), pages 181-238.
  9. Luc Bauwens & Pierre Giot & Joachim Grammig & David Veredas, 2004. "A comparison of financial duration models via density forecast," ULB Institutional Repository 2013/136218, ULB -- Universite Libre de Bruxelles.
  10. Geweke, John & Amisano, Gianni, 2008. "Comparing and evaluating Bayesian predictive distributions of assets returns," Working Paper Series 0969, European Central Bank.
  11. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-44, January.
  12. Gael M. Martin & Andrew Reidy & Jill Wright, 2007. "Does the Option Market Produce Superior Forecasts of Noise-Corrected Volatility Measures?," Monash Econometrics and Business Statistics Working Papers 5/07, Monash University, Department of Econometrics and Business Statistics.
  13. Alejandro Rodriguez & Esther Ruiz, 2008. "Bootstrap prediction intervals in State Space models," Statistics and Econometrics Working Papers ws081104, Universidad Carlos III, Departamento de Estadística y Econometría.
  14. DeRossi, G. & Harvey, A., 2007. "Quantiles, Expectiles and Splines," Cambridge Working Papers in Economics 0660, Faculty of Economics, University of Cambridge.
  15. Mark J. Jensen & John M. Maheu, 2008. "Bayesian semiparametric stochastic volatility modeling," FRB Atlanta Working Paper 2008-15, Federal Reserve Bank of Atlanta.
  16. Brownlees, C.T. & Gallo, G.M., 2006. "Financial econometric analysis at ultra-high frequency: Data handling concerns," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2232-2245, December.
  17. Anthony Tay & Kenneth F. Wallis, 2000. "Density Forecasting: A Survey," Econometric Society World Congress 2000 Contributed Papers 0370, Econometric Society.
  18. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-83, November.
  19. Yacine Aït-Sahalia & Andrew W. Lo, . "Nonparametric Estimation of State-Price Densities Implicit in Financial Asset Prices," CRSP working papers 332, Center for Research in Security Prices, Graduate School of Business, University of Chicago.
  20. BAUWENS, Luc & VEREDAS, David, . "The stochastic conditional duration model: a latent variable model for the analysis of financial durations," CORE Discussion Papers RP 1688, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
  21. Maneesoonthorn, Worapree & Martin, Gael M. & Forbes, Catherine S. & Grose, Simone D., 2012. "Probabilistic forecasts of volatility and its risk premia," Journal of Econometrics, Elsevier, vol. 171(2), pages 217-236.
  22. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
  23. Gianni Amisano & Raffaella Giacomini, 2005. "Comparing Density Forecsts via Weighted Likelihood Ratio Tests," Working Papers ubs0504, University of Brescia, Department of Economics.
  24. Mark Broadie & Mikhail Chernov & Michael Johannes, 2007. "Model Specification and Risk Premia: Evidence from Futures Options," Journal of Finance, American Finance Association, vol. 62(3), pages 1453-1490, 06.
  25. G.C. Lim & G.M. Martin & V.L. Martin, 2002. "Parametric Pricing of Higher Order Moments in S&P500 Options," Monash Econometrics and Business Statistics Working Papers 1/02, Monash University, Department of Econometrics and Business Statistics.
  26. Boero, Gianna & Smith, Jeremy & Wallis, Kenneth F., 2011. "Scoring rules and survey density forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 379-393.
  27. C. Yau & O. Papaspiliopoulos & G. O. Roberts & C. Holmes, 2011. "Bayesian non‐parametric hidden Markov models with applications in genomics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(1), pages 37-57, January.
  28. Freeland, R. K. & McCabe, B. P. M., 2004. "Forecasting discrete valued low count time series," International Journal of Forecasting, Elsevier, vol. 20(3), pages 427-434.
  29. André A. Monteiro, 2010. "A semiparametric state space model," Statistics and Econometrics Working Papers ws103418, Universidad Carlos III, Departamento de Estadística y Econometría.
  30. Genshiro Kitagawa, 1994. "The two-filter formula for smoothing and an implementation of the Gaussian-sum smoother," Annals of the Institute of Statistical Mathematics, Springer, vol. 46(4), pages 605-623, December.
  31. Pascual, Lorenzo & Romo, Juan & Ruiz, Esther, 2005. "Bootstrap prediction intervals for power-transformed time series," International Journal of Forecasting, Elsevier, vol. 21(2), pages 219-235.
  32. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268.
  33. Andersen, Torben G. & Bollerslev, Tim & Diebold, Francis X. & Ebens, Heiko, 2001. "The distribution of realized stock return volatility," Journal of Financial Economics, Elsevier, vol. 61(1), pages 43-76, July.
  34. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-59, October.
  35. McCabe, B.P.M. & Martin, G.M., 2005. "Bayesian predictions of low count time series," International Journal of Forecasting, Elsevier, vol. 21(2), pages 315-330.
  36. Tilmann Gneiting, 2008. "Editorial: Probabilistic forecasting," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 319-321.
  37. Ole E. Barndorff-Nielsen & Neil Shephard, 2000. "Econometric analysis of realised volatility and its use in estimating stochastic volatility models," Economics Papers 2001-W4, Economics Group, Nuffield College, University of Oxford, revised 05 Jul 2001.
  38. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Society for Financial Econometrics, vol. 7(2), pages 174-196, Spring.
  39. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-74, October.
  40. Joyce E. Berg & John Geweke & Thomas A. Rietz, 2010. "Memoirs of an indifferent trader: Estimating forecast distributions from prediction markets," Quantitative Economics, Econometric Society, vol. 1(1), pages 163-186, 07.
  41. Adam Clements & Stan Hurn & Scott White, 2006. "Estimating Stochastic Volatility Models Using a Discrete Non-linear Filter. Working paper #3," NCER Working Paper Series 3, National Centre for Econometric Research.
  42. Pascual, Lorenzo & Romo, Juan & Ruiz, Esther, 2001. "Effects of parameter estimation on prediction densities: a bootstrap approach," International Journal of Forecasting, Elsevier, vol. 17(1), pages 83-103.
  43. Brendan P. M. McCabe & Gael M. Martin & David Harris, 2011. "Efficient probabilistic forecasts for counts," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(2), pages 253-272, 03.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2011-11. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dr Xibin Zhang)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.