IDEAS home Printed from https://ideas.repec.org/p/not/notgts/19-02.html
   My bibliography  Save this paper

Nonparametric conditional density specification testing and quantile estimation; with application to S&P500 returns

Author

Listed:
  • Patrick Marsh

Abstract

This paper develops a two stage procedure to test for correct dynamic conditional specification. It exploits nonparametric likelihood for an exponential series density estimator applied to the in-sample Probability Integral Transforms obtained from a fitted conditional model. The test is shown to be asymptotically pivotal, without modification. Numerical experiments illustrate both this and also that it can have significantly more power than equivalent tests based on the empirical distribution function, when applied to a number of simple time series specifications. In the event of rejection, the second stage nonparametric estimator can both consistently estimate quantiles of the data, under empirically relevant conditions, as well as correct the predictive log-scores of mis-specified models. Both test and estimator are applied to monthly S&P500 returns data. The estimator leads to narrower predictive confidence bands which also enjoy better coverage and contributes positively to the predictive log-score of Gaussian fitted models. Additional application involves risk evaluation,such as Value at Risk calculations or estimation of the probability of a negative return. The contribution of the nonparametric estimator is particularly clear during the financial crisis of 2007/8 and highlights the usefulness of a specification procedure which offers the possibility of partially correcting rejected specifications.

Suggested Citation

  • Patrick Marsh, 2019. "Nonparametric conditional density specification testing and quantile estimation; with application to S&P500 returns," Discussion Papers 19/02, University of Nottingham, Granger Centre for Time Series Econometrics.
  • Handle: RePEc:not:notgts:19/02
    as

    Download full text from publisher

    File URL: https://www.nottingham.ac.uk/research/groups/grangercentre/documents/19-02.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    2. Christian Bontemps & Nour Meddahi, 2012. "Testing distributional assumptions: A GMM aproach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 978-1012, September.
    3. Donald W. K. Andrews, 1997. "A Conditional Kolmogorov Test," Econometrica, Econometric Society, vol. 65(5), pages 1097-1128, September.
    4. Marsh, Patrick, 2007. "Goodness of fit tests via exponential series density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 51(5), pages 2428-2441, February.
    5. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    6. Patrick Marsh, 2019. "Nonparametric series density estimation and testing," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(1), pages 77-99, March.
    7. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    8. Gerda Claeskens & Nils Lid Hjort, 2004. "Goodness of Fit via Non‐parametric Likelihood Ratios," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 31(4), pages 487-513, December.
    9. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    10. Domowitz, Ian & White, Halbert, 1982. "Misspecified models with dependent observations," Journal of Econometrics, Elsevier, vol. 20(1), pages 35-58, October.
    11. Bollerslev, Tim, 1987. "A Conditionally Heteroskedastic Time Series Model for Speculative Prices and Rates of Return," The Review of Economics and Statistics, MIT Press, vol. 69(3), pages 542-547, August.
    12. Jushan Bai, 2003. "Testing Parametric Conditional Distributions of Dynamic Models," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 531-549, August.
    13. Chen, Yi-Ting, 2012. "A simple approach to standardized-residuals-based higher-moment tests," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 427-453.
    14. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Isao Ishida, 2005. "Scanning Multivariate Conditional Densities with Probability Integral Transforms," CIRJE F-Series CIRJE-F-369, CIRJE, Faculty of Economics, University of Tokyo.
    3. Delle Monache, Davide & Petrella, Ivan, 2017. "Adaptive models and heavy tails with an application to inflation forecasting," International Journal of Forecasting, Elsevier, vol. 33(2), pages 482-501.
    4. Christian Bontemps & Nour Meddahi, 2012. "Testing distributional assumptions: A GMM aproach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 978-1012, September.
    5. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2011. "Likelihood-based scoring rules for comparing density forecasts in tails," Journal of Econometrics, Elsevier, vol. 163(2), pages 215-230, August.
    6. Corradi, Valentina & Swanson, Norman R., 2006. "Predictive density and conditional confidence interval accuracy tests," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 187-228.
    7. Bontemps, Christian & Meddahi, Nour, 2005. "Testing normality: a GMM approach," Journal of Econometrics, Elsevier, vol. 124(1), pages 149-186, January.
    8. Chen, Bin & Hong, Yongmiao, 2014. "A unified approach to validating univariate and multivariate conditional distribution models in time series," Journal of Econometrics, Elsevier, vol. 178(P1), pages 22-44.
    9. Rossi, Barbara & Sekhposyan, Tatevik, 2019. "Alternative tests for correct specification of conditional predictive densities," Journal of Econometrics, Elsevier, vol. 208(2), pages 638-657.
    10. Hua, Jian & Manzan, Sebastiano, 2013. "Forecasting the return distribution using high-frequency volatility measures," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4381-4403.
    11. Chen, Yi-Ting, 2012. "A simple approach to standardized-residuals-based higher-moment tests," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 427-453.
    12. Ñíguez, Trino-Manuel & Perote, Javier, 2017. "Moments expansion densities for quantifying financial risk," The North American Journal of Economics and Finance, Elsevier, vol. 42(C), pages 53-69.
    13. Roberto Leon-Gonzalez & Blessings Majoni, 2023. "Exact Likelihood for Inverse Gamma Stochastic Volatility Models," GRIPS Discussion Papers 23-07, National Graduate Institute for Policy Studies.
    14. Cees Diks & Valentyn Panchenko & Dick van Dijk, 2008. "Partial Likelihood-Based Scoring Rules for Evaluating Density Forecasts in Tails," Tinbergen Institute Discussion Papers 08-050/4, Tinbergen Institute.
    15. Thomas B. Fomby & Jeffery W. Gunther & Jian Hu, 2012. "Return Dependence and the Limits of Product Diversification in Financial Firms," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(6), pages 1151-1183, September.
    16. Tae-Hwy Lee & Yong Bao & Burak Saltoğlu, 2007. "Comparing density forecast models Previous versions of this paper have been circulated with the title, 'A Test for Density Forecast Comparison with Applications to Risk Management' since October 2003;," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(3), pages 203-225.
    17. Trino-Manuel Ñíguez & Javier Perote, 2012. "Forecasting Heavy-Tailed Densities with Positive Edgeworth and Gram-Charlier Expansions," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(4), pages 600-627, August.
    18. Bai, Jushan & Chen, Zhihong, 2008. "Testing multivariate distributions in GARCH models," Journal of Econometrics, Elsevier, vol. 143(1), pages 19-36, March.
    19. Wang, Yudong & Liu, Li & Ma, Feng & Wu, Chongfeng, 2016. "What the investors need to know about forecasting oil futures return volatility," Energy Economics, Elsevier, vol. 57(C), pages 128-139.
    20. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.

    More about this item

    Keywords

    Conditional specification; series density estimator; nonparametric likelihood ratio; predictive quantiles for returns; log-score.;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:not:notgts:19/02. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/tsnotuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.