IDEAS home Printed from https://ideas.repec.org/a/eee/dyncon/v90y2018icp1-29.html
   My bibliography  Save this article

Model Complexity and Out-of-Sample Performance: Evidence from S&P 500 Index Returns

Author

Listed:
  • Kaeck, Andreas
  • Rodrigues, Paulo
  • Seeger, Norman J.

Abstract

We apply a range of out-of-sample specification tests to more than forty competing stochastic volatility models to address how model complexity affects out-of-sample performance. Using daily S&P 500 index returns, model confidence set estimations provide strong evidence that the most important model feature is the non-affinity of the variance process. Despite testing alternative specifications during the turbulent market regime of the global financial crisis of 2008, we find no evidence that either finite- or infinite-activity jump models or other previously proposed model extensions improve the out-of-sample performance further. Applications to Value-at-Risk demonstrate the economic significance of our results. Furthermore, the out-of-sample results suggest that standard jump diffusion models are misspecified.

Suggested Citation

  • Kaeck, Andreas & Rodrigues, Paulo & Seeger, Norman J., 2018. "Model Complexity and Out-of-Sample Performance: Evidence from S&P 500 Index Returns," Journal of Economic Dynamics and Control, Elsevier, vol. 90(C), pages 1-29.
  • Handle: RePEc:eee:dyncon:v:90:y:2018:i:c:p:1-29
    DOI: 10.1016/j.jedc.2018.01.040
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165188918300605
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jedc.2018.01.040?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nelson, Daniel B., 1990. "ARCH models as diffusion approximations," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 7-38.
    2. Fulop, Andras & Li, Junye, 2013. "Efficient learning via simulation: A marginalized resample-move approach," Journal of Econometrics, Elsevier, vol. 176(2), pages 146-161.
    3. Worapree Maneesoonthorn & Catherine S. Forbes & Gael M. Martin, 2017. "Inference on Self‐Exciting Jumps in Prices and Volatility Using High‐Frequency Measures," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(3), pages 504-532, April.
    4. S. G. Kou, 2002. "A Jump-Diffusion Model for Option Pricing," Management Science, INFORMS, vol. 48(8), pages 1086-1101, August.
    5. Yun, Jaeho, 2014. "Out-of-sample density forecasts with affine jump diffusion models," Journal of Banking & Finance, Elsevier, vol. 47(C), pages 74-87.
    6. Aleksandar Mijatović & Paul Schneider, 2014. "Empirical Asset Pricing with Nonlinear Risk Premia," Journal of Financial Econometrics, Oxford University Press, vol. 12(3), pages 479-506.
    7. Ornthanalai, Chayawat, 2014. "Lévy jump risk: Evidence from options and returns," Journal of Financial Economics, Elsevier, vol. 112(1), pages 69-90.
    8. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    9. Pan, Jun, 2002. "The jump-risk premia implicit in options: evidence from an integrated time-series study," Journal of Financial Economics, Elsevier, vol. 63(1), pages 3-50, January.
    10. Takahashi, Makoto & Omori, Yasuhiro & Watanabe, Toshiaki, 2009. "Estimating stochastic volatility models using daily returns and realized volatility simultaneously," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 2404-2426, April.
    11. Torben G. Andersen & Luca Benzoni & Jesper Lund, 2002. "An Empirical Investigation of Continuous‐Time Equity Return Models," Journal of Finance, American Finance Association, vol. 57(3), pages 1239-1284, June.
    12. Anders Wilhelmsson, 2013. "Density Forecasting with Time‐Varying Higher Moments: A Model Confidence Set Approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 32(1), pages 19-31, January.
    13. Luc Bauwens & Sébastien Laurent & Jeroen V. K. Rombouts, 2006. "Multivariate GARCH models: a survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(1), pages 79-109, January.
    14. Christoffersen, Peter & Jacobs, Kris & Ornthanalai, Chayawat, 2012. "Dynamic jump intensities and risk premiums: Evidence from S&P500 returns and options," Journal of Financial Economics, Elsevier, vol. 106(3), pages 447-472.
    15. Peter Christoffersen & Kris Jacobs & Karim Mimouni, 2010. "Volatility Dynamics for the S&P500: Evidence from Realized Volatility, Daily Returns, and Option Prices," Review of Financial Studies, Society for Financial Studies, vol. 23(8), pages 3141-3189, August.
    16. Shackleton, Mark B. & Taylor, Stephen J. & Yu, Peng, 2010. "A multi-horizon comparison of density forecasts for the S&P 500 using index returns and option prices," Journal of Banking & Finance, Elsevier, vol. 34(11), pages 2678-2693, November.
    17. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    18. Pedro Santa-Clara & Shu Yan, 2010. "Crashes, Volatility, and the Equity Premium: Lessons from S&P 500 Options," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 435-451, May.
    19. Darrell Duffie & Jun Pan & Kenneth Singleton, 2000. "Transform Analysis and Asset Pricing for Affine Jump-Diffusions," Econometrica, Econometric Society, vol. 68(6), pages 1343-1376, November.
    20. Heston, Steven L, 1993. "A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options," Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 327-343.
    21. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    22. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    23. Creal, Drew D., 2008. "Analysis of filtering and smoothing algorithms for Lévy-driven stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 2863-2876, February.
    24. David S. Bates, 2006. "Maximum Likelihood Estimation of Latent Affine Processes," Review of Financial Studies, Society for Financial Studies, vol. 19(3), pages 909-965.
    25. Ole E. Barndorff‐Nielsen & Neil Shephard, 2002. "Econometric analysis of realized volatility and its use in estimating stochastic volatility models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 253-280, May.
    26. Jones, Christopher S., 2003. "The dynamics of stochastic volatility: evidence from underlying and options markets," Journal of Econometrics, Elsevier, vol. 116(1-2), pages 181-224.
    27. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    28. Cheridito, Patrick & Filipovic, Damir & Kimmel, Robert L., 2007. "Market price of risk specifications for affine models: Theory and evidence," Journal of Financial Economics, Elsevier, vol. 83(1), pages 123-170, January.
    29. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
    30. Kaeck, Andreas, 2013. "Asymmetry in the jump-size distribution of the S&P 500: Evidence from equity and option markets," Journal of Economic Dynamics and Control, Elsevier, vol. 37(9), pages 1872-1888.
    31. Nicolas Chopin, 2002. "A sequential particle filter method for static models," Biometrika, Biometrika Trust, vol. 89(3), pages 539-552, August.
    32. Torben G. Andersen & Nicola Fusari & Viktor Todorov, 2017. "Short-Term Market Risks Implied by Weekly Options," Journal of Finance, American Finance Association, vol. 72(3), pages 1335-1386, June.
    33. Bates, David S, 1996. "Jumps and Stochastic Volatility: Exchange Rate Processes Implicit in Deutsche Mark Options," Review of Financial Studies, Society for Financial Studies, vol. 9(1), pages 69-107.
    34. Chernov, Mikhail & Ronald Gallant, A. & Ghysels, Eric & Tauchen, George, 2003. "Alternative models for stock price dynamics," Journal of Econometrics, Elsevier, vol. 116(1-2), pages 225-257.
    35. N. Chopin & P. E. Jacob & O. Papaspiliopoulos, 2013. "SMC-super-2: an efficient algorithm for sequential analysis of state space models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 397-426, June.
    36. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    37. Engle, Robert F & Ng, Victor K, 1993. "Measuring and Testing the Impact of News on Volatility," Journal of Finance, American Finance Association, vol. 48(5), pages 1749-1778, December.
    38. Madan, Dilip B & Seneta, Eugene, 1990. "The Variance Gamma (V.G.) Model for Share Market Returns," The Journal of Business, University of Chicago Press, vol. 63(4), pages 511-524, October.
    39. Michael S. Johannes & Nicholas G. Polson & Jonathan R. Stroud, 2009. "Optimal Filtering of Jump Diffusions: Extracting Latent States from Asset Prices," Review of Financial Studies, Society for Financial Studies, vol. 22(7), pages 2559-2599, July.
    40. Peter Carr & Hélyette Geman & Dilip B. Madan & Marc Yor, 2003. "Stochastic Volatility for Lévy Processes," Mathematical Finance, Wiley Blackwell, vol. 13(3), pages 345-382, July.
    41. Bjørn Eraker & Michael Johannes & Nicholas Polson, 2003. "The Impact of Jumps in Volatility and Returns," Journal of Finance, American Finance Association, vol. 58(3), pages 1269-1300, June.
    42. Katja Ignatieva & Paulo Rodrigues & Norman Seeger, 2015. "Empirical Analysis of Affine Versus Nonaffine Variance Specifications in Jump-Diffusion Models for Equity Indices," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 68-75, January.
    43. Tilmann Gneiting & Roopesh Ranjan, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 411-422, July.
    44. Bjørn Eraker, 2004. "Do Stock Prices and Volatility Jump? Reconciling Evidence from Spot and Option Prices," Journal of Finance, American Finance Association, vol. 59(3), pages 1367-1404, June.
    45. Haitao Li & Martin T. Wells & Cindy L. Yu, 2008. "A Bayesian Analysis of Return Dynamics with Lévy Jumps," Review of Financial Studies, Society for Financial Studies, vol. 21(5), pages 2345-2378, September.
    46. Lee, Suzanne S. & Hannig, Jan, 2010. "Detecting jumps from Lévy jump diffusion processes," Journal of Financial Economics, Elsevier, vol. 96(2), pages 271-290, May.
    47. Jonathan R. Stroud & Michael S. Johannes, 2014. "Bayesian Modeling and Forecasting of 24-Hour High-Frequency Volatility," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1368-1384, December.
    48. Egloff, Daniel & Leippold, Markus & Wu, Liuren, 2010. "The Term Structure of Variance Swap Rates and Optimal Variance Swap Investments," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 45(5), pages 1279-1310, October.
    49. Peter Reinhard Hansen & Zhuo Huang & Howard Howan Shek, 2012. "Realized GARCH: a joint model for returns and realized measures of volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 877-906, September.
    50. Kaeck, Andreas & Alexander, Carol, 2012. "Volatility dynamics for the S&P 500: Further evidence from non-affine, multi-factor jump diffusions," Journal of Banking & Finance, Elsevier, vol. 36(11), pages 3110-3121.
    51. David S. Bates, 2016. "How Crashes Develop: Intradaily Volatility and Crash Evolution," NBER Working Papers 22028, National Bureau of Economic Research, Inc.
    52. repec:dau:papers:123456789/7305 is not listed on IDEAS
    53. Gneiting, Tilmann & Ranjan, Roopesh, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 411-422.
    54. Mark Broadie & Mikhail Chernov & Michael Johannes, 2007. "Model Specification and Risk Premia: Evidence from Futures Options," Journal of Finance, American Finance Association, vol. 62(3), pages 1453-1490, June.
    55. Peter Carr & Helyette Geman, 2002. "The Fine Structure of Asset Returns: An Empirical Investigation," The Journal of Business, University of Chicago Press, vol. 75(2), pages 305-332, April.
    56. Pawel J. Szerszen, 2009. "Bayesian analysis of stochastic volatility models with Lévy jumps: application to risk analysis," Finance and Economics Discussion Series 2009-40, Board of Governors of the Federal Reserve System (U.S.).
    57. Bates, David S., 2012. "U.S. stock market crash risk, 1926–2010," Journal of Financial Economics, Elsevier, vol. 105(2), pages 229-259.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jiling Cao & Xinfeng Ruan & Shu Su & Wenjun Zhang, 2020. "Pricing VIX derivatives with infinite‐activity jumps," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 40(3), pages 329-354, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kaeck, Andreas & Rodrigues, Paulo & Seeger, Norman J., 2017. "Equity index variance: Evidence from flexible parametric jump–diffusion models," Journal of Banking & Finance, Elsevier, vol. 83(C), pages 85-103.
    2. Kaeck, Andreas & Alexander, Carol, 2012. "Volatility dynamics for the S&P 500: Further evidence from non-affine, multi-factor jump diffusions," Journal of Banking & Finance, Elsevier, vol. 36(11), pages 3110-3121.
    3. Calvet, Laurent E. & Fearnley, Marcus & Fisher, Adlai J. & Leippold, Markus, 2015. "What is beneath the surface? Option pricing with multifrequency latent states," Journal of Econometrics, Elsevier, vol. 187(2), pages 498-511.
    4. Shackleton, Mark B. & Taylor, Stephen J. & Yu, Peng, 2010. "A multi-horizon comparison of density forecasts for the S&P 500 using index returns and option prices," Journal of Banking & Finance, Elsevier, vol. 34(11), pages 2678-2693, November.
    5. Bardgett, Chris & Gourier, Elise & Leippold, Markus, 2019. "Inferring volatility dynamics and risk premia from the S&P 500 and VIX markets," Journal of Financial Economics, Elsevier, vol. 131(3), pages 593-618.
    6. Du Du & Dan Luo, 2019. "The Pricing of Jump Propagation: Evidence from Spot and Options Markets," Management Science, INFORMS, vol. 67(5), pages 2360-2387, May.
    7. H. Peter Boswijk & Roger J. A. Laeven & Evgenii Vladimirov, 2022. "Estimating Option Pricing Models Using a Characteristic Function Based Linear State Space Representation," Tinbergen Institute Discussion Papers 22-000/III, Tinbergen Institute.
    8. Carverhill, Andrew & Luo, Dan, 2023. "A Bayesian analysis of time-varying jump risk in S&P 500 returns and options," Journal of Financial Markets, Elsevier, vol. 64(C).
    9. Peter Christoffersen & Kris Jacobs & Chayawat Ornthanalai, 2012. "GARCH Option Valuation: Theory and Evidence," CREATES Research Papers 2012-50, Department of Economics and Business Economics, Aarhus University.
    10. Ornthanalai, Chayawat, 2014. "Lévy jump risk: Evidence from options and returns," Journal of Financial Economics, Elsevier, vol. 112(1), pages 69-90.
    11. Diego Amaya & Jean-François Bégin & Geneviève Gauthier, 2022. "The Informational Content of High-Frequency Option Prices," Management Science, INFORMS, vol. 68(3), pages 2166-2201, March.
    12. A. S. Hurn & K. A. Lindsay & A. J. McClelland, 2015. "Estimating the Parameters of Stochastic Volatility Models Using Option Price Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(4), pages 579-594, October.
    13. Bates, David S., 2012. "U.S. stock market crash risk, 1926–2010," Journal of Financial Economics, Elsevier, vol. 105(2), pages 229-259.
    14. Christoffersen, Peter & Jacobs, Kris & Ornthanalai, Chayawat & Wang, Yintian, 2008. "Option valuation with long-run and short-run volatility components," Journal of Financial Economics, Elsevier, vol. 90(3), pages 272-297, December.
    15. Neumann, Maximilian & Prokopczuk, Marcel & Wese Simen, Chardin, 2016. "Jump and variance risk premia in the S&P 500," Journal of Banking & Finance, Elsevier, vol. 69(C), pages 72-83.
    16. Kaeck, Andreas & Seeger, Norman J., 2020. "VIX derivatives, hedging and vol-of-vol risk," European Journal of Operational Research, Elsevier, vol. 283(2), pages 767-782.
    17. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2005. "Volatility forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies (CFS).
    18. Byun, Suk Joon & Jeon, Byoung Hyun & Min, Byungsun & Yoon, Sun-Joong, 2015. "The role of the variance premium in Jump-GARCH option pricing models," Journal of Banking & Finance, Elsevier, vol. 59(C), pages 38-56.
    19. Peter Christoffersen & Kris Jacobs & Chayawat Ornthanalai, 2009. "Exploring Time-Varying Jump Intensities: Evidence from S&P500 Returns and Options," CIRANO Working Papers 2009s-34, CIRANO.
    20. Chourdakis, Kyriakos & Dotsis, George, 2011. "Maximum likelihood estimation of non-affine volatility processes," Journal of Empirical Finance, Elsevier, vol. 18(3), pages 533-545, June.

    More about this item

    Keywords

    Out-of-sample specification tests; Jump-diffusion models; Lévy-jump models; Non-affine variance models; Forecasting;
    All these keywords.

    JEL classification:

    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates
    • G15 - Financial Economics - - General Financial Markets - - - International Financial Markets
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:dyncon:v:90:y:2018:i:c:p:1-29. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jedc .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.