IDEAS home Printed from https://ideas.repec.org/p/een/camaaa/2014-51.html
   My bibliography  Save this paper

Issues in Comparing Stochastic Volatility Models Using the Deviance Information Criterion

Author

Listed:
  • Joshua C.C. Chan
  • Angelia L. Grant

Abstract

The deviance information criterion (DIC) has been widely used for Bayesian model comparison. In particular, a popular metric for comparing stochastic volatility models is the DIC based on the conditional likelihood—obtained by conditioning on the latent variables. However, some recent studies have argued against the use of the conditional DIC on both theoretical and practical grounds. We show via a Monte Carlo study that the conditional DIC tends to favor overfitted models, whereas the DIC calculated using the observed-data likelihood—obtained by integrating out the latent variables—seems to perform well. The main challenge for obtaining the latter DIC for stochastic volatility models is that the observed-data likelihoods are not available in closed-form. To overcome this difficulty, we propose fast algorithms for estimating the observed-data likelihoods for a variety of stochastic volatility models using importance sampling. We demonstrate the methodology with an application involving daily returns on the Standard & Poors (S&P) 500 index.

Suggested Citation

  • Joshua C.C. Chan & Angelia L. Grant, 2014. "Issues in Comparing Stochastic Volatility Models Using the Deviance Information Criterion," CAMA Working Papers 2014-51, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
  • Handle: RePEc:een:camaaa:2014-51
    as

    Download full text from publisher

    File URL: https://cama.crawford.anu.edu.au/sites/default/files/publication/cama_crawford_anu_edu_au/2014-07/51_2014_chan_grant.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Abanto-Valle, C.A. & Bandyopadhyay, D. & Lachos, V.H. & Enriquez, I., 2010. "Robust Bayesian analysis of heavy-tailed stochastic volatility models using scale mixtures of normal distributions," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 2883-2898, December.
    2. McCausland, William J. & Miller, Shirley & Pelletier, Denis, 2011. "Simulation smoothing for state-space models: A computational efficiency analysis," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 199-212, January.
    3. Chris Brooks & Marcel Prokopczuk, 2013. "The dynamics of commodity prices," Quantitative Finance, Taylor & Francis Journals, vol. 13(4), pages 527-542, March.
    4. Eric Eisenstat & Rodney W. Strachan, 2016. "Modelling Inflation Volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(5), pages 805-820, August.
    5. Chan, Joshua C.C. & Grant, Angelia L., 2016. "Fast computation of the deviance information criterion for latent variable models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 847-859.
    6. Russell B. Millar, 2009. "Comparison of Hierarchical Bayesian Models for Overdispersed Count Data using DIC and Bayes' Factors," Biometrics, The International Biometric Society, vol. 65(3), pages 962-969, September.
    7. Tsiotas, Georgios, 2012. "On generalised asymmetric stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 151-172, January.
    8. Timothy Cogley & Thomas J. Sargent, 2005. "Drift and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 262-302, April.
    9. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," Review of Economic Studies, Oxford University Press, vol. 65(3), pages 361-393.
    10. Håvard Rue, 2001. "Fast sampling of Gaussian Markov random fields," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 325-338.
    11. Joshua C. C. Chan & Gary Koop & Simon M. Potter, 2013. "A New Model of Trend Inflation," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 94-106, January.
    12. Joshua C. C. Chan, 2017. "The Stochastic Volatility in Mean Model With Time-Varying Parameters: An Application to Inflation Modeling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(1), pages 17-28, January.
    13. Yong Li & Zeng Tao & Jun Yu, "undated". "Robust Deviance Information Criterion for Latent Variable Models," Working Papers CoFie-04-2012, Singapore Management University, Sim Kee Boon Institute for Financial Economics.
    14. McCausland, William J., 2012. "The HESSIAN method: Highly efficient simulation smoothing, in a nutshell," Journal of Econometrics, Elsevier, vol. 168(2), pages 189-206.
    15. Chan, Joshua C.C., 2013. "Moving average stochastic volatility models with application to inflation forecast," Journal of Econometrics, Elsevier, vol. 176(2), pages 162-172.
    16. Siem Jan Koopman & Eugenie Hol Uspensky, 2002. "The stochastic volatility in mean model: empirical evidence from international stock markets," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(6), pages 667-689.
    17. Nakajima, Jouchi & Omori, Yasuhiro, 2012. "Stochastic volatility model with leverage and asymmetrically heavy-tailed error using GH skew Student’s t-distribution," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3690-3704.
    18. Jun Yu & Renate Meyer, 2006. "Multivariate Stochastic Volatility Models: Bayesian Estimation and Model Comparison," Econometric Reviews, Taylor & Francis Journals, vol. 25(2-3), pages 361-384.
    19. Haroon Mumtaz & Paolo Surico, 2012. "Evolving International Inflation Dynamics: World And Country-Specific Factors," Journal of the European Economic Association, European Economic Association, vol. 10(4), pages 716-734, August.
    20. Chib, Siddhartha & Nardari, Federico & Shephard, Neil, 2006. "Analysis of high dimensional multivariate stochastic volatility models," Journal of Econometrics, Elsevier, vol. 134(2), pages 341-371, October.
    21. Barnabé Djegnéné & William J. McCausland, 2015. "The HESSIAN Method for Models with Leverage-like Effects," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 13(3), pages 722-755.
    22. Håvard Rue & Sara Martino & Nicolas Chopin, 2009. "Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 319-392, April.
    23. David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
    24. Berg, Andreas & Meyer, Renate & Yu, Jun, 2004. "Deviance Information Criterion for Comparing Stochastic Volatility Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 22(1), pages 107-120, January.
    25. Chib, Siddhartha & Nardari, Federico & Shephard, Neil, 2002. "Markov chain Monte Carlo methods for stochastic volatility models," Journal of Econometrics, Elsevier, vol. 108(2), pages 281-316, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tao Zeng & Yong Li & Jun Yu, 2014. "Deviance Information Criterion for Comparing VAR Models," Advances in Econometrics, in: Essays in Honor of Peter C. B. Phillips, volume 33, pages 615-637, Emerald Group Publishing Limited.
    2. Joshua C. C. Chan, 2020. "Large Bayesian VARs: A Flexible Kronecker Error Covariance Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(1), pages 68-79, January.
    3. Chan, Joshua C.C. & Grant, Angelia L., 2015. "Pitfalls of estimating the marginal likelihood using the modified harmonic mean," Economics Letters, Elsevier, vol. 131(C), pages 29-33.
    4. Nonejad Nima, 2015. "Particle Gibbs with ancestor sampling for stochastic volatility models with: heavy tails, in mean effects, leverage, serial dependence and structural breaks," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(5), pages 561-584, December.
    5. Abdelhakim Aknouche, 2017. "Periodic autoregressive stochastic volatility," Statistical Inference for Stochastic Processes, Springer, vol. 20(2), pages 139-177, July.
    6. Joshua C. C. Chan, 2018. "Specification tests for time-varying parameter models with stochastic volatility," Econometric Reviews, Taylor & Francis Journals, vol. 37(8), pages 807-823, September.
    7. Joshua C. C. Chan & Eric Eisenstat, 2018. "Bayesian model comparison for time‐varying parameter VARs with stochastic volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(4), pages 509-532, June.
    8. Aknouche, Abdelhakim, 2013. "Periodic autoregressive stochastic volatility," MPRA Paper 69571, University Library of Munich, Germany, revised 2015.
    9. Chan, Joshua C.C. & Grant, Angelia L., 2016. "Modeling energy price dynamics: GARCH versus stochastic volatility," Energy Economics, Elsevier, vol. 54(C), pages 182-189.
    10. Lu Yang & Shigeyuki Hamori, 2018. "Modeling The Dynamics Of International Agricultural Commodity Prices: A Comparison Of Garch And Stochastic Volatility Models," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 13(03), pages 1-20, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joshua C. C. Chan & Eric Eisenstat, 2018. "Bayesian model comparison for time‐varying parameter VARs with stochastic volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(4), pages 509-532, June.
    2. Joshua C. C. Chan, 2017. "The Stochastic Volatility in Mean Model With Time-Varying Parameters: An Application to Inflation Modeling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(1), pages 17-28, January.
    3. Gong, Xiao-Li & Liu, Xi-Hua & Xiong, Xiong & Zhuang, Xin-Tian, 2018. "Modeling volatility dynamics using non-Gaussian stochastic volatility model based on band matrix routine," Chaos, Solitons & Fractals, Elsevier, vol. 114(C), pages 193-201.
    4. Joshua C. C. Chan, 2018. "Specification tests for time-varying parameter models with stochastic volatility," Econometric Reviews, Taylor & Francis Journals, vol. 37(8), pages 807-823, September.
    5. Chan, Joshua C.C. & Grant, Angelia L., 2016. "Fast computation of the deviance information criterion for latent variable models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 847-859.
    6. Chan, Joshua C.C., 2013. "Moving average stochastic volatility models with application to inflation forecast," Journal of Econometrics, Elsevier, vol. 176(2), pages 162-172.
    7. Nonejad Nima, 2015. "Particle Gibbs with ancestor sampling for stochastic volatility models with: heavy tails, in mean effects, leverage, serial dependence and structural breaks," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(5), pages 561-584, December.
    8. Iseringhausen, Martin, 2020. "The time-varying asymmetry of exchange rate returns: A stochastic volatility – stochastic skewness model," Journal of Empirical Finance, Elsevier, vol. 58(C), pages 275-292.
    9. Eric Eisenstat & Rodney W. Strachan, 2016. "Modelling Inflation Volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(5), pages 805-820, August.
    10. Lengua Lafosse, Patricia & Rodríguez, Gabriel, 2018. "An empirical application of a stochastic volatility model with GH skew Student's t-distribution to the volatility of Latin-American stock returns," The Quarterly Review of Economics and Finance, Elsevier, vol. 69(C), pages 155-173.
    11. Nonejad, Nima, 2014. "Particle Gibbs with Ancestor Sampling Methods for Unobserved Component Time Series Models with Heavy Tails, Serial Dependence and Structural Breaks," MPRA Paper 55664, University Library of Munich, Germany.
    12. Osman Doğan & Süleyman Taşpınar & Anil K. Bera, 2021. "Bayesian estimation of stochastic tail index from high-frequency financial data," Empirical Economics, Springer, vol. 61(5), pages 2685-2711, November.
    13. Philipp Otto & Osman Dou{g}an & Suleyman Tac{s}p{i}nar & Wolfgang Schmid & Anil K. Bera, 2023. "Spatial and Spatiotemporal Volatility Models: A Review," Papers 2308.13061, arXiv.org.
    14. Patricia Lengua Lafosse & Cristian Bayes & Gabriel Rodríguez, 2015. "A Stochastic Volatility Model with GH Skew Student’s t-Distribution: Application to Latin-American Stock Returns," Documentos de Trabajo / Working Papers 2015-405, Departamento de Economía - Pontificia Universidad Católica del Perú.
    15. Mukhoti, Sujay, 2014. "Non-Stationary Stochastic Volatility Model for Dynamic Feedback and Skewness," MPRA Paper 62532, University Library of Munich, Germany.
    16. Joshua C.C. Chan & Rodney W. Strachan, 2023. "Bayesian State Space Models In Macroeconometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 58-75, February.
    17. Xi, Yanhui & Peng, Hui & Qin, Yemei & Xie, Wenbiao & Chen, Xiaohong, 2015. "Bayesian analysis of heavy-tailed market microstructure model and its application in stock markets," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 117(C), pages 141-153.
    18. Chen, Liyuan & Zerilli, Paola & Baum, Christopher F., 2019. "Leverage effects and stochastic volatility in spot oil returns: A Bayesian approach with VaR and CVaR applications," Energy Economics, Elsevier, vol. 79(C), pages 111-129.
    19. Jamie L. Cross & Chenghan Hou & Aubrey Poon, 2018. "International Transmission of Macroeconomic Uncertainty in Small Open Economies: An Empirical Approach," Working Papers No 12/2018, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    20. Jean Pierre Fernández Prada Saucedo & Gabriel Rodríguez, 2020. "Modeling the Volatility of Returns on Commodities: An Application and Empirical Comparison of GARCH and SV Models," Documentos de Trabajo / Working Papers 2020-484, Departamento de Economía - Pontificia Universidad Católica del Perú.

    More about this item

    Keywords

    Bayesian model comparison; nonlinear state space; DIC; jumps; moving average; S&P 500;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:een:camaaa:2014-51. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Cama Admin (email available below). General contact details of provider: https://edirc.repec.org/data/asanuau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.