IDEAS home Printed from https://ideas.repec.org/a/eee/eneeco/v34y2012i2p576-583.html
   My bibliography  Save this article

A data envelopment analysis-based framework for the relative performance evaluation of competing crude oil prices' volatility forecasting models

Author

Listed:
  • Xu, Bing
  • Ouenniche, Jamal

Abstract

Forecasts of crude oil prices' volatility are important inputs to many decision making processes in application areas such as macroeconomic policy making, risk management, options pricing, and portfolio management. Despite the fact that a large number of forecasting models have been designed to forecast crude oil prices' volatility, so far the relative performance evaluation of competing forecasting models remains an exercise that is unidimensional in nature. To be more specific, most studies tend to use several criteria and their measures to assess the relative performance of these models, but competing models are always ranked by performance measure; thus, leading in general to different rankings for different criteria and to a situation where one cannot make an informed decision as to which model performs best with respect to all criteria under consideration. The purpose of this paper is to propose a single ranking that takes account of several criteria using a Data Envelopment Analysis framework. Our empirical results reveal that the unidimensional rankings for different criteria might differ significantly and that the multidimensional ranking of some models could be substantially different from their unidimensional rankings, which highlights the importance of the proposed performance evaluation tool.

Suggested Citation

  • Xu, Bing & Ouenniche, Jamal, 2012. "A data envelopment analysis-based framework for the relative performance evaluation of competing crude oil prices' volatility forecasting models," Energy Economics, Elsevier, vol. 34(2), pages 576-583.
  • Handle: RePEc:eee:eneeco:v:34:y:2012:i:2:p:576-583
    DOI: 10.1016/j.eneco.2011.12.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0140988311003008
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.eneco.2011.12.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    2. Ghysels, E. & Harvey, A. & Renault, E., 1995. "Stochastic Volatility," Papers 95.400, Toulouse - GREMAQ.
    3. Robert B. Barsky & Lutz Kilian, 2004. "Oil and the Macroeconomy Since the 1970s," Journal of Economic Perspectives, American Economic Association, vol. 18(4), pages 115-134, Fall.
    4. Vo, Minh T., 2009. "Regime-switching stochastic volatility: Evidence from the crude oil market," Energy Economics, Elsevier, vol. 31(5), pages 779-788, September.
    5. Fong, Wai Mun & See, Kim Hock, 2002. "A Markov switching model of the conditional volatility of crude oil futures prices," Energy Economics, Elsevier, vol. 24(1), pages 71-95, January.
    6. Yokuma, J. Thomas & Armstrong, J. Scott, 1995. "Beyond accuracy: Comparison of criteria used to select forecasting methods," International Journal of Forecasting, Elsevier, vol. 11(4), pages 591-597, December.
    7. Pindyck, Robert S, 1991. "Irreversibility, Uncertainty, and Investment," Journal of Economic Literature, American Economic Association, vol. 29(3), pages 1110-1148, September.
    8. James D. Hamilton, 2009. "Understanding Crude Oil Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 179-206.
    9. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    10. Agnolucci, Paolo, 2009. "Volatility in crude oil futures: A comparison of the predictive ability of GARCH and implied volatility models," Energy Economics, Elsevier, vol. 31(2), pages 316-321, March.
    11. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    12. Lutz Kilian, 2009. "Not All Oil Price Shocks Are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market," American Economic Review, American Economic Association, vol. 99(3), pages 1053-1069, June.
    13. Peter Ferderer, J., 1996. "Oil price volatility and the macroeconomy," Journal of Macroeconomics, Elsevier, vol. 18(1), pages 1-26.
    14. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    15. Jan Bentzen, 2007. "Does OPEC influence crude oil prices? Testing for co-movements and causality between regional crude oil prices," Applied Economics, Taylor & Francis Journals, vol. 39(11), pages 1375-1385.
    16. Bollerslev, Tim & Chou, Ray Y. & Kroner, Kenneth F., 1992. "ARCH modeling in finance : A review of the theory and empirical evidence," Journal of Econometrics, Elsevier, vol. 52(1-2), pages 5-59.
    17. Massimiliano Marzo & Paolo Zagaglia, 2010. "Volatility forecasting for crude oil futures," Applied Economics Letters, Taylor & Francis Journals, vol. 17(16), pages 1587-1599.
    18. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    19. Hamilton, James D, 1988. "A Neoclassical Model of Unemployment and the Business Cycle," Journal of Political Economy, University of Chicago Press, vol. 96(3), pages 593-617, June.
    20. Donna F. Davis & John T. Mentzer & Teresa M. Mccarthy & Susan L. Golicic, 2006. "The evolution of sales forecasting management: a 20-year longitudinal study of forecasting practices," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(5), pages 303-324.
    21. Perry Sadorsky, 2005. "Stochastic volatility forecasting and risk management," Applied Financial Economics, Taylor & Francis Journals, vol. 15(2), pages 121-135.
    22. Sadorsky, Perry, 2006. "Modeling and forecasting petroleum futures volatility," Energy Economics, Elsevier, vol. 28(4), pages 467-488, July.
    23. Chib, Siddhartha & Nardari, Federico & Shephard, Neil, 2002. "Markov chain Monte Carlo methods for stochastic volatility models," Journal of Econometrics, Elsevier, vol. 108(2), pages 281-316, June.
    24. Kilian, Lutz, 2010. "Oil price volatility: Origins and effects," WTO Staff Working Papers ERSD-2010-02, World Trade Organization (WTO), Economic Research and Statistics Division.
    25. William W. Cooper & Lawrence M. Seiford & Kaoru Tone, 2007. "Data Envelopment Analysis," Springer Books, Springer, edition 0, number 978-0-387-45283-8, November.
    26. Kang, Sang Hoon & Kang, Sang-Mok & Yoon, Seong-Min, 2009. "Forecasting volatility of crude oil markets," Energy Economics, Elsevier, vol. 31(1), pages 119-125, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gong, Xu & Lin, Boqiang, 2018. "The incremental information content of investor fear gauge for volatility forecasting in the crude oil futures market," Energy Economics, Elsevier, vol. 74(C), pages 370-386.
    2. Azarnoosh Kafi & Behrouz Daneshian & Mohsen Rostamy-Malkhalifeh, 2021. "Forecasting the confidence interval of efficiency in fuzzy DEA," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 31(1), pages 41-59.
    3. Sueyoshi, Toshiyuki & Yuan, Yan & Goto, Mika, 2017. "A literature study for DEA applied to energy and environment," Energy Economics, Elsevier, vol. 62(C), pages 104-124.
    4. Sueyoshi, Toshiyuki & Goto, Mika, 2012. "Returns to scale and damages to scale on U.S. fossil fuel power plants: Radial and non-radial approaches for DEA environmental assessment," Energy Economics, Elsevier, vol. 34(6), pages 2240-2259.
    5. Xiong, Tao & Bao, Yukun & Hu, Zhongyi, 2013. "Beyond one-step-ahead forecasting: Evaluation of alternative multi-step-ahead forecasting models for crude oil prices," Energy Economics, Elsevier, vol. 40(C), pages 405-415.
    6. Chatziantoniou, Ioannis & Degiannakis, Stavros & Filis, George, 2019. "Futures-based forecasts: How useful are they for oil price volatility forecasting?," Energy Economics, Elsevier, vol. 81(C), pages 639-649.
    7. Azarnoosh Kafi & Behrouz Daneshian & Mohsen Rostamy-Malkhalifeh, 2021. "Forecasting the confidence interval of efficiency in fuzzy DEA," Operations Research and Decisions, Wroclaw University of Science Technology, Faculty of Management, vol. 31, pages 41-59.
    8. Opeyemi Akinyemi & Philip O. Alege & Oluseyi O. Ajayi & Lloyd Amaghionyeodiwe & Adeyemi A. Ogundipe, 2015. "Fuel Subsidy Reform and Environmental Quality in Nigeria," International Journal of Energy Economics and Policy, Econjournals, vol. 5(2), pages 540-549.
    9. Zhu, Xuehong & Zhang, Hongwei & Zhong, Meirui, 2017. "Volatility forecasting using high frequency data: The role of after-hours information and leverage effects," Resources Policy, Elsevier, vol. 54(C), pages 58-70.
    10. Kaoru Tone, 2013. "Resampling in DEA," GRIPS Discussion Papers 13-23, National Graduate Institute for Policy Studies.
    11. Wen, Fenghua & Gong, Xu & Cai, Shenghua, 2016. "Forecasting the volatility of crude oil futures using HAR-type models with structural breaks," Energy Economics, Elsevier, vol. 59(C), pages 400-413.
    12. Zhongbao Zhou & Qianying Jin & Jian Peng & Helu Xiao & Shijian Wu, 2019. "Further Study of the DEA-Based Framework for Performance Evaluation of Competing Crude Oil Prices’ Volatility Forecasting Models," Mathematics, MDPI, vol. 7(9), pages 1-10, September.
    13. Tarek Bouazizi & Mongi Lassoued & Zouhaier Hadhek, 2021. "Oil Price Volatility Models during Coronavirus Crisis: Testing with Appropriate Models Using Further Univariate GARCH and Monte Carlo Simulation Models," International Journal of Energy Economics and Policy, Econjournals, vol. 11(1), pages 281-292.
    14. Zhang, Yue-Jun & Chen, Ming-Ying, 2018. "Evaluating the dynamic performance of energy portfolios: Empirical evidence from the DEA directional distance function," European Journal of Operational Research, Elsevier, vol. 269(1), pages 64-78.
    15. Nuri Ozgur DOGAN & Can Tansel TUGCU, 2015. "Energy Efficiency in Electricity Production: A Data Envelopment Analysis (DEA) Approach for the G-20 Countries," International Journal of Energy Economics and Policy, Econjournals, vol. 5(1), pages 246-252.
    16. Gong, Xu & Lin, Boqiang, 2017. "Forecasting the good and bad uncertainties of crude oil prices using a HAR framework," Energy Economics, Elsevier, vol. 67(C), pages 315-327.
    17. Jamal Ouenniche & Kaoru Tone, 2017. "An out-of-sample evaluation framework for DEA with application in bankruptcy prediction," Annals of Operations Research, Springer, vol. 254(1), pages 235-250, July.
    18. Chen, Rongda & Bao, Weiwei & Jin, Chenglu, 2021. "Investor sentiment and predictability for volatility on energy futures Markets: Evidence from China," International Review of Economics & Finance, Elsevier, vol. 75(C), pages 112-129.
    19. Byrne, Joseph P. & Lorusso, Marco & Xu, Bing, 2019. "Oil prices, fundamentals and expectations," Energy Economics, Elsevier, vol. 79(C), pages 59-75.
    20. Herrera, Ana María & Hu, Liang & Pastor, Daniel, 2018. "Forecasting crude oil price volatility," International Journal of Forecasting, Elsevier, vol. 34(4), pages 622-635.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    2. Stavros Degiannakis, George Filis, and Renatas Kizys, 2014. "The Effects of Oil Price Shocks on Stock Market Volatility: Evidence from European Data," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1).
    3. Raúl De Jesús Gutiérrez & Reyna Vergara González & Miguel A. Díaz Carreño, 2015. "Predicción de la volatilidad en el mercado del petróleo mexicano ante la presencia de efectos asimétricos," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, March.
    4. Chan, Joshua C.C. & Grant, Angelia L., 2016. "Modeling energy price dynamics: GARCH versus stochastic volatility," Energy Economics, Elsevier, vol. 54(C), pages 182-189.
    5. Nonejad, Nima, 2017. "Parameter instability, stochastic volatility and estimation based on simulated likelihood: Evidence from the crude oil market," Economic Modelling, Elsevier, vol. 61(C), pages 388-408.
    6. Chang, Kuang-Liang, 2012. "Volatility regimes, asymmetric basis effects and forecasting performance: An empirical investigation of the WTI crude oil futures market," Energy Economics, Elsevier, vol. 34(1), pages 294-306.
    7. Ronald A. Ratti & M. Zahid Hasan, 2013. "Oil Price Shocks and Volatility in Australian Stock Returns," The Economic Record, The Economic Society of Australia, vol. 89, pages 67-83, June.
    8. Joëts, Marc & Mignon, Valérie & Razafindrabe, Tovonony, 2017. "Does the volatility of commodity prices reflect macroeconomic uncertainty?," Energy Economics, Elsevier, vol. 68(C), pages 313-326.
    9. Filis, George & Degiannakis, Stavros & Floros, Christos, 2011. "Dynamic correlation between stock market and oil prices: The case of oil-importing and oil-exporting countries," International Review of Financial Analysis, Elsevier, vol. 20(3), pages 152-164, June.
    10. Valcarcel, Victor J. & Wohar, Mark E., 2013. "Changes in the oil price-inflation pass-through," Journal of Economics and Business, Elsevier, vol. 68(C), pages 24-42.
    11. Degiannakis, Stavros & Filis, George, 2017. "Forecasting oil price realized volatility using information channels from other asset classes," Journal of International Money and Finance, Elsevier, vol. 76(C), pages 28-49.
    12. Canepa, Alessandra & Zanetti Chini, Emilio & Alqaralleh, Huthaifa, 2023. "Modelling and Forecasting Energy Market Cycles: A Generalized Smooth Transition Approach," Department of Economics and Statistics Cognetti de Martiis. Working Papers 202318, University of Turin.
    13. Christiane Baumeister & Gert Peersman, 2013. "Time-Varying Effects of Oil Supply Shocks on the US Economy," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(4), pages 1-28, October.
    14. Drachal, Krzysztof, 2016. "Forecasting spot oil price in a dynamic model averaging framework — Have the determinants changed over time?," Energy Economics, Elsevier, vol. 60(C), pages 35-46.
    15. Degiannakis, Stavros & Filis, George & Panagiotakopoulou, Sofia, 2018. "Oil price shocks and uncertainty: How stable is their relationship over time?," Economic Modelling, Elsevier, vol. 72(C), pages 42-53.
    16. Stavros Degiannakis, George Filis, and Vipin Arora, 2018. "Oil Prices and Stock Markets: A Review of the Theory and Empirical Evidence," The Energy Journal, International Association for Energy Economics, vol. 0(Number 5).
    17. Stavros Degiannakis & George Filis & Renatas Kizys, 2013. "Oil price shocks and stock market volatility: evidence from European data," Working Papers 161, Bank of Greece.
    18. Qadan, Mahmoud & Nama, Hazar, 2018. "Investor sentiment and the price of oil," Energy Economics, Elsevier, vol. 69(C), pages 42-58.
    19. Sévi, Benoît, 2014. "Forecasting the volatility of crude oil futures using intraday data," European Journal of Operational Research, Elsevier, vol. 235(3), pages 643-659.
    20. Chen, Yixiang & Ma, Feng & Zhang, Yaojie, 2019. "Good, bad cojumps and volatility forecasting: New evidence from crude oil and the U.S. stock markets," Energy Economics, Elsevier, vol. 81(C), pages 52-62.

    More about this item

    Keywords

    Forecasting; Performance criteria; Performance evaluation; Volatility; GARCH; Data Envelopment Analysis (DEA);
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • Q43 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy and the Macroeconomy
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eneeco:v:34:y:2012:i:2:p:576-583. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eneco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.