IDEAS home Printed from https://ideas.repec.org/a/eee/eneeco/v34y2012i2p576-583.html

A data envelopment analysis-based framework for the relative performance evaluation of competing crude oil prices' volatility forecasting models

Author

Listed:
  • Xu, Bing
  • Ouenniche, Jamal

Abstract

Forecasts of crude oil prices' volatility are important inputs to many decision making processes in application areas such as macroeconomic policy making, risk management, options pricing, and portfolio management. Despite the fact that a large number of forecasting models have been designed to forecast crude oil prices' volatility, so far the relative performance evaluation of competing forecasting models remains an exercise that is unidimensional in nature. To be more specific, most studies tend to use several criteria and their measures to assess the relative performance of these models, but competing models are always ranked by performance measure; thus, leading in general to different rankings for different criteria and to a situation where one cannot make an informed decision as to which model performs best with respect to all criteria under consideration. The purpose of this paper is to propose a single ranking that takes account of several criteria using a Data Envelopment Analysis framework. Our empirical results reveal that the unidimensional rankings for different criteria might differ significantly and that the multidimensional ranking of some models could be substantially different from their unidimensional rankings, which highlights the importance of the proposed performance evaluation tool.

Suggested Citation

  • Xu, Bing & Ouenniche, Jamal, 2012. "A data envelopment analysis-based framework for the relative performance evaluation of competing crude oil prices' volatility forecasting models," Energy Economics, Elsevier, vol. 34(2), pages 576-583.
  • Handle: RePEc:eee:eneeco:v:34:y:2012:i:2:p:576-583
    DOI: 10.1016/j.eneco.2011.12.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0140988311003008
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.eneco.2011.12.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Peter Ferderer, J., 1996. "Oil price volatility and the macroeconomy," Journal of Macroeconomics, Elsevier, vol. 18(1), pages 1-26.
    2. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    3. Ghysels, E. & Harvey, A. & Renault, E., 1995. "Stochastic Volatility," Papers 95.400, Toulouse - GREMAQ.
    4. Donna F. Davis & John T. Mentzer & Teresa M. Mccarthy & Susan L. Golicic, 2006. "The evolution of sales forecasting management: a 20-year longitudinal study of forecasting practices," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(5), pages 303-324.
    5. Robert B. Barsky & Lutz Kilian, 2004. "Oil and the Macroeconomy Since the 1970s," Journal of Economic Perspectives, American Economic Association, vol. 18(4), pages 115-134, Fall.
    6. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    7. Vo, Minh T., 2009. "Regime-switching stochastic volatility: Evidence from the crude oil market," Energy Economics, Elsevier, vol. 31(5), pages 779-788, September.
    8. Fong, Wai Mun & See, Kim Hock, 2002. "A Markov switching model of the conditional volatility of crude oil futures prices," Energy Economics, Elsevier, vol. 24(1), pages 71-95, January.
    9. Yokuma, J. Thomas & Armstrong, J. Scott, 1995. "Beyond accuracy: Comparison of criteria used to select forecasting methods," International Journal of Forecasting, Elsevier, vol. 11(4), pages 591-597, December.
    10. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    11. repec:aen:journl:2009v30-02-a09 is not listed on IDEAS
    12. Perry Sadorsky, 2005. "Stochastic volatility forecasting and risk management," Applied Financial Economics, Taylor & Francis Journals, vol. 15(2), pages 121-135.
    13. Jan Bentzen, 2007. "Does OPEC influence crude oil prices? Testing for co-movements and causality between regional crude oil prices," Applied Economics, Taylor & Francis Journals, vol. 39(11), pages 1375-1385.
    14. Sadorsky, Perry, 2006. "Modeling and forecasting petroleum futures volatility," Energy Economics, Elsevier, vol. 28(4), pages 467-488, July.
    15. Hamilton, James D, 1988. "A Neoclassical Model of Unemployment and the Business Cycle," Journal of Political Economy, University of Chicago Press, vol. 96(3), pages 593-617, June.
    16. Pindyck, Robert S, 1991. "Irreversibility, Uncertainty, and Investment," Journal of Economic Literature, American Economic Association, vol. 29(3), pages 1110-1148, September.
    17. Bollerslev, Tim & Chou, Ray Y. & Kroner, Kenneth F., 1992. "ARCH modeling in finance : A review of the theory and empirical evidence," Journal of Econometrics, Elsevier, vol. 52(1-2), pages 5-59.
    18. Massimiliano Marzo & Paolo Zagaglia, 2010. "Volatility forecasting for crude oil futures," Applied Economics Letters, Taylor & Francis Journals, vol. 17(16), pages 1587-1599.
    19. Chib, Siddhartha & Nardari, Federico & Shephard, Neil, 2002. "Markov chain Monte Carlo methods for stochastic volatility models," Journal of Econometrics, Elsevier, vol. 108(2), pages 281-316, June.
    20. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    21. Agnolucci, Paolo, 2009. "Volatility in crude oil futures: A comparison of the predictive ability of GARCH and implied volatility models," Energy Economics, Elsevier, vol. 31(2), pages 316-321, March.
    22. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    23. Lutz Kilian, 2009. "Not All Oil Price Shocks Are Alike: Disentangling Demand and Supply Shocks in the Crude Oil Market," American Economic Review, American Economic Association, vol. 99(3), pages 1053-1069, June.
    24. Kilian, Lutz, 2010. "Oil price volatility: Origins and effects," WTO Staff Working Papers ERSD-2010-02, World Trade Organization (WTO), Economic Research and Statistics Division.
    25. William W. Cooper & Lawrence M. Seiford & Kaoru Tone, 2007. "Data Envelopment Analysis," Springer Books, Springer, edition 0, number 978-0-387-45283-8, August.
    26. Kang, Sang Hoon & Kang, Sang-Mok & Yoon, Seong-Min, 2009. "Forecasting volatility of crude oil markets," Energy Economics, Elsevier, vol. 31(1), pages 119-125, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gong, Xu & Lin, Boqiang, 2018. "The incremental information content of investor fear gauge for volatility forecasting in the crude oil futures market," Energy Economics, Elsevier, vol. 74(C), pages 370-386.
    2. Azarnoosh Kafi & Behrouz Daneshian & Mohsen Rostamy-Malkhalifeh, 2021. "Forecasting the confidence interval of efficiency in fuzzy DEA," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 31(1), pages 41-59.
    3. Sueyoshi, Toshiyuki & Yuan, Yan & Goto, Mika, 2017. "A literature study for DEA applied to energy and environment," Energy Economics, Elsevier, vol. 62(C), pages 104-124.
    4. Sueyoshi, Toshiyuki & Goto, Mika, 2012. "Returns to scale and damages to scale on U.S. fossil fuel power plants: Radial and non-radial approaches for DEA environmental assessment," Energy Economics, Elsevier, vol. 34(6), pages 2240-2259.
    5. Xiong, Tao & Bao, Yukun & Hu, Zhongyi, 2013. "Beyond one-step-ahead forecasting: Evaluation of alternative multi-step-ahead forecasting models for crude oil prices," Energy Economics, Elsevier, vol. 40(C), pages 405-415.
    6. Chatziantoniou, Ioannis & Degiannakis, Stavros & Filis, George, 2019. "Futures-based forecasts: How useful are they for oil price volatility forecasting?," Energy Economics, Elsevier, vol. 81(C), pages 639-649.
    7. Azarnoosh Kafi & Behrouz Daneshian & Mohsen Rostamy-Malkhalifeh, 2021. "Forecasting the confidence interval of efficiency in fuzzy DEA," Operations Research and Decisions, Wroclaw University of Science Technology, Faculty of Management, vol. 31, pages 41-59.
    8. Nuri Ozgur DOGAN & Can Tansel TUGCU, 2015. "Energy Efficiency in Electricity Production: A Data Envelopment Analysis (DEA) Approach for the G-20 Countries," International Journal of Energy Economics and Policy, Econjournals, vol. 5(1), pages 246-252.
    9. Gong, Xu & Lin, Boqiang, 2017. "Forecasting the good and bad uncertainties of crude oil prices using a HAR framework," Energy Economics, Elsevier, vol. 67(C), pages 315-327.
    10. Alex Babiš, 2025. "Performance Evaluation of a Family of GARCH Processes Based on Value at Risk Forecasts: Data Envelopment Analysis Approach," Computational Economics, Springer;Society for Computational Economics, vol. 66(2), pages 1379-1411, August.
    11. Jamal Ouenniche & Kaoru Tone, 2017. "An out-of-sample evaluation framework for DEA with application in bankruptcy prediction," Annals of Operations Research, Springer, vol. 254(1), pages 235-250, July.
    12. Opeyemi Akinyemi & Philip O. Alege & Oluseyi O. Ajayi & Lloyd Amaghionyeodiwe & Adeyemi A. Ogundipe, 2015. "Fuel Subsidy Reform and Environmental Quality in Nigeria," International Journal of Energy Economics and Policy, Econjournals, vol. 5(2), pages 540-549.
    13. Zhu, Xuehong & Zhang, Hongwei & Zhong, Meirui, 2017. "Volatility forecasting using high frequency data: The role of after-hours information and leverage effects," Resources Policy, Elsevier, vol. 54(C), pages 58-70.
    14. Wenwen Liu & Miaomiao Tang & Peng Zhao, 2025. "The dynamic impact of investor climate sentiment on the crude oil futures market: Evidence from the Chinese market," PLOS ONE, Public Library of Science, vol. 20(2), pages 1-29, February.
    15. Chen, Rongda & Bao, Weiwei & Jin, Chenglu, 2021. "Investor sentiment and predictability for volatility on energy futures Markets: Evidence from China," International Review of Economics & Finance, Elsevier, vol. 75(C), pages 112-129.
    16. Kaoru Tone, 2013. "Resampling in DEA," GRIPS Discussion Papers 13-23, National Graduate Institute for Policy Studies.
    17. Byrne, Joseph P. & Lorusso, Marco & Xu, Bing, 2019. "Oil prices, fundamentals and expectations," Energy Economics, Elsevier, vol. 79(C), pages 59-75.
    18. Wen, Fenghua & Gong, Xu & Cai, Shenghua, 2016. "Forecasting the volatility of crude oil futures using HAR-type models with structural breaks," Energy Economics, Elsevier, vol. 59(C), pages 400-413.
    19. Zhongbao Zhou & Qianying Jin & Jian Peng & Helu Xiao & Shijian Wu, 2019. "Further Study of the DEA-Based Framework for Performance Evaluation of Competing Crude Oil Prices’ Volatility Forecasting Models," Mathematics, MDPI, vol. 7(9), pages 1-10, September.
    20. Tarek Bouazizi & Mongi Lassoued & Zouhaier Hadhek, 2021. "Oil Price Volatility Models during Coronavirus Crisis: Testing with Appropriate Models Using Further Univariate GARCH and Monte Carlo Simulation Models," International Journal of Energy Economics and Policy, Econjournals, vol. 11(1), pages 281-292.
    21. Herrera, Ana María & Hu, Liang & Pastor, Daniel, 2018. "Forecasting crude oil price volatility," International Journal of Forecasting, Elsevier, vol. 34(4), pages 622-635.
    22. Zhang, Yue-Jun & Chen, Ming-Ying, 2018. "Evaluating the dynamic performance of energy portfolios: Empirical evidence from the DEA directional distance function," European Journal of Operational Research, Elsevier, vol. 269(1), pages 64-78.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    2. Raúl De Jesús Gutiérrez & Reyna Vergara Gonz�lez & Miguel A. D�az Carre�o, 2015. "Predicción de la volatilidad en el mercado del petróleo mexicano ante la presencia de efectos asimétricos," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID.
    3. Nonejad, Nima, 2017. "Parameter instability, stochastic volatility and estimation based on simulated likelihood: Evidence from the crude oil market," Economic Modelling, Elsevier, vol. 61(C), pages 388-408.
    4. Chang, Kuang-Liang, 2012. "Volatility regimes, asymmetric basis effects and forecasting performance: An empirical investigation of the WTI crude oil futures market," Energy Economics, Elsevier, vol. 34(1), pages 294-306.
    5. Chan, Joshua C.C. & Grant, Angelia L., 2016. "Modeling energy price dynamics: GARCH versus stochastic volatility," Energy Economics, Elsevier, vol. 54(C), pages 182-189.
    6. Ronald A. Ratti & M. Zahid Hasan, 2013. "Oil Price Shocks and Volatility in Australian Stock Returns," The Economic Record, The Economic Society of Australia, vol. 89, pages 67-83, June.
    7. Degiannakis, Stavros & Filis, George, 2017. "Forecasting oil price realized volatility using information channels from other asset classes," Journal of International Money and Finance, Elsevier, vol. 76(C), pages 28-49.
    8. repec:aen:journl:ej35-1-03 is not listed on IDEAS
    9. Canepa, Alessandra & Zanetti Chini, Emilio & Alqaralleh, Huthaifa, 2023. "Modelling and Forecasting Energy Market Cycles: A Generalized Smooth Transition Approach," Department of Economics and Statistics Cognetti de Martiis. Working Papers 202318, University of Turin.
    10. Drachal, Krzysztof, 2016. "Forecasting spot oil price in a dynamic model averaging framework — Have the determinants changed over time?," Energy Economics, Elsevier, vol. 60(C), pages 35-46.
    11. Qadan, Mahmoud & Nama, Hazar, 2018. "Investor sentiment and the price of oil," Energy Economics, Elsevier, vol. 69(C), pages 42-58.
    12. Sévi, Benoît, 2014. "Forecasting the volatility of crude oil futures using intraday data," European Journal of Operational Research, Elsevier, vol. 235(3), pages 643-659.
    13. Chen, Yixiang & Ma, Feng & Zhang, Yaojie, 2019. "Good, bad cojumps and volatility forecasting: New evidence from crude oil and the U.S. stock markets," Energy Economics, Elsevier, vol. 81(C), pages 52-62.
    14. Muhammad Arshad Khan & Ayaz Ahmed, 2011. "Macroeconomic Effects of Global Food and Oil Price Shocks to the Pakistan Economy: A Structural Vector Autoregressive (SVAR) Analysis," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 50(4), pages 491-511.
    15. Scarcioffolo, Alexandre R. & Etienne, Xiaoli L., 2021. "Regime-switching energy price volatility: The role of economic policy uncertainty," International Review of Economics & Finance, Elsevier, vol. 76(C), pages 336-356.
    16. Vo, Minh, 2011. "Oil and stock market volatility: A multivariate stochastic volatility perspective," Energy Economics, Elsevier, vol. 33(5), pages 956-965, September.
    17. Claudio Morana, 2013. "The Oil Price-Macroeconomy Relationship Since the Mid-1980s: A Global Perspective," The Energy Journal, , vol. 34(3), pages 153-190, July.
    18. Degiannakis, Stavros & Filis, George, 2016. "Forecasting oil price realized volatility: A new approach," MPRA Paper 69105, University Library of Munich, Germany.
    19. Hung, Jui-Cheng & Yi-Hsien Wang, & Chang, Matthew C. & Shih, Kuang-Hsun & Hsiu-Hsueh Kao,, 2011. "Minimum variance hedging with bivariate regime-switching model for WTI crude oil," Energy, Elsevier, vol. 36(5), pages 3050-3057.
    20. Lin, Boqiang & Wesseh, Presley K., 2013. "What causes price volatility and regime shifts in the natural gas market," Energy, Elsevier, vol. 55(C), pages 553-563.
    21. Wei, Yu, 2012. "Forecasting volatility of fuel oil futures in China: GARCH-type, SV or realized volatility models?," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(22), pages 5546-5556.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • Q43 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy and the Macroeconomy
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eneeco:v:34:y:2012:i:2:p:576-583. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eneco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.