IDEAS home Printed from https://ideas.repec.org/p/fem/femwpa/2011.91.html
   My bibliography  Save this paper

Oil Price Forecast Evaluation with Flexible Loss Functions

Author

Listed:
  • Andrea Bastianin

    (Department of Statistics, University of Milan-Bicocca and Fondazione Eni Enrico Mattei)

  • Matteo Manera

    (Department of Statistics, University of Milan-Bicocca and Fondazione Eni Enrico Mattei)

  • Anil Markandya

    (BC3 Basque Centre for Climate Change)

  • Elisa Scarpa

    (Edison Trading)

Abstract

The empirical literature is very far from any consensus about the appropriate model for oil price forecasting that should be implemented. Relative to the previous literature, this paper is novel in several respects. First of all, we test and systematically evaluate the ability of several alternative econometric specifications proposed in the literature to capture the dynamics of oil prices. Second, we analyse the effects of different data frequencies on the coefficient estimates and forecasts obtained using each selected econometric specification. Third, we compare different models at different data frequencies on a common sample and common data. Fourth, we evaluate the forecasting performance of each selected model using static forecasts, as well as different measures of forecast errors. Finally, we propose a new class of models which combine the relevant aspects of the financial and structural specifications proposed in the literature (“mixed” models). Our empirical findings suggest that, irrespective of the shape of the loss function, the class of financial models is to be preferred to time series models. Both financial and time series models are better than mixed and structural models. Results of the Diebold and Mariano test are not conclusive, for the loss differential seems to be statistically insignificant in the large majority of cases. Although the random walk model is not statistically outperformed by any of the alternative models, the empirical findings seem to suggest that theoretically well-grounded financial models are valid instruments for producing accurate forecasts of the WTI spot price.

Suggested Citation

  • Andrea Bastianin & Matteo Manera & Anil Markandya & Elisa Scarpa, 2011. "Oil Price Forecast Evaluation with Flexible Loss Functions," Working Papers 2011.91, Fondazione Eni Enrico Mattei.
  • Handle: RePEc:fem:femwpa:2011.91
    as

    Download full text from publisher

    File URL: https://feem-media.s3.eu-central-1.amazonaws.com/wp-content/uploads/NDL2011-091.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Dees, Stephane & Karadeloglou, Pavlos & Kaufmann, Robert K. & Sanchez, Marcelo, 2007. "Modelling the world oil market: Assessment of a quarterly econometric model," Energy Policy, Elsevier, vol. 35(1), pages 178-191, January.
    2. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    3. Menzie D. Chinn & Michael LeBlanc & Olivier Coibion, 2005. "The Predictive Content of Energy Futures: An Update on Petroleum, Natural Gas, Heating Oil and Gasoline," NBER Working Papers 11033, National Bureau of Economic Research, Inc.
    4. Apostolos Serletis, 2007. "Rational Expectations, Risk, and Efficiency in Energy Futures Markets," World Scientific Book Chapters, in: Quantitative And Empirical Analysis Of Energy Markets, chapter 2, pages 15-22, World Scientific Publishing Co. Pte. Ltd..
    5. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    6. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    7. Kaufmann, Robert K., 1995. "A model of the world oil market for project LINK Integrating economics, geology and politics," Economic Modelling, Elsevier, vol. 12(2), pages 165-178, April.
    8. Stanislav Radchenko, 2005. "The Long-Run Forecasting of Energy Prices Using the Model of Shifting Trend," Econometrics 0502002, University Library of Munich, Germany.
    9. John R. Moroney & M. Douglas Berg, 1999. "An Integrated Model of Oil Production," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1), pages 105-124.
    10. Zeng Tian & Swanson Norman R., 1998. "Predictive Evaluation of Econometric Forecasting Models in Commodity Futures Markets," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 2(4), pages 1-21, January.
    11. Saeed Moshiri & Faezeh Foroutan, 2006. "Forecasting Nonlinear Crude Oil Futures Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 81-96.
    12. Garratt A. & Lee K. & Pesaran M.H. & Shin Y., 2003. "Forecast Uncertainties in Macroeconomic Modeling: An Application to the U.K. Economy," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 829-838, January.
    13. Bopp, Anthony E. & Lady, George M., 1991. "A comparison of petroleum futures versus spot prices as predictors of prices in the future," Energy Economics, Elsevier, vol. 13(4), pages 274-282, October.
    14. MacKinnon, James G, 1996. "Numerical Distribution Functions for Unit Root and Cointegration Tests," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(6), pages 601-618, Nov.-Dec..
    15. Moosa, Imad A. & Al-Loughani, Nabeel E., 1994. "Unbiasedness and time varying risk premia in the crude oil futures market," Energy Economics, Elsevier, vol. 16(2), pages 99-105, April.
    16. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    17. Robert K. Kaufmann, Stephane Dees, Pavlos Karadeloglou and Marcelo Sanchez, 2004. "Does OPEC Matter? An Econometric Analysis of Oil Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 67-90.
    18. Johansen, Soren, 1995. "Likelihood-Based Inference in Cointegrated Vector Autoregressive Models," OUP Catalogue, Oxford University Press, number 9780198774501.
    19. Ye, Michael & Zyren, John & Shore, Joanne, 2005. "A monthly crude oil spot price forecasting model using relative inventories," International Journal of Forecasting, Elsevier, vol. 21(3), pages 491-501.
    20. Salah Abosedra, 2005. "Futures versus univariate forecast of crude oil prices," OPEC Energy Review, Organization of the Petroleum Exporting Countries, vol. 29(4), pages 231-241, December.
    21. Brenner, Robin J. & Kroner, Kenneth F., 1995. "Arbitrage, Cointegration, and Testing the Unbiasedness Hypothesis in Financial Markets," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 30(1), pages 23-42, March.
    22. Morana, Claudio, 2001. "A semiparametric approach to short-term oil price forecasting," Energy Economics, Elsevier, vol. 23(3), pages 325-338, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Winchester, Niven & Ledvina, Kirby, 2017. "The impact of oil prices on bioenergy, emissions and land use," Energy Economics, Elsevier, vol. 65(C), pages 219-227.
    2. Karel Janda & Štěpán Krška & Jan Průša, 2014. "Česká fotovoltaická energie: modelový odhad nákladů na její podporu [Czech Photovoltaic Energy: Model Estimation of The Costs of its Support]," Politická ekonomie, Prague University of Economics and Business, vol. 2014(3), pages 323-346.
    3. Štěpán Chrz & Karel Janda & Ladislav Krištoufek, 2014. "Modelování provázanosti trhů potravin, biopaliv a fosilních paliv [Modeling Interconnections within Food, Biofuel, and Fossil Fuel Markets]," Politická ekonomie, Prague University of Economics and Business, vol. 2014(1), pages 117-140.
    4. Janda, Karel & Krska, Stepan & Prusa, Jan, 2014. "Odhad nákladů na podporu české fotovoltaické energie [The Estimation of the Cost of Promotion of the Czech Photovoltaic Energy]," MPRA Paper 54108, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Scarpa, Elisa & Longo, Chiara & Manera, Matteo & Markandya, Anil, 2007. "Evaluating the Empirical Performance of Alternative Econometric Models for Oil Price Forecasting," International Energy Markets Working Papers 12118, Fondazione Eni Enrico Mattei (FEEM).
    2. Giliola Frey & Matteo Manera & Anil Markandya & Elisa Scarpa, 2009. "Econometric Models for Oil Price Forecasting: A Critical Survey," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 10(1), pages 29-44, April.
    3. Giliola Frey & Matteo Manera & Anil Markandya & Elisa Scarpa, 2009. "Econometric Models for Oil Price Forecasting: A Critical Survey," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 10(01), pages 29-44, April.
    4. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    5. Claudio Dicembrino & Pasquale Lucio Scandizzo, 2012. "The Fundamental and Speculative Components of the Oil Spot Price: A Real Option Value Approach," CEIS Research Paper 229, Tor Vergata University, CEIS, revised 18 Apr 2012.
    6. Naser, Hanan, 2016. "Estimating and forecasting the real prices of crude oil: A data rich model using a dynamic model averaging (DMA) approach," Energy Economics, Elsevier, vol. 56(C), pages 75-87.
    7. Ai Han & Yanan He & Yongmiao Hong & Shouyang Wang, 2013. "Forecasting Interval-valued Crude Oil Prices via Autoregressive Conditional Interval Models," Working Papers 2013-10-14, Wang Yanan Institute for Studies in Economics (WISE), Xiamen University.
    8. Chen, Shyh-Wei & Lin, Shih-Mo, 2014. "Non-linear dynamics in international resource markets: Evidence from regime switching approach," Research in International Business and Finance, Elsevier, vol. 30(C), pages 233-247.
    9. Jeffrey A Frankel & Andrew K Rose, 2010. "Determinants of Agricultural and Mineral Commodity Prices," RBA Annual Conference Volume (Discontinued), in: Renée Fry & Callum Jones & Christopher Kent (ed.),Inflation in an Era of Relative Price Shocks, Reserve Bank of Australia.
    10. Menzie D. Chinn & Olivier Coibion, 2014. "The Predictive Content of Commodity Futures," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 34(7), pages 607-636, July.
    11. Clostermann, Jörg & Keis, Nikolaus & Seitz, Franz, 2010. "Short-term oil models before and during the financial market crisis," Arbeitsberichte – Working Papers 18, Technische Hochschule Ingolstadt (THI).
    12. Frankel, Jeffrey A., 2014. "Effects of speculation and interest rates in a “carry trade” model of commodity prices," Journal of International Money and Finance, Elsevier, vol. 42(C), pages 88-112.
    13. Manuel Frondel and Marco Horvath, 2019. "The U.S. Fracking Boom: Impact on Oil Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4).
    14. Andrea BASTIANIN & Marzio GALEOTTI & Matteo MANERA, 2011. "Forecast evaluation in call centers: combined forecasts, flexible loss functions and economic criteria," Departmental Working Papers 2011-08, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    15. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2019. "Statistical and economic evaluation of time series models for forecasting arrivals at call centers," Empirical Economics, Springer, vol. 57(3), pages 923-955, September.
    16. Kaufmann, Robert K. & Dees, Stephane & Gasteuil, Audrey & Mann, Michael, 2008. "Oil prices: The role of refinery utilization, futures markets and non-linearities," Energy Economics, Elsevier, vol. 30(5), pages 2609-2622, September.
    17. Chevillon, Guillaume & Rifflart, Christine, 2009. "Physical market determinants of the price of crude oil and the market premium," Energy Economics, Elsevier, vol. 31(4), pages 537-549, July.
    18. Pierdzioch, Christian & Rülke, Jan-Christoph & Stadtmann, Georg, 2012. "On the loss function of the Bank of Canada: A note," Economics Letters, Elsevier, vol. 115(2), pages 155-159.
    19. Pierdzioch, Christian & Rülke, Jan-Christoph & Stadtmann, Georg, 2013. "A note on forecasting the prices of gold and silver: Asymmetric loss and forecast rationality," The Quarterly Review of Economics and Finance, Elsevier, vol. 53(3), pages 294-301.
    20. Mr. Aasim M. Husain & Chakriya Bowman, 2004. "Forecasting Commodity Prices: Futures Versus Judgment," IMF Working Papers 2004/041, International Monetary Fund.

    More about this item

    Keywords

    Oil Price; WTI Spot and Futures Prices; Forecasting; Econometric Models;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q32 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Nonrenewable Resources and Conservation - - - Exhaustible Resources and Economic Development
    • Q43 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy and the Macroeconomy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fem:femwpa:2011.91. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alberto Prina Cerai (email available below). General contact details of provider: https://edirc.repec.org/data/feemmit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.