IDEAS home Printed from https://ideas.repec.org/p/ags/feemer/120042.html
   My bibliography  Save this paper

Oil Price Forecast Evaluation with Flexible Loss Functions

Author

Listed:
  • Bastianin, Andrea
  • Manera, Matteo
  • Markandya, Anil
  • Scarpa, Elisa

Abstract

The empirical literature is very far from any consensus about the appropriate model for oil price forecasting that should be implemented. Relative to the previous literature, this paper is novel in several respects. First of all, we test and systematically evaluate the ability of several alternative econometric specifications proposed in the literature to capture the dynamics of oil prices. Second, we analyse the effects of different data frequencies on the coefficient estimates and forecasts obtained using each selected econometric specification. Third, we compare different models at different data frequencies on a common sample and common data. Fourth, we evaluate the forecasting performance of each selected model using static forecasts, as well as different measures of forecast errors. Finally, we propose a new class of models which combine the relevant aspects of the financial and structural specifications proposed in the literature (“mixed” models). Our empirical findings suggest that, irrespective of the shape of the loss function, the class of financial models is to be preferred to time series models. Both financial and time series models are better than mixed and structural models. Results of the Diebold and Mariano test are not conclusive, for the loss differential seems to be statistically insignificant in the large majority of cases. Although the random walk model is not statistically outperformed by any of the alternative models, the empirical findings seem to suggest that theoretically well-grounded financial models are valid instruments for producing accurate forecasts of the WTI spot price.

Suggested Citation

  • Bastianin, Andrea & Manera, Matteo & Markandya, Anil & Scarpa, Elisa, 2011. "Oil Price Forecast Evaluation with Flexible Loss Functions," Energy: Resources and Markets 120042, Fondazione Eni Enrico Mattei (FEEM).
  • Handle: RePEc:ags:feemer:120042
    DOI: 10.22004/ag.econ.120042
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/120042/files/NDL2011-091.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.22004/ag.econ.120042?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ye, Michael & Zyren, John & Shore, Joanne, 2005. "A monthly crude oil spot price forecasting model using relative inventories," International Journal of Forecasting, Elsevier, vol. 21(3), pages 491-501.
    2. John R. Moroney & M. Douglas Berg, 1999. "An Integrated Model of Oil Production," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1), pages 105-124.
    3. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    4. Moosa, Imad A. & Al-Loughani, Nabeel E., 1994. "Unbiasedness and time varying risk premia in the crude oil futures market," Energy Economics, Elsevier, vol. 16(2), pages 99-105, April.
    5. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    6. Zeng Tian & Swanson Norman R., 1998. "Predictive Evaluation of Econometric Forecasting Models in Commodity Futures Markets," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 2(4), pages 1-21, January.
    7. Saeed Moshiri & Faezeh Foroutan, 2006. "Forecasting Nonlinear Crude Oil Futures Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 81-96.
    8. Dees, Stephane & Karadeloglou, Pavlos & Kaufmann, Robert K. & Sanchez, Marcelo, 2007. "Modelling the world oil market: Assessment of a quarterly econometric model," Energy Policy, Elsevier, vol. 35(1), pages 178-191, January.
    9. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    10. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    11. Robert K. Kaufmann, Stephane Dees, Pavlos Karadeloglou and Marcelo Sanchez, 2004. "Does OPEC Matter? An Econometric Analysis of Oil Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 67-90.
    12. Apostolos Serletis, 2007. "Rational Expectations, Risk, and Efficiency in Energy Futures Markets," World Scientific Book Chapters, in: Quantitative And Empirical Analysis Of Energy Markets, chapter 2, pages 15-22, World Scientific Publishing Co. Pte. Ltd..
    13. Menzie D. Chinn & Michael LeBlanc & Olivier Coibion, 2005. "The Predictive Content of Energy Futures: An Update on Petroleum, Natural Gas, Heating Oil and Gasoline," NBER Working Papers 11033, National Bureau of Economic Research, Inc.
    14. Salah Abosedra, 2005. "Futures versus univariate forecast of crude oil prices," OPEC Energy Review, Organization of the Petroleum Exporting Countries, vol. 29(4), pages 231-241, December.
    15. Garratt A. & Lee K. & Pesaran M.H. & Shin Y., 2003. "Forecast Uncertainties in Macroeconomic Modeling: An Application to the U.K. Economy," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 829-838, January.
    16. Bopp, Anthony E. & Lady, George M., 1991. "A comparison of petroleum futures versus spot prices as predictors of prices in the future," Energy Economics, Elsevier, vol. 13(4), pages 274-282, October.
    17. MacKinnon, James G, 1996. "Numerical Distribution Functions for Unit Root and Cointegration Tests," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(6), pages 601-618, Nov.-Dec..
    18. Johansen, Soren, 1995. "Likelihood-Based Inference in Cointegrated Vector Autoregressive Models," OUP Catalogue, Oxford University Press, number 9780198774501.
    19. Brenner, Robin J. & Kroner, Kenneth F., 1995. "Arbitrage, Cointegration, and Testing the Unbiasedness Hypothesis in Financial Markets," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 30(1), pages 23-42, March.
    20. Morana, Claudio, 2001. "A semiparametric approach to short-term oil price forecasting," Energy Economics, Elsevier, vol. 23(3), pages 325-338, May.
    21. Kaufmann, Robert K., 1995. "A model of the world oil market for project LINK Integrating economics, geology and politics," Economic Modelling, Elsevier, vol. 12(2), pages 165-178, April.
    22. Stanislav Radchenko, 2005. "The Long-Run Forecasting of Energy Prices Using the Model of Shifting Trend," Econometrics 0502002, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Winchester, Niven & Ledvina, Kirby, 2017. "The impact of oil prices on bioenergy, emissions and land use," Energy Economics, Elsevier, vol. 65(C), pages 219-227.
    2. Štěpán Chrz & Karel Janda & Ladislav Krištoufek, 2014. "Modelování provázanosti trhů potravin, biopaliv a fosilních paliv [Modeling Interconnections within Food, Biofuel, and Fossil Fuel Markets]," Politická ekonomie, Prague University of Economics and Business, vol. 2014(1), pages 117-140.
    3. Karel Janda & Štěpán Krška & Jan Průša, 2014. "Česká fotovoltaická energie: modelový odhad nákladů na její podporu [Czech Photovoltaic Energy: Model Estimation of The Costs of its Support]," Politická ekonomie, Prague University of Economics and Business, vol. 2014(3), pages 323-346.
    4. Janda, Karel & Krska, Stepan & Prusa, Jan, 2014. "Odhad nákladů na podporu české fotovoltaické energie [The Estimation of the Cost of Promotion of the Czech Photovoltaic Energy]," MPRA Paper 54108, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo Manera & Chiara Longo & Anil Markandya & Elisa Scarpa, 2007. "Evaluating the Empirical Performance of Alternative Econometric Models for Oil Price Forecasting," Working Papers 2007.4, Fondazione Eni Enrico Mattei.
    2. Giliola Frey & Matteo Manera & Anil Markandya & Elisa Scarpa, 2009. "Econometric Models for Oil Price Forecasting: A Critical Survey," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 10(1), pages 29-44, April.
    3. Lang, Korbinian & Auer, Benjamin R., 2020. "The economic and financial properties of crude oil: A review," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    4. Giliola Frey & Matteo Manera & Anil Markandya & Elisa Scarpa, 2009. "Econometric Models for Oil Price Forecasting: A Critical Survey," CESifo Forum, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 10(01), pages 29-44, April.
    5. Claudio Dicembrino & Pasquale Lucio Scandizzo, 2012. "The Fundamental and Speculative Components of the Oil Spot Price: A Real Option Value Approach," CEIS Research Paper 229, Tor Vergata University, CEIS, revised 18 Apr 2012.
    6. Naser, Hanan, 2016. "Estimating and forecasting the real prices of crude oil: A data rich model using a dynamic model averaging (DMA) approach," Energy Economics, Elsevier, vol. 56(C), pages 75-87.
    7. Ai Han & Yanan He & Yongmiao Hong & Shouyang Wang, 2013. "Forecasting Interval-valued Crude Oil Prices via Autoregressive Conditional Interval Models," Working Papers 2013-10-14, Wang Yanan Institute for Studies in Economics (WISE), Xiamen University.
    8. Chen, Shyh-Wei & Lin, Shih-Mo, 2014. "Non-linear dynamics in international resource markets: Evidence from regime switching approach," Research in International Business and Finance, Elsevier, vol. 30(C), pages 233-247.
    9. Jeffrey A Frankel & Andrew K Rose, 2010. "Determinants of Agricultural and Mineral Commodity Prices," RBA Annual Conference Volume (Discontinued), in: Renée Fry & Callum Jones & Christopher Kent (ed.),Inflation in an Era of Relative Price Shocks, Reserve Bank of Australia.
    10. Clostermann, Jörg & Keis, Nikolaus & Seitz, Franz, 2010. "Short-term oil models before and during the financial market crisis," Arbeitsberichte – Working Papers 18, Technische Hochschule Ingolstadt (THI).
    11. Menzie D. Chinn & Olivier Coibion, 2014. "The Predictive Content of Commodity Futures," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 34(7), pages 607-636, July.
    12. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2019. "Statistical and economic evaluation of time series models for forecasting arrivals at call centers," Empirical Economics, Springer, vol. 57(3), pages 923-955, September.
    13. Manuel Frondel and Marco Horvath, 2019. "The U.S. Fracking Boom: Impact on Oil Prices," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4).
    14. Frankel, Jeffrey A., 2014. "Effects of speculation and interest rates in a “carry trade” model of commodity prices," Journal of International Money and Finance, Elsevier, vol. 42(C), pages 88-112.
    15. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2011. "Forecast Evaluation in Call Centers: Combined Forecasts, Flexible Loss Functions and Economic Criteria," UNIMI - Research Papers in Economics, Business, and Statistics unimi-1109, Universitá degli Studi di Milano.
    16. Chevillon, Guillaume & Rifflart, Christine, 2009. "Physical market determinants of the price of crude oil and the market premium," Energy Economics, Elsevier, vol. 31(4), pages 537-549, July.
    17. Kaufmann, Robert K. & Dees, Stephane & Gasteuil, Audrey & Mann, Michael, 2008. "Oil prices: The role of refinery utilization, futures markets and non-linearities," Energy Economics, Elsevier, vol. 30(5), pages 2609-2622, September.
    18. Möbert, Jochen, 2007. "Crude oil price determinants," Darmstadt Discussion Papers in Economics 186, Darmstadt University of Technology, Department of Law and Economics.
    19. Christian Pierdzioch & Jan C Rülke & Georg Stadtmann, 2012. "Forecasting the Dollar/British Pound Exchange Rate: Asymmetric Loss and Forecast Rationality," Economics Bulletin, AccessEcon, vol. 32(3), pages 213-213.
    20. Prat, Georges & Uctum, Remzi, 2011. "Modelling oil price expectations: Evidence from survey data," The Quarterly Review of Economics and Finance, Elsevier, vol. 51(3), pages 236-247, June.

    More about this item

    Keywords

    Research and Development/Tech Change/Emerging Technologies;

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q32 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Nonrenewable Resources and Conservation - - - Exhaustible Resources and Economic Development
    • Q43 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy and the Macroeconomy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:feemer:120042. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/feemmit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.