IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v220y2018icp138-153.html
   My bibliography  Save this article

Oil projections in retrospect: Revisions, accuracy and current uncertainty

Author

Listed:
  • Wachtmeister, Henrik
  • Henke, Petter
  • Höök, Mikael

Abstract

Scenarios and projections are important for decision and policy making. Accuracy of past projections can be useful for both scenario users and developers, for insight on current projection uncertainty, and for guiding improvement efforts. This paper compiles projections of oil production, oil prices and upstream investments from the years 2000 to 2016 from the annual World Energy Outlook by the International Energy Agency, and investigates revisions and accuracy of past projections and implied uncertainty of current ones. Revisions of world oil production, price and investments have been motivated by a combination of demand and supply factors. Downward revisions are mainly allocated to OPEC, while recent upward revisions are due to unconventional oil, in particular US tight oil. Non-OPEC conventional projections have been stable. Price and investments have been revised mostly upwards. Projection accuracy follows the size and directions of these revisions, with high accuracy for Non-OPEC (mean absolute percentage error of 4.8% on a 5 year horizon) and low for OPEC (8.9%) and unconventional (37%). Counteracting error directions contribute to accurate total World oil supply projections (4%) while price projections have low accuracy (37%). Scenario users should be aware of implied uncertainty of current oil projections. In planning and decision making, uncertainty ranges such as those presented here can be used as benchmarks. Scenario developers should focus improvements efforts on three areas in particular: tight oil, OPEC and new technology.

Suggested Citation

  • Wachtmeister, Henrik & Henke, Petter & Höök, Mikael, 2018. "Oil projections in retrospect: Revisions, accuracy and current uncertainty," Applied Energy, Elsevier, vol. 220(C), pages 138-153.
  • Handle: RePEc:eee:appene:v:220:y:2018:i:c:p:138-153
    DOI: 10.1016/j.apenergy.2018.03.013
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261918303428
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2018.03.013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Atalla, Tarek & Joutz, Fred & Pierru, Axel, 2016. "Does disagreement among oil price forecasters reflect volatility? Evidence from the ECB surveys," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1178-1192.
    2. Christiane Baumeister & Lutz Kilian, 2016. "Forty Years of Oil Price Fluctuations: Why the Price of Oil May Still Surprise Us," Journal of Economic Perspectives, American Economic Association, vol. 30(1), pages 139-160, Winter.
    3. Reynolds, Douglas B. & Pippenger, Michael K., 2010. "OPEC and Venezuelan oil production: Evidence against a cartel hypothesis," Energy Policy, Elsevier, vol. 38(10), pages 6045-6055, October.
    4. Jakobsson, Kristofer & Söderbergh, Bengt & Snowden, Simon & Aleklett, Kjell, 2014. "Bottom-up modeling of oil production: A review of approaches," Energy Policy, Elsevier, vol. 64(C), pages 113-123.
    5. Brown, Stephen P.A. & Huntington, Hillard G., 2017. "OPEC and world oil security," Energy Policy, Elsevier, vol. 108(C), pages 512-523.
    6. Behar, Alberto & Ritz, Robert A., 2017. "OPEC vs US shale: Analyzing the shift to a market-share strategy," Energy Economics, Elsevier, vol. 63(C), pages 185-198.
    7. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    8. DeCarolis, Joseph & Daly, Hannah & Dodds, Paul & Keppo, Ilkka & Li, Francis & McDowall, Will & Pye, Steve & Strachan, Neil & Trutnevyte, Evelina & Usher, Will & Winning, Matthew & Yeh, Sonia & Zeyring, 2017. "Formalizing best practice for energy system optimization modelling," Applied Energy, Elsevier, vol. 194(C), pages 184-198.
    9. Fischer, Carolyn & Herrnstadt, Evan & Morgenstern, Richard, 2009. "Understanding errors in EIA projections of energy demand," Resource and Energy Economics, Elsevier, vol. 31(3), pages 198-209, August.
    10. Linderoth, Hans, 2002. "Forecast errors in IEA-countries' energy consumption," Energy Policy, Elsevier, vol. 30(1), pages 53-61, January.
    11. Evelina Trutnevyte & Céline Guivarch & Robert Lempert & Neil Strachan, 2016. "Reinvigorating the scenario technique to expand uncertainty consideration," Climatic Change, Springer, vol. 135(3), pages 373-379, April.
    12. Liao, Hua & Cai, Jia-Wei & Yang, Dong-Wei & Wei, Yi-Ming, 2016. "Why did the historical energy forecasting succeed or fail? A case study on IEA's projection," Technological Forecasting and Social Change, Elsevier, vol. 107(C), pages 90-96.
    13. Bentley, Roger & Bentley, Yongmei, 2015. "Explaining the price of oil 1971–2014 : The need to use reliable data on oil discovery and to account for ‘mid-point’ peak," Energy Policy, Elsevier, vol. 86(C), pages 880-890.
    14. Hillard G. Huntington, 1994. "Oil Price Forecasting in the 1980s: What Went Wrong?," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 1-22.
    15. Fye, Shannon R. & Charbonneau, Steven M. & Hay, Jason W. & Mullins, Carie A., 2013. "An examination of factors affecting accuracy in technology forecasts," Technological Forecasting and Social Change, Elsevier, vol. 80(6), pages 1222-1231.
    16. McGlade, Christophe E., 2014. "Comment on the ‘Uppsala critique’," Energy Policy, Elsevier, vol. 67(C), pages 154-158.
    17. Kleinberg, R.L. & Paltsev, S. & Ebinger, C.K.E. & Hobbs, D.A. & Boersma, T., 2018. "Tight oil market dynamics: Benchmarks, breakeven points, and inelasticities," Energy Economics, Elsevier, vol. 70(C), pages 70-83.
    18. Sällh, David & Höök, Mikael & Grandell, Leena & Davidsson, Simon, 2014. "Evaluation and update of Norwegian and Danish oil production forecasts and implications for Swedish oil import," Energy, Elsevier, vol. 65(C), pages 333-345.
    19. Jonathan Koomey & Paul Craig & Ashok Gadgil & David Lorenzetti, 2003. "Improving Long-Range Energy Modeling: A Plea for Historical Retrospectives," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 75-92.
    20. Shlyakhter, Alexander I. & Kammen, Daniel M. & Broido, Claire L. & Wilson, Richard, 1994. "Quantifying the credibility of energy projections from trends in past data : The US energy sector," Energy Policy, Elsevier, vol. 22(2), pages 119-130, February.
    21. Lee, Yun Shin & Scholtes, Stefan, 2014. "Empirical prediction intervals revisited," International Journal of Forecasting, Elsevier, vol. 30(2), pages 217-234.
    22. Labys, Walter C., 1982. "Measuring the validity and performance of energy models," Energy Economics, Elsevier, vol. 4(3), pages 159-168, July.
    23. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    24. Moret, Stefano & Codina Gironès, Víctor & Bierlaire, Michel & Maréchal, François, 2017. "Characterization of input uncertainties in strategic energy planning models," Applied Energy, Elsevier, vol. 202(C), pages 597-617.
    25. Aleklett, Kjell & Höök, Mikael & Jakobsson, Kristofer & Lardelli, Michael & Snowden, Simon & Söderbergh, Bengt, 2010. "The Peak of the Oil Age - Analyzing the world oil production Reference Scenario in World Energy Outlook 2008," Energy Policy, Elsevier, vol. 38(3), pages 1398-1414, March.
    26. O'Neill, Brian C. & Desai, Mausami, 2005. "Accuracy of past projections of US energy consumption," Energy Policy, Elsevier, vol. 33(8), pages 979-993, May.
    27. Peter Tulip & Stephanie Wallace, 2012. "Estimates of Uncertainty around the RBA's Forecasts," RBA Research Discussion Papers rdp2012-07, Reserve Bank of Australia.
    28. Gilbert, Alexander Q. & Sovacool, Benjamin K., 2016. "Looking the wrong way: Bias, renewable electricity, and energy modelling in the United States," Energy, Elsevier, vol. 94(C), pages 533-541.
    29. Hans H. Landsberg, 1985. "Energy in Transition: A View from 1960," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 1-18.
    30. Trutnevyte, Evelina & McDowall, Will & Tomei, Julia & Keppo, Ilkka, 2016. "Energy scenario choices: Insights from a retrospective review of UK energy futures," Renewable and Sustainable Energy Reviews, Elsevier, vol. 55(C), pages 326-337.
    31. Sohn, Ira, 2007. "Long-term energy projections: What lessons have we learned?," Energy Policy, Elsevier, vol. 35(9), pages 4574-4584, September.
    32. Van de Graaf, Thijs, 2012. "Obsolete or resurgent? The International Energy Agency in a changing global landscape," Energy Policy, Elsevier, vol. 48(C), pages 233-241.
    33. Hua Liao & Jia-Wei Cai & Dong-Wei Yang & Yi-Ming Wei, 2016. "Why did the historical energy forecasting succeed or fail? A case study on IEA¡¯s projection," CEEP-BIT Working Papers 92, Center for Energy and Environmental Policy Research (CEEP), Beijing Institute of Technology.
    34. Jakobsson, Kristofer & Bentley, Roger & Söderbergh, Bengt & Aleklett, Kjell, 2012. "The end of cheap oil: Bottom-up economic and geologic modeling of aggregate oil production curves," Energy Policy, Elsevier, vol. 41(C), pages 860-870.
    35. Pilavachi, P.A. & Dalamaga, Th. & Rossetti di Valdalbero, D. & Guilmot, J.-F., 2008. "Ex-post evaluation of European energy models," Energy Policy, Elsevier, vol. 36(5), pages 1726-1735, May.
    36. Winebrake, James J. & Sakva, Denys, 2006. "An evaluation of errors in US energy forecasts: 1982-2003," Energy Policy, Elsevier, vol. 34(18), pages 3475-3483, December.
    37. Brandt, Adam R. & Yeskoo, Tim & Vafi, Kourosh, 2015. "Net energy analysis of Bakken crude oil production using a well-level engineering-based model," Energy, Elsevier, vol. 93(P2), pages 2191-2198.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jen-Yu Lee & Tien-Thinh Nguyen & Hong-Giang Nguyen & Jen-Yao Lee, 2022. "Towards Predictive Crude Oil Purchase: A Case Study in the USA and Europe," Energies, MDPI, vol. 15(11), pages 1-15, May.
    2. Wang, Gang & Sharma, Paritosh & Jain, Vipin & Shukla, Avanish & Shahzad Shabbir, Malik & Tabash, Mosab I. & Chawla, Chanchal, 2022. "The relationship among oil prices volatility, inflation rate, and sustainable economic growth: Evidence from top oil importer and exporter countries," Resources Policy, Elsevier, vol. 77(C).
    3. R W. Bentley & M. Mushalik & J. Wang, 2020. "The Resource-Limited Plateau in Global Conventional Oil Production: Analysis and Consequences," Biophysical Economics and Resource Quality, Springer, vol. 5(2), pages 1-22, June.
    4. Nyambuu, Unurjargal & Semmler, Willi, 2020. "Climate change and the transition to a low carbon economy – Carbon targets and the carbon budget," Economic Modelling, Elsevier, vol. 84(C), pages 367-376.
    5. Le Boulzec, Hugo & Delannoy, Louis & Andrieu, Baptiste & Verzier, François & Vidal, Olivier & Mathy, Sandrine, 2022. "Dynamic modeling of global fossil fuel infrastructure and materials needs: Overcoming a lack of available data," Applied Energy, Elsevier, vol. 326(C).
    6. Dardonville, Manon & Bockstaller, Christian & Villerd, Jean & Therond, Olivier, 2022. "Resilience of agricultural systems: biodiversity-based systems are stable, while intensified ones are resistant and high-yielding," Agricultural Systems, Elsevier, vol. 197(C).
    7. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2022. "Accuracy indicators for evaluating retrospective performance of energy system models," Applied Energy, Elsevier, vol. 325(C).
    8. Ma, Qiang & Zhang, Mei & Ali, Sher & Kirikkaleli, Dervis & Khan, Zeeshan, 2021. "Natural resources commodity prices volatility and economic performance: Evidence from China pre and post COVID-19," Resources Policy, Elsevier, vol. 74(C).
    9. Wu, Wenhan & Wu, Wenzhuo & Wu, Kouhua & Ding, Chen, 2022. "The nexus between green innovations and natural resources commodity prices in China," Resources Policy, Elsevier, vol. 78(C).
    10. Salim Bagadeem, 2023. "Oil Volatility and Economic Growth: Evidences from Top Oil Trading Countries," International Journal of Energy Economics and Policy, Econjournals, vol. 13(6), pages 381-387, November.
    11. Delannoy, Louis & Longaretti, Pierre-Yves & Murphy, David J. & Prados, Emmanuel, 2021. "Peak oil and the low-carbon energy transition: A net-energy perspective," Applied Energy, Elsevier, vol. 304(C).
    12. Mo, Bin & Chen, Cuiqiong & Nie, He & Jiang, Yonghong, 2019. "Visiting effects of crude oil price on economic growth in BRICS countries: Fresh evidence from wavelet-based quantile-on-quantile tests," Energy, Elsevier, vol. 178(C), pages 234-251.
    13. Alizadeh, Reza & Lund, Peter D. & Soltanisehat, Leili, 2020. "Outlook on biofuels in future studies: A systematic literature review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 134(C).
    14. Wang, Fangzhi & Liao, Hua, 2022. "Unexpected economic growth and oil price shocks," Energy Economics, Elsevier, vol. 116(C).
    15. Arif, Asma & Minh Vu, Hieu & Cong, Ma & Hon Wei, Leow & Islam, Md. Monirul & Niedbała, Gniewko, 2022. "Natural resources commodity prices volatility and economic performance: Evaluating the role of green finance," Resources Policy, Elsevier, vol. 76(C).
    16. Wang, Sen & Qin, Chaoxu & Feng, Qihong & Javadpour, Farzam & Rui, Zhenhua, 2021. "A framework for predicting the production performance of unconventional resources using deep learning," Applied Energy, Elsevier, vol. 295(C).
    17. Sven Teske & Jaysson Guerrero, 2022. "One Earth Climate Model—Integrated Energy Assessment Model to Develop Industry-Specific 1.5 °C Pathways with High Technical Resolution for the Finance Sector," Energies, MDPI, vol. 15(9), pages 1-32, April.
    18. Chang, Lei & Mohsin, Muhammad & Gao, Zhennan & Taghizadeh-Hesary, Farhad, 2023. "Asymmetric impact of oil price on current account balance: Evidence from oil importing countries," Energy Economics, Elsevier, vol. 123(C).
    19. Jean-Pierre Amigues & Michel Moreaux & Nguyen Manh-Hung, 2019. "The Fossil Energy Interlude: Optimal Building, Maintaining and Scraping a Dedicated Capital, and the Hotelling Rule," Working Papers 2019.07, FAERE - French Association of Environmental and Resource Economists.
    20. Sun, Li & Wang, Yang, 2021. "Global economic performance and natural resources commodity prices volatility: Evidence from pre and post COVID-19 era," Resources Policy, Elsevier, vol. 74(C).
    21. van Eyden, Reneé & Difeto, Mamothoana & Gupta, Rangan & Wohar, Mark E., 2019. "Oil price volatility and economic growth: Evidence from advanced economies using more than a century’s data," Applied Energy, Elsevier, vol. 233, pages 612-621.
    22. Kuchler, Magdalena & Höök, Mikael, 2020. "Fractured visions: Anticipating (un)conventional natural gas in Poland," Resources Policy, Elsevier, vol. 68(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2022. "Accuracy indicators for evaluating retrospective performance of energy system models," Applied Energy, Elsevier, vol. 325(C).
    2. Moret, Stefano & Codina Gironès, Víctor & Bierlaire, Michel & Maréchal, François, 2017. "Characterization of input uncertainties in strategic energy planning models," Applied Energy, Elsevier, vol. 202(C), pages 597-617.
    3. Liao, Hua & Cai, Jia-Wei & Yang, Dong-Wei & Wei, Yi-Ming, 2016. "Why did the historical energy forecasting succeed or fail? A case study on IEA's projection," Technological Forecasting and Social Change, Elsevier, vol. 107(C), pages 90-96.
    4. Wang, Fangzhi & Liao, Hua, 2022. "Unexpected economic growth and oil price shocks," Energy Economics, Elsevier, vol. 116(C).
    5. al Irsyad, Muhammad Indra & Halog, Anthony & Nepal, Rabindra, 2019. "Renewable energy projections for climate change mitigation: An analysis of uncertainty and errors," Renewable Energy, Elsevier, vol. 130(C), pages 536-546.
    6. Fodstad, Marte & Crespo del Granado, Pedro & Hellemo, Lars & Knudsen, Brage Rugstad & Pisciella, Paolo & Silvast, Antti & Bordin, Chiara & Schmidt, Sarah & Straus, Julian, 2022. "Next frontiers in energy system modelling: A review on challenges and the state of the art," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    7. Xexakis, Georgios & Hansmann, Ralph & Volken, Sandra P. & Trutnevyte, Evelina, 2020. "Models on the wrong track: Model-based electricity supply scenarios in Switzerland are not aligned with the perspectives of energy experts and the public," Renewable and Sustainable Energy Reviews, Elsevier, vol. 134(C).
    8. Berntsen, Philip B. & Trutnevyte, Evelina, 2017. "Ensuring diversity of national energy scenarios: Bottom-up energy system model with Modeling to Generate Alternatives," Energy, Elsevier, vol. 126(C), pages 886-898.
    9. O'Neill, Brian C. & Desai, Mausami, 2005. "Accuracy of past projections of US energy consumption," Energy Policy, Elsevier, vol. 33(8), pages 979-993, May.
    10. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2023. "Hindcasting to inform the development of bottom-up electricity system models: The cases of endogenous demand and technology learning," Applied Energy, Elsevier, vol. 340(C).
    11. Fischer, Carolyn & Herrnstadt, Evan & Morgenstern, Richard, 2009. "Understanding errors in EIA projections of energy demand," Resource and Energy Economics, Elsevier, vol. 31(3), pages 198-209, August.
    12. Wilkerson, Jordan T. & Cullenward, Danny & Davidian, Danielle & Weyant, John P., 2013. "End use technology choice in the National Energy Modeling System (NEMS): An analysis of the residential and commercial building sectors," Energy Economics, Elsevier, vol. 40(C), pages 773-784.
    13. O' Mahony, Tadhg & Zhou, P. & Sweeney, John, 2013. "Integrated scenarios of energy-related CO2 emissions in Ireland: A multi-sectoral analysis to 2020," Ecological Economics, Elsevier, vol. 93(C), pages 385-397.
    14. Comincioli, Nicola & Hagspiel, Verena & Kort, Peter M. & Menoncin, Francesco & Miniaci, Raffaele & Vergalli, Sergio, 2021. "Mothballing in a Duopoly: Evidence from a (Shale) Oil Market," Energy Economics, Elsevier, vol. 104(C).
    15. Delannoy, Louis & Longaretti, Pierre-Yves & Murphy, David J. & Prados, Emmanuel, 2021. "Peak oil and the low-carbon energy transition: A net-energy perspective," Applied Energy, Elsevier, vol. 304(C).
    16. Yue Liu & Hao Dong & Pierre Failler, 2019. "The Oil Market Reactions to OPEC’s Announcements," Energies, MDPI, vol. 12(17), pages 1-15, August.
    17. Ansari, Dawud, 2017. "OPEC, Saudi Arabia, and the shale revolution: Insights from equilibrium modelling and oil politics," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 111, pages 166-178.
    18. Charlie Wilson & Céline Guivarch & Elmar Kriegler & Bas Ruijven & Detlef P. Vuuren & Volker Krey & Valeria Jana Schwanitz & Erica L. Thompson, 2021. "Evaluating process-based integrated assessment models of climate change mitigation," Climatic Change, Springer, vol. 166(1), pages 1-22, May.
    19. Huntington, Hillard G., 2011. "Backcasting U.S. oil demand over a turbulent decade," Energy Policy, Elsevier, vol. 39(9), pages 5674-5680, September.
    20. Berk, Istemi & Ediger, Volkan Ş., 2016. "Forecasting the coal production: Hubbert curve application on Turkey's lignite fields," Resources Policy, Elsevier, vol. 50(C), pages 193-203.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:220:y:2018:i:c:p:138-153. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.