IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v107y2016icp90-96.html
   My bibliography  Save this article

Why did the historical energy forecasting succeed or fail? A case study on IEA's projection

Author

Listed:
  • Liao, Hua
  • Cai, Jia-Wei
  • Yang, Dong-Wei
  • Wei, Yi-Ming

Abstract

Medium-to-long term energy prediction plays a widely-acknowledged role in guiding national energy strategy and policy but could also lead to serious economic and social chaos when poorly executed. A consequent issue may be the effectiveness of these predictions, and sources that errors can be traced back to. The International Energy Agency (IEA) has published its annual World Energy Outlook (WEO) concerning energy demand based on its long term world energy model (WEM) under specific assumptions towards uncertainties such as population, macroeconomy, energy price and technology. Unfortunately, some of its predictions succeeded while others failed. We in this paper attempt to decompose the leading source of these errors quantitatively. Results suggest that GDP acts as the leading source of demand forecasting errors while fuel price comes thereafter, which requires extra attention in forecasting. Gas, among all fuel types witness the most biased projections. Ignoring the catch-up effect of acquiring rapid economic growth in developing countries such as China will lead to huge mistake in predicting global energy demand. Finally, asymmetric cost of under- and over-estimation of GDP suggests a potentially less conservative stance in the future.

Suggested Citation

  • Liao, Hua & Cai, Jia-Wei & Yang, Dong-Wei & Wei, Yi-Ming, 2016. "Why did the historical energy forecasting succeed or fail? A case study on IEA's projection," Technological Forecasting and Social Change, Elsevier, vol. 107(C), pages 90-96.
    • Handle: RePEc:eee:tefoso:v:107:y:2016:i:c:p:90-96
    DOI: 10.1016/j.techfore.2016.03.026
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162516300154
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techfore.2016.03.026?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bastianin, Andrea & Galeotti, Marzio & Manera, Matteo, 2014. "Forecasting the oil–gasoline price relationship: Do asymmetries help?," Energy Economics, Elsevier, vol. 46(S1), pages 44-56.
    2. Simoes, Sofia & Fortes, Patrícia & Seixas, Júlia & Huppes, Gjalt, 2015. "Assessing effects of exogenous assumptions in GHG emissions forecasts – a 2020 scenario study for Portugal using the Times energy technology model," Technological Forecasting and Social Change, Elsevier, vol. 94(C), pages 221-235.
    3. Suganthi, L. & Samuel, Anand A., 2012. "Energy models for demand forecasting—A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(2), pages 1223-1240.
    4. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    5. Fischer, Carolyn & Herrnstadt, Evan & Morgenstern, Richard, 2009. "Understanding errors in EIA projections of energy demand," Resource and Energy Economics, Elsevier, vol. 31(3), pages 198-209, August.
    6. Linderoth, Hans, 2002. "Forecast errors in IEA-countries' energy consumption," Energy Policy, Elsevier, vol. 30(1), pages 53-61, January.
    7. Baumeister, Christiane & Kilian, Lutz & Lee, Thomas K., 2014. "Are there gains from pooling real-time oil price forecasts?," Energy Economics, Elsevier, vol. 46(S1), pages 33-43.
    8. Laitner, J. A. & DeCanio, S. J. & Koomey, J. G. & Sanstad, A. H., 2003. "Room for improvement: increasing the value of energy modeling for policy analysis," Utilities Policy, Elsevier, vol. 11(2), pages 87-94, June.
    9. Fye, Shannon R. & Charbonneau, Steven M. & Hay, Jason W. & Mullins, Carie A., 2013. "An examination of factors affecting accuracy in technology forecasts," Technological Forecasting and Social Change, Elsevier, vol. 80(6), pages 1222-1231.
    10. Sanders, Dwight R. & Manfredo, Mark R. & Boris, Keith, 2008. "Accuracy and efficiency in the U.S. Department of Energy's short-term supply forecasts," Energy Economics, Elsevier, vol. 30(3), pages 1192-1207, May.
    11. Jonathan Koomey & Paul Craig & Ashok Gadgil & David Lorenzetti, 2003. "Improving Long-Range Energy Modeling: A Plea for Historical Retrospectives," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 75-92.
    12. Granger, C. W. J. & Newbold, P., 1974. "Spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 2(2), pages 111-120, July.
    13. Huntington, Hillard G., 2011. "Backcasting U.S. oil demand over a turbulent decade," Energy Policy, Elsevier, vol. 39(9), pages 5674-5680, September.
    14. O'Neill, Brian C. & Desai, Mausami, 2005. "Accuracy of past projections of US energy consumption," Energy Policy, Elsevier, vol. 33(8), pages 979-993, May.
    15. Utgikar, V.P. & Scott, J.P., 2006. "Energy forecasting: Predictions, reality and analysis of causes of error," Energy Policy, Elsevier, vol. 34(17), pages 3087-3092, November.
    16. Baghestani, Hamid, 2015. "Predicting gasoline prices using Michigan survey data," Energy Economics, Elsevier, vol. 50(C), pages 27-32.
    17. Chang, Yusang & Lee, Jinsoo & Yoon, Hyerim, 2012. "Alternative projection of the world energy consumption-in comparison with the 2010 international energy outlook," Energy Policy, Elsevier, vol. 50(C), pages 154-160.
    18. Winebrake, James J. & Sakva, Denys, 2006. "An evaluation of errors in US energy forecasts: 1982-2003," Energy Policy, Elsevier, vol. 34(18), pages 3475-3483, December.
    19. Lady, George M., 2010. "Evaluating long term forecasts," Energy Economics, Elsevier, vol. 32(2), pages 450-457, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2022. "Accuracy indicators for evaluating retrospective performance of energy system models," Applied Energy, Elsevier, vol. 325(C).
    2. Jun Hao & Xiaolei Sun & Qianqian Feng, 2020. "A Novel Ensemble Approach for the Forecasting of Energy Demand Based on the Artificial Bee Colony Algorithm," Energies, MDPI, vol. 13(3), pages 1-25, January.
    3. Wang, Fangzhi & Liao, Hua, 2022. "Unexpected economic growth and oil price shocks," Energy Economics, Elsevier, vol. 116(C).
    4. Yuan, Xiao-Chen & Sun, Xun & Zhao, Weigang & Mi, Zhifu & Wang, Bing & Wei, Yi-Ming, 2017. "Forecasting China’s regional energy demand by 2030: A Bayesian approach," Resources, Conservation & Recycling, Elsevier, vol. 127(C), pages 85-95.
    5. Moret, Stefano & Codina Gironès, Víctor & Bierlaire, Michel & Maréchal, François, 2017. "Characterization of input uncertainties in strategic energy planning models," Applied Energy, Elsevier, vol. 202(C), pages 597-617.
    6. Wachtmeister, Henrik & Henke, Petter & Höök, Mikael, 2018. "Oil projections in retrospect: Revisions, accuracy and current uncertainty," Applied Energy, Elsevier, vol. 220(C), pages 138-153.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wachtmeister, Henrik & Henke, Petter & Höök, Mikael, 2018. "Oil projections in retrospect: Revisions, accuracy and current uncertainty," Applied Energy, Elsevier, vol. 220(C), pages 138-153.
    2. Garratt, Anthony & Petrella, Ivan & Zhang, Yunyi, 2023. "Asymmetry and interdependence when evaluating U.S. Energy Information Administration forecasts," Energy Economics, Elsevier, vol. 121(C).
    3. Moret, Stefano & Codina Gironès, Víctor & Bierlaire, Michel & Maréchal, François, 2017. "Characterization of input uncertainties in strategic energy planning models," Applied Energy, Elsevier, vol. 202(C), pages 597-617.
    4. Garratt, Anthony & Petrella, Ivan & Zhang, Yunyi, 2022. "Asymmetry and Interdependence when Evaluating U.S. Energy Information Agency Forecasts," National Institute of Economic and Social Research (NIESR) Discussion Papers 541, National Institute of Economic and Social Research.
    5. Wilkerson, Jordan T. & Cullenward, Danny & Davidian, Danielle & Weyant, John P., 2013. "End use technology choice in the National Energy Modeling System (NEMS): An analysis of the residential and commercial building sectors," Energy Economics, Elsevier, vol. 40(C), pages 773-784.
    6. Aydin, Gokhan, 2014. "Modeling of energy consumption based on economic and demographic factors: The case of Turkey with projections," Renewable and Sustainable Energy Reviews, Elsevier, vol. 35(C), pages 382-389.
    7. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2022. "Accuracy indicators for evaluating retrospective performance of energy system models," Applied Energy, Elsevier, vol. 325(C).
    8. Bernard, Jean-Thomas & Khalaf, Lynda & Kichian, Maral & Yelou, Clement, 2018. "Oil Price Forecasts For The Long Term: Expert Outlooks, Models, Or Both?," Macroeconomic Dynamics, Cambridge University Press, vol. 22(3), pages 581-599, April.
    9. Wang, Fangzhi & Liao, Hua, 2022. "Unexpected economic growth and oil price shocks," Energy Economics, Elsevier, vol. 116(C).
    10. Kialashaki, Arash & Reisel, John R., 2014. "Development and validation of artificial neural network models of the energy demand in the industrial sector of the United States," Energy, Elsevier, vol. 76(C), pages 749-760.
    11. Huntington, Hillard G., 2011. "Backcasting U.S. oil demand over a turbulent decade," Energy Policy, Elsevier, vol. 39(9), pages 5674-5680, September.
    12. Gilbert, Alexander Q. & Sovacool, Benjamin K., 2016. "Looking the wrong way: Bias, renewable electricity, and energy modelling in the United States," Energy, Elsevier, vol. 94(C), pages 533-541.
    13. al Irsyad, Muhammad Indra & Halog, Anthony & Nepal, Rabindra, 2019. "Renewable energy projections for climate change mitigation: An analysis of uncertainty and errors," Renewable Energy, Elsevier, vol. 130(C), pages 536-546.
    14. Millard-Ball, Adam, 2013. "The trouble with voluntary emissions trading: Uncertainty and adverse selection in sectoral crediting programs☆☆Special thanks to Suzi Kerr, Lawrence Goulder, Michael Wara, Arthur van Benthem, Lee Sch," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 40-55.
    15. Christiane Baumeister & Lutz Kilian & Thomas K. Lee, 2017. "Inside the Crystal Ball: New Approaches to Predicting the Gasoline Price at the Pump," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 275-295, March.
    16. Gholami, M. & Barbaresi, A. & Torreggiani, D. & Tassinari, P., 2020. "Upscaling of spatial energy planning, phases, methods, and techniques: A systematic review through meta-analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 132(C).
    17. Winebrake, James J. & Sakva, Denys, 2006. "An evaluation of errors in US energy forecasts: 1982-2003," Energy Policy, Elsevier, vol. 34(18), pages 3475-3483, December.
    18. Gonzalo Cortazar & Cristobal Millard & Hector Ortega & Eduardo S. Schwartz, 2019. "Commodity Price Forecasts, Futures Prices, and Pricing Models," Management Science, INFORMS, vol. 65(9), pages 4141-4155, September.
    19. Wang, Sen & Gao, Yi, 2021. "A literature review and citation analyses of air travel demand studies published between 2010 and 2020," Journal of Air Transport Management, Elsevier, vol. 97(C).
    20. Fischer, Carolyn & Herrnstadt, Evan & Morgenstern, Richard, 2009. "Understanding errors in EIA projections of energy demand," Resource and Energy Economics, Elsevier, vol. 31(3), pages 198-209, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:107:y:2016:i:c:p:90-96. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.