IDEAS home Printed from https://ideas.repec.org/a/eee/resene/v31y2009i3p198-209.html

Understanding errors in EIA projections of energy demand

Author

Listed:
  • Fischer, Carolyn
  • Herrnstadt, Evan
  • Morgenstern, Richard

Abstract

This paper investigates the potential for systematic errors in the Energy Information Administration's (EIA) widely used Annual Energy Outlook, focusing on the near- to mid-term projections of energy demand. Based on analysis of the EIA's 22-year projection record, we find a fairly modest but persistent tendency to underestimate total energy demand by an average of 2 percent per year after controlling for projection errors in gross domestic product, oil prices, and heating/cooling degree days. For 14 individual fuels/consuming sectors routinely reported by the EIA, we observe a great deal of directional consistency in the errors over time, ranging up to 7 percent per year. Electric utility renewables, electric utility natural gas, transportation distillate, and residential electricity show significant biases on average. Projections for certain other sectors have significant unexplained errors for selected time horizons. Such independent evaluation can be useful for validating analytic efforts and for prioritizing future model revisions.

Suggested Citation

  • Fischer, Carolyn & Herrnstadt, Evan & Morgenstern, Richard, 2009. "Understanding errors in EIA projections of energy demand," Resource and Energy Economics, Elsevier, vol. 31(3), pages 198-209, August.
    • Handle: RePEc:eee:resene:v:31:y:2009:i:3:p:198-209
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0928-7655(09)00018-9
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or

    for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    2. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    3. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    4. Shlyakhter, Alexander I. & Kammen, Daniel M. & Broido, Claire L. & Wilson, Richard, 1994. "Quantifying the credibility of energy projections from trends in past data : The US energy sector," Energy Policy, Elsevier, vol. 22(2), pages 119-130, February.
    5. O'Neill, Brian C. & Desai, Mausami, 2005. "Accuracy of past projections of US energy consumption," Energy Policy, Elsevier, vol. 33(8), pages 979-993, May.
    6. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    7. Randall Lutter, 2000. "Developing Countries' Greenhouse Emmissions: Uncertainty and Implications for Participation in the Kyoto Protocol," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 93-120.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liao, Hua & Cai, Jia-Wei & Yang, Dong-Wei & Wei, Yi-Ming, 2016. "Why did the historical energy forecasting succeed or fail? A case study on IEA's projection," Technological Forecasting and Social Change, Elsevier, vol. 107(C), pages 90-96.
    2. Gilbert, Alexander Q. & Sovacool, Benjamin K., 2016. "Looking the wrong way: Bias, renewable electricity, and energy modelling in the United States," Energy, Elsevier, vol. 94(C), pages 533-541.
    3. Bernard, Jean-Thomas & Khalaf, Lynda & Kichian, Maral & Yelou, Clement, 2018. "Oil Price Forecasts For The Long Term: Expert Outlooks, Models, Or Both?," Macroeconomic Dynamics, Cambridge University Press, vol. 22(3), pages 581-599, April.
    4. Wilkerson, Jordan T. & Cullenward, Danny & Davidian, Danielle & Weyant, John P., 2013. "End use technology choice in the National Energy Modeling System (NEMS): An analysis of the residential and commercial building sectors," Energy Economics, Elsevier, vol. 40(C), pages 773-784.
    5. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2022. "Accuracy indicators for evaluating retrospective performance of energy system models," Applied Energy, Elsevier, vol. 325(C).
    6. Mohammad Sharifi & Shamsi Soodmand-Moghaddam & Hesam Moloudi, 2024. "Investigation of environmental, energy and economic indicators of the turkey breeding farms: a case study in West Azarbaijan and Zanjan, Iran," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(9), pages 24221-24245, September.
    7. Millard-Ball, Adam, 2013. "The trouble with voluntary emissions trading: Uncertainty and adverse selection in sectoral crediting programs☆☆Special thanks to Suzi Kerr, Lawrence Goulder, Michael Wara, Arthur van Benthem, Lee Sch," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 40-55.
    8. Wang, Fangzhi & Liao, Hua, 2022. "Unexpected economic growth and oil price shocks," Energy Economics, Elsevier, vol. 116(C).
    9. James G. Baldwin & Ian Sue Wing, 2013. "The Spatiotemporal Evolution Of U.S. Carbon Dioxide Emissions: Stylized Facts And Implications For Climate Policy," Journal of Regional Science, Wiley Blackwell, vol. 53(4), pages 672-689, October.
    10. Wirl, Franz, 2015. "Output adjusting cartels facing dynamic, convex demand under uncertainty: The case of OPEC," Economic Modelling, Elsevier, vol. 44(C), pages 307-316.
    11. Moret, Stefano & Codina Gironès, Víctor & Bierlaire, Michel & Maréchal, François, 2017. "Characterization of input uncertainties in strategic energy planning models," Applied Energy, Elsevier, vol. 202(C), pages 597-617.
    12. Huntington, Hillard G., 2011. "Backcasting U.S. oil demand over a turbulent decade," Energy Policy, Elsevier, vol. 39(9), pages 5674-5680, September.
    13. Wachtmeister, Henrik & Henke, Petter & Höök, Mikael, 2018. "Oil projections in retrospect: Revisions, accuracy and current uncertainty," Applied Energy, Elsevier, vol. 220(C), pages 138-153.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wachtmeister, Henrik & Henke, Petter & Höök, Mikael, 2018. "Oil projections in retrospect: Revisions, accuracy and current uncertainty," Applied Energy, Elsevier, vol. 220(C), pages 138-153.
    2. David de Antonio Liedo, 2014. "Nowcasting Belgium," Working Paper Research 256, National Bank of Belgium.
    3. Bec, Frédérique & Kanda, Patrick, 2020. "Is inflation driven by survey-based, VAR-based or myopic expectations? An empirical assessment from US real-time data," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).
    4. Clements Michael P., 2012. "Forecasting U.S. Output Growth with Non-Linear Models in the Presence of Data Uncertainty," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 16(1), pages 1-27, January.
    5. Heather L. R. Tierney, 2019. "Forecasting with the Nonparametric Exclusion-from-Core Inflation Persistence Model Using Real-Time Data," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 25(1), pages 39-63, February.
    6. Frenkel, Michael & Rülke, Jan-Christoph & Zimmermann, Lilli, 2013. "Do private sector forecasters chase after IMF or OECD forecasts?," Journal of Macroeconomics, Elsevier, vol. 37(C), pages 217-229.
    7. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    8. Martin D. D. Evans(Georgetown University and NBER) and Richard K. Lyons(U.C. Berkeley and NBER, Haas School of Business), 2005. "Exchange Rate Fundamentals and Order Flow (July 2004)," Working Papers gueconwpa~05-05-03, Georgetown University, Department of Economics.
    9. Croushore, D., 2002. "Comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 483-489, December.
    10. Clark, Todd E. & Kozicki, Sharon, 2005. "Estimating equilibrium real interest rates in real time," The North American Journal of Economics and Finance, Elsevier, vol. 16(3), pages 395-413, December.
    11. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Common Drifting Volatility in Large Bayesian VARs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 375-390, July.
    12. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    13. Michael P. Clements, 2014. "Anticipating Early Data Revisions to US GDP and the Effects of Releases on Equity Markets," ICMA Centre Discussion Papers in Finance icma-dp2014-06, Henley Business School, University of Reading.
    14. Leo Krippner & Leif Anders Thorsrud, 2009. "Forecasting New Zealand's economic growth using yield curve information," Reserve Bank of New Zealand Discussion Paper Series DP2009/18, Reserve Bank of New Zealand.
    15. Davide Delle Monache & Andrea De Polis & Ivan Petrella, 2024. "Modeling and Forecasting Macroeconomic Downside Risk," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(3), pages 1010-1025, July.
    16. Tomaz Cajner & Leland D. Crane & Ryan A. Decker & Adrian Hamins-Puertolas & Christopher J. Kurz & Tyler Radler, 2018. "Using Payroll Processor Microdata to Measure Aggregate Labor Market Activity," Finance and Economics Discussion Series 2018-005, Board of Governors of the Federal Reserve System (U.S.).
    17. Massimiliano Marcellino, 2008. "A linear benchmark for forecasting GDP growth and inflation?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(4), pages 305-340.
    18. Jon Ellingsen & Vegard H. Larsen & Leif Anders Thorsrud, 2020. "News Media vs. FRED-MD for Macroeconomic Forecasting," CESifo Working Paper Series 8639, CESifo.
    19. Givens, Gregory E. & Salemi, Michael K., 2015. "Inferring monetary policy objectives with a partially observed state," Journal of Economic Dynamics and Control, Elsevier, vol. 52(C), pages 190-208.
    20. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.

    More about this item

    Keywords

    ;

    JEL classification:

    • Q43 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy and the Macroeconomy
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:resene:v:31:y:2009:i:3:p:198-209. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505569 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.