IDEAS home Printed from https://ideas.repec.org/a/eee/resene/v31y2009i3p198-209.html
   My bibliography  Save this article

Understanding errors in EIA projections of energy demand

Author

Listed:
  • Fischer, Carolyn
  • Herrnstadt, Evan
  • Morgenstern, Richard

Abstract

This paper investigates the potential for systematic errors in the Energy Information Administration's (EIA) widely used Annual Energy Outlook, focusing on the near- to mid-term projections of energy demand. Based on analysis of the EIA's 22-year projection record, we find a fairly modest but persistent tendency to underestimate total energy demand by an average of 2 percent per year after controlling for projection errors in gross domestic product, oil prices, and heating/cooling degree days. For 14 individual fuels/consuming sectors routinely reported by the EIA, we observe a great deal of directional consistency in the errors over time, ranging up to 7 percent per year. Electric utility renewables, electric utility natural gas, transportation distillate, and residential electricity show significant biases on average. Projections for certain other sectors have significant unexplained errors for selected time horizons. Such independent evaluation can be useful for validating analytic efforts and for prioritizing future model revisions.

Suggested Citation

  • Fischer, Carolyn & Herrnstadt, Evan & Morgenstern, Richard, 2009. "Understanding errors in EIA projections of energy demand," Resource and Energy Economics, Elsevier, vol. 31(3), pages 198-209, August.
    • Handle: RePEc:eee:resene:v:31:y:2009:i:3:p:198-209
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0928-7655(09)00018-9
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    2. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    3. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    4. Shlyakhter, Alexander I. & Kammen, Daniel M. & Broido, Claire L. & Wilson, Richard, 1994. "Quantifying the credibility of energy projections from trends in past data : The US energy sector," Energy Policy, Elsevier, vol. 22(2), pages 119-130, February.
    5. O'Neill, Brian C. & Desai, Mausami, 2005. "Accuracy of past projections of US energy consumption," Energy Policy, Elsevier, vol. 33(8), pages 979-993, May.
    6. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    7. Randall Lutter, 2000. "Developing Countries' Greenhouse Emmissions: Uncertainty and Implications for Participation in the Kyoto Protocol," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 93-120.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liao, Hua & Cai, Jia-Wei & Yang, Dong-Wei & Wei, Yi-Ming, 2016. "Why did the historical energy forecasting succeed or fail? A case study on IEA's projection," Technological Forecasting and Social Change, Elsevier, vol. 107(C), pages 90-96.
    2. Bernard, Jean-Thomas & Khalaf, Lynda & Kichian, Maral & Yelou, Clement, 2018. "Oil Price Forecasts For The Long Term: Expert Outlooks, Models, Or Both?," Macroeconomic Dynamics, Cambridge University Press, vol. 22(3), pages 581-599, April.
    3. Gilbert, Alexander Q. & Sovacool, Benjamin K., 2016. "Looking the wrong way: Bias, renewable electricity, and energy modelling in the United States," Energy, Elsevier, vol. 94(C), pages 533-541.
    4. Wilkerson, Jordan T. & Cullenward, Danny & Davidian, Danielle & Weyant, John P., 2013. "End use technology choice in the National Energy Modeling System (NEMS): An analysis of the residential and commercial building sectors," Energy Economics, Elsevier, vol. 40(C), pages 773-784.
    5. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2022. "Accuracy indicators for evaluating retrospective performance of energy system models," Applied Energy, Elsevier, vol. 325(C).
    6. Millard-Ball, Adam, 2013. "The trouble with voluntary emissions trading: Uncertainty and adverse selection in sectoral crediting programs☆☆Special thanks to Suzi Kerr, Lawrence Goulder, Michael Wara, Arthur van Benthem, Lee Sch," Journal of Environmental Economics and Management, Elsevier, vol. 65(1), pages 40-55.
    7. Wang, Fangzhi & Liao, Hua, 2022. "Unexpected economic growth and oil price shocks," Energy Economics, Elsevier, vol. 116(C).
    8. James G. Baldwin & Ian Sue Wing, 2013. "The Spatiotemporal Evolution Of U.S. Carbon Dioxide Emissions: Stylized Facts And Implications For Climate Policy," Journal of Regional Science, Wiley Blackwell, vol. 53(4), pages 672-689, October.
    9. Wirl, Franz, 2015. "Output adjusting cartels facing dynamic, convex demand under uncertainty: The case of OPEC," Economic Modelling, Elsevier, vol. 44(C), pages 307-316.
    10. Moret, Stefano & Codina Gironès, Víctor & Bierlaire, Michel & Maréchal, François, 2017. "Characterization of input uncertainties in strategic energy planning models," Applied Energy, Elsevier, vol. 202(C), pages 597-617.
    11. Huntington, Hillard G., 2011. "Backcasting U.S. oil demand over a turbulent decade," Energy Policy, Elsevier, vol. 39(9), pages 5674-5680, September.
    12. Wachtmeister, Henrik & Henke, Petter & Höök, Mikael, 2018. "Oil projections in retrospect: Revisions, accuracy and current uncertainty," Applied Energy, Elsevier, vol. 220(C), pages 138-153.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wachtmeister, Henrik & Henke, Petter & Höök, Mikael, 2018. "Oil projections in retrospect: Revisions, accuracy and current uncertainty," Applied Energy, Elsevier, vol. 220(C), pages 138-153.
    2. Stan Hurn & Jing Tian & Lina Xu, 2021. "Assessing the Informational Content of Official Australian Bureau of Meteorology Forecasts of Wind Speed," The Economic Record, The Economic Society of Australia, vol. 97(319), pages 525-547, December.
    3. Orphanides, Athanasios & Williams, John C., 2008. "Learning, expectations formation, and the pitfalls of optimal control monetary policy," Journal of Monetary Economics, Elsevier, vol. 55(Supplemen), pages 80-96, October.
    4. Frederick H. Wallace & Gary L. Shelley & Luis F. Cabrera Castellanos, 2004. "Pruebas de la neutralidad monetaria a largo plazo: el caso de Nicaragua," Monetaria, CEMLA, vol. 0(4), pages 407-418, octubre-d.
    5. Brave, Scott A. & Gascon, Charles & Kluender, William & Walstrum, Thomas, 2021. "Predicting benchmarked US state employment data in real time," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1261-1275.
    6. Croushore, Dean & Evans, Charles L., 2006. "Data revisions and the identification of monetary policy shocks," Journal of Monetary Economics, Elsevier, vol. 53(6), pages 1135-1160, September.
    7. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Realtime nowcasting with a Bayesian mixed frequency model with stochastic volatility," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(4), pages 837-862, October.
    8. Harrison, Richard & Kapetanios, George & Yates, Tony, 2005. "Forecasting with measurement errors in dynamic models," International Journal of Forecasting, Elsevier, vol. 21(3), pages 595-607.
    9. Clements, Michael P. & Beatriz Galvao, Ana, 2010. "Real-time Forecasting of Inflation and Output Growth in the Presence of Data Revisions," Economic Research Papers 270771, University of Warwick - Department of Economics.
    10. Aastveit, Knut Are & Trovik, Tørres, 2014. "Estimating the output gap in real time: A factor model approach," The Quarterly Review of Economics and Finance, Elsevier, vol. 54(2), pages 180-193.
    11. Michael P. Clements, 2014. "US Inflation Expectations and Heterogeneous Loss Functions, 1968–2010," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 1-14, January.
    12. Pär Stockhammar & Pär Österholm, 2018. "Do inflation expectations granger cause inflation?," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 35(2), pages 403-431, August.
    13. Corradi, Valentina & Swanson, Norman R., 2004. "Some recent developments in predictive accuracy testing with nested models and (generic) nonlinear alternatives," International Journal of Forecasting, Elsevier, vol. 20(2), pages 185-199.
    14. David de Antonio Liedo, 2014. "Nowcasting Belgium," Working Paper Research 256, National Bank of Belgium.
    15. Athanasios Orphanides & John C. Williams, 2007. "Inflation targeting under imperfect knowledge," Economic Review, Federal Reserve Bank of San Francisco, pages 1-23.
    16. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    17. Bec, Frédérique & Kanda, Patrick, 2020. "Is inflation driven by survey-based, VAR-based or myopic expectations? An empirical assessment from US real-time data," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).
    18. Clements, Michael P. & Beatriz Galvão, Ana, 2010. "First announcements and real economic activity," European Economic Review, Elsevier, vol. 54(6), pages 803-817, August.
    19. Knut Are Aastveit & Karsten R. Gerdrup & Anne Sofie Jore & Leif Anders Thorsrud, 2014. "Nowcasting GDP in Real Time: A Density Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(1), pages 48-68, January.
    20. Michael P. Clements & Ana Beatriz Galvão, 2007. "Macroeconomic Forecasting with Mixed Frequency Data: Forecasting US Output Growth," Working Papers 616, Queen Mary University of London, School of Economics and Finance.

    More about this item

    Keywords

    EIA Energy forecasting Bias;

    JEL classification:

    • Q43 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy and the Macroeconomy
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:resene:v:31:y:2009:i:3:p:198-209. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505569 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.