IDEAS home Printed from https://ideas.repec.org/a/eee/eneeco/v30y2008i3p1192-1207.html
   My bibliography  Save this article

Accuracy and efficiency in the U.S. Department of Energy's short-term supply forecasts

Author

Listed:
  • Sanders, Dwight R.
  • Manfredo, Mark R.
  • Boris, Keith

Abstract

One-step-ahead forecasts of quarterly crude oil, natural gas, electricity, and coal supplies are evaluated under two general approaches: accuracy-based measures and classification- or directional-based measures. Results suggest the U.S. Department of Energy (DOE) supply forecasts for U.S. domestic energy products are generally more accurate than a naïve alternative. There is only limited evidence of bias and inefficiency in the forecasts; although there is some evidence of error repetition. Directional forecasts for supply changes are statistically better than random, but they generally do not outperform a naïve forecast.

Suggested Citation

  • Sanders, Dwight R. & Manfredo, Mark R. & Boris, Keith, 2008. "Accuracy and efficiency in the U.S. Department of Energy's short-term supply forecasts," Energy Economics, Elsevier, vol. 30(3), pages 1192-1207, May.
    • Handle: RePEc:eee:eneeco:v:30:y:2008:i:3:p:1192-1207
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0140-9883(07)00016-3
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-533, October.
    2. Ringwood, J. V. & Austin, P. C. & Monteith, W., 1993. "Forecasting weekly electricity consumption : A case study," Energy Economics, Elsevier, vol. 15(4), pages 285-296, October.
    3. Mills, Terence C. & Pepper, Gordon T., 1999. "Assessing the forecasters: an analysis of the forecasting records of the Treasury, the London Business School and the National Institute," International Journal of Forecasting, Elsevier, vol. 15(3), pages 247-257, July.
    4. David J. Smyth, 1973. "Effect of Public Price Forecasts on Market Price Variation: A Stochastic Cobweb Example," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 55(1), pages 83-88.
    5. Brown, Bryan W & Maital, Shlomo, 1981. "What Do Economists Know? An Empirical Study of Experts' Expectations," Econometrica, Econometric Society, vol. 49(2), pages 491-504, March.
    6. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    7. Cumby, Robert E. & Modest, David M., 1987. "Testing for market timing ability : A framework for forecast evaluation," Journal of Financial Economics, Elsevier, vol. 19(1), pages 169-189, September.
    8. Granger, Clive W J, 1996. "Can We Improve the Perceived Quality of Economic Forecasts?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 455-473, Sept.-Oct.
    9. Bailey, DeeVon & Brorsen, B. Wade, 1998. "Trends In The Accuracy Of Usda Production Forecasts For Beef And Pork," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 23(2), pages 1-11, December.
    10. Assimakopoulos, V. & Psarras, J., 1992. "A double horizon peak demand forecast model," Energy Economics, Elsevier, vol. 14(2), pages 103-106, April.
    11. Freebairn, John W., 1978. "An Evaluation of Outlook Information for Australian Agricultural Commodities," Review of Marketing and Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 46(03), pages 1-21, December.
    12. Pesaran, M. Hashem & Timmermann, Allan G., 1994. "A generalization of the non-parametric Henriksson-Merton test of market timing," Economics Letters, Elsevier, vol. 44(1-2), pages 1-7.
    13. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    14. Stein, Jerome L, 1981. "Speculative Price: Economic Welfare and the Idiot of Chance," The Review of Economics and Statistics, MIT Press, vol. 63(2), pages 223-232, May.
    15. Shlyakhter, Alexander I. & Kammen, Daniel M. & Broido, Claire L. & Wilson, Richard, 1994. "Quantifying the credibility of energy projections from trends in past data : The US energy sector," Energy Policy, Elsevier, vol. 22(2), pages 119-130, February.
    16. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    17. Irwin, Scott H. & Good, Darrel L. & Gomez, Jennifer K., 2001. "The Value Of Usda Outlook Information: An Investigation Using Event Study Analysis," 2001 Conference, April 23-24, 2001, St. Louis, Missouri 18948, NCR-134 Conference on Applied Commodity Price Analysis, Forecasting, and Market Risk Management.
    18. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    19. Jordi Pons, 2001. "The rationality of price forecasts: a directional analysis," Applied Financial Economics, Taylor & Francis Journals, vol. 11(3), pages 287-290.
    20. Chang, Eric C, 1985. "Returns to Speculators and the Theory of Normal Backwardation," Journal of Finance, American Finance Association, vol. 40(1), pages 193-208, March.
    21. Lynch, Michael C., 2002. "Forecasting oil supply: theory and practice," The Quarterly Review of Economics and Finance, Elsevier, vol. 42(2), pages 373-389.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liao, Hua & Cai, Jia-Wei & Yang, Dong-Wei & Wei, Yi-Ming, 2016. "Why did the historical energy forecasting succeed or fail? A case study on IEA's projection," Technological Forecasting and Social Change, Elsevier, vol. 107(C), pages 90-96.
    2. Tian, Zhirui & Wang, Jiyang, 2022. "Variable frequency wind speed trend prediction system based on combined neural network and improved multi-objective optimization algorithm," Energy, Elsevier, vol. 254(PA).
    3. Mamatzakis, E. & Koutsomanoli-Filippaki, A., 2014. "Testing the rationality of DOE's energy price forecasts under asymmetric loss preferences," Energy Policy, Elsevier, vol. 68(C), pages 567-575.
    4. Garratt, Anthony & Petrella, Ivan & Zhang, Yunyi, 2022. "Asymmetry and Interdependence when Evaluating U.S. Energy Information Agency Forecasts," MPRA Paper 114325, University Library of Munich, Germany.
    5. Santamaría-Bonfil, G. & Reyes-Ballesteros, A. & Gershenson, C., 2016. "Wind speed forecasting for wind farms: A method based on support vector regression," Renewable Energy, Elsevier, vol. 85(C), pages 790-809.
    6. Sanders, Dwight R. & Manfredo, Mark R. & Boris, Keith, 2009. "Evaluating information in multiple horizon forecasts: The DOE's energy price forecasts," Energy Economics, Elsevier, vol. 31(2), pages 189-196.
    7. Garratt, Anthony & Petrella, Ivan & Zhang, Yunyi, 2023. "Asymmetry and interdependence when evaluating U.S. Energy Information Administration forecasts," Energy Economics, Elsevier, vol. 121(C).
    8. E. Mamatzakis, 2014. "Revealing asymmetries in the loss function of WTI oil futures market," Empirical Economics, Springer, vol. 47(2), pages 411-426, September.
    9. Mamatzakis, E. & Remoundos, P., 2011. "Testing for adjustment costs and regime shifts in BRENT crude futures market," Economic Modelling, Elsevier, vol. 28(3), pages 1000-1008, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sanders, Dwight R. & Manfredo, Mark R., 2003. "USDA Livestock Price Forecasts: A Comprehensive Evaluation," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 28(2), pages 1-19, August.
    2. Sanders, Dwight R. & Manfredo, Mark R. & Boris, Keith, 2009. "Evaluating information in multiple horizon forecasts: The DOE's energy price forecasts," Energy Economics, Elsevier, vol. 31(2), pages 189-196.
    3. Sanders, Dwight R. & Manfredo, Mark R., 2002. "Usda Production Forecasts For Pork, Beef, And Broilers: An Evaluation," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 27(1), pages 1-14, July.
    4. Mills, Terence C. & Pepper, Gordon T., 1999. "Assessing the forecasters: an analysis of the forecasting records of the Treasury, the London Business School and the National Institute," International Journal of Forecasting, Elsevier, vol. 15(3), pages 247-257, July.
    5. Oliver Blaskowitz & Helmut Herwartz, 2008. "Testing directional forecast value in the presence of serial correlation," SFB 649 Discussion Papers SFB649DP2008-073, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    6. Blaskowitz, Oliver & Herwartz, Helmut, 2014. "Testing the value of directional forecasts in the presence of serial correlation," International Journal of Forecasting, Elsevier, vol. 30(1), pages 30-42.
    7. McCracken,M.W. & West,K.D., 2001. "Inference about predictive ability," Working papers 14, Wisconsin Madison - Social Systems.
    8. repec:lan:wpaper:470 is not listed on IDEAS
    9. Lim, Terence & Lo, Andrew W. & Merton, Robert C. & Scholes, Myron S., 2006. "The Derivatives Sourcebook," Foundations and Trends(R) in Finance, now publishers, vol. 1(5–6), pages 365-572, April.
    10. Rapach, David E. & Wohar, Mark E., 2006. "The out-of-sample forecasting performance of nonlinear models of real exchange rate behavior," International Journal of Forecasting, Elsevier, vol. 22(2), pages 341-361.
    11. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    12. Mizen, Paul & Tsoukas, Serafeim, 2012. "Forecasting US bond default ratings allowing for previous and initial state dependence in an ordered probit model," International Journal of Forecasting, Elsevier, vol. 28(1), pages 273-287.
    13. Aubry, Mathilde & Renou-Maissant, Patricia, 2014. "Semiconductor industry cycles: Explanatory factors and forecasting," Economic Modelling, Elsevier, vol. 39(C), pages 221-231.
    14. Hamid Baghestani, 2011. "A directional analysis of Federal Reserve predictions of growth in unit labor costs and productivity," International Review of Applied Economics, Taylor & Francis Journals, vol. 25(3), pages 303-311.
    15. Oller, Lars-Erik & Barot, Bharat, 2000. "The accuracy of European growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 16(3), pages 293-315.
    16. Kappler, Marcus, 2007. "Projecting the Medium-Term: Outcomes and Errors for GDP Growth," ZEW Discussion Papers 07-068, ZEW - Leibniz Centre for European Economic Research.
    17. Barot, Bharat, 2007. "Empirical Studies in Consumption, House Prices and the Accuracy of European Growth and Inflation Forecasts," Working Papers 98, National Institute of Economic Research.
    18. Mitchell, Karlyn & Pearce, Douglas K., 2007. "Professional forecasts of interest rates and exchange rates: Evidence from the Wall Street Journal's panel of economists," Journal of Macroeconomics, Elsevier, vol. 29(4), pages 840-854, December.
    19. repec:lan:wpaper:425 is not listed on IDEAS
    20. repec:lan:wpaper:539557 is not listed on IDEAS
    21. repec:lan:wpaper:413 is not listed on IDEAS
    22. Kuethe, Todd H. & Regmi, Hari, 2023. "An Evaluation of Congressional Budget Office’s Baseline Projections of USDA Mandatory Farm and Nutrition Programs," 2023 Annual Meeting, July 23-25, Washington D.C. 335690, Agricultural and Applied Economics Association.
    23. Baghestani, Hamid, 2011. "Federal Reserve and private forecasts of growth in investment," Journal of Economics and Business, Elsevier, vol. 63(4), pages 290-305, July.
    24. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eneeco:v:30:y:2008:i:3:p:1192-1207. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eneco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.