IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/87545.html
   My bibliography  Save this paper

The Evolution of Inefficiency in USDA’s Forecasts of U.S. and World Soybean Markets

Author

Listed:
  • MacDonald, Stephen
  • Ash, Mark
  • Cooke, Bryce

Abstract

We derive a set of stylized facts about USDA’s soybean supply and demand forecasts and draw implications from these results for efforts to improve the accuracy of these forecasts. USDA’s short run soybean supply and demand forecasts are inefficient, with several key variables significantly biased throughout much of the annual forecast cycle. Bias and other characteristics have varied significantly over recent decades, and evaluation efforts intended to guide forecast improvement need to focus on very recent sample years and seasonally disaggregated data. USDA should expand the information set used in its forecasting of U.S. soybean yields, take note of its mid-season downward bias in its Brazilian production forecasts, and shift the weight of its early-season focus for China’s soybean consumption estimates towards forecasts of growth rates and reduce the weight it applies to forecasting consumption and trade by China in terms of levels. During 2004-2015, downward-biased U.S. production forecasts and upward-biased foreign excess supply forecasts resulted in downward-biased U.S. export forecasts throughout much of USDA’s annual forecasting cycle. Twenty years earlier, this downward bias was confined to the end of the forecasting cycle, whereas U.S. soybean ending stock forecasts have been upward biased for decades across much of the forecasting cycle. The forecasts for U.S. soybean exports are also characterized by smoothing, with strong correlation between month-to-month forecast revisions towards the later months of USDA’s annual forecasting cycle.

Suggested Citation

  • MacDonald, Stephen & Ash, Mark & Cooke, Bryce, 2017. "The Evolution of Inefficiency in USDA’s Forecasts of U.S. and World Soybean Markets," MPRA Paper 87545, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:87545
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/87545/1/MPRA_paper_87545.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Williams,Jeffrey C. & Wright,Brian D., 2005. "Storage and Commodity Markets," Cambridge Books, Cambridge University Press, number 9780521023399.
    2. Isengildina-Massa, Olga & Irwin, Scott H. & Good, Darrel L. & Gomez, Jennifer K., 2008. "The Impact of Situation and Outlook Information in Corn and Soybean Futures Markets: Evidence from WASDE Reports," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 40(1), pages 89-103, April.
    3. Botto, Augusto C. & Isengildina, Olga & Irwin, Scott H. & Good, Darrel L., 2006. "Accuracy Trends and Sources of Forecast Errors in WASDE Balance Sheet Categories for Corn and Soybeans," 2006 Annual meeting, July 23-26, Long Beach, CA 21332, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    4. Cheung, Yin-Wong & Chinn, Menzie D. & Pascual, Antonio Garcia, 2005. "Empirical exchange rate models of the nineties: Are any fit to survive?," Journal of International Money and Finance, Elsevier, vol. 24(7), pages 1150-1175, November.
    5. Isengildina, Olga & Irwin, Scott H. & Good, Darrel L., 2013. "Do Big Crops Get Bigger and Small Crops Get Smaller? Further Evidence on Smoothing in U.S. Department of Agriculture Forecasts," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 45(1), pages 1-13, February.
    6. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    7. Bailey, DeeVon & Brorsen, B. Wade, 1998. "Trends In The Accuracy Of Usda Production Forecasts For Beef And Pork," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 23(2), pages 1-11, December.
    8. Granger, C. W. J. & Newbold, Paul, 1986. "Forecasting Economic Time Series," Elsevier Monographs, Elsevier, edition 2, number 9780122951831 edited by Shell, Karl.
    9. Granger, C. W. J., 1980. "Testing for causality : A personal viewpoint," Journal of Economic Dynamics and Control, Elsevier, vol. 2(1), pages 329-352, May.
    10. Olga Isengildina-Massa & Berna Karali & Scott H. Irwin, 2013. "When do the USDA forecasters make mistakes?," Applied Economics, Taylor & Francis Journals, vol. 45(36), pages 5086-5103, December.
    11. Irwin, Scott H. & Sanders, Dwight R. & Good, Darrel L., 2014. "Evaluation of Selected USDA WAOB and NASS Forecasts and Estimates in Corn and Soybeans," Marketing and Outlook Research Reports 183477, University of Illinois at Urbana-Champaign, Department of Agricultural and Consumer Economics.
    12. Phil L. Colling & Scott H. Irwin, 1990. "The Reaction of Live Hog Futures Prices to USDA Hogs and Pigs Reports," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 72(1), pages 84-94.
    13. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    14. Irwin, Scott & Sanders, Dwight & Good, Darrel, 2014. "Evaluation of Selected USDA WAOB and NASS Forecasts and Estimates in Corn and Soybeans," farmdoc daily, University of Illinois at Urbana-Champaign, Department of Agricultural and Consumer Economics, vol. 4, January.
    15. Dwight R. Sanders & Mark R. Manfredo, 2008. "Multiple horizons and information in USDA production forecasts," Agribusiness, John Wiley & Sons, Ltd., vol. 24(1), pages 55-66.
    16. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    17. Olga Isengildina & Scott H. Irwin & Darrel L. Good, 2006. "Are Revisions to USDA Crop Production Forecasts Smoothed?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 88(4), pages 1091-1104.
    18. Good, Darrel L. & Irwin, Scott H., 2006. "Understanding USDA Corn and Soybean Production Forecasts: Methods, Performance and Market Impacts over 1970 - 2005," AgMAS Project Research Reports 37514, University of Illinois at Urbana-Champaign, Department of Agricultural and Consumer Economics.
    19. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1, March.
    20. Xiao, Jinzhi & Lence, Sergio H. & Hart, Chad, 2014. "Usda And Private Analysts' Forecasts Of Ending Stocks: How Good Are They?," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 170642, Agricultural and Applied Economics Association.
    21. MacDonald, Stephen, 1992. "The Accuracy of USDA's Export Forecasts," Staff Reports 278679, United States Department of Agriculture, Economic Research Service.
    22. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    23. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February.
    24. Egelkraut, Thorsten M. & Garcia, Philip & Irwin, Scott H. & Good, Darrel L., 2003. "An Evaluation of Crop Forecast Accuracy for Corn and Soybeans: USDA and Private Information Agencies," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 35(1), pages 79-95, April.
    25. Sanders, Dwight R. & Manfredo, Mark R., 2002. "Usda Production Forecasts For Pork, Beef, And Broilers: An Evaluation," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 27(1), pages 1-14, July.
    26. Orazem, Peter & Baur, Robert F., 1994. "The Rationality and Price Effects of Usda Forecasts of Oranges," Staff General Research Papers Archive 11133, Iowa State University, Department of Economics.
    27. Clough, Malcolm, 1951. "Changes in Corn Acreage and Production After the Early Indications," Journal of Agricultural Economics Research, United States Department of Agriculture, Economic Research Service, vol. 3(4), pages 1-7, October.
    28. Sanders, Dwight R. & Manfredo, Mark R., 2003. "USDA Livestock Price Forecasts: A Comprehensive Evaluation," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 28(2), pages 1-19, August.
    29. Good, Darrel L. & Irwin, Scott H., 2005. "Understanding USDA Corn and Soybean Production Forecasts: Methods, Performance and Market Impacts over 1970 - 2004," AgMAS Project Research Reports 14785, University of Illinois at Urbana-Champaign, Department of Agricultural and Consumer Economics.
    30. MacDonald, Stephen, 2005. "A Comparison of USDA's Agricultural Export Forecasts with ARIMA-based Forecasts," MPRA Paper 70912, University Library of Munich, Germany.
    31. Clough, Malcolm, 1951. "Changes in Corn Acreage and Production After the Early Indications," Journal of Agricultural Economics Research, United States Department of Agriculture, Economic Research Service, vol. 3(4), pages 1-7, October.
    32. Lewis, Karen E. & Manfredo, Mark R., 2012. "An Evaluation of the USDA Sugar Production and Consumption Forecasts," Journal of Agribusiness, Agricultural Economics Association of Georgia, vol. 30(2).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bahram Sanginabadi, 2018. "USDA Forecasts: A meta-analysis study," Papers 1801.06575, arXiv.org.
    2. Olga Isengildina‐Massa & Berna Karali & Todd H. Kuethe & Ani L. Katchova, 2021. "Joint Evaluation of the System of USDA's Farm Income Forecasts," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(3), pages 1140-1160, September.
    3. Tianyang Zhang & Ziran Li, 2022. "Can a rational expectation storage model explain the USDA ending grain stocks forecast errors?," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 42(3), pages 313-337, March.
    4. Olga Isengildina-Massa & Berna Karali & Scott H Irwin, 2017. "Do Markets Correct for Smoothing in USDA Crop Production Forecasts? Evidence from Private Analysts and Futures Prices," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 39(4), pages 559-583.
    5. Siddhartha S. Bora & Ani L. Katchova & Todd H. Kuethe, 2021. "The Rationality of USDA Forecasts under Multivariate Asymmetric Loss," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(3), pages 1006-1033, May.
    6. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    7. Berna Karali & Scott H. Irwin & Olga Isengildina‐Massa, 2020. "Supply Fundamentals and Grain Futures Price Movements," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(2), pages 548-568, March.
    8. Ying, Jiahui & Shonkwiler, J. Scott, 2017. "A Temporal Impact Assessment Method for the Informational Content of USDA Reports in Corn and Soybean Futures Markets," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258201, Agricultural and Applied Economics Association.
    9. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    10. Xiao, Jinzhi & Lence, Sergio H. & Hart, Chad, 2014. "Usda And Private Analysts' Forecasts Of Ending Stocks: How Good Are They?," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 170642, Agricultural and Applied Economics Association.
    11. Karali, Berna & Isengildina-Massa, Olga & Irwin, Scott H. & Adjemian, Michael K. & Johansson, Robert, 2019. "Are USDA reports still news to changing crop markets?," Food Policy, Elsevier, vol. 84(C), pages 66-76.
    12. Taylor, Christopher W., 2012. "Market Reactions to USDA Reports: State Analysis of Corn Price Response," 2012 Annual Meeting, August 12-14, 2012, Seattle, Washington 124661, Agricultural and Applied Economics Association.
    13. Dwight R. Sanders & Mark R. Manfredo, 2008. "Multiple horizons and information in USDA production forecasts," Agribusiness, John Wiley & Sons, Ltd., vol. 24(1), pages 55-66.
    14. Christophe Gouel, 2020. "The Value of Public Information in Storable Commodity Markets: Application to the Soybean Market," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(3), pages 846-865, May.
    15. Sanders, Dwight R. & Manfredo, Mark R., 2003. "USDA Livestock Price Forecasts: A Comprehensive Evaluation," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 28(2), pages 1-19, August.
    16. Kuethe, Todd H. & Hubbs, Todd & Sanders, Dwight R., 2018. "Evaluating the USDA’s Net Farm Income Forecast," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 43(3), September.
    17. Xiao, Jinzhi, 2015. "Essays on the forecasts of ending stocks," ISU General Staff Papers 201501010800005902, Iowa State University, Department of Economics.
    18. MacDonald, Stephen & Ash, Mark, 2016. "Detecting the Sources of Information Rigidity: Analyzing Forecast Bias and Smoothing in USDA’s Soybean Forecasts," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235349, Agricultural and Applied Economics Association.
    19. Irwin, Scott H. & Sanders, Dwight R. & Good, Darrel L., 2014. "Evaluation of Selected USDA WAOB and NASS Forecasts and Estimates in Corn and Soybeans," Marketing and Outlook Research Reports 183477, University of Illinois at Urbana-Champaign, Department of Agricultural and Consumer Economics.
    20. Barbara Rossi, 2013. "Exchange Rate Predictability," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1063-1119, December.

    More about this item

    Keywords

    Forecast evaluation; overlapping forecasts; bias; smoothing; agriculture; soybeans; China; United States; Brazil; Argentina; USDA; WASDE;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q02 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - General - - - Commodity Market
    • Q11 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Aggregate Supply and Demand Analysis; Prices
    • Q17 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Agriculture in International Trade

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:87545. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.