IDEAS home Printed from https://ideas.repec.org/a/wly/ajagec/v103y2021i3p1006-1033.html
   My bibliography  Save this article

The Rationality of USDA Forecasts under Multivariate Asymmetric Loss

Author

Listed:
  • Siddhartha S. Bora
  • Ani L. Katchova
  • Todd H. Kuethe

Abstract

A large number of previous studies suggest that many USDA forecasts are biased and/or inefficient. These findings, however, may be the result of the assumed loss function of USDA forecasters. We test the rationality of the USDA net cash income forecasts and the WASDE production and price forecasts between 1988 and 2018 using a flexible multivariate loss function that allows for asymmetric loss and non‐separable forecast errors. Our results provide robust evidence that USDA forecasters are rational expected loss minimizers yet demonstrate a tendency to place a greater weight on under‐ or overprediction. As a result, this study provides an alternate interpretation of previous findings of forecast irrationality.

Suggested Citation

  • Siddhartha S. Bora & Ani L. Katchova & Todd H. Kuethe, 2021. "The Rationality of USDA Forecasts under Multivariate Asymmetric Loss," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(3), pages 1006-1033, May.
    • Handle: RePEc:wly:ajagec:v:103:y:2021:i:3:p:1006-1033
    DOI: 10.1111/ajae.12142
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/ajae.12142
    Download Restriction: no
    File URL: https://libkey.io/10.1111/ajae.12142?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Merola, Rossana & Pérez, Javier J., 2013. "Fiscal forecast errors: Governments versus independent agencies?," European Journal of Political Economy, Elsevier, vol. 32(C), pages 285-299.
    2. Christodoulakis, George, 2020. "Estimating the term structure of commodity market preferences," European Journal of Operational Research, Elsevier, vol. 282(3), pages 1146-1163.
    3. Christian Pierdzioch & Jan-Christoph Rülke & Georg Stadtmann, 2013. "Forecasting US housing starts under asymmetric loss," Applied Financial Economics, Taylor & Francis Journals, vol. 23(6), pages 505-513, March.
    4. Raffaella Giacomini & Barbara Rossi, 2009. "Detecting and Predicting Forecast Breakdowns," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 669-705.
    5. Ivana Komunjer & Michael T. Owyang, 2012. "Multivariate Forecast Evaluation and Rationality Testing," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1066-1080, November.
    6. Vogel, Fred A. & Bange, Gerald A., 1999. "Understanding USDA Crop Forecasts," USDA Miscellaneous 320799, United States Department of Agriculture.
    7. Michael P. Keane & David E. Runkle, 1998. "Are Financial Analysts' Forecasts of Corporate Profits Rational?," Journal of Political Economy, University of Chicago Press, vol. 106(4), pages 768-805, August.
    8. Isengildina-Massa, Olga & Cao, Xiang & Karali, Berna & Irwin, Scott H. & Adjemian, Michael & Johansson, Robert C., 2021. "When does USDA information have the most impact on crop and livestock markets?," Journal of Commodity Markets, Elsevier, vol. 22(C).
    9. Jeffrey Frankel, 2011. "Over-optimism in forecasts by official budget agencies and its implications," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 27(4), pages 536-562.
    10. Tsuchiya, Yoichi, 2016. "Asymmetric loss and rationality of Chinese renminbi forecasts: An implication for the trade between China and the US," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 44(C), pages 116-127.
    11. Isengildina-Massa, Olga & Irwin, Scott H. & Good, Darrel L. & Gomez, Jennifer K., 2008. "The Impact of Situation and Outlook Information in Corn and Soybean Futures Markets: Evidence from WASDE Reports," Journal of Agricultural and Applied Economics, Cambridge University Press, vol. 40(1), pages 89-103, April.
    12. Pierdzioch, Christian & Reid, Monique B. & Gupta, Rangan, 2016. "Forecasting the South African inflation rate: On asymmetric loss and forecast rationality," Economic Systems, Elsevier, vol. 40(1), pages 82-92.
    13. Batchelor, Roy, 2007. "Bias in macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(2), pages 189-203.
    14. Young Bin Ahn & Yoichi Tsuchiya, 2019. "Asymmetric Loss and the Rationality of Inflation Forecasts: Evidence from South Korea," Pacific Economic Review, Wiley Blackwell, vol. 24(4), pages 588-605, October.
    15. Olga Isengildina & Scott H. Irwin & Darrel L. Good, 2006. "Are Revisions to USDA Crop Production Forecasts Smoothed?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 88(4), pages 1091-1104.
    16. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    17. Lars Jonung & Martin Larch, 2006. "Improving fiscal policy in the EU: the case for independent forecasts [‘Fiscal forecasting: The track record of the IMF, OECD and EC’]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 21(47), pages 492-534.
    18. Fritsche, Ulrich & Pierdzioch, Christian & Rülke, Jan-Christoph & Stadtmann, Georg, 2015. "Forecasting the Brazilian real and the Mexican peso: Asymmetric loss, forecast rationality, and forecaster herding," International Journal of Forecasting, Elsevier, vol. 31(1), pages 130-139.
    19. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    20. Capistrán, Carlos, 2008. "Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?," Journal of Monetary Economics, Elsevier, vol. 55(8), pages 1415-1427, November.
    21. Clive W.J. Granger, 1999. "Outline of forecast theory using generalized cost functions," Spanish Economic Review, Springer;Spanish Economic Association, vol. 1(2), pages 161-173.
    22. Aretz, Kevin & Bartram, Söhnke M. & Pope, Peter F., 2011. "Asymmetric loss functions and the rationality of expected stock returns," International Journal of Forecasting, Elsevier, vol. 27(2), pages 413-437.
    23. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    24. Tsuchiya, Yoichi, 2016. "Assessing macroeconomic forecasts for Japan under an asymmetric loss function," International Journal of Forecasting, Elsevier, vol. 32(2), pages 233-242.
    25. Higgins, Matthew L. & Mishra, Sagarika, 2014. "State dependent asymmetric loss and the consensus forecast of real U.S. GDP growth," Economic Modelling, Elsevier, vol. 38(C), pages 627-632.
    26. Francis, Jennifer & Douglas Hanna, J. & Philbrick, Donna R., 1997. "Management communications with securities analysts," Journal of Accounting and Economics, Elsevier, vol. 24(3), pages 363-394, December.
    27. Christoffersen, Peter F. & Diebold, Francis X., 1997. "Optimal Prediction Under Asymmetric Loss," Econometric Theory, Cambridge University Press, vol. 13(6), pages 808-817, December.
    28. T. Randall Fortenbery & Daniel A. Sumner, 1993. "The effects of USDA reports in futures and options markets," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 13(2), pages 157-173, April.
    29. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-735, September.
    30. Roy Batchelor, 2007. "Forecaster Behaviour and Bias in Macroeconomic Forecasts," ifo Working Paper Series 39, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    31. David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias in Macroeconomic Forecasts," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 293-318.
    32. Paul Beaudry & Tim Willems, 2022. "On the Macroeconomic Consequences of Over-Optimism," American Economic Journal: Macroeconomics, American Economic Association, vol. 14(1), pages 38-59, January.
    33. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    34. Auffhammer, Maximilian, 2007. "The rationality of EIA forecasts under symmetric and asymmetric loss," Resource and Energy Economics, Elsevier, vol. 29(2), pages 102-121, May.
    35. Batchelor, Roy & Peel, David A., 1998. "Rationality testing under asymmetric loss," Economics Letters, Elsevier, vol. 61(1), pages 49-54, October.
    36. Daniel A. Summer & Rolf A. E. Mueller, 1989. "Are Harvest Forecasts News? USDA Announcements and Futures Market Reactions," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 71(1), pages 1-8.
    37. Jinzhi Xiao & Chad E. Hart & Sergio H. Lence, 2017. "USDA Forecasts Of Crop Ending Stocks: How Well Have They Performed?," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 39(2), pages 220-241.
    38. Terence Lim, 2001. "Rationality and Analysts' Forecast Bias," Journal of Finance, American Finance Association, vol. 56(1), pages 369-385, February.
    39. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    40. Mamatzakis, E. & Koutsomanoli-Filippaki, A., 2014. "Testing the rationality of DOE's energy price forecasts under asymmetric loss preferences," Energy Policy, Elsevier, vol. 68(C), pages 567-575.
    41. Christoffersen, Peter F & Diebold, Francis X, 1996. "Further Results on Forecasting and Model Selection under Asymmetric Loss," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 561-571, Sept.-Oct.
    42. Batchelor, Roy A. & Dua, Pami, 1990. "Product differentiation in the economic forecasting industry," International Journal of Forecasting, Elsevier, vol. 6(3), pages 311-316, October.
    43. Bailey, DeeVon & Brorsen, B. Wade, 1998. "Trends In The Accuracy Of Usda Production Forecasts For Beef And Pork," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 23(2), pages 1-11, December.
    44. Estrin, Saul & Holmes, Peter, 1990. "Indicative planning in developed economies," Journal of Comparative Economics, Elsevier, vol. 14(4), pages 531-554, December.
    45. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    46. Hamid Baghestani, 2013. "Evaluating Federal Reserve predictions of growth in consumer spending," Applied Economics, Taylor & Francis Journals, vol. 45(13), pages 1637-1646, May.
    47. Julieta Caunedo & Riccardo Dicecio & Ivana Komunjer & Michael T. Owyang, 2020. "Asymmetry, Complementarities, and State Dependence in Federal Reserve Forecasts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 52(1), pages 205-228, February.
    48. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    49. Zellner, Arnold, 1986. "Biased predictors, rationality and the evaluation of forecasts," Economics Letters, Elsevier, vol. 21(1), pages 45-48.
    50. Dorfmann, Jeffrey & Karali, Berna, 2015. "A Nonparametric Search for Information Effects from USDA Reports," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 40(1), pages 1-20.
    51. Krol, Robert, 2013. "Evaluating state revenue forecasting under a flexible loss function," International Journal of Forecasting, Elsevier, vol. 29(2), pages 282-289.
    52. Giovannelli, Alessandro & Pericoli, Filippo Maria, 2020. "Are GDP forecasts optimal? Evidence on European countries," International Journal of Forecasting, Elsevier, vol. 36(3), pages 963-973.
    53. George A. Christodoulakis & Emmanuel C. Mamatzakis, 2008. "An assessment of the EU growth forecasts under asymmetric preferences," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(6), pages 483-492.
    54. Sanders, Dwight R. & Manfredo, Mark R., 2003. "USDA Livestock Price Forecasts: A Comprehensive Evaluation," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 28(2), pages 1-19, August.
    55. Mamatzakis, Emmanuel & Tsionas, Mike G., 2015. "How are market preferences shaped? The case of sovereign debt of stressed euro-area countries," Journal of Banking & Finance, Elsevier, vol. 61(C), pages 106-116.
    56. John R. Graham, 1999. "Herding among Investment Newsletters: Theory and Evidence," Journal of Finance, American Finance Association, vol. 54(1), pages 237-268, February.
    57. Ulu, Yasemin, 2013. "Multivariate test for forecast rationality under asymmetric loss functions: Recent evidence from MMS survey of inflation–output forecasts," Economics Letters, Elsevier, vol. 119(2), pages 168-171.
    58. Karali, Berna & Isengildina-Massa, Olga & Irwin, Scott H. & Adjemian, Michael K. & Johansson, Robert, 2019. "Are USDA reports still news to changing crop markets?," Food Policy, Elsevier, vol. 84(C), pages 66-76.
    59. Michael K Adjemian & Scott H Irwin, 2018. "USDA Announcement Effects in Real-Time," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(4), pages 1151-1171.
    60. Jens J. Krüger & Julian LeCrone, 2019. "Forecast Evaluation Under Asymmetric Loss: A Monte Carlo Analysis of the EKT Method," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 81(2), pages 437-455, April.
    61. repec:oup:ecpoli:v:21:y:2006:i:47:p:491-534 is not listed on IDEAS
    62. Michael K. Adjemian, 2012. "Quantifying the WASDE Announcement Effect," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 94(1), pages 238-256.
    63. Lewis, Karen E. & Manfredo, Mark R., 2012. "An Evaluation of the USDA Sugar Production and Consumption Forecasts," Journal of Agribusiness, Agricultural Economics Association of Georgia, vol. 30(2).
    64. Lucier, Gary & Chesley, Agnes & Ahearn, Mary Clare, 1986. "Farm Income Data: A Historical Perspective," Statistical Bulletin 154593, United States Department of Agriculture, Economic Research Service.
    65. Krüger, Jens & LeCrone, Julian, 2019. "Forecast Evaluation Under Asymmetric Loss: A Monte Carlo Analysis of the EKT Method," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 118710, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Garratt, Anthony & Petrella, Ivan & Zhang, Yunyi, 2022. "Asymmetry and Interdependence when Evaluating U.S. Energy Information Agency Forecasts," MPRA Paper 114325, University Library of Munich, Germany.
    2. Yoichi Tsuchiya, 2022. "Evaluating plant managers’ production plans over business cycles: asymmetric loss and rationality," SN Business & Economics, Springer, vol. 2(8), pages 1-29, August.
    3. Garratt, Anthony & Petrella, Ivan & Zhang, Yunyi, 2023. "Asymmetry and interdependence when evaluating U.S. Energy Information Administration forecasts," Energy Economics, Elsevier, vol. 121(C).
    4. Kwame Asiam Addey & William Nganje, 2023. "The role of the U.S. exchange‐rate equity market volatility on agricultural exports and forecasts," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 71(1), pages 25-47, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giovannelli, Alessandro & Pericoli, Filippo Maria, 2020. "Are GDP forecasts optimal? Evidence on European countries," International Journal of Forecasting, Elsevier, vol. 36(3), pages 963-973.
    2. Yoichi Tsuchiya, 2022. "Evaluating plant managers’ production plans over business cycles: asymmetric loss and rationality," SN Business & Economics, Springer, vol. 2(8), pages 1-29, August.
    3. Behrens, Christoph & Pierdzioch, Christian & Risse, Marian, 2018. "Testing the optimality of inflation forecasts under flexible loss with random forests," Economic Modelling, Elsevier, vol. 72(C), pages 270-277.
    4. Christoph Behrens, 2019. "A Nonparametric Evaluation of the Optimality of German Export and Import Growth Forecasts under Flexible Loss," Economies, MDPI, vol. 7(3), pages 1-23, September.
    5. Capistrán, Carlos, 2008. "Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?," Journal of Monetary Economics, Elsevier, vol. 55(8), pages 1415-1427, November.
    6. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    7. Demetrescu, Matei & Hacıoğlu Hoke, Sinem, 2019. "Predictive regressions under asymmetric loss: Factor augmentation and model selection," International Journal of Forecasting, Elsevier, vol. 35(1), pages 80-99.
    8. Tsuchiya, Yoichi, 2016. "Assessing macroeconomic forecasts for Japan under an asymmetric loss function," International Journal of Forecasting, Elsevier, vol. 32(2), pages 233-242.
    9. Anatolyev, Stanislav, 2009. "Dynamic modeling under linear-exponential loss," Economic Modelling, Elsevier, vol. 26(1), pages 82-89, January.
    10. Carlos Capistr¡N & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2-3), pages 365-396, March.
    11. Roy Batchelor, 2007. "Forecaster Behaviour and Bias in Macroeconomic Forecasts," ifo Working Paper Series 39, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    12. Patrick Schmidt & Matthias Katzfuss & Tilmann Gneiting, 2021. "Interpretation of point forecasts with unknown directive," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 728-743, September.
    13. Tianyang Zhang & Ziran Li, 2022. "Can a rational expectation storage model explain the USDA ending grain stocks forecast errors?," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 42(3), pages 313-337, March.
    14. Carlos Capistrán & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2‐3), pages 365-396, March.
    15. Batchelor, Roy, 2007. "Bias in macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(2), pages 189-203.
    16. Higgins, Matthew L. & Mishra, Sagarika, 2014. "State dependent asymmetric loss and the consensus forecast of real U.S. GDP growth," Economic Modelling, Elsevier, vol. 38(C), pages 627-632.
    17. Frenkel, Michael & Rülke, Jan-Christoph & Zimmermann, Lilli, 2013. "Do private sector forecasters chase after IMF or OECD forecasts?," Journal of Macroeconomics, Elsevier, vol. 37(C), pages 217-229.
    18. Ying, Jiahui & Shonkwiler, J. Scott, 2017. "A Temporal Impact Assessment Method for the Informational Content of USDA Reports in Corn and Soybean Futures Markets," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258201, Agricultural and Applied Economics Association.
    19. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    20. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:ajagec:v:103:y:2021:i:3:p:1006-1033. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1467-8276 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.