IDEAS home Printed from https://ideas.repec.org/p/ags/nccc21/316405.html

Evaluating USDA’s Baseline Projections

Author

Listed:
  • Bora, Siddhartha
  • Katchova, Ani L.
  • Kuethe, Todd

Abstract

Agricultural baselines play an important role in shaping agricultural policy, yet there are few studies evaluating these projections. This study evaluates the accuracy and informativeness of two widely used baselines for the US farm sector published by the United States Department of Agriculture (USDA) and the Food and Agricultural Policy Research Institute (FAPRI). First, we examine the average percent errors of the projections and perform tests of bias. Second, we use a novel testing framework based on the encompassing principle to test the predictive content of the projections for each horizon (year), determining the longest informative projection horizon. Third, we compare the USDA and FAPRI baseline projections using a multi-horizon framework that considers all projection horizons together. We find that prediction error and bias increase with the horizon's length. The predictive content of the baselines projections for most variables diminishes after 4-5 years from the current year. The multi-horizon comparison suggests that neither the USDA nor the FAPRI projection has uniform or average superior predictive ability over the other projection. Our findings are useful for the agencies producing these baselines, and policymakers, agricultural businesses, and other stakeholders who use them.

Suggested Citation

  • Bora, Siddhartha & Katchova, Ani L. & Kuethe, Todd, 2021. "Evaluating USDA’s Baseline Projections," 2021 Conference 316405, NCR-134/ NCCC-134 Applied Commodity Price Analysis, Forecasting, and Market Risk Management.
  • Handle: RePEc:ags:nccc21:316405
    DOI: 10.22004/ag.econ.316405
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/316405/files/Bora_Katchova_Kuethe_NCCC-134_2021.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.22004/ag.econ.316405?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    2. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    3. Meyers, William H. & Westhoff, Patrick & Fabiosa, Jacinto F. & Hayes, Dermot J., 2010. "The FAPRI Global Modeling System and Outlook Process," Staff General Research Papers Archive 31534, Iowa State University, Department of Economics.
    4. Siddhartha S. Bora & Ani L. Katchova & Todd H. Kuethe, 2021. "The Rationality of USDA Forecasts under Multivariate Asymmetric Loss," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(3), pages 1006-1033, May.
    5. Hjort, Kim & Boussios, David & Seeley, Ralph & Hansen, James, 2018. "The ERS Country-Commodity Linked System: Documenting Its International Country and Regional Agricultural Baseline Models," Technical Bulletins 282511, United States Department of Agriculture, Economic Research Service.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sucarrat, Genaro, 2009. "Forecast Evaluation of Explanatory Models of Financial Variability," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy, vol. 3, pages 1-33.
    2. Barbara Rossi & Atsushi Inoue, 2012. "Out-of-Sample Forecast Tests Robust to the Choice of Window Size," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 432-453, April.
    3. Hollstein, Fabian & Prokopczuk, Marcel & Wese Simen, Chardin, 2017. "How to Estimate Beta?," Hannover Economic Papers (HEP) dp-617, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    4. Kappler, Marcus, 2007. "Projecting the Medium-Term: Outcomes and Errors for GDP Growth," ZEW Discussion Papers 07-068, ZEW - Leibniz Centre for European Economic Research.
    5. McCracken,M.W. & West,K.D., 2001. "Inference about predictive ability," Working papers 14, Wisconsin Madison - Social Systems.
    6. Rodríguez-Vargas, Adolfo, 2020. "Forecasting Costa Rican inflation with machine learning methods," Latin American Journal of Central Banking (previously Monetaria), Elsevier, vol. 1(1).
    7. repec:lan:wpaper:470 is not listed on IDEAS
    8. Garratt, Anthony & Petrella, Ivan & Zhang, Yunyi, 2023. "Asymmetry and interdependence when evaluating U.S. Energy Information Administration forecasts," Energy Economics, Elsevier, vol. 121(C).
    9. Cepni, Oguzhan & Clements, Michael P., 2024. "How local is the local inflation factor? Evidence from emerging European countries," International Journal of Forecasting, Elsevier, vol. 40(1), pages 160-183.
    10. Chortareas, Georgios & Jiang, Ying & Nankervis, John. C., 2011. "Forecasting exchange rate volatility using high-frequency data: Is the euro different?," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1089-1107, October.
    11. Fabian Hollstein & Marcel Prokopczuk & Chardin Wese Simen, 2020. "The Conditional Capital Asset Pricing Model Revisited: Evidence from High-Frequency Betas," Management Science, INFORMS, vol. 66(6), pages 2474-2494, June.
    12. Halkos, George E. & Tsirivis, Apostolos S., 2019. "Effective energy commodity risk management: Econometric modeling of price volatility," Economic Analysis and Policy, Elsevier, vol. 63(C), pages 234-250.
    13. Clemens J. M. Kool & Daniel L. Thornton, 2015. "How Effective Is Central Bank Forward Guidance?," Review, Federal Reserve Bank of St. Louis, vol. 97(4), pages 303-322.
    14. Gharsallah, Sofian & Sucarrat, Genaro, 2019. "Hvor presise er prognosene i Nasjonalbudsjettet? [How precise are the forecasts of the Norwegian national budget?]," MPRA Paper 96850, University Library of Munich, Germany.
    15. Helder Ferreira de Mendonça & João Pedro Neves Maia, 2022. "Interest rate expectations based on Taylor rule versus central bank’s survey: which performs better in a large emerging economy?," Applied Economics, Taylor & Francis Journals, vol. 54(39), pages 4532-4544, August.
    16. M. Mogliani & Thomas Ferrière, 2016. "Rationality of announcements, business cycle asymmetry, and predictability of revisions. The case of French GDP," Working papers 600, Banque de France.
    17. Adolfo Rodríguez-Vargas, 2019. "Univariate Forecasts for Costa Rican Inflation With Stochastic Volatility and GARCH Effects," Documentos de Trabajo 1604, Banco Central de Costa Rica.
    18. Garratt, Anthony & Petrella, Ivan & Zhang, Yunyi, 2022. "Asymmetry and Interdependence when Evaluating U.S. Energy Information Agency Forecasts," MPRA Paper 114325, University Library of Munich, Germany.
    19. Siddhartha S. Bora & Ani L. Katchova & Todd H. Kuethe, 2023. "The accuracy and informativeness of agricultural baselines," American Journal of Agricultural Economics, John Wiley & Sons, vol. 105(4), pages 1116-1148, August.
    20. Yoichi Tsuchiya, 2022. "Evaluating plant managers’ production plans over business cycles: asymmetric loss and rationality," SN Business & Economics, Springer, vol. 2(8), pages 1-29, August.
    21. Regmi, Hari & Kuethe, Todd H. & Foster, Kenneth A., 2022. "Evaluation of USDA's Agricultural Exports Projections," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322363, Agricultural and Applied Economics Association.

    More about this item

    Keywords

    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:nccc21:316405. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://legacy.farmdoc.illinois.edu/nccc134/index.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.