IDEAS home Printed from https://ideas.repec.org/p/zbw/zewdip/340840.html

Survey design and professional forecasters: The case of uncertainty in the US SPF

Author

Listed:
  • Knüppel, Malte
  • Pavlova, Lora

Abstract

Histogram forecasts of inflation and growth from the US Survey of Professional Forecasters (SPF) allow for an assessment of the evolution of forecast uncertainty. However, this assessment is complicated by structural breaks in measured uncertainty arising from changes in histogram bin widths over time. The existing literature typically does not take these breaks into account. We propose a break adjustment based on the insights provided by a structural break in 2014, during which bin widths-and consequently, measured inflation uncertainty-shifted significantly, despite true inflation uncertainty remaining virtually constant. Drawing on our results, we propose horizon-specific bin widths for inflation and growth to align measured uncertainty more closely with underlying uncertainty.

Suggested Citation

  • Knüppel, Malte & Pavlova, Lora, 2026. "Survey design and professional forecasters: The case of uncertainty in the US SPF," ZEW Discussion Papers 26-017, ZEW - Leibniz Centre for European Economic Research.
    • Handle: RePEc:zbw:zewdip:340840
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/340840/1/1969826037.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    2. Michael P. Clements, 2014. "Forecast Uncertainty- Ex Ante and Ex Post : U.S. Inflation and Output Growth," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(2), pages 206-216, April.
    3. Bai, Jushan, 1997. "Estimating Multiple Breaks One at a Time," Econometric Theory, Cambridge University Press, vol. 13(3), pages 315-352, June.
    4. Gabriel Perez-Quiros & Margaret M. McConnell, 2000. "Output Fluctuations in the United States: What Has Changed since the Early 1980's?," American Economic Review, American Economic Association, vol. 90(5), pages 1464-1476, December.
    5. Barbara Rossi & Tatevik Sekhposyan, 2015. "Macroeconomic Uncertainty Indices Based on Nowcast and Forecast Error Distributions," American Economic Review, American Economic Association, vol. 105(5), pages 650-655, May.
    6. Goldfayn-Frank, Olga & Kieren, Pascal & Trautmann, Stefan, 2026. "A choice-based approach to the measurement of inflation expectations," Journal of Monetary Economics, Elsevier, vol. 157(C).
    7. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    8. Tobias Broer & Alexandre L. Kholhas, 2024. "Forecaster (Mis-) behavior," PSE-Ecole d'économie de Paris (Postprint) halshs-03956330, HAL.
    9. Tobias Broer & Alexandre L. Kholhas, 2024. "Forecaster (Mis-) behavior," Post-Print halshs-03956330, HAL.
    10. Nicholas Bloom, 2009. "The Impact of Uncertainty Shocks," Econometrica, Econometric Society, vol. 77(3), pages 623-685, May.
    11. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    12. Tobias Broer & Alexandre N. Kohlhas, 2024. "Forecaster (Mis-)Behavior," The Review of Economics and Statistics, MIT Press, vol. 106(5), pages 1334-1351, September.
    13. Becker, Christoph & Duersch, Peter & Eife, Thomas, 2023. "Measuring Inflation Expectations: How the Response Scale Shapes Density Forecasts," Working Papers 0723, University of Heidelberg, Department of Economics.
    14. Dean Croushore & Tom Stark, 2019. "Fifty Years of the Survey of Professional Forecasters," Economic Insights, Federal Reserve Bank of Philadelphia, vol. 4(4), pages 1-11, October.
    15. Alexander Glas & Matthias Hartmann, 2022. "Uncertainty measures from partially rounded probabilistic forecast surveys," Quantitative Economics, Econometric Society, vol. 13(3), pages 979-1022, July.
    16. Bruine de Bruin, Wändi & van der Klaauw, Wilbert & van Rooij, Maarten & Teppa, Federica & de Vos, Klaas, 2017. "Measuring expectations of inflation: Effects of survey mode, wording, and opportunities to revise," Journal of Economic Psychology, Elsevier, vol. 59(C), pages 45-58.
    17. Liu, Yang & Sheng, Xuguang Simon, 2019. "The measurement and transmission of macroeconomic uncertainty: Evidence from the U.S. and BRIC countries," International Journal of Forecasting, Elsevier, vol. 35(3), pages 967-979.
    18. Kyle Jurado & Sydney C. Ludvigson & Serena Ng, 2015. "Measuring Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1177-1216, March.
    19. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    20. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    21. Sydney C. Ludvigson & Sai Ma & Serena Ng, 2021. "Uncertainty and Business Cycles: Exogenous Impulse or Endogenous Response?," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(4), pages 369-410, October.
    22. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    23. Robert Rich & Joseph Tracy, 2010. "The Relationships among Expected Inflation, Disagreement, and Uncertainty: Evidence from Matched Point and Density Forecasts," The Review of Economics and Statistics, MIT Press, vol. 92(1), pages 200-207, February.
    24. Binder, Carola C., 2017. "Measuring uncertainty based on rounding: New method and application to inflation expectations," Journal of Monetary Economics, Elsevier, vol. 90(C), pages 1-12.
    25. Kenneth C. Lichtendahl & Yael Grushka-Cockayne & Robert L. Winkler, 2013. "Is It Better to Average Probabilities or Quantiles?," Management Science, INFORMS, vol. 59(7), pages 1594-1611, July.
    26. Margaret M. McConnell & Gabriel Perez-Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue mar.
    27. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    28. Krüger, Fabian & Pavlova, Lora, 2024. "Quantifying subjective uncertainty in survey expectations," International Journal of Forecasting, Elsevier, vol. 40(2), pages 796-810.
    29. Gergely Ganics & Barbara Rossi & Tatevik Sekhposyan, 2024. "From Fixed‐Event to Fixed‐Horizon Density Forecasts: Obtaining Measures of Multihorizon Uncertainty from Survey Density Forecasts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 56(7), pages 1675-1704, October.
    30. Joshua Abel & Robert Rich & Joseph Song & Joseph Tracy, 2016. "The Measurement and Behavior of Uncertainty: Evidence from the ECB Survey of Professional Forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 533-550, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Yang & Sheng, Xuguang Simon, 2019. "The measurement and transmission of macroeconomic uncertainty: Evidence from the U.S. and BRIC countries," International Journal of Forecasting, Elsevier, vol. 35(3), pages 967-979.
    2. Zohar, Osnat, 2024. "Cyclicality of uncertainty and disagreement," Journal of Monetary Economics, Elsevier, vol. 143(C).
    3. Glas, Alexander, 2020. "Five dimensions of the uncertainty–disagreement linkage," International Journal of Forecasting, Elsevier, vol. 36(2), pages 607-627.
    4. Ambrocio, Gene, 2017. "The real effects of overconfidence and fundamental uncertainty shocks," Research Discussion Papers 37/2017, Bank of Finland.
    5. Ambrocio, Gene, 2020. "Inflationary household uncertainty shocks," Bank of Finland Research Discussion Papers 5/2020, Bank of Finland.
    6. Sheen, Jeffrey & Wang, Ben Zhe, 2021. "Measuring macroeconomic disagreement – A mixed frequency approach," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 547-566.
    7. Clements, Michael P., 2025. "Inconsistent survey histograms and point forecasts revisited," Journal of Economic Behavior & Organization, Elsevier, vol. 236(C).
    8. Manzan, Sebastiano, 2021. "Are professional forecasters Bayesian?," Journal of Economic Dynamics and Control, Elsevier, vol. 123(C).
    9. Knüppel, Malte, 2018. "Forecast-error-based estimation of forecast uncertainty when the horizon is increased," International Journal of Forecasting, Elsevier, vol. 34(1), pages 105-116.
    10. Hartmann, Matthias & Herwartz, Helmut & Ulm, Maren, 2017. "A comparative assessment of alternative ex ante measures of inflation uncertainty," International Journal of Forecasting, Elsevier, vol. 33(1), pages 76-89.
    11. Ambrocio, Gene, 2020. "Inflationary household uncertainty shocks," Research Discussion Papers 5/2020, Bank of Finland.
    12. Clements, Michael P. & Rich, Robert W. & Tracy, Joseph, 2025. "An Investigation into the Uncertainty Revision Process of Professional Forecasters," Journal of Economic Dynamics and Control, Elsevier, vol. 173(C).
    13. Knüppel, Malte & Schultefrankenfeld, Guido, 2019. "Assessing the uncertainty in central banks’ inflation outlooks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1748-1769.
    14. Beckmann, Joscha & Davidson, Sharada Nia & Koop, Gary & Schüssler, Rainer, 2023. "Cross-country uncertainty spillovers: Evidence from international survey data," Journal of International Money and Finance, Elsevier, vol. 130(C).
    15. Svetlana Makarova, 2018. "European Central Bank Footprints On Inflation Forecast Uncertainty," Economic Inquiry, Western Economic Association International, vol. 56(1), pages 637-652, January.
    16. Oscar Claveria & Enric Monte & Salvador Torra, 2019. "Economic Uncertainty: A Geometric Indicator of Discrepancy Among Experts’ Expectations," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 143(1), pages 95-114, May.
    17. Dovern, Jonas, 2024. "Eliciting expectation uncertainty from private households," International Journal of Forecasting, Elsevier, vol. 40(1), pages 113-123.
    18. Huang, Rong & Pilbeam, Keith & Pouliot, William, 2022. "Are macroeconomic forecasters optimists or pessimists? A reassessment of survey based forecasts," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 706-724.
    19. Oscar Claveria & Enric Monte & Salvador Torra, 2018. "“A geometric approach to proxy economic uncertainty by a metric of disagreement among qualitative expectations”," IREA Working Papers 201806, University of Barcelona, Research Institute of Applied Economics, revised Mar 2018.
    20. Amélie Charles & Olivier Darné & Laurent Ferrara, 2018. "Does The Great Recession Imply The End Of The Great Moderation? International Evidence," Economic Inquiry, Western Economic Association International, vol. 56(2), pages 745-760, April.

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:zewdip:340840. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zemande.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.