IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v42y2026i1p235-258.html

All forecasters are not the same: Systematic patterns in predictive performance

Author

Listed:
  • Rich, Robert W.
  • Tracy, Joseph

Abstract

Are all forecasters the same? Expectations models incorporating information rigidities typically imply that forecasters are interchangeable, which predicts an absence of systematic patterns in individual forecast behavior. Motivated by this prediction, we examine the European Central Bank’s Survey of Professional Forecasters and find, in contrast, that participants display systematic patterns in predictive performance both within and across target variables. Moreover, we document a new result from professional forecast surveys, which is that inter- and intra-forecaster relative predictive performance are strongly linked to the degree of difficulty in the forecasting environment. This insight can inform the ongoing development of expectations models.

Suggested Citation

  • Rich, Robert W. & Tracy, Joseph, 2026. "All forecasters are not the same: Systematic patterns in predictive performance," International Journal of Forecasting, Elsevier, vol. 42(1), pages 235-258.
  • Handle: RePEc:eee:intfor:v:42:y:2026:i:1:p:235-258
    DOI: 10.1016/j.ijforecast.2025.02.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207025000159
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2025.02.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Bartosz Mackowiak & Mirko Wiederholt, 2009. "Optimal Sticky Prices under Rational Inattention," American Economic Review, American Economic Association, vol. 99(3), pages 769-803, June.
    2. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    3. N. Gregory Mankiw & Ricardo Reis, 2002. "Sticky Information versus Sticky Prices: A Proposal to Replace the New Keynesian Phillips Curve," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1295-1328.
    4. Robert Rich & Joseph Tracy, 2021. "A Closer Look at the Behavior of Uncertainty and Disagreement: Micro Evidence from the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 53(1), pages 233-253, February.
    5. Carlos Bowles & Roberta Friz & Veronique Genre & Geoff Kenny & Aidan Meyler & Tuomas Rautanen, 2007. "The ECB survey of professional forecasters (SPF) – A review after eight years’ experience," Occasional Paper Series 59, European Central Bank.
    6. M. Hashem Pesaran, 2006. "Estimation and Inference in Large Heterogeneous Panels with a Multifactor Error Structure," Econometrica, Econometric Society, vol. 74(4), pages 967-1012, July.
    7. N. Gregory Mankiw & Ricardo Reis & Justin Wolfers, 2004. "Disagreement about Inflation Expectations," NBER Chapters, in: NBER Macroeconomics Annual 2003, Volume 18, pages 209-270, National Bureau of Economic Research, Inc.
    8. Alexander Glas & Matthias Hartmann, 2022. "Uncertainty measures from partially rounded probabilistic forecast surveys," Quantitative Economics, Econometric Society, vol. 13(3), pages 979-1022, July.
    9. Geoff Kenny & Thomas Kostka & Federico Masera, 2015. "Density characteristics and density forecast performance: a panel analysis," Empirical Economics, Springer, vol. 48(3), pages 1203-1231, May.
    10. Wändi Bruine De Bruin & Charles F. Manski & Giorgio Topa & Wilbert van der Klaauw, 2011. "Measuring consumer uncertainty about future inflation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(3), pages 454-478, April.
    11. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    12. Antonello D’Agostino & Kieran Mcquinn & Karl Whelan, 2012. "Are Some Forecasters Really Better Than Others?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(4), pages 715-732, June.
    13. Geoff Kenny & Thomas Kostka & Federico Masera, 2014. "How Informative are the Subjective Density Forecasts of Macroeconomists?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(3), pages 163-185, April.
    14. Geoff Kenny & Thomas Kostka & Federico Masera, 2015. "Can Macroeconomists Forecast Risk? Event-Based Evidence from the Euro-Area SPF," International Journal of Central Banking, International Journal of Central Banking, vol. 11(4), pages 1-46, December.
    15. Qu, Ritong & Timmermann, Allan & Zhu, Yinchu, 2023. "Comparing forecasting performance in cross-sections," Journal of Econometrics, Elsevier, vol. 237(2).
    16. Timmermann, Allan & Qu, Ritong & Zhu, Yinchu, 2019. "Do Any Economists Have Superior Forecasting Skills?," CEPR Discussion Papers 14112, C.E.P.R. Discussion Papers.
    17. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    18. Michael P. Clements, 2022. "Forecaster Efficiency, Accuracy, and Disagreement: Evidence Using Individual‐Level Survey Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(2-3), pages 537-568, March.
    19. Olivier Coibion & Yuriy Gorodnichenko, 2012. "What Can Survey Forecasts Tell Us about Information Rigidities?," Journal of Political Economy, University of Chicago Press, vol. 120(1), pages 116-159.
    20. Kenny, Geoff & Genre, Véronique & Bowles, Carlos & Friz, Roberta & Meyler, Aidan & Rautanen, Tuomas, 2007. "The ECB survey of professional forecasters (SPF) - A review after eight years' experience," Occasional Paper Series 59, European Central Bank.
    21. Meyler, Aidan, 2020. "Forecast performance in the ECB SPF: ability or chance?," Working Paper Series 2371, European Central Bank.
    22. Gianna Boero & Jeremy Smith & Kenneth F. Wallis, 2015. "The Measurement and Characteristics of Professional Forecasters' Uncertainty," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(7), pages 1029-1046, November.
    23. Whitney Newey & Kenneth West, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    24. Ulrich Hounyo & Kajal Lahiri, 2023. "Are Some Forecasters Really Better than Others? A Note," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 55(2-3), pages 577-593, March.
    25. Joshua Abel & Robert Rich & Joseph Song & Joseph Tracy, 2016. "The Measurement and Behavior of Uncertainty: Evidence from the ECB Survey of Professional Forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 533-550, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Manzan, Sebastiano, 2021. "Are professional forecasters Bayesian?," Journal of Economic Dynamics and Control, Elsevier, vol. 123(C).
    2. Glas, Alexander & Heinisch, Katja, 2023. "Conditional macroeconomic survey forecasts: Revisions and errors," Journal of International Money and Finance, Elsevier, vol. 138(C).
    3. Conrad, Christian & Lahiri, Kajal, 2023. "Heterogeneous expectations among professional forecasters," ZEW Discussion Papers 23-062, ZEW - Leibniz Centre for European Economic Research.
    4. Robert Rich & Joseph Tracy, 2021. "A Closer Look at the Behavior of Uncertainty and Disagreement: Micro Evidence from the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 53(1), pages 233-253, February.
    5. Andrade, Philippe & Le Bihan, Hervé, 2013. "Inattentive professional forecasters," Journal of Monetary Economics, Elsevier, vol. 60(8), pages 967-982.
    6. Vania Esady, 2022. "Real and nominal effects of monetary shocks under time-varying disagreement," Bank of England working papers 1007, Bank of England.
    7. Robert W. Rich & Joseph Tracy, 2017. "The behavior of uncertainty and disagreement and their roles in economic prediction: a panel analysis," Staff Reports 808, Federal Reserve Bank of New York.
    8. An, Zidong & Zheng, Xinye, 2023. "Diligent forecasters can make accurate predictions despite disagreeing with the consensus," Economic Modelling, Elsevier, vol. 125(C).
    9. Abe, Naohito & Ueno, Yuko, 2016. "The Mechanism of Inflation Expectation Formation among Consumers," RCESR Discussion Paper Series DP16-1, Research Center for Economic and Social Risks, Institute of Economic Research, Hitotsubashi University.
    10. Camille Cornand & Paul Hubert, 2021. "Information frictions in inflation expectations among five types of economic agents," Working Papers halshs-03351632, HAL.
    11. Czudaj, Robert L., 2022. "Heterogeneity of beliefs and information rigidity in the crude oil market: Evidence from survey data," European Economic Review, Elsevier, vol. 143(C).
    12. Zohar, Osnat, 2024. "Cyclicality of uncertainty and disagreement," Journal of Monetary Economics, Elsevier, vol. 143(C).
    13. Adrien Auclert & Ludwig Straub & Matthew Rognlie, 2019. "Micro Jumps, Macro Humps: monetary policy and business cycles in an estimated HANK model," 2019 Meeting Papers 1449, Society for Economic Dynamics.
    14. Mokinski, Frieder, 2016. "Using time-stamped survey responses to measure expectations at a daily frequency," International Journal of Forecasting, Elsevier, vol. 32(2), pages 271-282.
    15. Elías Albagli & Francesco Grigoli & Emiliano Luttini, 2025. "Inflation Expectations and the Supply Chain," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 73(3), pages 819-850, September.
    16. Candia, Bernardo & Coibion, Olivier & Gorodnichenko, Yuriy, 2024. "The inflation expectations of U.S. firms: Evidence from a new survey," Journal of Monetary Economics, Elsevier, vol. 145(S).
    17. Angeletos, G.-M. & Lian, C., 2016. "Incomplete Information in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 1065-1240, Elsevier.
    18. Clements, Michael P., 2024. "Do professional forecasters believe in the Phillips curve?," International Journal of Forecasting, Elsevier, vol. 40(3), pages 1238-1254.
    19. Dovern, Jonas & Müller, Lena Sophia & Wohlrabe, Klaus, 2023. "Local information and firm expectations about aggregates," Journal of Monetary Economics, Elsevier, vol. 138(C), pages 1-13.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:42:y:2026:i:1:p:235-258. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.