IDEAS home Printed from https://ideas.repec.org/p/ecb/ecbwps/20232791.html

Testing for differences in survey-based density expectations: a compositional data approach

Author

Listed:
  • Dovern, Jonas
  • Glas, Alexander
  • Kenny, Geoff

Abstract

We propose to treat survey-based density expectations as compositional data when testing either for heterogeneity in density forecasts across different groups of agents or for changes over time. Monte Carlo simulations show that the proposed test has more power relative to both a bootstrap approach based on the KLIC and an approach which involves multiple testing for differences of individual parts of the density. In addition, the test is computaionally much faster than the KLIC-based one, which relies on simulations, and allows for comparisons across multiple groups. Using density expectations from the ECB Survey of Professional Forecasters and the U.S. Survey of Consumer Expectations, we show the usefulness of the test in detecting possible changes in density expectations over time and across different types of forecasters. JEL Classification: C12, D84, E27

Suggested Citation

  • Dovern, Jonas & Glas, Alexander & Kenny, Geoff, 2023. "Testing for differences in survey-based density expectations: a compositional data approach," Working Paper Series 2791, European Central Bank.
    • Handle: RePEc:ecb:ecbwps:20232791
    Note: 339061
    as

    Download full text from publisher

    File URL: https://www.ecb.europa.eu//pub/pdf/scpwps/ecb.wp2791~63b402562b.en.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Robert Rich & Joseph Tracy, 2021. "A Closer Look at the Behavior of Uncertainty and Disagreement: Micro Evidence from the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 53(1), pages 233-253, February.
    2. Olivier Armantier & Wändi Bruine de Bruin & Giorgio Topa & Wilbert van der Klaauw & Basit Zafar, 2015. "Inflation Expectations And Behavior: Do Survey Respondents Act On Their Beliefs?," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56(2), pages 505-536, May.
    3. Olivier Coibion & Yuriy Gorodnichenko & Saten Kumar, 2018. "How Do Firms Form Their Expectations? New Survey Evidence," American Economic Review, American Economic Association, vol. 108(9), pages 2671-2713, September.
    4. N. Gregory Mankiw & Ricardo Reis & Justin Wolfers, 2004. "Disagreement about Inflation Expectations," NBER Chapters, in: NBER Macroeconomics Annual 2003, Volume 18, pages 209-270, National Bureau of Economic Research, Inc.
    5. Reiche, Lovisa & Meyler, Aidan, 2022. "Making sense of consumer inflation expectations: the role of uncertainty," Working Paper Series 2642, European Central Bank.
    6. Theresa Kuchler & Basit Zafar, 2019. "Personal Experiences and Expectations about Aggregate Outcomes," Journal of Finance, American Finance Association, vol. 74(5), pages 2491-2542, October.
    7. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    8. Olivier Armantier & Wändi Bruine de Bruin & Giorgio Topa & Wilbert Klaauw & Basit Zafar, 2015. "Inflation Expectations And Behavior: Do Survey Respondents Act On Their Beliefs?," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56, pages 505-536, May.
    9. Alexander Glas & Matthias Hartmann, 2022. "Uncertainty measures from partially rounded probabilistic forecast surveys," Quantitative Economics, Econometric Society, vol. 13(3), pages 979-1022, July.
    10. Saten Kumar & Hassan Afrouzi & Olivier Coibion & Yuriy Gorodnichenko, 2015. "Inflation Targeting Does Not Anchor Inflation Expectations: Evidence from Firms in New Zealand," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 46(2 (Fall)), pages 151-225.
    11. Ulrike Malmendier & Stefan Nagel, 2016. "Learning from Inflation Experiences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(1), pages 53-87.
    12. Andrade, Philippe & Coibion, Olivier & Gautier, Erwan & Gorodnichenko, Yuriy, 2022. "No firm is an island? How industry conditions shape firms’ expectations," Journal of Monetary Economics, Elsevier, vol. 125(C), pages 40-56.
    13. Dovern, Jonas & Müller, Lena Sophia & Wohlrabe, Klaus, 2023. "Local information and firm expectations about aggregates," Journal of Monetary Economics, Elsevier, vol. 138(C), pages 1-13.
    14. Conrad, Christian & Enders, Zeno & Glas, Alexander, 2022. "The role of information and experience for households’ inflation expectations," European Economic Review, Elsevier, vol. 143(C).
    15. Kenny, Geoff & Genre, Véronique & Bowles, Carlos & Friz, Roberta & Meyler, Aidan & Rautanen, Tuomas, 2007. "The ECB survey of professional forecasters (SPF) - A review after eight years' experience," Occasional Paper Series 59, European Central Bank.
    16. Saten Kumar & Yuriy Gorodnichenko & Olivier Coibion, 2023. "The Effect of Macroeconomic Uncertainty on Firm Decisions," Econometrica, Econometric Society, vol. 91(4), pages 1297-1332, July.
    17. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    18. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    19. Michael P. Clements, 2022. "Individual forecaster perceptions of the persistence of shocks to GDP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(3), pages 640-656, April.
    20. Binder, Carola C., 2017. "Measuring uncertainty based on rounding: New method and application to inflation expectations," Journal of Monetary Economics, Elsevier, vol. 90(C), pages 1-12.
    21. Charles F. Manski, 2018. "Survey Measurement of Probabilistic Macroeconomic Expectations: Progress and Promise," NBER Macroeconomics Annual, University of Chicago Press, vol. 32(1), pages 411-471.
    22. Francesco D’Acunto & Ulrike Malmendier & Juan Ospina & Michael Weber, 2021. "Exposure to Grocery Prices and Inflation Expectations," Journal of Political Economy, University of Chicago Press, vol. 129(5), pages 1615-1639.
    23. Gwangmin Kim & Carola Binder, 2023. "Learning-through-Survey in Inflation Expectations," American Economic Journal: Macroeconomics, American Economic Association, vol. 15(2), pages 254-278, April.
    24. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    25. Armantier, Olivier & Koşar, Gizem & Pomerantz, Rachel & Skandalis, Daphné & Smith, Kyle & Topa, Giorgio & van der Klaauw, Wilbert, 2021. "How economic crises affect inflation beliefs: Evidence from the Covid-19 pandemic," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 443-469.
    26. Olivier Coibion & Dimitris Georgarakos & Yuriy Gorodnichenko & Geoff Kenny & Michael Weber, 2024. "The Effect of Macroeconomic Uncertainty on Household Spending," American Economic Review, American Economic Association, vol. 114(3), pages 645-677, March.
    27. Carola Binder & Wesley Janson & Randal Verbrugge, 2023. "Out of Bounds: Do SPF Respondents Have Anchored Inflation Expectations?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 55(2-3), pages 559-576, March.
    28. James Mitchell & Stephen G. Hall, 2005. "Evaluating, Comparing and Combining Density Forecasts Using the KLIC with an Application to the Bank of England and NIESR ‘Fan’ Charts of Inflation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 995-1033, December.
    29. Gergely Ganics & Barbara Rossi & Tatevik Sekhposyan, 2024. "From Fixed‐Event to Fixed‐Horizon Density Forecasts: Obtaining Measures of Multihorizon Uncertainty from Survey Density Forecasts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 56(7), pages 1675-1704, October.
    30. Olivier Coibion & Yuriy Gorodnichenko & Tiziano Ropele, 2020. "Inflation Expectations and Firm Decisions: New Causal Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 165-219.
    31. Fry, Jane M. & Fry, Tim R. L. & McLaren, Keith R., 1996. "The stochastic specification of demand share equations: Restricting budget shares to the unit simplex," Journal of Econometrics, Elsevier, vol. 73(2), pages 377-385, August.
    32. Clements, Michael P., 2021. "Rounding behaviour of professional macro-forecasters," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1614-1631.
    33. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    34. Ulrike Malmendier & Stefan Nagel, 2011. "Depression Babies: Do Macroeconomic Experiences Affect Risk Taking?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 373-416.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dovern, Jonas & Müller, Lena Sophia & Wohlrabe, Klaus, 2023. "Local information and firm expectations about aggregates," Journal of Monetary Economics, Elsevier, vol. 138(C), pages 1-13.
    2. Christopher Roth & Johannes Wohlfart, 2020. "How Do Expectations about the Macroeconomy Affect Personal Expectations and Behavior?," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 731-748, October.
    3. Dovern, Jonas & Müller, Lena Sophia & Wohlrabe, Klaus, 2020. "How Do Firms Form Expectations of Aggregate Growth? New Evidence from a Large-scale Business Survey," Working Papers 15, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    4. Lena Dräger & Michael J. Lamla, 2024. "Consumers' macroeconomic expectations," Journal of Economic Surveys, Wiley Blackwell, vol. 38(2), pages 427-451, April.
    5. Becker, Christoph Karl & Duersch, Peter & Eife, Thomas & Glas, Alexander, 2025. "Personalizing probabilistic survey scales," Journal of Economic Behavior & Organization, Elsevier, vol. 236(C).
    6. Crump, Richard K. & Eusepi, Stefano & Tambalotti, Andrea & Topa, Giorgio, 2022. "Subjective intertemporal substitution," Journal of Monetary Economics, Elsevier, vol. 126(C), pages 118-133.
    7. Becker, Christoph & Dürsch, Peter & Eife, Thomas A. & Glas, Alexander, 2023. "Households' probabilistic inflation expectations in high-inflation regimes," FAU Discussion Papers in Economics 01/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    8. Dräger, Lena & Gründler, Klaus & Potrafke, Niklas, 2025. "Political shocks and inflation expectations: Evidence from the 2022 Russian invasion of Ukraine," Journal of International Economics, Elsevier, vol. 153(C).
    9. Pavlova, Lora, 2025. "Framing effects in consumer expectations surveys," Journal of Economic Behavior & Organization, Elsevier, vol. 231(C).
    10. Lena Dräger, 2023. "Central Bank Communication with the General Public," CESifo Working Paper Series 10713, CESifo.
    11. Anat Bracha & Jenny Tang, 2022. "Inflation Levels and (In)Attention," Working Papers 22-4, Federal Reserve Bank of Boston.
    12. Armantier, Olivier & Koşar, Gizem & Pomerantz, Rachel & Skandalis, Daphné & Smith, Kyle & Topa, Giorgio & van der Klaauw, Wilbert, 2021. "How economic crises affect inflation beliefs: Evidence from the Covid-19 pandemic," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 443-469.
    13. Conrad, Christian & Lahiri, Kajal, 2023. "Heterogeneous expectations among professional forecasters," ZEW Discussion Papers 23-062, ZEW - Leibniz Centre for European Economic Research.
    14. Michael Weber & Bernardo Candia & Hassan Afrouzi & Tiziano Ropele & Rodrigo Lluberas & Serafin Frache & Brent Meyer & Saten Kumar & Yuriy Gorodnichenko & Dimitris Georgarakos & Olivier Coibion & Geoff, 2025. "Tell Me Something I Don't Already Know: Learning in Low‐ and High‐Inflation Settings," Econometrica, Econometric Society, vol. 93(1), pages 229-264, January.
    15. Okan Akarsu & Emrehan Aktug & Huzeyfe Torun, 2025. "Inflation Expectations and Firms' Decisions in High Inflation: Evidence from a Randomized Control Trial," Working Papers 2512, Research and Monetary Policy Department, Central Bank of the Republic of Turkey.
    16. Wehrhöfer, Nils, 2023. "Energy prices and inflation expectations: Evidence from households and firms," Discussion Papers 28/2023, Deutsche Bundesbank.
    17. Ali Inayat, 2023. "Household Inflation Expectations Uncertainty: A Case for Pakistan," Lahore Journal of Economics, Department of Economics, The Lahore School of Economics, vol. 28(1), pages 1-39, Jan-June.
    18. Francesco D’Acunto & Daniel Hoang & Maritta Paloviita & Michael Weber, 2023. "IQ, Expectations, and Choice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(5), pages 2292-2325.
    19. Candia, Bernardo & Coibion, Olivier & Gorodnichenko, Yuriy, 2024. "The inflation expectations of U.S. firms: Evidence from a new survey," Journal of Monetary Economics, Elsevier, vol. 145(S).
    20. Comerford, David A., 2025. "Cognitive reflection, arithmetic ability and financial literacy independently predict both inflation expectations and forecast accuracy," International Journal of Forecasting, Elsevier, vol. 41(2), pages 517-531.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • D84 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Expectations; Speculations
    • E27 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecb:ecbwps:20232791. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Official Publications (email available below). General contact details of provider: https://edirc.repec.org/data/emieude.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.