IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_12522.html

Expertise and Prediction Accuracy

Author

Listed:
  • Elisabeth Grewenig
  • Klaus Gründler
  • Philipp Lergetporer
  • Niklas Potrafke

  • Katharina Werner
  • Helen Zeidler

Abstract

Public support for policy interventions depends on citizens’ beliefs about their likely ef-fects. We examine how individuals form such beliefs by studying their predictions of experimental outcomes in a policy-relevant setting, and why their predictions differ from expert benchmarks. We elicit forecasts from 127 professional economists and a repre-sentative sample of 6,200 German households about a large-scale behavioral experi-ment on education policy (N = 3, 133). Non-experts predict both average outcomes and treatment effects far less accurately than experts. Prediction accuracy improves with calibrated priors, self-reported effort, and the use of structured reasoning, but remains well below expert levels. We show that scalable design features, including the provision of well-calibrated numerical anchors and monetary incentives to rise effort, improve non-expert predictions, with effects comparable in magnitude to tertiary education or structured reasoning. Our findings have important implications for bridging the ‘expertise gap’ in public discourse.

Suggested Citation

  • Elisabeth Grewenig & Klaus Gründler & Philipp Lergetporer & Niklas Potrafke & Katharina Werner & Helen Zeidler, 2026. "Expertise and Prediction Accuracy," CESifo Working Paper Series 12522, CESifo.
  • Handle: RePEc:ces:ceswps:_12522
    as

    Download full text from publisher

    File URL: https://www.ifo.de/DocDL/cesifo1_wp12522.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gründler, Klaus & Potrafke, Niklas & Wochner, Timo, 2025. "Outside employment and parliamentary priorities," Journal of Economic Behavior & Organization, Elsevier, vol. 237(C).
    2. Jonas Hjort & Diana Moreira & Gautam Rao & Juan Francisco Santini, 2021. "How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities," American Economic Review, American Economic Association, vol. 111(5), pages 1442-1480, May.
    3. Stefano DellaVigna & Nicholas Otis & Eva Vivalt, 2020. "Forecasting the Results of Experiments: Piloting an Elicitation Strategy," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 75-79, May.
    4. Stefano DellaVigna & Devin Pope, 2018. "Predicting Experimental Results: Who Knows What?," Journal of Political Economy, University of Chicago Press, vol. 126(6), pages 2410-2456.
    5. Lergetporer, Philipp & Woessmann, Ludger, 2023. "Earnings information and public preferences for university tuition: Evidence from representative experiments," Journal of Public Economics, Elsevier, vol. 226(C).
    6. Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2025. "Understanding Economic Behavior Using Open-Ended Survey Data," Journal of Economic Literature, American Economic Association, vol. 63(4), pages 1244-1280, December.
    7. Beatrice Ferrario & Stefanie Stantcheva, 2022. "Eliciting People's First-Order Concerns: Text Analysis of Open-Ended Survey Questions," AEA Papers and Proceedings, American Economic Association, vol. 112, pages 163-169, May.
    8. Charles F. Manski, 2004. "Measuring Expectations," Econometrica, Econometric Society, vol. 72(5), pages 1329-1376, September.
    9. Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2020. "Educational inequality and public policy preferences: Evidence from representative survey experiments," Journal of Public Economics, Elsevier, vol. 188(C).
    10. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    11. Adeline Delavande & Xavier Giné & David McKenzie, 2011. "Eliciting probabilistic expectations with visual aids in developing countries: how sensitive are answers to variations in elicitation design?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(3), pages 479-497, April.
    12. Klaus Gründler & Michael Lamla & Niklas Potrafke & Timo Wochner, 2026. "Experts as Intermediaries," CESifo Working Paper Series 12492, CESifo.
    13. Sheheryar Banuri & Stefan Dercon & Varun Gauri, 2019. "Biased Policy Professionals," The World Bank Economic Review, World Bank, vol. 33(2), pages 310-327.
    14. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    15. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    16. Christopher Roth & Johannes Wohlfart, 2020. "How Do Expectations about the Macroeconomy Affect Personal Expectations and Behavior?," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 731-748, October.
    17. Stefan T. Trautmann & Gijs Kuilen, 2015. "Belief Elicitation: A Horse Race among Truth Serums," Economic Journal, Royal Economic Society, vol. 125(589), pages 2116-2135, December.
    18. Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2023. "Designing Information Provision Experiments," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 3-40, March.
    19. Stefano DellaVigna, 2018. "Structural Behavioral Economics," NBER Working Papers 24797, National Bureau of Economic Research, Inc.
    20. Stefanie Stantcheva, 2021. "Understanding Tax Policy: How do People Reason?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(4), pages 2309-2369.
    21. Peter Andrebriq & Carlo Pizzinelli & Christopher Roth & Johannes Wohlfart, 2022. "Subjective Models of the Macroeconomy: Evidence From Experts and Representative Samples," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(6), pages 2958-2991.
    22. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    23. Prior, Markus & Sood, Gaurav & Khanna, Kabir, 2015. "You Cannot be Serious: The Impact of Accuracy Incentives on Partisan Bias in Reports of Economic Perceptions," Quarterly Journal of Political Science, now publishers, vol. 10(4), pages 489-518, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grewenig, Elisabeth & Gründler, Klaus & Lergetporer, Philipp & Potrafke, Niklas & Werner, Katharina & Zeidler, Helen, 2026. "Expertise and Prediction Accuracy," IZA Discussion Papers 18453, IZA Network @ LISER.
    2. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2022. "Incentives, search engines, and the elicitation of subjective beliefs: Evidence from representative online survey experiments," Journal of Econometrics, Elsevier, vol. 231(1), pages 304-326.
    3. Klaus Gründler & Michael Lamla & Niklas Potrafke & Timo Wochner, 2026. "Experts as Intermediaries," CESifo Working Paper Series 12492, CESifo.
    4. Ersoy, Fulya Y., 2025. "Do incentives matter in elicitation of beliefs?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 119(C).
    5. Boumans, Dorine & Gründler, Klaus & Potrafke, Niklas & Ruthardt, Fabian, 2024. "Political leaders and macroeconomic expectations: Evidence from a global survey experiment," Journal of Public Economics, Elsevier, vol. 235(C).
    6. repec:ecb:ecbdps:202424 is not listed on IDEAS
    7. Ingar Haaland & Christopher Roth, 2023. "Beliefs about Racial Discrimination and Support for Pro-Black Policies," The Review of Economics and Statistics, MIT Press, vol. 105(1), pages 40-53, January.
    8. Blesse, Sebastian & Gruendler, Klaus & Heil, Philipp & Hermes, Henning, 2025. "The demand for economic narratives," ZEW Discussion Papers 25-054, ZEW - Leibniz Centre for European Economic Research.
    9. Francesco D’Acunto & Daniel Hoang & Maritta Paloviita & Michael Weber, 2023. "IQ, Expectations, and Choice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(5), pages 2292-2325.
    10. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina, 2020. "Gender Norms and Labor-Supply Expectations: Experimental Evidence from Adolescents," Rationality and Competition Discussion Paper Series 259, CRC TRR 190 Rationality and Competition.
    11. Chadimová, Kateřina & Cahlíková, Jana & Cingl, Lubomír, 2022. "Foretelling what makes people pay: Predicting the results of field experiments on TV fee enforcement," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    12. Bocar A. Ba & Abdoulaye Ndiaye & Roman Rivera & Alexander Whitefield, 2024. "Mispricing Narratives after Social Unrest," NBER Working Papers 32730, National Bureau of Economic Research, Inc.
    13. Francesco Capozza & Krishna Srinivasan & Mattie Toma, 2025. "Science by Consensus: Eliciting Citizens’ and Experts’ R&D Spending Priorities," CESifo Working Paper Series 12235, CESifo.
    14. Alistair Macaulay, 2026. "The Causal Effects of Heterogeneous Expectation Formation in General Equilibrium," School of Economics Discussion Papers 0226, School of Economics, University of Surrey.
    15. Philip Schnorpfeil & Michael Weber & Andreas Hackethal, 2023. "Households' Response to the Wealth Effects of Inflation," NBER Working Papers 31672, National Bureau of Economic Research, Inc.
    16. Burdea, Valeria & Woon, Jonathan, 2022. "Online belief elicitation methods," Journal of Economic Psychology, Elsevier, vol. 90(C).
    17. Blesse, Sebastian & Heinemann, Friedrich & Krieger, Tommy, 2021. "Informationsdefizite als Hindernis rationaler Wirtschaftspolitik: Ausmass, Ursachen und Gegenstrategien. Eine Studie mit Unterstützung der Brigitte Strube Stiftung," ZEW Expertises, ZEW - Leibniz Centre for European Economic Research, number 241989.
    18. Roth, Christopher & Settele, Sonja & Wohlfart, Johannes, 2022. "Beliefs about public debt and the demand for government spending," Journal of Econometrics, Elsevier, vol. 231(1), pages 165-187.
    19. Jianhao Lin & Lexuan Sun & Yixin Yan, 2025. "Simulating Macroeconomic Expectations using LLM Agents," Papers 2505.17648, arXiv.org, revised Nov 2025.
    20. Francesco Capozza & Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2021. "Studying Information Acquisition in the Field: A Practical Guide and Review," CEBI working paper series 21-15, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    21. Westberg, Nina Bruvik & Skjeflo, Sofie Waage & Kallbekken, Steffen, 2025. "The power of information: A survey experiment on public support for electricity price compensation schemes," Energy Policy, Elsevier, vol. 206(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_12522. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.