IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp18453.html

Expertise and Prediction Accuracy

Author

Listed:
  • Grewenig, Elisabeth

    (KfW, Frankfurt)

  • Gründler, Klaus

    (University of Kassel)

  • Lergetporer, Philipp

    (Technical University of Munich)

  • Potrafke, Niklas

    (ifo Institute)

  • Werner, Katharina

    (Business School Pforzheim)

  • Zeidler, Helen

    (Technical University of Munich)

Abstract

Public support for policy interventions depends on citizens' beliefs about their likely effects. We examine how individuals form such beliefs by studying their predictions of experimental outcomes in a policy-relevant setting, and why their predictions differ from expert benchmarks. We elicit forecasts from 127 professional economists and a representative sample of 6,200 German households about a large-scale behavioral experiment on education policy (N = 3, 133). Nonexperts predict both average outcomes and treatment effects far less accurately than experts. Prediction accuracy improves with calibrated priors, self-reported effort, and the use of structured reasoning, but remains well below expert levels. We show that scalable design features, including the provision of well-calibrated numerical anchors and monetary incentives to rise effort, improve non-expert predictions, with effects comparable in magnitude to tertiary education or structured reasoning. Our findings have important implications for bridging the ‘expertise gap' in public discourse.

Suggested Citation

  • Grewenig, Elisabeth & Gründler, Klaus & Lergetporer, Philipp & Potrafke, Niklas & Werner, Katharina & Zeidler, Helen, 2026. "Expertise and Prediction Accuracy," IZA Discussion Papers 18453, IZA Network @ LISER.
  • Handle: RePEc:iza:izadps:dp18453
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp18453.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jonas Hjort & Diana Moreira & Gautam Rao & Juan Francisco Santini, 2021. "How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities," American Economic Review, American Economic Association, vol. 111(5), pages 1442-1480, May.
    2. Stefano DellaVigna & Nicholas Otis & Eva Vivalt, 2020. "Forecasting the Results of Experiments: Piloting an Elicitation Strategy," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 75-79, May.
    3. Stefano DellaVigna & Devin Pope, 2018. "Predicting Experimental Results: Who Knows What?," Journal of Political Economy, University of Chicago Press, vol. 126(6), pages 2410-2456.
    4. Lergetporer, Philipp & Woessmann, Ludger, 2023. "Earnings information and public preferences for university tuition: Evidence from representative experiments," Journal of Public Economics, Elsevier, vol. 226(C).
    5. Lergetporer, Philipp & Schwerdt, Guido & Werner, Katharina & West, Martin R. & Woessmann, Ludger, 2018. "How information affects support for education spending: Evidence from survey experiments in Germany and the United States," Journal of Public Economics, Elsevier, vol. 167(C), pages 138-157.
    6. Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2025. "Understanding Economic Behavior Using Open-Ended Survey Data," Journal of Economic Literature, American Economic Association, vol. 63(4), pages 1244-1280, December.
    7. Beatrice Ferrario & Stefanie Stantcheva, 2022. "Eliciting People's First-Order Concerns: Text Analysis of Open-Ended Survey Questions," AEA Papers and Proceedings, American Economic Association, vol. 112, pages 163-169, May.
    8. Dräger, Lena & Gründler, Klaus & Potrafke, Niklas, 2025. "Political shocks and inflation expectations: Evidence from the 2022 Russian invasion of Ukraine," Journal of International Economics, Elsevier, vol. 153(C).
    9. Charles F. Manski, 2004. "Measuring Expectations," Econometrica, Econometric Society, vol. 72(5), pages 1329-1376, September.
    10. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    11. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    12. Christopher Roth & Johannes Wohlfart, 2020. "How Do Expectations about the Macroeconomy Affect Personal Expectations and Behavior?," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 731-748, October.
    13. Stefan T. Trautmann & Gijs Kuilen, 2015. "Belief Elicitation: A Horse Race among Truth Serums," Economic Journal, Royal Economic Society, vol. 125(589), pages 2116-2135, December.
    14. Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2023. "Designing Information Provision Experiments," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 3-40, March.
    15. Stefano DellaVigna, 2018. "Structural Behavioral Economics," NBER Working Papers 24797, National Bureau of Economic Research, Inc.
    16. Stefanie Stantcheva, 2021. "Understanding Tax Policy: How do People Reason?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(4), pages 2309-2369.
    17. Peter Andrebriq & Carlo Pizzinelli & Christopher Roth & Johannes Wohlfart, 2022. "Subjective Models of the Macroeconomy: Evidence From Experts and Representative Samples," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(6), pages 2958-2991.
    18. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    19. Prior, Markus & Sood, Gaurav & Khanna, Kabir, 2015. "You Cannot be Serious: The Impact of Accuracy Incentives on Partisan Bias in Reports of Economic Perceptions," Quarterly Journal of Political Science, now publishers, vol. 10(4), pages 489-518, December.
    20. Gründler, Klaus & Potrafke, Niklas & Wochner, Timo, 2025. "Outside employment and parliamentary priorities," Journal of Economic Behavior & Organization, Elsevier, vol. 237(C).
    21. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2022. "Incentives, search engines, and the elicitation of subjective beliefs: Evidence from representative online survey experiments," Journal of Econometrics, Elsevier, vol. 231(1), pages 304-326.
    22. Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2020. "Educational inequality and public policy preferences: Evidence from representative survey experiments," Journal of Public Economics, Elsevier, vol. 188(C).
    23. Adeline Delavande & Xavier Giné & David McKenzie, 2011. "Eliciting probabilistic expectations with visual aids in developing countries: how sensitive are answers to variations in elicitation design?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(3), pages 479-497, April.
    24. Klaus Gründler & Michael Lamla & Niklas Potrafke & Timo Wochner, 2026. "Experts as Intermediaries," CESifo Working Paper Series 12492, CESifo.
    25. Sheheryar Banuri & Stefan Dercon & Varun Gauri, 2019. "Biased Policy Professionals," The World Bank Economic Review, World Bank, vol. 33(2), pages 310-327.
    26. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2022. "Incentives, search engines, and the elicitation of subjective beliefs: Evidence from representative online survey experiments," Journal of Econometrics, Elsevier, vol. 231(1), pages 304-326.
    2. Ersoy, Fulya Y., 2025. "Do incentives matter in elicitation of beliefs?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 119(C).
    3. Boumans, Dorine & Gründler, Klaus & Potrafke, Niklas & Ruthardt, Fabian, 2024. "Political leaders and macroeconomic expectations: Evidence from a global survey experiment," Journal of Public Economics, Elsevier, vol. 235(C).
    4. Roth, Christopher & Settele, Sonja & Wohlfart, Johannes, 2022. "Beliefs about public debt and the demand for government spending," Journal of Econometrics, Elsevier, vol. 231(1), pages 165-187.
    5. Klaus Gründler & Michael Lamla & Niklas Potrafke & Timo Wochner, 2026. "Experts as Intermediaries," CESifo Working Paper Series 12492, CESifo.
    6. Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2023. "Designing Information Provision Experiments," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 3-40, March.
    7. Blesse, Sebastian & Heinemann, Friedrich & Krieger, Tommy, 2021. "Informationsdefizite als Hindernis rationaler Wirtschaftspolitik: Ausmass, Ursachen und Gegenstrategien. Eine Studie mit Unterstützung der Brigitte Strube Stiftung," ZEW Expertises, ZEW - Leibniz Centre for European Economic Research, number 241989.
    8. repec:ecb:ecbdps:202424 is not listed on IDEAS
    9. Blesse, Sebastian & Gruendler, Klaus & Heil, Philipp & Hermes, Henning, 2025. "The demand for economic narratives," ZEW Discussion Papers 25-054, ZEW - Leibniz Centre for European Economic Research.
    10. Lergetporer, Philipp & Woessmann, Ludger, 2023. "Earnings information and public preferences for university tuition: Evidence from representative experiments," Journal of Public Economics, Elsevier, vol. 226(C).
    11. Dräger, Lena & Gründler, Klaus & Potrafke, Niklas, 2025. "Peer Effects in Macroeconomic Expectations," Hannover Economic Papers (HEP) dp-739, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    12. Zakharov, Alexei, 2024. "Overestimation of social security payments reduces preferences for spending on social policy," European Journal of Political Economy, Elsevier, vol. 85(C).
    13. Francesco Capozza & Krishna Srinivasan & Mattie Toma, 2025. "Science by Consensus: Eliciting Citizens’ and Experts’ R&D Spending Priorities," CESifo Working Paper Series 12235, CESifo.
    14. Alistair Macaulay, 2026. "The Causal Effects of Heterogeneous Expectation Formation in General Equilibrium," School of Economics Discussion Papers 0226, School of Economics, University of Surrey.
    15. Bocar A. Ba & Abdoulaye Ndiaye & Roman G. Rivera & Alexander Whitefield, 2024. "Mispricing Narratives after Social Unrest," CESifo Working Paper Series 11264, CESifo.
    16. Sebastian Blesse & Philipp Lergetporer & Justus Nover & Katharina Werner, 2023. "Transparency and Policy Competition: Experimental Evidence from German Citizens and Politicians," Munich Papers in Political Economy 27, Munich School of Politics and Public Policy and the School of Management at the Technical University of Munich.
    17. Burdea, Valeria & Woon, Jonathan, 2022. "Online belief elicitation methods," Journal of Economic Psychology, Elsevier, vol. 90(C).
    18. Schnorpfeil, Philip & Weber, Michael & Hackethal, Andreas, 2023. "Households' response to the wealth effects of inflation," SAFE Working Paper Series 400, Leibniz Institute for Financial Research SAFE.
    19. Jianhao Lin & Lexuan Sun & Yixin Yan, 2025. "Simulating Macroeconomic Expectations using LLM Agents," Papers 2505.17648, arXiv.org, revised Nov 2025.
    20. Ingar Haaland & Christopher Roth, 2023. "Beliefs about Racial Discrimination and Support for Pro-Black Policies," The Review of Economics and Statistics, MIT Press, vol. 105(1), pages 40-53, January.
    21. Francesco D’Acunto & Daniel Hoang & Maritta Paloviita & Michael Weber, 2023. "IQ, Expectations, and Choice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(5), pages 2292-2325.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp18453. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Fallak (email available below). General contact details of provider: https://edirc.repec.org/data/izaaalu.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.