IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/23335.html
   My bibliography  Save this paper

An Economic Approach to Alleviate the Crises of Confidence in Science: With an Application to the Public Goods Game

Author

Listed:
  • Luigi Butera
  • John A. List

Abstract

Novel empirical insights by their very nature tend to be unanticipated, and in some cases at odds with the current state of knowledge on the topic. The mechanics of statistical inference suggest that such initial findings, even when robust and statistically significant within the study, should not appreciably move priors about the phenomenon under investigation. Yet, a few well-conceived independent replications dramatically improve the reliability of novel findings. Nevertheless, the incentives to replicate are seldom in place in the sciences, especially within the social sciences. We propose a simple incentive-compatible mechanism to promote replications, and use experimental economics to highlight our approach. We begin by reporting results from an experiment in which we investigate how cooperation in allocation games is affected by the presence of Knightian uncertainty, a pervasive and yet unexplored characteristic of most public goods. Unexpectedly, we find that adding uncertainty enhances cooperation. This surprising result serves as a test case for our mechanism: instead of sending this paper to a peer-reviewed journal, we make it available online as a working paper, but we commit never to submit it to a journal for publication. We instead offered co-authorship for a second, yet to be written, paper to other scholars willing to replicate our study. That second paper will reference this working paper, will include all replications, and will be submitted to a peer-reviewed journal for publication. Our mechanism allows mutually-beneficial gains from trade between the original investigators and other scholars, alleviates the publication bias problem that often surrounds novel experimental results, and accelerates the advancement of economic science by leveraging the mechanics of statistical inference.

Suggested Citation

  • Luigi Butera & John A. List, 2017. "An Economic Approach to Alleviate the Crises of Confidence in Science: With an Application to the Public Goods Game," NBER Working Papers 23335, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:23335
    Note: PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w23335.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Catherine C. Eckel & Philip J. Grossman, 2002. "Sex Differences and Statistical Stereotyping in Attitudes Toward Financial Risk," Monash Economics Working Papers archive-03, Monash University, Department of Economics.
    2. John P A Ioannidis, 2005. "Why Most Published Research Findings Are False," PLOS Medicine, Public Library of Science, vol. 2(8), pages 1-1, August.
    3. Reuben, Ernesto & Tyran, Jean-Robert, 2010. "Everyone is a winner: Promoting cooperation through all-can-win intergroup competition," European Journal of Political Economy, Elsevier, vol. 26(1), pages 25-35, March.
    4. Bochet, Olivier & Page, Talbot & Putterman, Louis, 2006. "Communication and punishment in voluntary contribution experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 60(1), pages 11-26, May.
    5. Mana Komai & Philip J. Grossman & Travis Deters, 2011. "Leadership and information in a single‐shot collective action game: An experimental study," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 32(2), pages 119-134, March.
    6. Martin Sefton & Robert Shupp & James M. Walker, 2007. "The Effect Of Rewards And Sanctions In Provision Of Public Goods," Economic Inquiry, Western Economic Association International, vol. 45(4), pages 671-690, October.
    7. Béatrice Boulu-Reshef & Samuel H. Brott & Adam Zylbersztejn, 2017. "Does Uncertainty Deter Provision of Public Goods?," Revue économique, Presses de Sciences-Po, vol. 68(5), pages 785-791.
    8. Fabrice Etilé & Pierre Combris & Urs Fischbacher & Simeon Schudy & Sabrina Teyssier, 2014. "Heterogeneous reactions to heterogeneity in returns from public goods," PSE-Ecole d'économie de Paris (Postprint) hal-02076872, HAL.
    9. Fischbacher, Urs & Gachter, Simon & Fehr, Ernst, 2001. "Are people conditionally cooperative? Evidence from a public goods experiment," Economics Letters, Elsevier, vol. 71(3), pages 397-404, June.
    10. Dufwenberg, Martin & Kirchsteiger, Georg, 2004. "A theory of sequential reciprocity," Games and Economic Behavior, Elsevier, vol. 47(2), pages 268-298, May.
    11. Michael Kosfeld & Akira Okada & Arno Riedl, 2009. "Institution Formation in Public Goods Games," American Economic Review, American Economic Association, vol. 99(4), pages 1335-1355, September.
    12. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    13. David Masclet & Charles Noussair & Steven Tucker & Marie-Claire Villeval, 2003. "Monetary and Nonmonetary Punishment in the Voluntary Contributions Mechanism," American Economic Review, American Economic Association, vol. 93(1), pages 366-380, March.
    14. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    15. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    16. Andreoni, James, 1995. "Cooperation in Public-Goods Experiments: Kindness or Confusion?," American Economic Review, American Economic Association, vol. 85(4), pages 891-904, September.
    17. McEvoy, David M. & Cherry, Todd L. & Stranlund, John K., 2011. "The Endogenous Formation of Coalitions to Provide Public Goods: Theory and Experimental Evidence," Working Paper Series 102265, University of Massachusetts, Amherst, Department of Resource Economics.
    18. Astrid Dannenberg & Andreas Lange & Bodo Sturm, 2010. "On the Formation of Coalitions to Provide Public Goods - Experimental Evidence from the Lab," NBER Working Papers 15967, National Bureau of Economic Research, Inc.
    19. Kesternich, Martin & Lange, Andreas & Sturm, Bodo, 2014. "The impact of burden sharing rules on the voluntary provision of public goods," Journal of Economic Behavior & Organization, Elsevier, vol. 105(C), pages 107-123.
    20. Glenn W. Harrison & John A. List, 2008. "Naturally Occurring Markets and Exogenous Laboratory Experiments: A Case Study of the Winner's Curse," Economic Journal, Royal Economic Society, vol. 118(528), pages 822-843, April.
    21. Daniel S. Hamermesh, 2007. "Replication in Economics," NBER Working Papers 13026, National Bureau of Economic Research, Inc.
    22. Urs Fischbacher & Simon Gachter, 2010. "Social Preferences, Beliefs, and the Dynamics of Free Riding in Public Goods Experiments," American Economic Review, American Economic Association, vol. 100(1), pages 541-556, March.
    23. James C. Cox & Daniel Friedman & Vjollca Sadiraj, 2008. "Revealed Altruism," Econometrica, Econometric Society, vol. 76(1), pages 31-69, January.
    24. Lata Gangadharan & Veronika Nemes, 2009. "Experimental Analysis Of Risk And Uncertainty In Provisioning Private And Public Goods," Economic Inquiry, Western Economic Association International, vol. 47(1), pages 146-164, January.
    25. Josef Falkinger, 2000. "A Simple Mechanism for the Efficient Provision of Public Goods: Experimental Evidence," American Economic Review, American Economic Association, vol. 90(1), pages 247-264, March.
    26. Palfrey, Thomas R & Prisbrey, Jeffrey E, 1997. "Anomalous Behavior in Public Goods Experiments: How Much and Why?," American Economic Review, American Economic Association, vol. 87(5), pages 829-846, December.
    27. Iris Bohnet & Fiona Greig & Benedikt Herrmann & Richard Zeckhauser, 2008. "Betrayal Aversion: Evidence from Brazil, China, Oman, Switzerland, Turkey, and the United States," American Economic Review, American Economic Association, vol. 98(1), pages 294-310, March.
    28. repec:hal:journl:halshs-01366375 is not listed on IDEAS
    29. Urs Fischbacher & Simeon Schudy & Sabrina Teyssier, 2014. "Heterogeneous reactions to heterogeneity in returns from public goods," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 43(1), pages 195-217, June.
    30. Bruno S. Frey & Stephan Meier, 2004. "Social Comparisons and Pro-social Behavior: Testing "Conditional Cooperation" in a Field Experiment," American Economic Review, American Economic Association, vol. 94(5), pages 1717-1722, December.
    31. Gary Charness & Matthew Rabin, 2002. "Understanding Social Preferences with Simple Tests," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 817-869.
    32. repec:feb:framed:0071 is not listed on IDEAS
    33. Daniel Houser & Robert Kurzban, 2002. "Revisiting Kindness and Confusion in Public Goods Experiments," American Economic Review, American Economic Association, vol. 92(4), pages 1062-1069, September.
    34. M. Levati & Andrea Morone & Annamaria Fiore, 2009. "Voluntary contributions with imperfect information: An experimental study," Public Choice, Springer, vol. 138(1), pages 199-216, January.
    35. Anderson, Simon P. & Goeree, Jacob K. & Holt, Charles A., 1998. "A theoretical analysis of altruism and decision error in public goods games," Journal of Public Economics, Elsevier, vol. 70(2), pages 297-323, November.
    36. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    37. Putterman, Louis & Tyran, Jean-Robert & Kamei, Kenju, 2011. "Public goods and voting on formal sanction schemes," Journal of Public Economics, Elsevier, vol. 95(9), pages 1213-1222.
    38. Rabin, Matthew, 1993. "Incorporating Fairness into Game Theory and Economics," American Economic Review, American Economic Association, vol. 83(5), pages 1281-1302, December.
    39. Cox, James C. & Friedman, Daniel & Gjerstad, Steven, 2007. "A tractable model of reciprocity and fairness," Games and Economic Behavior, Elsevier, vol. 59(1), pages 17-45, April.
    40. Nikiforakis, Nikos, 2010. "Feedback, punishment and cooperation in public good experiments," Games and Economic Behavior, Elsevier, vol. 68(2), pages 689-702, March.
    41. Zacharias Maniadis & Fabio Tufano & John A. List, 2014. "One Swallow Doesn't Make a Summer: New Evidence on Anchoring Effects," American Economic Review, American Economic Association, vol. 104(1), pages 277-290, January.
    42. Brandts, Jordi & Schram, Arthur, 2001. "Cooperation and noise in public goods experiments: applying the contribution function approach," Journal of Public Economics, Elsevier, vol. 79(2), pages 399-427, February.
    43. Ambrus, Attila & Pathak, Parag A., 2011. "Cooperation over finite horizons: A theory and experiments," Journal of Public Economics, Elsevier, vol. 95(7), pages 500-512.
    44. Chen, Daniel L. & Schonger, Martin & Wickens, Chris, 2016. "oTree—An open-source platform for laboratory, online, and field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 9(C), pages 88-97.
    45. Andreoni, James, 1988. "Why free ride? : Strategies and learning in public goods experiments," Journal of Public Economics, Elsevier, vol. 37(3), pages 291-304, December.
    46. Fisher, Joseph & Isaac, R. Mark & Schatzberg, Jeffrey W & Walker, James M., 1995. "Heterogenous Demand for Public Goods: Behavior in the Voluntary Contributions Mechanism," Public Choice, Springer, vol. 85(3-4), pages 249-266, December.
    47. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
    48. Béatrice Boulu-Reshef & Samuel Brott & Adam Zylbersztejn, 2017. "Does Uncertainty Deter Provision to the Public Good?," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01366375, HAL.
    49. John A. List, 2011. "The Market for Charitable Giving," Journal of Economic Perspectives, American Economic Association, vol. 25(2), pages 157-180, Spring.
    50. Bochet, Olivier & Putterman, Louis, 2009. "Not just babble: Opening the black box of communication in a voluntary contribution experiment," European Economic Review, Elsevier, vol. 53(3), pages 309-326, April.
    51. Andreoni, James, 1990. "Impure Altruism and Donations to Public Goods: A Theory of Warm-Glow Giving?," Economic Journal, Royal Economic Society, vol. 100(401), pages 464-477, June.
    52. Simon Gachter & Ernst Fehr, 2000. "Cooperation and Punishment in Public Goods Experiments," American Economic Review, American Economic Association, vol. 90(4), pages 980-994, September.
    53. Jason Aimone & Daniel Houser, 2012. "What you don’t know won’t hurt you: a laboratory analysis of betrayal aversion," Experimental Economics, Springer;Economic Science Association, vol. 15(4), pages 571-588, December.
    54. Ananish Chaudhuri, 2011. "Sustaining cooperation in laboratory public goods experiments: a selective survey of the literature," Experimental Economics, Springer;Economic Science Association, vol. 14(1), pages 47-83, March.
    55. Bruno Frey & Stephan Meier, 2004. "In a field experiment," Natural Field Experiments 00243, The Field Experiments Website.
    56. Pablo Branas-Garza & Antonio Cabrales (ed.), 2016. "Experimental Economics," Palgrave Macmillan Books, Palgrave Macmillan, number 978-1-137-53816-1.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Wednesday assorted links
      by Tyler Cowen in Marginal Revolution on 2017-04-19 20:48:19
    2. Friday links: the most famous ecologist, March for Science, and more
      by ? in Dynamic Ecology on 2017-04-21 16:00:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Omar Al-Ubaydli & John List & Claire Mackevicius & Min Sok Lee & Dana Suskind, 2019. "How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling," Artefactual Field Experiments 00679, The Field Experiments Website.
    2. John A. List, 2024. "Optimally generate policy-based evidence before scaling," Nature, Nature, vol. 626(7999), pages 491-499, February.
    3. Luigi Butera & Philip J Grossman & Daniel Houser & John A List & Marie Claire Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science With An Application to the Public Goods GameA Review," Working Papers halshs-02512932, HAL.
    4. Hou, Kewei & Xue, Chen & Zhang, Lu, 2017. "Replicating Anomalies," Working Paper Series 2017-10, Ohio State University, Charles A. Dice Center for Research in Financial Economics.
    5. Luigi Butera & Philip Grossman & Daniel Houser & John List & Marie-Claire Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science - With an Application to the Public Goods Game," Artefactual Field Experiments 00684, The Field Experiments Website.
    6. Billur Aksoy & Silvana Krasteva, 2020. "When does less information translate into more giving to public goods?," Experimental Economics, Springer;Economic Science Association, vol. 23(4), pages 1148-1177, December.
    7. Allan Drazen & Anna Dreber & Erkut Y. Ozbay & Erik Snowberg, 2019. "A Journal-Based Replication of "Being Chosen to Lead"," CESifo Working Paper Series 7942, CESifo.
    8. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    9. Davide Pace & Joël van der Weele, 2020. "Curbing Carbon: An Experiment on Uncertainty and Information about CO2 emissions," Tinbergen Institute Discussion Papers 20-059/I, Tinbergen Institute.
    10. Ding, Shuze & Lugovskyy, Volodymyr & Puzzello, Daniela & Tucker, Steven & Williams, Arlington, 2018. "Cash versus extra-credit incentives in experimental asset markets," Journal of Economic Behavior & Organization, Elsevier, vol. 150(C), pages 19-27.
    11. Caleb A. Cox & Brock Stoddard, 2021. "Common-Value Public Goods and Informational Social Dilemmas," American Economic Journal: Microeconomics, American Economic Association, vol. 13(2), pages 343-369, May.
    12. Bulte, Erwin & Di Falco, Salvatore & Lensink, Robert, 2020. "Randomized interventions and “real” treatment effects: A cautionary tale and an example," World Development, Elsevier, vol. 127(C).
    13. Demiral, Elif E. & Mollerstrom, Johanna, 2020. "The entitlement effect in the ultimatum game – does it even exist?," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 341-352.
    14. Takeuchi, Ai & Seki, Erika, 2023. "Coordination and free-riding problems in the provision of multiple public goods," Journal of Economic Behavior & Organization, Elsevier, vol. 206(C), pages 95-121.
    15. Igor Asanov & Christoph Buehren & Panagiota Zacharodimou, 2020. "The power of experiments: How big is your n?," MAGKS Papers on Economics 202032, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    16. Schöller, Vanessa & Ulmer, Clara, 2023. "Can monetized carbon information increase pro-environmental behavior? Experimental evidence," Ecological Economics, Elsevier, vol. 206(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luigi Butera & Philip Grossman & Daniel Houser & John List & Marie-Claire Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science - With an Application to the Public Goods Game," Artefactual Field Experiments 00684, The Field Experiments Website.
    2. Luigi Butera & Philip J Grossman & Daniel Houser & John A List & Marie Claire Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science With An Application to the Public Goods GameA Review," Working Papers halshs-02512932, HAL.
    3. Ananish Chaudhuri, 2011. "Sustaining cooperation in laboratory public goods experiments: a selective survey of the literature," Experimental Economics, Springer;Economic Science Association, vol. 14(1), pages 47-83, March.
    4. Boosey, Luke A., 2017. "Conditional cooperation in network public goods experiments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 69(C), pages 108-116.
    5. Marie Claire Villeval, 2012. "Contribution au bien public et préférences sociales : Apports récents de l'économie comportementale," Post-Print halshs-00681348, HAL.
    6. Kurt A. Ackermann & Ryan O. Murphy, 2019. "Explaining Cooperative Behavior in Public Goods Games: How Preferences and Beliefs Affect Contribution Levels," Games, MDPI, vol. 10(1), pages 1-34, March.
    7. Chaudhuri, Ananish & Paichayontvijit, Tirnud & Smith, Alexander, 2017. "Belief heterogeneity and contributions decay among conditional cooperators in public goods games," Journal of Economic Psychology, Elsevier, vol. 58(C), pages 15-30.
    8. Simon Gaechter, 2014. "Human Pro-Social Motivation and the Maintenance of Social Order," CESifo Working Paper Series 4729, CESifo.
    9. Gächter, Simon & Kölle, Felix & Quercia, Simone, 2022. "Preferences and perceptions in Provision and Maintenance public goods," Games and Economic Behavior, Elsevier, vol. 135(C), pages 338-355.
    10. Billur Aksoy & Silvana Krasteva, 2020. "When does less information translate into more giving to public goods?," Experimental Economics, Springer;Economic Science Association, vol. 23(4), pages 1148-1177, December.
    11. Urs Fischbacher & Simon Gachter, 2010. "Social Preferences, Beliefs, and the Dynamics of Free Riding in Public Goods Experiments," American Economic Review, American Economic Association, vol. 100(1), pages 541-556, March.
    12. Bodo Sturm & Joachim Weimann, 2006. "Experiments in Environmental Economics and Some Close Relatives," Journal of Economic Surveys, Wiley Blackwell, vol. 20(3), pages 419-457, July.
    13. Arifovic, Jasmina & Ledyard, John, 2012. "Individual evolutionary learning, other-regarding preferences, and the voluntary contributions mechanism," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 808-823.
    14. Barron, Kai & Nurminen, Tuomas, 2018. "Nudging cooperation," Discussion Papers, Research Unit: Economics of Change SP II 2018-305, WZB Berlin Social Science Center.
    15. Christoph Engel & Bettina Rockenbach, 2009. "We Are Not Alone: The Impact of Externalities on Public Good Provision," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2009_29, Max Planck Institute for Research on Collective Goods, revised May 2011.
    16. Reuben, Ernesto & Riedl, Arno, 2013. "Enforcement of contribution norms in public good games with heterogeneous populations," Games and Economic Behavior, Elsevier, vol. 77(1), pages 122-137.
    17. Barron, Kai & Nurminen, Tuomas, 2020. "Nudging cooperation in public goods provision," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 88, pages 1-1.
    18. Felix Koelle, 2012. "Heterogeneity and Cooperation in Privileged Groups: The Role of Capability and Valuation on Public Goods Provision," Cologne Graduate School Working Paper Series 03-08, Cologne Graduate School in Management, Economics and Social Sciences.
    19. Karakostas, Alexandros & Kocher, Martin & Matzat, Dominik & Rau, Holger A. & Riewe, Gerhard, 2021. "The team allocator game: Allocation power in public goods games," University of Göttingen Working Papers in Economics 419, University of Goettingen, Department of Economics.
    20. Baader, Malte & Gächter, Simon & Lee, Kyeongtae & Sefton, Martin, 2022. "Social Preferences and the Variability of Conditional Cooperation," IZA Discussion Papers 15523, Institute of Labor Economics (IZA).

    More about this item

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior
    • H4 - Public Economics - - Publicly Provided Goods
    • D64 - Microeconomics - - Welfare Economics - - - Altruism; Philanthropy; Intergenerational Transfers

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:23335. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.