IDEAS home Printed from https://ideas.repec.org/p/hal/wpaper/halshs-01651080.html
   My bibliography  Save this paper

Replication in experimental economics: A historical and quantitative approach focused on public good game experiments

Author

Listed:
  • Nicolas Vallois

    (CRIISEA - Centre de Recherche sur les Institutions, l'Industrie et les Systèmes Économiques d'Amiens - UR UPJV 3908 - UPJV - Université de Picardie Jules Verne)

  • Dorian Jullien

    (GREDEG - Groupe de Recherche en Droit, Economie et Gestion - UNS - Université Nice Sophia Antipolis (... - 2019) - COMUE UCA - COMUE Université Côte d'Azur (2015 - 2019) - CNRS - Centre National de la Recherche Scientifique - UCA - Université Côte d'Azur)

Abstract

We propose a historical perspective on replication in experimental economics focused on public good games. Our intended contribution is twofold: in terms of method and in terms of object. Methodologically, we blend traditional qualitative history of economics with a less traditional quantitative approach using basic econometric tools to detect unnoticed historical patterns of replication. In terms of our object, we highlight a type of replication that we call " baseline replication " , which is not present in explicit methodological discussions, yet central in the specificity of experimental economics regarding replication in economics.

Suggested Citation

  • Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Working Papers halshs-01651080, HAL.
  • Handle: RePEc:hal:wpaper:halshs-01651080
    Note: View the original document on HAL open archive server: https://halshs.archives-ouvertes.fr/halshs-01651080
    as

    Download full text from publisher

    File URL: https://halshs.archives-ouvertes.fr/halshs-01651080/document
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Andreoni, James, 1988. "Why free ride? : Strategies and learning in public goods experiments," Journal of Public Economics, Elsevier, vol. 37(3), pages 291-304, December.
    2. Andrew C. Chang & Phillip Li, 2017. "A Preanalysis Plan to Replicate Sixty Economics Research Papers That Worked Half of the Time," American Economic Review, American Economic Association, vol. 107(5), pages 60-64, May.
    3. Jennifer Zelmer, 2003. "Linear Public Goods Experiments: A Meta-Analysis," Experimental Economics, Springer;Economic Science Association, vol. 6(3), pages 299-310, November.
    4. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
    5. Frank Mueller-Langer & Benedikt Fecher & Dietmar Harhoff & Gert G. Wagner, 2017. "The Economics of Replication," Discussion Papers of DIW Berlin 1640, DIW Berlin, German Institute for Economic Research.
    6. Calvin Blackwell, 2007. "A Meta-Analysis of Tax Compliance Experiments," International Center for Public Policy Working Paper Series, at AYSPS, GSU paper0724, International Center for Public Policy, Andrew Young School of Policy Studies, Georgia State University.
    7. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    8. Daniel S. Hamermesh, 2017. "Replication in Labor Economics: Evidence from Data, and What It Suggests," American Economic Review, American Economic Association, vol. 107(5), pages 37-40, May.
    9. Johnson, Noel D. & Mislin, Alexandra A., 2011. "Trust games: A meta-analysis," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 865-889.
    10. Rachel Croson & Melanie Marks, 2000. "Step Returns in Threshold Public Goods: A Meta- and Experimental Analysis," Experimental Economics, Springer;Economic Science Association, vol. 2(3), pages 239-259, March.
    11. Urs Fischbacher & Simon Gachter, 2010. "Social Preferences, Beliefs, and the Dynamics of Free Riding in Public Goods Experiments," American Economic Review, American Economic Association, vol. 100(1), pages 541-556, March.
    12. Andreas Ortman & Le Zhang, 2013. "Exploring the Meaning of Significance in Experimental Economics," Discussion Papers 2013-32, School of Economics, The University of New South Wales.
    13. Attila Ambrus & Ben Greiner, 2012. "Imperfect Public Monitoring with Costly Punishment: An Experimental Study," American Economic Review, American Economic Association, vol. 102(7), pages 3317-3332, December.
    14. Nikiforakis, Nikos, 2008. "Punishment and counter-punishment in public good games: Can we really govern ourselves," Journal of Public Economics, Elsevier, vol. 92(1-2), pages 91-112, February.
    15. repec:ebl:ecbull:v:3:y:2006:i:8:p:1-14 is not listed on IDEAS
    16. Michael Clemens, 2015. "The Meaning of Failed Replications: A Review and Proposal - Working Paper 399," Working Papers 399, Center for Global Development.
    17. Maren Duvendack & Richard W. Palmer-Jones & W. Robert Reed, 2015. "Replications in Economics: A Progress Report," Econ Journal Watch, Econ Journal Watch, vol. 12(2), pages 164–191-1, May.
    18. Marco Percoco & Peter Nijkamp, 2009. "Estimating individual rates of discount: a meta-analysis," Applied Economics Letters, Taylor & Francis Journals, vol. 16(12), pages 1235-1239.
    19. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    20. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    21. repec:ebl:ecbull:v:3:y:2007:i:68:p:1-7 is not listed on IDEAS
    22. repec:feb:artefa:0087 is not listed on IDEAS
    23. Ananish Chaudhuri, 2011. "Sustaining cooperation in laboratory public goods experiments: a selective survey of the literature," Experimental Economics, Springer;Economic Science Association, vol. 14(1), pages 47-83, March.
    24. David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 144-161, March.
    25. Marwell, Gerald & Ames, Ruth E., 1981. "Economists free ride, does anyone else? : Experiments on the provision of public goods, IV," Journal of Public Economics, Elsevier, vol. 15(3), pages 295-310, June.
    26. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    27. McCullough, B. D. & McGeary, Kerry Anne & Harrison, Teresa D., 2006. "Lessons from the JMCB Archive," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(4), pages 1093-1107, June.
    28. Cary A. Deck & Enrique Fatas & Tanya Rosenblat (ed.), 2015. "Replication in Experimental Economics," Research in Experimental Economics, Emerald Publishing Ltd, volume 18, number rexe.2015.18, July.
    29. Tyler Prante & Robert P. Berrens & Jennifer A. Thacher, 2007. "Evaluating coasean bargaining experiments with meta-analysis," Economics Bulletin, AccessEcon, vol. 3(68), pages 1-7.
    30. Lucas C. Coffman & Muriel Niederle, 2015. "Pre-analysis Plans Have Limited Upside, Especially Where Replications Are Feasible," Journal of Economic Perspectives, American Economic Association, vol. 29(3), pages 81-98, Summer.
    31. Guala,Francesco, 2005. "The Methodology of Experimental Economics," Cambridge Books, Cambridge University Press, number 9780521618618.
    32. Plott, Charles R, 1982. "Industrial Organization Theory and Experimental Economics," Journal of Economic Literature, American Economic Association, vol. 20(4), pages 1485-1527, December.
    33. Roger Koenker & Achim Zeileis, 2009. "On reproducible econometric research," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(5), pages 833-847.
    34. Sandip Sukhtankar, 2017. "Replications in Development Economics," American Economic Review, American Economic Association, vol. 107(5), pages 32-36, May.
    35. Friedrich Schneider & Werner W. Pommerehne, 1981. "Free Riding and Collective Action: An Experiment in Public Microeconomics," The Quarterly Journal of Economics, Oxford University Press, vol. 96(4), pages 689-704.
    36. Vernon L. Smith, 1994. "Economics in the Laboratory," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 113-131, Winter.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01651080, HAL.
    2. Nicolas Vallois & Dorian Jullien, 2017. "Replication in Experimental Economics: A Historical and Quantitative Approach Focused on Public Good Game Experiments," GREDEG Working Papers 2017-21, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    3. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    4. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," Research Policy, Elsevier, vol. 48(1), pages 62-83.
    5. Maurizio Canavari & Andreas C. Drichoutis & Jayson L. Lusk & Rodolfo M. Nayga, Jr., 2018. "How to run an experimental auction: A review of recent advances," Working Papers 2018-5, Agricultural University of Athens, Department Of Agricultural Economics.
    6. Christophe Hurlin & Christophe Pérignon, 2020. "Reproducibility Certification in Economics Research," Working Papers hal-02896404, HAL.
    7. Valérie Orozco & Christophe Bontemps & Elise Maigne & Virginie Piguet & Annie Hofstetter & Anne Marie Lacroix & Fabrice Levert & Jean-Marc Rousselle, 2017. "How to make a pie? Reproducible Research for Empirical Economics & Econometrics," Post-Print hal-01939942, HAL.
    8. Luigi Butera & Philip J. Grossman & Daniel Houser & John A. List & Marie-Claire Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science-With An Application to the Public Goods Game," NBER Working Papers 26801, National Bureau of Economic Research, Inc.
    9. Hernández Alemán, Anastasia & León, Carmelo J., 2018. "La Réplica en el Análisis Económico Aplicado/Replication in Applied Economic Analysis," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 36, pages 317-332, Enero.
    10. Kenju Kamei & Louis Putterman & Jean-Robert Tyran, 2015. "State or nature? Endogenous formal versus informal sanctions in the voluntary provision of public goods," Experimental Economics, Springer;Economic Science Association, vol. 18(1), pages 38-65, March.
    11. Luigi Butera & Philip Grossman & Daniel Houser & John List & Marie Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science With An Application to the Public Goods GameA Review," Working Papers halshs-02512932, HAL.
    12. Roy Chen & Yan Chen & Yohanes E. Riyanto, 2021. "Best practices in replication: a case study of common information in coordination games," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 2-30, March.
    13. Nicolas Vallois & Dorian Jullien, 2017. "Estimating Rationality in Economics: A History of Statistical Methods in Experimental Economics," Working Papers halshs-01651070, HAL.
    14. Felix Koelle, 2012. "Heterogeneity and Cooperation in Privileged Groups: The Role of Capability and Valuation on Public Goods Provision," Cologne Graduate School Working Paper Series 03-08, Cologne Graduate School in Management, Economics and Social Sciences.
    15. Karakostas, Alexandros & Kocher, Martin & Matzat, Dominik & Rau, Holger A. & Riewe, Gerhard, 2021. "The team allocator game: Allocation power in public goods games," Center for European, Governance and Economic Development Research Discussion Papers 419, University of Goettingen, Department of Economics.
    16. Nicolas Vallois & Dorian Jullien, 2017. "Estimating Rationality in Economics: A History of Statistical Methods in Experimental Economics," GREDEG Working Papers 2017-20, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    17. Simon Gaechter, 2014. "Human Pro-Social Motivation and the Maintenance of Social Order," CESifo Working Paper Series 4729, CESifo.
    18. Nicolas Vallois & Dorian Jullien, 2018. "A History of Statistical Methods in Experimental Economics," Post-Print halshs-01651070, HAL.
    19. Khadjavi, Menusch & Lange, Andreas & Nicklisch, Andreas, 2014. "The Social Value of Transparency and Accountability: Experimental Evidence from Asymmetric Public Good Games," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100512, Verein für Socialpolitik / German Economic Association.
    20. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2020. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics (RM/19/029-revised-)," Research Memorandum 014, Maastricht University, Graduate School of Business and Economics (GSBE).

    More about this item

    Keywords

    Methodology; Public Good Experiments; History of Economic Thought; Replication; Experimental Economics;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:wpaper:halshs-01651080. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://hal.archives-ouvertes.fr/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.