IDEAS home Printed from https://ideas.repec.org/p/gre/wpaper/2017-20.html
   My bibliography  Save this paper

Estimating Rationality in Economics: A History of Statistical Methods in Experimental Economics

Author

Listed:
  • Nicolas Vallois

    (Université Picardie Jules Verne
    CRIISEA)

  • Dorian Jullien

    (Université Côte d'Azur
    GREDEG CNRS)

Abstract

Experimental economists increasingly apply econometric techniques to interpret their data, as suggested the emergence of "experimetrics" in the 2000's (Camerer, 2003; Houser, 2008; Moffatt, 2015). Yet statistics remains a minor topic in experimental economics' (EE) methodology. This article aims to study the historical roots of this present paradox. To do so, we analyze the use of statistical tools in EE from early economics experiments of the 1940's-1950's to the present days. Our narrative is based on qualitative analysis of published papers for the earliest periods and on bibliometric and quantitative approaches for the more recent time period. Our results reveal a significant change in EE' statistical methods, from purely descriptive methods to more sophisticated and standardized techniques. Statistics now plays a decisive role in the way EE estimates rationality, particularly in structural modeling approaches, but it is still considered as a non-methodological, because purely technical, matter. Our historical analysis shows that this technical conception was the result of a long-run evolution of research tactics in EE, that notably allowed experimental economists to escape from psychologist's more re exive culture toward statistics.

Suggested Citation

  • Nicolas Vallois & Dorian Jullien, 2017. "Estimating Rationality in Economics: A History of Statistical Methods in Experimental Economics," GREDEG Working Papers 2017-20, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
  • Handle: RePEc:gre:wpaper:2017-20
    as

    Download full text from publisher

    File URL: http://www.gredeg.cnrs.fr/working-papers/GREDEG-WP-2017-20.pdf
    File Function: First version, 2017
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Matthew T. Panhans & John D. Singleton, 2015. "The Empirical Economist's Toolkit: From Models to Methods," Center for the History of Political Economy Working Paper Series 2015-3, Center for the History of Political Economy.
    2. Stephen W. Rousseas & Albert G. Hart, 1951. "Experimental Verification of a Composite Indifference Map," Journal of Political Economy, University of Chicago Press, vol. 59, pages 288-288.
    3. Kevin Hoover & Mark Siegler, 2008. "The rhetoric of 'Signifying nothing': a rejoinder to Ziliak and McCloskey," Journal of Economic Methodology, Taylor & Francis Journals, vol. 15(1), pages 57-68.
    4. Güth, Werner & Kocher, Martin G., 2014. "More than thirty years of ultimatum bargaining experiments: Motives, variations, and a survey of the recent literature," Journal of Economic Behavior & Organization, Elsevier, vol. 108(C), pages 396-409.
    5. El-Gamal, Mahmoud A & Palfrey, Thomas R, 1996. "Economical Experiments: Bayesian Efficient Experimental Design," International Journal of Game Theory, Springer;Game Theory Society, vol. 25(4), pages 495-517.
    6. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    7. Charles Bellemare & Luc Bissonnette & Sabine Kröger, 2016. "Simulating power of economic experiments: the powerBBK package," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 2(2), pages 157-168, November.
    8. F. T. Dolbear & L. B. Lave & G. Bowman & A. Lieberman & E. Prescott & F. Rueter & R. Sherman, 1968. "Collusion in Oligopoly: An Experiment on the Effect of Numbers and Information," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 82(2), pages 240-259.
    9. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    10. Andreas Ortman & Le Zhang, 2013. "Exploring the Meaning of Significance in Experimental Economics," Discussion Papers 2013-32, School of Economics, The University of New South Wales.
    11. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    12. Urs Fischbacher & Simon Gachter, 2010. "Social Preferences, Beliefs, and the Dynamics of Free Riding in Public Goods Experiments," American Economic Review, American Economic Association, vol. 100(1), pages 541-556, March.
    13. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten Igel & Rutström, Elisabet E., 2010. "Behavioral econometrics for psychologists," Journal of Economic Psychology, Elsevier, vol. 31(4), pages 553-576, August.
    14. Lester B. Lave, 1962. "An Empirical Approach to the Prisoners' Dilemma Game," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 76(3), pages 424-436.
    15. Vernon L. Smith, 1962. "An Experimental Study of Competitive Market Behavior," Journal of Political Economy, University of Chicago Press, vol. 70, pages 111-111.
    16. Loewenstein, George, 1987. "Anticipation and the Valuation of Delayed Consumption," Economic Journal, Royal Economic Society, vol. 97(387), pages 666-684, September.
    17. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    18. Harry J. Paarsch & Han Hong, 2006. "An Introduction to the Structural Econometrics of Auction Data," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262162350, December.
    19. Joseph L. Bower, 1965. "The Role of Conflict in Economic Decision-Making Groups: Some Empirical Results," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 79(2), pages 263-277.
    20. Kevin Hoover & Mark Siegler, 2008. "Sound and fury: McCloskey and significance testing in economics," Journal of Economic Methodology, Taylor & Francis Journals, vol. 15(1), pages 1-37.
    21. Contini, Bruno, 1970. "The Value of Time in Bargaining Negotiations: A Dynamic Model," Kyklos, Wiley Blackwell, vol. 23(2), pages 255-271.
    22. Ivan Moscati, 2007. "Early Experiments in Consumer Demand Theory: 1930-1970," History of Political Economy, Duke University Press, vol. 39(3), pages 359-401, Fall.
    23. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    24. Vesna Prasnikar & Alvin E. Roth, 1992. "Considerations of Fairness and Strategy: Experimental Data from Sequential Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(3), pages 865-888.
    25. Deirdre N. McCloskey & Stephen T. Ziliak, 1996. "The Standard Error of Regressions," Journal of Economic Literature, American Economic Association, vol. 34(1), pages 97-114, March.
    26. Marco Cipriani & Riccardo Costantini & Antonio Guarino, 2012. "A Bayesian approach to experimental analysis: trading in a laboratory financial market," Review of Economic Design, Springer;Society for Economic Design, vol. 16(2), pages 175-191, September.
    27. Charles N. Noussair & Steven Tucker, 2013. "Experimental Research On Asset Pricing," Journal of Economic Surveys, Wiley Blackwell, vol. 27(3), pages 554-569, July.
    28. Durham, Yvonne & Hirshleifer, Jack & Smith, Vernon L, 1998. "Do the Rich Get Richer and the Poor Poorer? Experimental Tests of a Model of Power," American Economic Review, American Economic Association, vol. 88(4), pages 970-983, September.
    29. Biddle, Jeff, 2017. "2016 Hes Presidential Address: Statistical Inference In Economics, 1920–1965: Changes In Meaning And Practice," Journal of the History of Economic Thought, Cambridge University Press, vol. 39(2), pages 149-173, June.
    30. William Fellner, 1961. "Distortion of Subjective Probabilities as a Reaction to Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 75(4), pages 670-689.
    31. Frederick Mosteller & Philip Nogee, 1951. "An Experimental Measurement of Utility," Journal of Political Economy, University of Chicago Press, vol. 59, pages 371-371.
    32. Vernon L. Smith, 1964. "Effect of Market Organization on Competitive Equilibrium," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 78(2), pages 181-201.
    33. Martin Shubik, 1962. "Some Experimental Non-Zero Sum Games with Lack of Information About the Rules," Management Science, INFORMS, vol. 8(2), pages 215-234, January.
    34. Frechette, Guillaume R. & Schotter, Andrew (ed.), 2015. "Handbook of Experimental Economic Methodology," OUP Catalogue, Oxford University Press, number 9780195328325.
    35. repec:feb:artefa:0087 is not listed on IDEAS
    36. Ananish Chaudhuri, 2011. "Sustaining cooperation in laboratory public goods experiments: a selective survey of the literature," Experimental Economics, Springer;Economic Science Association, vol. 14(1), pages 47-83, March.
    37. Deirdre McCloskey & Stephen Ziliak, 2008. "Signifying nothing: reply to Hoover and Siegler," Journal of Economic Methodology, Taylor & Francis Journals, vol. 15(1), pages 39-55.
    38. Guala,Francesco, 2005. "The Methodology of Experimental Economics," Cambridge Books, Cambridge University Press, number 9780521618618.
    39. Ziliak, Stephen T., 2014. "Balanced versus Randomized Field Experiments in Economics: Why W. S. Gosset aka "Student" Matters," Review of Behavioral Economics, now publishers, vol. 1(1-2), pages 167-208, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicolas Vallois & Dorian Jullien, 2017. "Estimating Rationality in Economics: A History of Statistical Methods in Experimental Economics," Working Papers halshs-01651070, HAL.
    2. Nicolas Vallois & Dorian Jullien, 2018. "A history of statistical methods in experimental economics," The European Journal of the History of Economic Thought, Taylor & Francis Journals, vol. 25(6), pages 1455-1492, November.
    3. Nicolas Vallois & Dorian Jullien, 2017. "Replication in experimental economics: A historical and quantitative approach focused on public good game experiments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01651080, HAL.
    4. Fiore, Annamaria, 2009. "Experimental Economics: Some Methodological Notes," MPRA Paper 12498, University Library of Munich, Germany.
    5. Nicolas Vallois & Dorian Jullien, 2017. "Replication in Experimental Economics: A Historical and Quantitative Approach Focused on Public Good Game Experiments," GREDEG Working Papers 2017-21, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    6. Peter J. Veazie, 2015. "Understanding Statistical Testing," SAGE Open, , vol. 5(1), pages 21582440145, January.
    7. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    8. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    9. Alessandro Innocenti, 2008. "How can a psychologist inform economics? The strange case of Sidney Siegel," Department of Economic Policy, Finance and Development (DEPFID) University of Siena 0808, Department of Economic Policy, Finance and Development (DEPFID), University of Siena.
    10. Dorian Jullien & Nicolas Vallois, 2014. "A probabilistic ghost in the experimental machine," Journal of Economic Methodology, Taylor & Francis Journals, vol. 21(3), pages 232-250, September.
    11. Gizatulina, Alia & Gorelkina, Olga, 2021. "Selling “Money” on eBay: A field study of surplus division," Journal of Economic Behavior & Organization, Elsevier, vol. 181(C), pages 19-38.
    12. Loerakker, Ben & Bault, Nadège & Hoyer, Maximilian & van Winden, Frans, 2022. "On the Development of Cooperative and Antagonistic Relationships in Public Good Environments. A Model-Based Experimental Study," OSF Preprints wur7c, Center for Open Science.
    13. Goeschl, Timo & Kettner, Sara Elisa & Lohse, Johannes & Schwieren, Christiane, 2015. "What do we learn from public good games about voluntary climate action? Evidence from an artefactual field experiment," Working Papers 0595, University of Heidelberg, Department of Economics.
    14. Tom Engsted, 2009. "Statistical vs. Economic Significance in Economics and Econometrics: Further comments on McCloskey & Ziliak," CREATES Research Papers 2009-17, Department of Economics and Business Economics, Aarhus University.
    15. Alejandro Lee-Penagos, 2016. "Modelling Contributions in Public Good Games with Punishment," Discussion Papers 2016-15, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    16. Jinkwon Lee, 2007. "Repetition And Financial Incentives In Economics Experiments," Journal of Economic Surveys, Wiley Blackwell, vol. 21(3), pages 628-681, July.
    17. John A. List, 2024. "Optimally generate policy-based evidence before scaling," Nature, Nature, vol. 626(7999), pages 491-499, February.
    18. Omar Al-Ubaydli & John A. List, 2019. "How natural field experiments have enhanced our understanding of unemployment," Nature Human Behaviour, Nature, vol. 3(1), pages 33-39, January.
    19. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2020. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics (RM/19/029-revised-)," Research Memorandum 014, Maastricht University, Graduate School of Business and Economics (GSBE).
    20. Omar Al-Ubaydli & John List, 2016. "Field Experiments in Markets," Artefactual Field Experiments j0002, The Field Experiments Website.

    More about this item

    Keywords

    Experimental Economics; Statistics; Econometrics; History of Economic Thought; Methodology;
    All these keywords.

    JEL classification:

    • B20 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - General
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gre:wpaper:2017-20. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Patrice Bougette (email available below). General contact details of provider: https://edirc.repec.org/data/credcfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.