IDEAS home Printed from https://ideas.repec.org/p/uea/wcbess/09-17.html
   My bibliography  Save this paper

A test of the experimental method

Author

Listed:
  • Shaun P. Hargreaves Heap

    (University of East Anglia)

  • Arjan Verschoor

    (University of East Anglia)

  • Daniel John Zizzo

    (University of East Anglia)

Abstract

Do the insights into human behavior generated by laboratory experiments hold outside the lab? This is the crucial question of external validity that naturally troubles both experimentalists and their critics. We address this question by adopting Popper's injunction that hypotheses should be tested, not by seeking instances of confirmation, but through exposure to conditions where falsification is a serious possibility. We select a population where the non-experimental evidence points to behavior which is quite unlike what is typically found in the laboratory and we examine whether their experimental results track these untypical behaviors. In our case, they do.

Suggested Citation

  • Shaun P. Hargreaves Heap & Arjan Verschoor & Daniel John Zizzo, 2009. "A test of the experimental method," Working Paper series, University of East Anglia, Centre for Behavioural and Experimental Social Science (CBESS) 09-17, School of Economics, University of East Anglia, Norwich, UK..
  • Handle: RePEc:uea:wcbess:09-17
    as

    Download full text from publisher

    File URL: https://ueaeco.github.io/working-papers/papers/cbess/UEA-CBESS-09-17.pdf
    File Function: main text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Guala,Francesco, 2005. "The Methodology of Experimental Economics," Cambridge Books, Cambridge University Press, number 9780521618618.
    2. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grüner Sven, 2020. "Sample Size Calculation in Economic Experiments," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 240(6), pages 791-823, December.
    2. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    3. Katherine Farrow & Gilles Grolleau & Naoufel Mzoughi, 2018. "What in the Word! The Scope for the Effect of Word Choice on Economic Behavior," Kyklos, Wiley Blackwell, vol. 71(4), pages 557-580, November.
    4. Nicolas Vallois & Dorian Jullien, 2017. "Estimating Rationality in Economics: A History of Statistical Methods in Experimental Economics," Working Papers halshs-01651070, HAL.
    5. Nicolas Vallois & Dorian Jullien, 2018. "A history of statistical methods in experimental economics," The European Journal of the History of Economic Thought, Taylor & Francis Journals, vol. 25(6), pages 1455-1492, November.
    6. Croson, Rachel & Gächter, Simon, 2010. "The science of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 73(1), pages 122-131, January.
    7. Jordi Tena‐Sánchez & Francisco J. León‐Medina & José A. Noguera, 2020. "Empathic cultural consumers: Pay what you want in the theater," Journal of Consumer Affairs, Wiley Blackwell, vol. 54(4), pages 1213-1245, December.
    8. Dorian Jullien & Nicolas Vallois, 2014. "A probabilistic ghost in the experimental machine," Journal of Economic Methodology, Taylor & Francis Journals, vol. 21(3), pages 232-250, September.
    9. Hanna J. Ihli & Syster C. Maart-Noelck & Oliver Musshoff, 2014. "Does timing matter? A real options experiment to farmers' investment and disinvestment behaviours," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 58(3), pages 430-452, July.
    10. Luis Roberto Martínez & Christian Jaramillo & Nicolas De Roux & Juan-Camilo Cárdenas, 2010. "It´s Not My Money: An Experiment on Risk Aversion and the House-money Effect," Documentos CEDE 6712, Universidad de los Andes, Facultad de Economía, CEDE.
    11. Emin Karagözoğlu & Ümit Barış Urhan, 2017. "The Effect of Stake Size in Experimental Bargaining and Distribution Games: A Survey," Group Decision and Negotiation, Springer, vol. 26(2), pages 285-325, March.
    12. Nicolas Vallois & Dorian Jullien, 2017. "Estimating Rationality in Economics: A History of Statistical Methods in Experimental Economics," GREDEG Working Papers 2017-20, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    13. Jürgen Strohhecker, 2016. "Factors influencing strategy implementation decisions: an evaluation of a balanced scorecard cockpit, intelligence, and knowledge," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 27(1), pages 89-119, February.
    14. Fiore, Annamaria, 2009. "Experimental Economics: Some Methodological Notes," MPRA Paper 12498, University Library of Munich, Germany.
    15. Gruener, Sven, 2018. "Sample size calculations in economic RCTs: following clinical studies?," SocArXiv 43zbg, Center for Open Science.
    16. John Duffy, 2011. "Trust in Second Life," Southern Economic Journal, John Wiley & Sons, vol. 78(1), pages 53-62, July.
    17. Gruener, Sven & Lehberger, Mira & Hirschauer, Norbert & Mußhoff, Oliver, 2021. "How (un-)informative are experiments with “standard subjects” for other social groups? – The case of agricultural students and farmers," SocArXiv psda5, Center for Open Science.
    18. Juan Cárdenas & Nicolas Roux & Christian Jaramillo & Luis Martinez, 2014. "Is it my money or not? An experiment on risk aversion and the house-money effect," Experimental Economics, Springer;Economic Science Association, vol. 17(1), pages 47-60, March.
    19. Wettstein, Dominik J. & Boes, Stefan, 2022. "How value-based policy interventions influence price negotiations for new medicines: An experimental approach and initial evidence," Health Policy, Elsevier, vol. 126(2), pages 112-121.
    20. Potters, Jan & Stoop, Jan, 2016. "Do cheaters in the lab also cheat in the field?," European Economic Review, Elsevier, vol. 87(C), pages 26-33.

    More about this item

    Keywords

    external validity; experiments; trust; groups; discrimination;
    All these keywords.

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • Z13 - Other Special Topics - - Cultural Economics - - - Economic Sociology; Economic Anthropology; Language; Social and Economic Stratification

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uea:wcbess:09-17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Cara Liggins (email available below). General contact details of provider: https://edirc.repec.org/data/esueauk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.