IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v81y2012i1p1-8.html
   My bibliography  Save this article

Experimental methods: Between-subject and within-subject design

Author

Listed:
  • Charness, Gary
  • Gneezy, Uri
  • Kuhn, Michael A.

Abstract

In this article we explore the issues that surround within-subject and between-subject designs. We describe experiments in economics and in psychology that make comparisons using either of these designs (or both) that sometimes yield the same results and sometimes do not. The overall goal is to establish a framework for understanding which critical questions need to be asked about such experimental studies, what authors of such studies can do to ameliorate fears of confoundedness, and which scenarios are particularly susceptible to divergent results from the two approaches. Overall, we find that both designs have their merits, and the choice of designs should be carefully considered in the context of the question being studied and in terms of the practical implementation of the research study.

Suggested Citation

  • Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2012. "Experimental methods: Between-subject and within-subject design," Journal of Economic Behavior & Organization, Elsevier, vol. 81(1), pages 1-8.
  • Handle: RePEc:eee:jeborg:v:81:y:2012:i:1:p:1-8
    DOI: 10.1016/j.jebo.2011.08.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268111002289
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jebo.2011.08.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Richard Carson & Nicholas Flores & Norman Meade, 2001. "Contingent Valuation: Controversies and Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 19(2), pages 173-210, June.
    2. Andreoni, James & Samuelson, Larry, 2006. "Building rational cooperation," Journal of Economic Theory, Elsevier, vol. 127(1), pages 117-154, March.
    3. James Andreoni, 1995. "Warm-Glow versus Cold-Prickle: The Effects of Positive and Negative Framing on Cooperation in Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(1), pages 1-21.
    4. Hsee, Christopher K., 1996. "The Evaluability Hypothesis: An Explanation for Preference Reversals between Joint and Separate Evaluations of Alternatives," Organizational Behavior and Human Decision Processes, Elsevier, vol. 67(3), pages 247-257, September.
    5. Kahneman, Daniel & Ritov, Ilana, 1994. "Determinants of Stated Willingness to Pay for Public Goods: A Study in the Headline Method," Journal of Risk and Uncertainty, Springer, vol. 9(1), pages 5-38, July.
    6. Budescu, David V. & Weiss, Wendy, 1987. "Reflection of transitive and intransitive preferences: A test of prospect theory," Organizational Behavior and Human Decision Processes, Elsevier, vol. 39(2), pages 184-202, April.
    7. R. Mark Isaac & James M. Walker, 1988. "Group Size Effects in Public Goods Provision: The Voluntary Contributions Mechanism," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 103(1), pages 179-199.
    8. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    9. Brookshire, David S. & Ives, Berry C. & Schulze, William D., 1976. "The valuation of aesthetic preferences," Journal of Environmental Economics and Management, Elsevier, vol. 3(4), pages 325-346, December.
    10. Uri Gneezy, 2005. "Deception: The Role of Consequences," American Economic Review, American Economic Association, vol. 95(1), pages 384-394, March.
    11. Kahneman, Daniel & Knetsch, Jack L., 1992. "Valuing public goods: The purchase of moral satisfaction," Journal of Environmental Economics and Management, Elsevier, vol. 22(1), pages 57-70, January.
    12. Craig R. Fox & Amos Tversky, 1995. "Ambiguity Aversion and Comparative Ignorance," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(3), pages 585-603.
    13. Epley, Nicholas & Gneezy, Ayelet, 2007. "The framing of financial windfalls and implications for public policy," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 36(1), pages 36-47, February.
    14. Isaac, R Mark & Walker, James M, 1988. "Communication and Free-Riding Behavior: The Voluntary Contribution Mechanism," Economic Inquiry, Western Economic Association International, vol. 26(4), pages 585-608, October.
    15. Hsee, Christopher K & Leclerc, France, 1998. "Will Products Look More Attractive When Presented Separately or Together?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 25(2), pages 175-186, September.
    16. Simon Gachter & Ernst Fehr, 2000. "Cooperation and Punishment in Public Goods Experiments," American Economic Review, American Economic Association, vol. 90(4), pages 980-994, September.
    17. Tversky, Amos & Kahneman, Daniel, 1986. "Rational Choice and the Framing of Decisions," The Journal of Business, University of Chicago Press, vol. 59(4), pages 251-278, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bougherara, Douadia & Denant-Boemont, Laurent & Masclet, David, 2011. "Cooperation and framing effects in provision point mechanisms: Experimental evidence," Ecological Economics, Elsevier, vol. 70(6), pages 1200-1210, April.
    2. Richard Carson & Nicholas Flores & Norman Meade, 2001. "Contingent Valuation: Controversies and Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 19(2), pages 173-210, June.
    3. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    4. Bogliacino, Francesco & Codagnone, Cristiano, 2021. "Microfoundations, behaviour, and evolution: Evidence from experiments," Structural Change and Economic Dynamics, Elsevier, vol. 56(C), pages 372-385.
    5. France Leclerc & Christopher K. Hsee & Joseph C. Nunes, 2005. "Narrow Focusing: Why the Relative Position of a Good in Its Category Matters More Than It Should," Marketing Science, INFORMS, vol. 24(2), pages 194-205, August.
    6. Matthew Rabin, 1998. "Psychology and Economics," Journal of Economic Literature, American Economic Association, vol. 36(1), pages 11-46, March.
    7. James Cox & Vjollca Sadiraj & Ulrich Schmidt, 2015. "Paradoxes and mechanisms for choice under risk," Experimental Economics, Springer;Economic Science Association, vol. 18(2), pages 215-250, June.
    8. Li-Chen Hsu, 2013. "Tax Auditing as a Public Good Game: An Experimental Study on Punishment and Compliance," Pacific Economic Review, Wiley Blackwell, vol. 18(4), pages 475-501, October.
    9. Jan Stoop & Charles N. Noussair & Daan van Soest, 2012. "From the Lab to the Field: Cooperation among Fishermen," Journal of Political Economy, University of Chicago Press, vol. 120(6), pages 1027-1056.
    10. Barron, Kai & Nurminen, Tuomas, 2018. "Nudging cooperation," Discussion Papers, Research Unit: Economics of Change SP II 2018-305, WZB Berlin Social Science Center.
    11. Messer, Kent D. & Zarghamee, Homa & Kaiser, Harry M. & Schulze, William D., 2007. "New hope for the voluntary contributions mechanism: The effects of context," Journal of Public Economics, Elsevier, vol. 91(9), pages 1783-1799, September.
    12. Alexandra Rausch & Alexander Brauneis, 2015. "It’s about how the task is set: the inclusion–exclusion effect and accountability in preprocessing management information," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 23(2), pages 313-344, June.
    13. Moore, Don A., 1999. "Order Effects in Preference Judgments: Evidence for Context Dependence in the Generation of Preferences, ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 78(2), pages 146-165, May.
    14. Franz Hackl & Gerald J. Pruckner, 2005. "Warm glow, free‐riding and vehicle neutrality in a health‐related contingent valuation study," Health Economics, John Wiley & Sons, Ltd., vol. 14(3), pages 293-306, March.
    15. Noussair, Charles & Soo, Cindy, 2008. "Voluntary contributions to a dynamic public good: Experimental evidence," Economics Letters, Elsevier, vol. 98(1), pages 71-77, January.
    16. Mercè Roca & Robin Hogarth & A. Maule, 2006. "Ambiguity seeking as a result of the status quo bias," Journal of Risk and Uncertainty, Springer, vol. 32(3), pages 175-194, May.
    17. Richard T. Carson & Miko_aj Czajkowski, 2014. "The discrete choice experiment approach to environmental contingent valuation," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 9, pages 202-235, Edward Elgar Publishing.
    18. McDaniels, Timothy L. & Gregory, Robin & Arvai, Joseph & Chuenpagdee, Ratana, 2003. "Decision structuring to alleviate embedding in environmental valuation," Ecological Economics, Elsevier, vol. 46(1), pages 33-46, August.
    19. Faralla, Valeria & Novarese, Marco & Ardizzone, Antonella, 2017. "Framing Effects in Intertemporal Choice: A Nudge Experiment," MPRA Paper 82086, University Library of Munich, Germany.
    20. Rockenbach, Bettina & Wolff, Irenaeus, 2009. "Institution design in social dilemmas: How to design if you must?," MPRA Paper 16922, University Library of Munich, Germany.

    More about this item

    Keywords

    Within-subject; Between-subject; Experimental design and methodology;
    All these keywords.

    JEL classification:

    • B49 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Other
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:81:y:2012:i:1:p:1-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.