IDEAS home Printed from https://ideas.repec.org/p/cir/cirwor/2006s-21.html

Session Effects in the Laboratory

Author

Listed:
  • Guillaume Fréchette

Abstract

In experimental economics, where subjects participate in different sessions, observations across subjects of a given session might exhibit more correlation than observations across subjects in different sessions. The problem of session effects is related to similar problems in many experimental and non-experimental fields. This paper attempts to clarify what the issues are and proposes a set of practical tests to identify the problem as well as ways to test for treatment effects in the presence of session-effects. Simulations are used to assess how these tests perform given the relatively small samples typical of experimental data sets. En économie expérimentale où les sujets participent à différentes sessions, les observations peuvent être plus corrélées à l'intérieur d'une même session qu'entre les participants ayant participé à différentes sessions. Ce type d'effet est présent également dans plusieurs autres domaines, autant expérimentaux que non-expérimentaux. Cette étude tente de mettre en lumière quelles sont les sources du problème et propose un ensemble de tests pour déterminer s'il y a ou non présence de corrélation intra-session dans une collecte de données, et pour identifier l'effet d'un traitement lorsque ce problème est présent. Des simulations ont été effectuées pour évaluer la performance de ces tests sur des échantillons avec peu d'observations, ce qui est commun lors de la collecte de données de type expérimental.

Suggested Citation

  • Guillaume Fréchette, 2006. "Session Effects in the Laboratory," CIRANO Working Papers 2006s-21, CIRANO.
    • Handle: RePEc:cir:cirwor:2006s-21
    as

    Download full text from publisher

    File URL: https://cirano.qc.ca/files/publications/2006s-21.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Fortin, Bernard & Lacroix, Guy & Villeval, Marie-Claire, 2007. "Tax evasion and social interactions," Journal of Public Economics, Elsevier, vol. 91(11-12), pages 2089-2112, December.
    2. Andreas Blume & John Duffy & April Mitchell Franco, 2008. "Decentralized Organizational Learning: An Experimental Investigation," Working Paper 382, Department of Economics, University of Pittsburgh, revised May 2009.
    3. Uri Gneezy & Muriel Niederle & Aldo Rustichini, 2003. "Performance in Competitive Environments: Gender Differences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 1049-1074.
    4. Guillaume Fréchette & John H. Kagel & Massimo Morelli, 2005. "Behavioral Identification in Coalitional Bargaining: An Experimental Analysis of Demand Bargaining and Alternating Offers," Econometrica, Econometric Society, vol. 73(6), pages 1893-1937, November.
    5. Ham, John C. & Kagel, John H. & Lehrer, Steven F., 2005. "Randomization, endogeneity and laboratory experiments: the role of cash balances in private value auctions," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 175-205.
    6. Croson, Rachel T. A., 1996. "Partners and strangers revisited," Economics Letters, Elsevier, vol. 53(1), pages 25-32, October.
    7. Friedman,Daniel & Sunder,Shyam, 1994. "Experimental Methods," Cambridge Books, Cambridge University Press, number 9780521456821, January.
    8. Fischbacher, Urs & Gachter, Simon & Fehr, Ernst, 2001. "Are people conditionally cooperative? Evidence from a public goods experiment," Economics Letters, Elsevier, vol. 71(3), pages 397-404, June.
    9. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    10. Van Huyck, John B & Battalio, Raymond C & Beil, Richard O, 1990. "Tacit Coordination Games, Strategic Uncertainty, and Coordination Failure," American Economic Review, American Economic Association, vol. 80(1), pages 234-248, March.
    11. Apesteguia, Jose & Huck, Steffen & Oechssler, Jorg, 2007. "Imitation--theory and experimental evidence," Journal of Economic Theory, Elsevier, vol. 136(1), pages 217-235, September.
    12. Armantier, Olivier, 2004. "Does observation influence learning?," Games and Economic Behavior, Elsevier, vol. 46(2), pages 221-239, February.
    13. Charles F. Manski, 1993. "Identification of Endogenous Social Effects: The Reflection Problem," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 531-542.
    14. Rick L. Williams, 2000. "A Note on Robust Variance Estimation for Cluster-Correlated Data," Biometrics, The International Biometric Society, vol. 56(2), pages 645-646, June.
    15. Aoyagi, Masaki & Fréchette, Guillaume, 2009. "Collusion as public monitoring becomes noisy: Experimental evidence," Journal of Economic Theory, Elsevier, vol. 144(3), pages 1135-1165, May.
    16. Jordi Brandts & David J. Cooper, 2006. "A Change Would Do You Good .... An Experimental Study on How to Overcome Coordination Failure in Organizations," American Economic Review, American Economic Association, vol. 96(3), pages 669-693, June.
    17. Kagel, John H & Harstad, Ronald M & Levin, Dan, 1987. "Information Impact and Allocation Rules in Auctions with Affiliated Private Values: A Laboratory Study," Econometrica, Econometric Society, vol. 55(6), pages 1275-1304, November.
    18. Carpenter, Jeffrey P., 2007. "The demand for punishment," Journal of Economic Behavior & Organization, Elsevier, vol. 62(4), pages 522-542, April.
    19. Roth, Alvin E. & Vesna Prasnikar & Masahiro Okuno-Fujiwara & Shmuel Zamir, 1991. "Bargaining and Market Behavior in Jerusalem, Ljubljana, Pittsburgh, and Tokyo: An Experimental Study," American Economic Review, American Economic Association, vol. 81(5), pages 1068-1095, December.
    20. Chamberlain, Gary, 1982. "Multivariate regression models for panel data," Journal of Econometrics, Elsevier, vol. 18(1), pages 5-46, January.
    21. John B. Van Huyck & Raymond C. Battalio & Richard O. Beil, 1991. "Strategic Uncertainty, Equilibrium Selection, and Coordination Failure in Average Opinion Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(3), pages 885-910.
    22. Cooper, Russell & DeJong, Douglas V. & Forsythe, Robert & Ross, Thomas W., 1996. "Cooperation without Reputation: Experimental Evidence from Prisoner's Dilemma Games," Games and Economic Behavior, Elsevier, vol. 12(2), pages 187-218, February.
    23. Kathleen Stern & Martha K. McClintock, 1998. "Regulation of ovulation by human pheromones," Nature, Nature, vol. 392(6672), pages 177-179, March.
    24. Gary Chamberlain, 1980. "Analysis of Covariance with Qualitative Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(1), pages 225-238.
    25. Andreas Blume & John Duffy, 2004. "Organizational Learning: An Experimental Investigation," 2004 Meeting Papers 617, Society for Economic Dynamics.
    26. Andreas Blume & John Duffy & April M. Franco, 2009. "Decentralized Organizational Learning: An Experimental Investigation," American Economic Review, American Economic Association, vol. 99(4), pages 1178-1205, September.
    27. Charness, Gary & Frechette, Guillaume R. & Qin, Cheng-Zhong, 2007. "Endogenous transfers in the Prisoner's Dilemma game: An experimental test of cooperation and coordination," Games and Economic Behavior, Elsevier, vol. 60(2), pages 287-306, August.
    28. Seinen, Ingrid & Schram, Arthur, 2006. "Social status and group norms: Indirect reciprocity in a repeated helping experiment," European Economic Review, Elsevier, vol. 50(3), pages 581-602, April.
    29. Nick Feltovich, 2003. "Nonparametric Tests of Differences in Medians: Comparison of the Wilcoxon–Mann–Whitney and Robust Rank-Order Tests," Experimental Economics, Springer;Economic Science Association, vol. 6(3), pages 273-297, November.
    30. Gary Charness & Guillaume R. Frechette & John H. Kagel, 2004. "How Robust is Laboratory Gift Exchange?," Experimental Economics, Springer;Economic Science Association, vol. 7(2), pages 189-205, June.
    31. Chen, Yan & Katuščák, Peter & Ozdenoren, Emre, 2013. "Why canʼt a woman bid more like a man?," Games and Economic Behavior, Elsevier, vol. 77(1), pages 181-213.
    32. Arellano, Manuel, 2003. "Panel Data Econometrics," OUP Catalogue, Oxford University Press, number 9780199245291.
    33. Ivanova-Stenzel, Radosveta & Salmon, Timothy C., 2008. "Revenue equivalence revisited," Games and Economic Behavior, Elsevier, vol. 64(1), pages 171-192, September.
    34. Christoph Vanberg, 2008. "Why Do People Keep Their Promises? An Experimental Test of Two Explanations -super-1," Econometrica, Econometric Society, vol. 76(6), pages 1467-1480, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter H. Kriss & Roberto Weber, 2013. "Organizational formation and change: lessons from economic laboratory experiments," Chapters, in: Anna Grandori (ed.), Handbook of Economic Organization, chapter 14, Edward Elgar Publishing.
    2. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    3. Fehr, Dietmar, 2017. "Costly communication and learning from failure in organizational coordination," European Economic Review, Elsevier, vol. 93(C), pages 106-122.
    4. Nikiforakis, Nikos, 2010. "Feedback, punishment and cooperation in public good experiments," Games and Economic Behavior, Elsevier, vol. 68(2), pages 689-702, March.
    5. Simon Gaechter & Benedikt Herrmann, 2008. "Reciprocity, culture, and human cooperation: Previous insights and a new cross-cultural experiment," Discussion Papers 2008-14, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    6. Takafumi Yamakawa & Yoshitaka Okano & Tatsuyoshi Saijo, 2016. "Detecting motives for cooperation in public goods experiments," Experimental Economics, Springer;Economic Science Association, vol. 19(2), pages 500-512, June.
    7. David J. Cooper & John Van Huyck, 2018. "Coordination and transfer," Experimental Economics, Springer;Economic Science Association, vol. 21(3), pages 487-512, September.
    8. Luca Corazzini & Christopher Cotton & Paola Valbonesi, 2013. "Too many charities? Insight from an experiment with multiple public goods and contribution thresholds," Working Papers 2013-13, University of Miami, Department of Economics.
    9. Alós-Ferrer, Carlos & Weidenholzer, Simon, 2014. "Imitation and the role of information in overcoming coordination failures," Games and Economic Behavior, Elsevier, vol. 87(C), pages 397-411.
    10. Redzo Mujcic & Andreas Leibbrandt, 2018. "Indirect Reciprocity and Prosocial Behaviour: Evidence from a Natural Field Experiment," Economic Journal, Royal Economic Society, vol. 128(611), pages 1683-1699, June.
    11. Maoliang Ye & Jie Zheng & Plamen Nikolov & Sam Asher, 2020. "One Step at a Time: Does Gradualism Build Coordination?," Management Science, INFORMS, vol. 66(1), pages 113-129, January.
    12. Gunnthorsdottir, Anna & Vragov, Roumen & Mccabe, Kevin, 2007. "The meritocracy as a mechanism to overcome social dilemmas," MPRA Paper 2454, University Library of Munich, Germany.
    13. Ghidoni, Riccardo & Suetens, Sigrid, 2019. "Empirical Evidence on Repeated Sequential Games," Other publications TiSEM ff3a441f-e196-4e45-ba59-c, Tilburg University, School of Economics and Management.
    14. Urs Fischbacher & Simon Gaechter, 2008. "Heterogeneous Social Preferences And The Dynamics Of Free Riding In Public Good Experiments," Discussion Papers 2008-07, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    15. Beugnot, Julie & Fortin, Bernard & Lacroix, Guy & Villeval, Marie Claire, 2019. "Gender and peer effects on performance in social networks," European Economic Review, Elsevier, vol. 113(C), pages 207-224.
    16. Andreas Blume & April Mitchell Franco & Paul Heidhues, 2021. "Dynamic coordination via organizational routines," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 72(4), pages 1001-1047, November.
    17. Simon G�chter & Ernst Fehr, "undated". "Fairness in the Labour Market � A Survey of Experimental Results," IEW - Working Papers 114, Institute for Empirical Research in Economics - University of Zurich.
    18. Heijmans, Roweno J.R.K. & Suetens, Sigrid, 2025. "Comparing Subsidies to Solve Coordination Failure," Discussion Papers 2025/9, Norwegian School of Economics, Department of Business and Management Science.
    19. Pearson, Matthew & Schipper, Burkhard C., 2013. "Menstrual cycle and competitive bidding," Games and Economic Behavior, Elsevier, vol. 78(C), pages 1-20.
    20. Giovanna Devetag, 2000. "Coordination in "Critical Mass" Games: An Experimental Study," LEM Papers Series 2000/03, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cir:cirwor:2006s-21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Webmaster (email available below). General contact details of provider: https://edirc.repec.org/data/ciranca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.