IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_8386.html

Clustering Standard Errors at the "Session" Level

Author

Listed:
  • Duk Gyoo Kim

Abstract

Session-specific features of a laboratory experiment, if those exist, do not disappear by clustering standard errors at the session level. Randomly ordering sessions, which is crucial to deal with sampling issues, cannot justify clustering the standard errors at the session level. The experimental design should primarily determine the clustering level. In a typical controlled laboratory experiment where subjects make choices in the same environment repeatedly, clustering at a participant level is inherited from the experimental design, and standard errors could be larger (that is, statistical inference can be more conservative) when clustered at the individual or decision-group level than the session level. It implies that clustering standard errors at the session level can lead to false-positive treatment effects if it is mistakenly chosen. A rule of thumb using standard deviations is introduced.

Suggested Citation

  • Duk Gyoo Kim, 2020. "Clustering Standard Errors at the "Session" Level," CESifo Working Paper Series 8386, CESifo.
  • Handle: RePEc:ces:ceswps:_8386
    as

    Download full text from publisher

    File URL: https://www.ifo.de/DocDL/cesifo1_wp8386.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dirk Engelmann & Guillaume Hollard, 2010. "Reconsidering the Effect of Market Experience on the “Endowment Effect”," Econometrica, Econometric Society, vol. 78(6), pages 2005-2019, November.
    2. Carpenter, Jeffrey, 2016. "The labor supply of fixed-wage workers: Estimates from a real effort experiment," European Economic Review, Elsevier, vol. 89(C), pages 85-95.
    3. Rafael Hortala-Vallve & Aniol Llorente-Saguer & Rosemarie Nagel, 2013. "The role of information in different bargaining protocols," Experimental Economics, Springer;Economic Science Association, vol. 16(1), pages 88-113, March.
    4. Borodin A. D., 2016. "World experience of state influence on the economy," Visnyk of National University of Civil Protection of Ukraine. Public Administration series., National University of Civil Protection of Ukraine, vol. 4(1), pages 37-43, January.
    5. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    6. Anat Bracha & Uri Gneezy & George Loewenstein, 2015. "Relative Pay and Labor Supply," Journal of Labor Economics, University of Chicago Press, vol. 33(2), pages 297-315.
    7. Alberto Abadie & Susan Athey & Guido W Imbens & Jeffrey M Wooldridge, 2023. "When Should You Adjust Standard Errors for Clustering?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 1-35.
    8. Matthew Embrey & Guillaume R Fréchette & Sevgi Yuksel, 2018. "Cooperation in the Finitely Repeated Prisoner’s Dilemma," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 509-551.
    9. John Duffy & Dietmar Fehr, 2018. "Equilibrium selection in similar repeated games: experimental evidence on the role of precedents," Experimental Economics, Springer;Economic Science Association, vol. 21(3), pages 573-600, September.
    10. Brice Corgnet & Mark Desantis & David Porter, 2018. "What Makes a Good Trader? On the Role of Intuition and Reflection on Trader Performance," Journal of Finance, American Finance Association, vol. 73(3), pages 1113-1137, June.
    11. repec:hal:journl:hal-02312062 is not listed on IDEAS
    12. Andreoni, James & Croson, Rachel, 2008. "Partners versus Strangers: Random Rematching in Public Goods Experiments," Handbook of Experimental Economics Results, in: Charles R. Plott & Vernon L. Smith (ed.), Handbook of Experimental Economics Results, edition 1, volume 1, chapter 82, pages 776-783, Elsevier.
    13. Andrea Robbett, 2014. "Local Institutions and the Dynamics of Community Sorting," American Economic Journal: Microeconomics, American Economic Association, vol. 6(3), pages 136-156, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Véronique Flambard & Fabrice Le Lec & Rustam Romaniuc, 2024. "An experimental comparison of contributions in collective prevention games and public goods games," Economic Inquiry, Western Economic Association International, vol. 62(4), pages 1598-1617, October.
    2. Igor Asanov & Christoph Buehren & Panagiota Zacharodimou, 2020. "The power of experiments: How big is your n?," MAGKS Papers on Economics 202032, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    3. David Fielding & Stephen Knowles & Ronald Peeters, 2022. "In search of competitive givers," Southern Economic Journal, John Wiley & Sons, vol. 88(4), pages 1517-1548, April.
    4. Martinelli, César & Sebastián Esandi, Naila C., 2026. "Electoral accountability in the lab," Games and Economic Behavior, Elsevier, vol. 157(C), pages 480-495.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brandyn F. Churchill & Laura E. Henkhaus & Emily C. Lawler, 2025. "Effect of vaccine recommendations on consumer and firm behavior," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 44(1), pages 125-150, January.
    2. Dylan Brewer & Jim Crozier, 2025. "Who Heeds the Call to Conserve in an Energy Emergency? Evidence from Smart Thermostat Data," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 12(6), pages 1747-1789.
    3. João Pereira dos Santos & José Tavares & José Mesquita, 2021. "Leave them kids alone! National exams as a political tool," Public Choice, Springer, vol. 189(3), pages 405-426, December.
    4. Christopher S. Sutherland, 2020. "Forward Guidance and Expectation Formation: A Narrative Approach," Staff Working Papers 20-40, Bank of Canada.
    5. Doremus, Jacqueline, 2019. "Unintended impacts from forest certification: Evidence from indigenous Aka households in Congo," Ecological Economics, Elsevier, vol. 166(C), pages 1-1.
    6. Christopher S. Carpenter & Gilbert Gonzales Jr. & Tara McKay & Dario Sansone, 2020. "Effects of the Affordable Care Act Dependent Coverage Mandate on Health Insurance Coverage for Individuals in Same-Sex Couples," NBER Working Papers 26978, National Bureau of Economic Research, Inc.
    7. Brandts, Jordi & Busom, Isabel & Lopez-Mayan, Cristina & Panadés, Judith, 2022. "Dispelling misconceptions about economics," Journal of Economic Psychology, Elsevier, vol. 88(C).
    8. Anam Bilgrami & Henry Cutler & Kompal Sinha, 2025. "Higher penalties, broader definitions, and national standards: Did harmonized Australian workplace health and safety laws reduce workers' compensation receipt?," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 64(1), pages 77-102, January.
    9. Christian Kümpel, 2019. "Do financial incentives influence the hospitalization rate of nursing home residents? Evidence from Germany," Health Economics, John Wiley & Sons, Ltd., vol. 28(11), pages 1235-1247, November.
    10. James G. MacKinnon, 2019. "How cluster-robust inference is changing applied econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 52(3), pages 851-881, August.
    11. Dorner, Matthias & Görlitz, Katja, 2020. "Training, wages and a missing school graduation cohort," IAB-Discussion Paper 202028, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    12. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    13. Bruno Ferman, 2023. "Inference in difference‐in‐differences: How much should we trust in independent clusters?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 358-369, April.
    14. Wang, Wenjie & Zhang, Yichong, 2024. "Wild bootstrap inference for instrumental variables regressions with weak and few clusters," Journal of Econometrics, Elsevier, vol. 241(1).
    15. Sultan Mehmood, 2021. "The impact of Presidential appointment of judges: Montesquieu or the Federalists?," AMSE Working Papers 2118, Aix-Marseille School of Economics, France.
    16. Yanguas, Maria Lucia, 2020. "Technology and educational choices: Evidence from a one-laptop-per-child program," Economics of Education Review, Elsevier, vol. 76(C).
    17. Ernesto Reuben & Sigrid Suetens, 2018. "Instrumental Reciprocity as an Error," Games, MDPI, vol. 9(3), pages 1-9, September.
    18. Cäcilia Lipowski, 2024. "No Teens, No Tech: How Shortages of Young Workers Hinder Firm Technology Investments," CESifo Working Paper Series 11471, CESifo.
    19. Bicchieri, Cristina & Dimant, Eugen & Xiao, Erte, 2021. "Deviant or wrong? The effects of norm information on the efficacy of punishment," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 209-235.
    20. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2021. "Wild Bootstrap and Asymptotic Inference With Multiway Clustering," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 505-519, March.

    More about this item

    Keywords

    ;
    ;

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_8386. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.