IDEAS home Printed from https://ideas.repec.org/a/wly/emetrp/v92y2024i2p567-590.html
   My bibliography  Save this article

Randomization Tests for Peer Effects in Group Formation Experiments

Author

Listed:
  • Guillaume Basse
  • Peng Ding
  • Avi Feller
  • Panos Toulis

Abstract

Measuring the effect of peers on individuals' outcomes is a challenging problem, in part because individuals often select peers who are similar in both observable and unobservable ways. Group formation experiments avoid this problem by randomly assigning individuals to groups and observing their responses; for example, do first‐year students have better grades when they are randomly assigned roommates who have stronger academic backgrounds? In this paper, we propose randomization‐based permutation tests for group formation experiments, extending classical Fisher Randomization Tests to this setting. The proposed tests are justified by the randomization itself, require relatively few assumptions, and are exact in finite samples. This approach can also complement existing strategies, such as linear‐in‐means models, by using a regression coefficient as the test statistic. We apply the proposed tests to two recent group formation experiments.

Suggested Citation

  • Guillaume Basse & Peng Ding & Avi Feller & Panos Toulis, 2024. "Randomization Tests for Peer Effects in Group Formation Experiments," Econometrica, Econometric Society, vol. 92(2), pages 567-590, March.
    • Handle: RePEc:wly:emetrp:v:92:y:2024:i:2:p:567-590
    DOI: 10.3982/ECTA20134
    as

    Download full text from publisher

    File URL: https://doi.org/10.3982/ECTA20134
    Download Restriction: no
    File URL: https://libkey.io/10.3982/ECTA20134?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Angrist, Joshua D., 2014. "The perils of peer effects," Labour Economics, Elsevier, vol. 30(C), pages 98-108.
    2. Jing Cai & Adam Szeidl, 2018. "Interfirm Relationships and Business Performance," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(3), pages 1229-1282.
    3. Charles F. Manski, 1993. "Identification of Endogenous Social Effects: The Reflection Problem," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 531-542.
    4. Bruce Sacerdote, 2001. "Peer Effects with Random Assignment: Results for Dartmouth Roommates," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 681-704.
    5. Bhattacharya, Debopam, 2009. "Inferring Optimal Peer Assignment From Experimental Data," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 486-500.
    6. Young, Alwyn, 2019. "Channeling Fisher: randomization tests and the statistical insignificance of seemingly significant experimental results," LSE Research Online Documents on Economics 101401, London School of Economics and Political Science, LSE Library.
    7. Hennessy Jonathan & Dasgupta Tirthankar & Miratrix Luke & Pattanayak Cassandra & Sarkar Pradipta, 2016. "A Conditional Randomization Test to Account for Covariate Imbalance in Randomized Experiments," Journal of Causal Inference, De Gruyter, vol. 4(1), pages 61-80, March.
    8. Xinran Li & Peng Ding & Qian Lin & Dawei Yang & Jun S. Liu, 2019. "Randomization Inference for Peer Effects," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1651-1664, October.
    9. Alwyn Young, 2019. "Channeling Fisher: Randomization Tests and the Statistical Insignificance of Seemingly Significant Experimental Results," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(2), pages 557-598.
    10. Rosenbaum, Paul R., 2007. "Interference Between Units in Randomized Experiments," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 191-200, March.
    11. Ivan A. Canay & Joseph P. Romano & Azeem M. Shaikh, 2017. "Randomization Tests Under an Approximate Symmetry Assumption," Econometrica, Econometric Society, vol. 85, pages 1013-1030, May.
    12. Scott E. Carrell & Bruce I. Sacerdote & James E. West, 2013. "From Natural Variation to Optimal Policy? The Importance of Endogenous Peer Group Formation," Econometrica, Econometric Society, vol. 81(3), pages 855-882, May.
    13. Bruce Sacerdote, 2014. "Experimental and Quasi-Experimental Analysis of Peer Effects: Two Steps Forward?," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 253-272, August.
    14. Peng Ding & Tirthankar Dasgupta, 2018. "A randomization-based perspective on analysis of variance: a test statistic robust to treatment effect heterogeneity," Biometrika, Biometrika Trust, vol. 105(1), pages 45-56.
    15. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, December.
    16. David S. Lyle, 2009. "The Effects of Peer Group Heterogeneity on the Production of Human Capital at West Point," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 69-84, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexandra de Gendre & Nicolás Salamanca, 2020. "On the Mechanisms of Ability Peer Effects," Melbourne Institute Working Paper Series wp2020n19, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    2. Coveney, Max & Oosterveen, Matthijs, 2021. "What drives ability peer effects?," European Economic Review, Elsevier, vol. 136(C).
    3. Gonzalo Vazquez-Bare, 2017. "Identification and Estimation of Spillover Effects in Randomized Experiments," Papers 1711.02745, arXiv.org, revised Jan 2022.
    4. Adam S. Booij & Edwin Leuven & Hessel Oosterbeek, 2017. "Ability Peer Effects in University: Evidence from a Randomized Experiment," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(2), pages 547-578.
    5. Susan Athey & Dean Eckles & Guido W. Imbens, 2018. "Exact p-Values for Network Interference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 230-240, January.
    6. Christos Genakos & Eleni Kyrkopoulou, 2022. "Social policy gone bad educationally: unintended peer effects from transferred students," CEP Discussion Papers dp1851, Centre for Economic Performance, LSE.
    7. Robert Fairlie & Daniel Oliver & Glenn Millhauser & Randa Roland & Robert W. Fairlie, 2024. "Estimating Peer Effects among College Students: Evidence from a Field Experiment of One-to-One Pairings in STEM," CESifo Working Paper Series 11404, CESifo.
    8. Brodaty, Thibault & Gurgand, Marc, 2016. "Good peers or good teachers? Evidence from a French University," Economics of Education Review, Elsevier, vol. 54(C), pages 62-78.
    9. Bet Caeyers & Marcel Fafchamps, 2016. "Exclusion Bias in the Estimation of Peer Effects," NBER Working Papers 22565, National Bureau of Economic Research, Inc.
    10. Kuersteiner, Guido M. & Prucha, Ingmar R. & Zeng, Ying, 2023. "Efficient peer effects estimators with group effects," Journal of Econometrics, Elsevier, vol. 235(2), pages 2155-2194.
    11. Camila F. S. Campos & Shaun Hargreaves Heap & Fernanda Leite Lopez de Leon, 2017. "The political influence of peer groups: experimental evidence in the classroom," Oxford Economic Papers, Oxford University Press, vol. 69(4), pages 963-985.
    12. Humlum, Maria Knoth & Thorsager, Mette, 2021. "The Importance of Peer Quality for Completion of Higher Education," Economics of Education Review, Elsevier, vol. 83(C).
    13. Dench, Daniel & Joyce, Theodore, 2022. "Information and credible sanctions in curbing online cheating among undergraduates: A field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 195(C), pages 408-427.
    14. Petra Thiemann, 2022. "The Persistent Effects of Short-Term Peer Groups on Performance: Evidence from a Natural Experiment in Higher Education," Management Science, INFORMS, vol. 68(2), pages 1131-1148, February.
    15. Lépine, Andrea & Estevan, Fernanda, 2021. "Do ability peer effects matter for academic and labor market outcomes?," Labour Economics, Elsevier, vol. 71(C).
    16. Yann Bramoullé & Habiba Djebbari & Bernard Fortin, 2020. "Peer Effects in Networks: A Survey," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 603-629, August.
    17. Ingo E. Isphording & Ulf Zölitz, 2020. "The value of a peer," ECON - Working Papers 342, Department of Economics - University of Zurich.
    18. Yi Cao & Tao Zhou & Jian Gao, 2024. "Heterogeneous peer effects of college roommates on academic performance," Nature Communications, Nature, vol. 15(1), pages 1-11, December.
    19. Yann Algan & Quoc-Anh Do & Nicolò Dalvit & Alexis Le Chapelain & Yves Zenou, 2015. "How Social Networks Shape Our Beliefs: A Natural Experiment among Future French Politicians," Working Papers hal-03459820, HAL.
    20. repec:spo:wpmain:info:hdl:2441/78vacv4udu92eq3fec89svm9uv is not listed on IDEAS
    21. Brady, Ryan R. & Insler, Michael A. & Rahman, Ahmed S., 2017. "Bad Company: Understanding negative peer effects in college achievement," European Economic Review, Elsevier, vol. 98(C), pages 144-168.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:emetrp:v:92:y:2024:i:2:p:567-590. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.