IDEAS home Printed from https://ideas.repec.org/p/ags/aaea15/205586.html
   My bibliography  Save this paper

How important is spatial correlation in randomized controlled trials?

Author

Listed:
  • Baylis, Kathy
  • Ham, Andres

Abstract

Randomized controlled trials have become the gold standard for impact evaluation since they provide unbiased estimates of causal effects. This paper studies randomized settings where treatment is assigned over geographical units. We analyze how omitting spatial correlation in outcomes or unobservables affects treatment effect estimates. First, we study spatial dependence in Mexico's Progresa program. Second, we conduct Monte Carlo simulations to generalize our results. Findings reveal that spatial correlation is more relevant than the literature suggests, and may affect both the precision of the estimate and the estimate itself. Existing spatial econometric methods may provide solutions to mitigate the consequences of omitting spatial correlation.

Suggested Citation

  • Baylis, Kathy & Ham, Andres, 2015. "How important is spatial correlation in randomized controlled trials?," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205586, Agricultural and Applied Economics Association.
    • Handle: RePEc:ags:aaea15:205586
    DOI: 10.22004/ag.econ.205586
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/205586/files/spatialcorrelation_AAEA.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.205586?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael Kremer & Edward Miguel, 2007. "The Illusion of Sustainability," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1007-1065.
    2. Angus Deaton, 2010. "Instruments, Randomization, and Learning about Development," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 424-455, June.
    3. Sacerdote, Bruce, 2011. "Peer Effects in Education: How Might They Work, How Big Are They and How Much Do We Know Thus Far?," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 4, pages 249-277, Elsevier.
    4. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    5. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    6. Michael Kremer & Jessica Leino & Edward Miguel & Alix Peterson Zwane, 2011. "Spring Cleaning: Rural Water Impacts, Valuation, and Property Rights Institutions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 145-205.
    7. Menno Pradhan & Daniel Suryadarma & Amanda Beatty & Maisy Wong & Arya Gaduh & Armida Alisjahbana & Rima Prama Artha, 2014. "Improving Educational Quality through Enhancing Community Participation: Results from a Randomized Field Experiment in Indonesia," American Economic Journal: Applied Economics, American Economic Association, vol. 6(2), pages 105-126, April.
    8. Rafael Lalive & M. Alejandra Cattaneo, 2009. "Social Interactions and Schooling Decisions," The Review of Economics and Statistics, MIT Press, vol. 91(3), pages 457-477, August.
    9. Orazio P. Attanasio & Costas Meghir & Ana Santiago, 2012. "Education Choices in Mexico: Using a Structural Model and a Randomized Experiment to Evaluate PROGRESA," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(1), pages 37-66.
    10. Paul Glewwe & Nauman Ilias & Michael Kremer, 2010. "Teacher Incentives," American Economic Journal: Applied Economics, American Economic Association, vol. 2(3), pages 205-227, July.
    11. Sarah Baird & Aislinn Bohren & Berk Ozler & Craig McIntosh, 2014. "Designing Experiments to Measure Spillover Effects," Working Papers 2014-11, The George Washington University, Institute for International Economic Policy.
    12. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    13. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    14. Thomas Barrios & Rebecca Diamond & Guido W. Imbens & Michal Kolesár, 2012. "Clustering, Spatial Correlations, and Randomization Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 578-591, June.
    15. Benjamin A. Olken, 2007. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 115(2), pages 200-249.
    16. Benjamin, Dwayne, 1995. "Can unobserved land quality explain the inverse productivity relationship?," Journal of Development Economics, Elsevier, vol. 46(1), pages 51-84, February.
    17. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    18. repec:pri:rpdevs:deaton_instruments_randomization_learning_all_04april_2010 is not listed on IDEAS
    19. Anselin, Luc & Bera, Anil K. & Florax, Raymond & Yoon, Mann J., 1996. "Simple diagnostic tests for spatial dependence," Regional Science and Urban Economics, Elsevier, vol. 26(1), pages 77-104, February.
    20. Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
    21. Ravallion Martin, 2009. "Should the Randomistas Rule?," The Economists' Voice, De Gruyter, vol. 6(2), pages 1-5, February.
    22. Paul Gertler, 2004. "Do Conditional Cash Transfers Improve Child Health? Evidence from PROGRESA's Control Randomized Experiment," American Economic Review, American Economic Association, vol. 94(2), pages 336-341, May.
    23. Philip S. Babcock & John L. Hartman, 2010. "Networks and Workouts: Treatment Size and Status Specific Peer Effects in a Randomized Field Experiment," NBER Working Papers 16581, National Bureau of Economic Research, Inc.
    24. Gustavo J. Bobonis, 2009. "Is the Allocation of Resources within the Household Efficient? New Evidence from a Randomized Experiment," Journal of Political Economy, University of Chicago Press, vol. 117(3), pages 453-503, June.
    25. Peter M. Aronow, 2012. "A General Method for Detecting Interference Between Units in Randomized Experiments," Sociological Methods & Research, , vol. 41(1), pages 3-16, February.
    26. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    27. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    28. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    29. Rodrik, Dani, 2008. "The New Development Economics: We Shall Experiment, but How Shall We Learn?," Working Paper Series rwp08-055, Harvard University, John F. Kennedy School of Government.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marynia Kolak & Luc Anselin, 2020. "A Spatial Perspective on the Econometrics of Program Evaluation," International Regional Science Review, , vol. 43(1-2), pages 128-153, January.
    2. Stefano Mainardi, 2021. "Preference heterogeneity, neighbourhood effects and basic services: logit kernel models for farmers’ climate adaptation in Ethiopia," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(5), pages 6869-6912, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eduard Marinov, 2019. "The 2019 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 78-116.
    2. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    3. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    4. Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, May.
    5. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2014. "Designing Experiments to Measure Spillover Effects," PIER Working Paper Archive 14-032, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    6. Miguel Urquiola, 2015. "Progress and challenges in achieving an evidence-based education policy in Latin America and the Caribbean," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 24(1), pages 1-30, December.
    7. Benjamin A. Olken, 2020. "Banerjee, Duflo, Kremer, and the Rise of Modern Development Economics," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(3), pages 853-878, July.
    8. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2015. "Designing Experiments to Measure Spillover Effects, Second Version," PIER Working Paper Archive 15-021, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 01 Jun 2015.
    9. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2017. "Optimal Design of Experiments in the Presence of Interference*, Second Version," PIER Working Paper Archive 16-025, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 30 Nov 2017.
    10. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukerji & Marc Shotland & Michael Walton, 2017. "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 73-102, Fall.
    11. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    12. Rafael P. Ribas, 2020. "Liquidity constraints, spillovers, and entrepreneurship: evidence from a cash transfer program," Small Business Economics, Springer, vol. 55(4), pages 1131-1158, December.
    13. Berlinski, Samuel & Busso, Matias & Giannola, Michele, 2023. "Helping struggling students and benefiting all: Peer effects in primary education," Journal of Public Economics, Elsevier, vol. 224(C).
    14. Committee, Nobel Prize, 2019. "Understanding development and poverty alleviation," Nobel Prize in Economics documents 2019-2, Nobel Prize Committee.
    15. William Easterly, 2009. "Can the West Save Africa?," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 373-447, June.
    16. Manuela Angelucci & Silvia Prina & Heather Royer & Anya Samek, 2015. "When Incentives Backfire: Spillover Effects in Food Choice," NBER Working Papers 21481, National Bureau of Economic Research, Inc.
    17. Jacobus de Hoop & Jed Friedman & Eeshani Kandpal & Furio C. Rosati, 2019. "Child Schooling and Child Work in the Presence of a Partial Education Subsidy," Journal of Human Resources, University of Wisconsin Press, vol. 54(2), pages 503-531.
    18. David K. Evans & Arkadipta Ghosh, 2008. "Prioritizing Educational Investments in Children in the Developing World," Working Papers 587, RAND Corporation.
    19. Temple, Jonathan R.W., 2010. "Aid and Conditionality," Handbook of Development Economics, in: Dani Rodrik & Mark Rosenzweig (ed.), Handbook of Development Economics, edition 1, volume 5, chapter 0, pages 4415-4523, Elsevier.
    20. Rafael P. Ribas, 2014. "Liquidity Constraints, Informal Financing, and Entrepreneurship: Direct and Indirect Effects of a Cash Transfer Programme," Working Papers 131, International Policy Centre for Inclusive Growth.

    More about this item

    Keywords

    International Development; Research Methods/ Statistical Methods;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:aaea15:205586. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaeaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.