IDEAS home Printed from https://ideas.repec.org/p/azt/cemmap/24-23.html
   My bibliography  Save this paper

Using multiple outcomes to improve the synthetic control method

Author

Listed:
  • Liyang Sun
  • Eli Ben-Michael
  • Avi Feller

Abstract

When there are multiple outcome series of interest, Synthetic Control analyses typically proceed by estimating separate weights for each outcome. In this paper, we instead propose estimating a common set of weights across outcomes, by balancing either a vector of all outcomes or an index or average of them. Under a low-rank factor model, we show that these approaches lead to lower bias bounds than separate weights, and that averaging leads to further gains when the number of outcomes grows. We illustrate this via simulation and in a re-analysis of the impact of the Flint water crisis on educational outcomes.

Suggested Citation

  • Liyang Sun & Eli Ben-Michael & Avi Feller, 2023. "Using multiple outcomes to improve the synthetic control method," CeMMAP working papers 24/23, Institute for Fiscal Studies.
    • Handle: RePEc:azt:cemmap:24/23
    DOI: 10.47004/wp.cem.2023.2423
    as

    Download full text from publisher

    File URL: https://www.cemmap.ac.uk/wp-content/uploads/2023/12/CWP2423-Using-multiple-outcomes-to-improve-the-synthetic-control-method.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.47004/wp.cem.2023.2423?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Joseph Fry, 2023. "A Method of Moments Approach to Asymptotically Unbiased Synthetic Controls," Papers 2312.01209, arXiv.org, revised Mar 2024.
    2. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew Dustan & Alain de Janvry & Elisabeth Sadoulet, 2017. "Flourish or Fail?: The Risky Reward of Elite High School Admission in Mexico City," Journal of Human Resources, University of Wisconsin Press, vol. 52(3), pages 756-799.
    2. Ben Kelcey & Zuchao Shen & Jessaca Spybrook, 2016. "Intraclass Correlation Coefficients for Designing Cluster-Randomized Trials in Sub-Saharan Africa Education," Evaluation Review, , vol. 40(6), pages 500-525, December.
    3. Zhang, Hongliang, 2016. "The role of testing noise in the estimation of achievement-based peer effects," Economics of Education Review, Elsevier, vol. 54(C), pages 113-123.
    4. Giacomo De Giorgi & Michele Pellizzari & William Gui Woolston, 2012. "Class Size And Class Heterogeneity," Journal of the European Economic Association, European Economic Association, vol. 10(4), pages 795-830, August.
    5. Teresa Molina Millán & Karen Macours, 2017. "Attrition in randomized control trials: Using tracking information to correct bias," FEUNL Working Paper Series novaf:wp1702, Universidade Nova de Lisboa, Faculdade de Economia.
    6. Bonesrønning, Hans & Finseraas, Henning & Hardoy, Ines & Iversen, Jon Marius Vaag & Nyhus, Ole Henning & Opheim, Vibeke & Salvanes, Kari Vea & Sandsør, Astrid Marie Jorde & Schøne, Pål, 2022. "Small-group instruction to improve student performance in mathematics in early grades: Results from a randomized field experiment," Journal of Public Economics, Elsevier, vol. 216(C).
    7. Adam S. Booij & Edwin Leuven & Hessel Oosterbeek, 2017. "Ability Peer Effects in University: Evidence from a Randomized Experiment," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(2), pages 547-578.
    8. Peter Leopold S. Bergman & Elizabeth Kopko & Julio Rodriguez, 2021. "Using Predictive Analytics to Track Students: Evidence from a Seven-College Experiment," CESifo Working Paper Series 9157, CESifo.
    9. Stephen L. Ross, 2009. "Social Interactions within Cities: Neighborhood Environments and Peer Relationships," Working papers 2009-31, University of Connecticut, Department of Economics.
    10. David J. Deming & Sarah Cohodes & Jennifer Jennings & Christopher Jencks, 2016. "School Accountability, Postsecondary Attainment, and Earnings," The Review of Economics and Statistics, MIT Press, vol. 98(5), pages 848-862, December.
    11. Belot, Michèle & James, Jonathan, 2014. "A new perspective on the issue of selection bias in randomized controlled field experiments," Economics Letters, Elsevier, vol. 124(3), pages 326-328.
    12. Bastian Ravesteijn & Hans van Kippersluis & Mauricio Avendano & Pekka Martikainen & Hannu Vessari & Eddy van Doorslaer, 2017. "The Impact of Later Tracking on Mortality by Parental Income in Finland," Tinbergen Institute Discussion Papers 17-030/V, Tinbergen Institute.
    13. Amrei Lahno & Marta Serra-Garcia, 2015. "Peer effects in risk taking: Envy or conformity?," Journal of Risk and Uncertainty, Springer, vol. 50(1), pages 73-95, February.
    14. Marchionni, Mariana & Vazquez, Emmanuel & Pinto, Florencia, 2012. "Desigualdad educativa en la Argentina. Análisis en base a los datos PISA 2009 [Education Inequality in Argentina. An analysis based on PISA 2009 data]," MPRA Paper 56420, University Library of Munich, Germany.
    15. Larissa Zierow, 2017. "Economic Perspectives on the Implications of Public Child Care and Schooling for Educational Outcomes in Childhood and Adult Life," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 76.
    16. Nicole Schneeweis & Martina Zweimüller, 2014. "Early Tracking and the Misfortune of Being Young," Scandinavian Journal of Economics, Wiley Blackwell, vol. 116(2), pages 394-428, April.
    17. Holla,Alaka & Bendini,Maria Magdalena & Dinarte Diaz,Lelys Ileana & Trako,Iva, 2021. "Is Investment in Preprimary Education Too Low ? Lessons from (Quasi) ExperimentalEvidence across Countries," Policy Research Working Paper Series 9723, The World Bank.
    18. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials [Microcredit impacts: Evidence from a randomized microcredit program placement experiment by Compartamos Banco]," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    19. Luc Behaghel & Clément de Chaisemartin & Marc Gurgand, 2017. "Ready for Boarding? The Effects of a Boarding School for Disadvantaged Students," American Economic Journal: Applied Economics, American Economic Association, vol. 9(1), pages 140-164, January.
    20. Simone Balestra & Aurélien Sallin & Stefan C. Wolter, 2023. "High-Ability Influencers? The Heterogeneous Effects of Gifted Classmates," Journal of Human Resources, University of Wisconsin Press, vol. 58(2), pages 633-665.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:azt:cemmap:24/23. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dermot Watson (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.