IDEAS home Printed from https://ideas.repec.org/p/hka/wpaper/2019-024.html
   My bibliography  Save this paper

Breaking Ties: Regression Discontinuity Design Meets Market Design

Author

Listed:
  • Atila Abdulkadiroglu

    (Duke University)

  • Joshua Angrist

    (Massachusetts Institute of Technology)

  • Yusuke Narita

    (Massachusetts Institute of Technology)

  • Parag Pathak

    (Massachusetts Institute of Technology)

Abstract

Centralized school assignment algorithms must distinguish between applicants with the same preferences and priorities. This is done with randomly assigned lottery numbers, non-lottery tie-breakers like test scores, or both. The New York City public high school match illustrates the latter, using test scores, grades, and interviews to rank applicants to screened schools, combined with lottery tie-breaking at unscreened schools. We show how to identify causal effects of school attendance in such settings. Our approach generalizes regression discontinuity designs to allow for multiple treatments and multiple running variables, some of which are randomly assigned. Lotteries generate assignment risk at screened as well as unscreened schools. Centralized assignment also identifies screened school effects away from screened school cutoffs. These features of centralized assignment are used to assess the predictive value of New York City's school report cards. Grade A schools improve SAT math scores and increase the likelihood of graduating, though by less than OLS estimates suggest. Selection bias in OLS estimates is egregious for Grade A screened schools.

Suggested Citation

  • Atila Abdulkadiroglu & Joshua Angrist & Yusuke Narita & Parag Pathak, 2019. "Breaking Ties: Regression Discontinuity Design Meets Market Design," Working Papers 2019-024, Human Capital and Economic Opportunity Working Group.
  • Handle: RePEc:hka:wpaper:2019-024
    Note: MIP
    as

    Download full text from publisher

    File URL: http://humcap.uchicago.edu/RePEc/hka/wpaper/Abdulkadiroglu_Angrist_Narita_etal_breaking-ties-regression-discontinuity-design.pdf
    File Function: First version, March 6, 2019
    Download Restriction: no

    File URL: http://humcap.uchicago.edu/RePEc/hka/wpaper/Abdulkadiroglu_Angrist_Narita_etal_breaking-ties-regression-discontinuity-design_v2.pdf
    File Function: Second version, December 31, 2020
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Justine S. Hastings & Christopher A. Neilson & Seth D. Zimmerman, 2013. "Are Some Degrees Worth More than Others? Evidence from college admission cutoffs in Chile," NBER Working Papers 19241, National Bureau of Economic Research, Inc.
    2. Jackson, C. Kirabo, 2012. "Single-sex schools, student achievement, and course selection: Evidence from rule-based student assignments in Trinidad and Tobago," Journal of Public Economics, Elsevier, vol. 96(1), pages 173-187.
    3. Atila Abdulkadiroğlu & Parag A. Pathak & Alvin E. Roth, 2005. "The New York City High School Match," American Economic Review, American Economic Association, vol. 95(2), pages 364-367, May.
    4. Adrienne M. Lucas & Isaac M. Mbiti, 2014. "Effects of School Quality on Student Achievement: Discontinuity Evidence from Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 6(3), pages 234-263, July.
    5. Timothy B. Armstrong & Michal Kolesár, 2018. "Optimal Inference in a Class of Regression Models," Econometrica, Econometric Society, vol. 86(2), pages 655-683, March.
    6. Atila Abdulkadiro?lu & Yeon-Koo Che & Yosuke Yasuda, 2015. "Expanding "Choice" in School Choice," American Economic Journal: Microeconomics, American Economic Association, vol. 7(1), pages 1-42, February.
    7. Bugni, Federico A. & Canay, Ivan A., 2021. "Testing continuity of a density via g-order statistics in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 221(1), pages 138-159.
    8. Markus Frölich & Martin Huber, 2019. "Including Covariates in the Regression Discontinuity Design," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(4), pages 736-748, October.
    9. Lisa Barrow & Marisa de la Torre & Lauren Sartain, 2016. "The Role of Selective High Schools in Equalizing Educational Outcomes: Heterogeneous Effects by Neighborhood Socioeconomic Status," Working Paper Series WP-2016-17, Federal Reserve Bank of Chicago.
    10. Atı̇la Abdulkadı̇roğlu & Joshua D. Angrist & Yusuke Narita & Parag Pathak, 2022. "Breaking Ties: Regression Discontinuity Design Meets Market Design," Econometrica, Econometric Society, vol. 90(1), pages 117-151, January.
    11. Atila Abdulkadroǧlu & Joshua D. Angrist & Yusuke Narita & Parag A. Pathak & Roman A. Zarate, 2017. "Regression Discontinuity in Serial Dictatorship: Achievement Effects at Chicago's Exam Schools," American Economic Review, American Economic Association, vol. 107(5), pages 240-245, May.
    12. Yingying Dong, 2018. "Alternative Assumptions to Identify LATE in Fuzzy Regression Discontinuity Designs," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 80(5), pages 1020-1027, October.
    13. Atila Abdulkadiroglu & Parag A. Pathak & Alvin E. Roth, 2009. "Strategy-proofness versus Efficiency in Matching with Indifferences: Redesigning the New York City High School Match," NBER Working Papers 14864, National Bureau of Economic Research, Inc.
    14. Fort, Margherita & Zanella, Giulio, 2019. "Cognitive and non-cognitive costs of daycare 0–2 for children in advantaged families," CEPR Discussion Papers 11120, C.E.P.R. Discussion Papers.
    15. Yoichi Arai & Yu‐Chin Hsu & Toru Kitagawa & Ismael Mourifié & Yuanyuan Wan, 2022. "Testing identifying assumptions in fuzzy regression discontinuity designs," Quantitative Economics, Econometric Society, vol. 13(1), pages 1-28, January.
    16. Frölich, Markus, 2007. "Regression Discontinuity Design with Covariates," IZA Discussion Papers 3024, Institute of Labor Economics (IZA).
    17. Atila Abdulkadiroğlu & Joshua Angrist & Parag Pathak, 2014. "The Elite Illusion: Achievement Effects at Boston and New York Exam Schools," Econometrica, Econometric Society, vol. 82(1), pages 137-196, January.
    18. Abadie, Alberto, 2003. "Semiparametric instrumental variable estimation of treatment response models," Journal of Econometrics, Elsevier, vol. 113(2), pages 231-263, April.
    19. Sebastian Calonico & Matias D. Cattaneo & Max H. Farrell & Rocío Titiunik, 2019. "Regression Discontinuity Designs Using Covariates," The Review of Economics and Statistics, MIT Press, vol. 101(3), pages 442-451, July.
    20. Ivan A Canay & Vishal Kamat, 2018. "Approximate Permutation Tests and Induced Order Statistics in the Regression Discontinuity Design," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(3), pages 1577-1608.
    21. Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504.
    22. C. Kirabo Jackson, 2010. "Do Students Benefit from Attending Better Schools? Evidence from Rule-based Student Assignments in Trinidad and Tobago," Economic Journal, Royal Economic Society, vol. 120(549), pages 1399-1429, December.
    23. Jasjeet S. Sekhon & Rocío Titiunik, 2017. "On Interpreting the Regression Discontinuity Design as a Local Experiment," Advances in Econometrics, in: Regression Discontinuity Designs, volume 38, pages 1-28, Emerald Group Publishing Limited.
    24. Matias D. Cattaneo & Rocío Titiunik & Gonzalo Vazquez-Bare, 2020. "Analysis of regression-discontinuity designs with multiple cutoffs or multiple scores," Stata Journal, StataCorp LP, vol. 20(4), pages 866-891, December.
    25. Yusuke Narita, 2020. "A Theory of Quasi-Experimental Evaluation of School Quality," Working Papers 2020-085, Human Capital and Economic Opportunity Working Group.
    26. Parag A. Pathak & Tayfun Sönmez, 2013. "School Admissions Reform in Chicago and England: Comparing Mechanisms by Their Vulnerability to Manipulation," American Economic Review, American Economic Association, vol. 103(1), pages 80-106, February.
    27. Papay, John P. & Willett, John B. & Murnane, Richard J., 2011. "Extending the regression-discontinuity approach to multiple assignment variables," Journal of Econometrics, Elsevier, vol. 161(2), pages 203-207, April.
    28. Seth D. Zimmerman, 2019. "Elite Colleges and Upward Mobility to Top Jobs and Top Incomes," American Economic Review, American Economic Association, vol. 109(1), pages 1-47, January.
    29. Atila Abdulkadiroglu & Parag A. Pathak & Alvin E. Roth, 2009. "Strategy-Proofness versus Efficiency in Matching with Indifferences: Redesigning the NYC High School Match," American Economic Review, American Economic Association, vol. 99(5), pages 1954-1978, December.
    30. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    31. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    32. Wellner, Jon A., 1981. "A Glivenko-Cantelli theorem for empirical measures of independent but non-identically distributed random variables," Stochastic Processes and their Applications, Elsevier, vol. 11(3), pages 309-312, August.
    33. Gonzalo Vazquez-Bare & Matias Cattaneo & Rocio Titiunik, 2016. "rdlocrand: a Stata Package for Inference in Regression Discontinuity Designs under Local Randomizati," 2016 Stata Conference 25, Stata Users Group.
    34. Umut Dur & Parag A. Pathak & Fei Song & Tayfun Sönmez, 2022. "Deduction Dilemmas: The Taiwan Assignment Mechanism," American Economic Journal: Microeconomics, American Economic Association, vol. 14(1), pages 164-185, February.
    35. Girum Abebe & Marcel Fafchamps & Michael Koelle & Simon Quinn, 2019. "Learning Management Through Matching: A Field Experiment Using Mechanism Design," CSAE Working Paper Series 2019-11, Centre for the Study of African Economies, University of Oxford.
    36. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    37. Ergin, Haluk & Sonmez, Tayfun, 2006. "Games of school choice under the Boston mechanism," Journal of Public Economics, Elsevier, vol. 90(1-2), pages 215-237, January.
    38. Jonah Rockoff & Lesley J. Turner, 2010. "Short-Run Impacts of Accountability on School Quality," American Economic Journal: Economic Policy, American Economic Association, vol. 2(4), pages 119-147, November.
    39. Brigham R. Frandsen, 2017. "Party Bias in Union Representation Elections: Testing for Manipulation in the Regression Discontinuity Design when the Running Variable is Discrete," Advances in Econometrics, in: Regression Discontinuity Designs, volume 38, pages 281-315, Emerald Group Publishing Limited.
    40. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    41. Guido Imbens & Stefan Wager, 2019. "Optimized Regression Discontinuity Designs," The Review of Economics and Statistics, MIT Press, vol. 101(2), pages 264-278, May.
    42. Matias D. Cattaneo & Roc ́ıo Titiunik & Gonzalo Vazquez-Bare, 2016. "Inference in regression discontinuity designs under local randomization," Stata Journal, StataCorp LP, vol. 16(2), pages 331-367, June.
    43. Atila Abdulkadiroglu & Tayfun Sönmez, 2003. "School Choice: A Mechanism Design Approach," American Economic Review, American Economic Association, vol. 93(3), pages 729-747, June.
    44. Beuermann, Diether & Jackson, C. Kirabo & Sierra, Ricardo, 2015. "Privately Managed Public Secondary Schools and Academic Achievement in Trinidad and Tobago: Evidence from Rule-Based Student Assignments," IDB Publications (Working Papers) 7308, Inter-American Development Bank.
    45. Sebastian Calonico & Matias D. Cattaneo & Max H. Farrell & Roc ́ıo Titiunik, 2017. "rdrobust: Software for regression-discontinuity designs," Stata Journal, StataCorp LP, vol. 17(2), pages 372-404, June.
    46. Bergman, Peter, 2018. "The Risks and Benefits of School Integration for Participating Students: Evidence from a Randomized Desegregation Program," IZA Discussion Papers 11602, Institute of Labor Economics (IZA).
    47. Cristian Pop-Eleches & Miguel Urquiola, 2013. "Going to a Better School: Effects and Behavioral Responses," American Economic Review, American Economic Association, vol. 103(4), pages 1289-1324, June.
    48. Burt S. Barnow & Matias D. Cattaneo & Rocío Titiunik & Gonzalo Vazquez‐Bare, 2017. "Comparing Inference Approaches for RD Designs: A Reexamination of the Effect of Head Start on Child Mortality," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 36(3), pages 643-681, June.
    49. Joshua D. Angrist & Miikka Rokkanen, 2015. "Wanna Get Away? Regression Discontinuity Estimation of Exam School Effects Away From the Cutoff," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1331-1344, December.
    50. Eduardo M. Azevedo & Jacob D. Leshno, 2016. "A Supply and Demand Framework for Two-Sided Matching Markets," Journal of Political Economy, University of Chicago Press, vol. 124(5), pages 1235-1268.
    51. Charalambos D. Aliprantis & Kim C. Border, 2006. "Infinite Dimensional Analysis," Springer Books, Springer, edition 0, number 978-3-540-29587-7, September.
    52. Elliott Peranson & Alvin E. Roth, 1999. "The Redesign of the Matching Market for American Physicians: Some Engineering Aspects of Economic Design," American Economic Review, American Economic Association, vol. 89(4), pages 748-780, September.
    53. Yan Chen & Onur Kesten, 2017. "Chinese College Admissions and School Choice Reforms: A Theoretical Analysis," Journal of Political Economy, University of Chicago Press, vol. 125(1), pages 99-139.
    54. Rothe, Christoph & Firpo, Sergio, 2019. "Properties Of Doubly Robust Estimators When Nuisance Functions Are Estimated Nonparametrically," Econometric Theory, Cambridge University Press, vol. 35(5), pages 1048-1087, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Atila Abdulkadiroglu & Joshua D. Angrist & Yusuke Narita & Parag A. Pathak, 2017. "Impact Evaluation in Matching Markets with General Tie-Breaking," NBER Working Papers 24172, National Bureau of Economic Research, Inc.
    2. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    3. Yusuke Narita, 2020. "A Theory of Quasi-Experimental Evaluation of School Quality," Working Papers 2020-085, Human Capital and Economic Opportunity Working Group.
    4. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    5. Yusuke Narita & Kohei Yata, 2021. "Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules," Working Papers 2021-022, Human Capital and Economic Opportunity Working Group.
    6. Joshua D. Angrist, 2022. "Empirical Strategies in Economics: Illuminating the Path From Cause to Effect," Econometrica, Econometric Society, vol. 90(6), pages 2509-2539, November.
    7. Narita, Yusuke & Yata, Kohei, 2022. "Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules," CEI Working Paper Series 2021-05, Center for Economic Institutions, Institute of Economic Research, Hitotsubashi University.
    8. Narita, Yusuke & Yata, Kohei, 2022. "Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules," Discussion Paper Series 730, Institute of Economic Research, Hitotsubashi University.
    9. Yusuke Narita, 2021. "A Theory of Quasi-Experimental Evaluation of School Quality," Management Science, INFORMS, vol. 67(8), pages 4982-5010, August.
    10. Atila Abdulkadiroğlu & Joshua D. Angrist & Yusuke Narita & Parag A. Pathak, 2017. "Research Design Meets Market Design: Using Centralized Assignment for Impact Evaluation," Econometrica, Econometric Society, vol. 85, pages 1373-1432, September.
    11. Atila Abdulkadiroğlu & Joshua Angrist & Parag Pathak, 2014. "The Elite Illusion: Achievement Effects at Boston and New York Exam Schools," Econometrica, Econometric Society, vol. 82(1), pages 137-196, January.
    12. Crespo Cristian, 2020. "Beyond Manipulation: Administrative Sorting in Regression Discontinuity Designs," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 164-181, January.
    13. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    14. Bugni, Federico A. & Canay, Ivan A., 2021. "Testing continuity of a density via g-order statistics in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 221(1), pages 138-159.
    15. Crespo Cristian, 2020. "Beyond Manipulation: Administrative Sorting in Regression Discontinuity Designs," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 164-181, January.
    16. Masayuki Sawada & Takuya Ishihara & Daisuke Kurisu & Yasumasa Matsuda, 2024. "Local-Polynomial Estimation for Multivariate Regression Discontinuity Designs," Papers 2402.08941, arXiv.org.
    17. Yusuki Narita, 2016. "(Non)Randomization: A Theory of Quasi-Experimental Evaluation of School Quality," Cowles Foundation Discussion Papers 2056R, Cowles Foundation for Research in Economics, Yale University, revised Aug 2017.
    18. Dur, Umut & Pathak, Parag A. & Sönmez, Tayfun, 2020. "Explicit vs. statistical targeting in affirmative action: Theory and evidence from Chicago's exam schools," Journal of Economic Theory, Elsevier, vol. 187(C).
    19. Babii, Andrii & Kumar, Rohit, 2023. "Isotonic regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 234(2), pages 371-393.
    20. Chen, Yan & Jiang, Ming & Kesten, Onur & Robin, Stéphane & Zhu, Min, 2018. "Matching in the large: An experimental study," Games and Economic Behavior, Elsevier, vol. 110(C), pages 295-317.

    More about this item

    Keywords

    causal inference; natural experiment; local propensity score; instrumental variables; unified enrollment; school report card; school value added;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • C78 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Bargaining Theory; Matching Theory
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hka:wpaper:2019-024. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jennifer Pachon (email available below). General contact details of provider: https://edirc.repec.org/data/mfichus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.