IDEAS home Printed from https://ideas.repec.org/p/cer/papers/wp658.html
   My bibliography  Save this paper

Identification of School Admission Effects Using Propensity Scores Based on a Matching Market Structure

Author

Listed:
  • Marin Drlje

Abstract

A large literature estimates various school admission and graduation effects by employing variation in student admission scores around schools’ admission cutoffs, assuming (quasi-) random school assignment close to the cutoffs. In this paper, I present evidence suggesting that the samples corresponding to typical applications of the regression discontinuity design (RDD) fail to satisfy these assumptions. I distinguish ex-post randomization (as in admission lotteries applicable to those at the margin of admission) from ex-ante randomization, reflecting uncertainty about the market structure of applicants, which can be naturally quantified by resampling from the applicant population. Using data from the Croatian centralized collegeadmission system, I show that these ex-ante admission probabilities differ dramatically between treated and non-treated students within typical RDD bandwidths. Such unbalanced admission probability distributions suggest that bandwidths (and sample sizes) should be drastically reduced to avoid selection bias. I also show that a sizeable fraction of quasirandomized assignments occur outside of the typical RDD bandwidths, suggesting that these are also inefficient. As an alternative, I propose a new estimator, the Propensity Score Discontinuity Design (PSDD), based on all observations with random assignments, which compares outcomes of applicants matched on ex-ante admission probabilities, conditional on admission scores.

Suggested Citation

  • Marin Drlje, 2020. "Identification of School Admission Effects Using Propensity Scores Based on a Matching Market Structure," CERGE-EI Working Papers wp658, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
  • Handle: RePEc:cer:papers:wp658
    as

    Download full text from publisher

    File URL: http://www.cerge-ei.cz/pdf/wp/Wp658.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Adrienne M. Lucas & Isaac M. Mbiti, 2014. "Effects of School Quality on Student Achievement: Discontinuity Evidence from Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 6(3), pages 234-263, July.
    2. Gabrielle Fack & Julien Grenet & Yinghua He, 2019. "Beyond Truth-Telling: Preference Estimation with Centralized School Choice and College Admissions," American Economic Review, American Economic Association, vol. 109(4), pages 1486-1529, April.
    3. Atı̇la Abdulkadı̇roğlu & Joshua D. Angrist & Yusuke Narita & Parag Pathak, 2022. "Breaking Ties: Regression Discontinuity Design Meets Market Design," Econometrica, Econometric Society, vol. 90(1), pages 117-151, January.
    4. Atila Abdulkadiroğlu & Joshua D. Angrist & Yusuke Narita & Parag A. Pathak, 2017. "Research Design Meets Market Design: Using Centralized Assignment for Impact Evaluation," Econometrica, Econometric Society, vol. 85, pages 1373-1432, September.
    5. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    6. Gabrielle Fack & Julien Grenet & Yinghua He, 2019. "Beyond Truth-Telling: Preference Estimation with Centralized School Choice and College Admissions," American Economic Review, American Economic Association, vol. 109(4), pages 1486-1529, April.
    7. Atila Abdulkadiroğlu & Joshua Angrist & Parag Pathak, 2014. "The Elite Illusion: Achievement Effects at Boston and New York Exam Schools," Econometrica, Econometric Society, vol. 82(1), pages 137-196, January.
    8. Dustan, Andrew, 2018. "Family networks and school choice," Journal of Development Economics, Elsevier, vol. 134(C), pages 372-391.
    9. Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marco Ovidi, 2021. "Parents know better: primary school choice and student achievement in London," Working Papers 919, Queen Mary University of London, School of Economics and Finance.
    2. Ketel, Nadine & Oosterbeek, Hessel & Sovago, Sandor & van der Klaauw, Bas, 2023. "The (Un)Importance of School Assignment," IZA Discussion Papers 16591, Institute of Labor Economics (IZA).
    3. Aue, Robert & Bach, Maximilian & Heigle, Julia & Klein, Thilo & Pfeiffer, Friedhelm & Zapp, Kristina, 2020. "The implication of school admission rules for segregation and educational inequality: Research report," ZEW Expertises, ZEW - Leibniz Centre for European Economic Research, number 223254.
    4. Atı̇la Abdulkadı̇roğlu & Joshua D. Angrist & Yusuke Narita & Parag Pathak, 2022. "Breaking Ties: Regression Discontinuity Design Meets Market Design," Econometrica, Econometric Society, vol. 90(1), pages 117-151, January.
    5. Angrist, Joshua D. & Pathak, Parag A. & Zarate, Roman A., 2023. "Choice and consequence: Assessing mismatch at Chicago exam schools," Journal of Public Economics, Elsevier, vol. 223(C).
    6. Bütikofer, Aline & Ginja, Rita & Landaud, Fanny & Løken, Katrine V., 2020. "School Selectivity, Peers, and Mental Health," Working Papers in Economics 5/20, University of Bergen, Department of Economics.
    7. Kutscher, Macarena & Nath, Shanjukta & Urzúa, Sergio, 2023. "Centralized admission systems and school segregation: Evidence from a national reform," Journal of Public Economics, Elsevier, vol. 221(C).
    8. Atila Abdulkadiroğlu & Joshua D. Angrist & Yusuke Narita & Parag A. Pathak, 2017. "Research Design Meets Market Design: Using Centralized Assignment for Impact Evaluation," Econometrica, Econometric Society, vol. 85, pages 1373-1432, September.
    9. Marco Ovidi, 2022. "Parents Know Better: Sorting on Match Effects in Primary School," DISCE - Working Papers del Dipartimento di Economia e Finanza def121, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    10. Abdulkadiroglu, Atila & Andersson, Tommy, 2022. "School Choice," Working Papers 2022:4, Lund University, Department of Economics.
    11. Grenet, Julien & He, YingHua & Kübler, Dorothea, 2022. "Preference Discovery in University Admissions: The Case for Dynamic Multioffer Mechanisms," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 130(6), pages 1-1.
    12. Diether W Beuermann & C Kirabo Jackson & Laia Navarro-Sola & Francisco Pardo, 2023. "What is a Good School, and Can Parents Tell? Evidence on the Multidimensionality of School Output," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(1), pages 65-101.
    13. Robert Aue & Thilo Klein & Josue Ortega, 2020. "What Happens when Separate and Unequal School Districts Merge?," Papers 2006.13209, arXiv.org.
    14. Cook, Jason B., 2018. "Race-Blind Admissions, School Segregation, and Student Outcomes: Evidence from Race-Blind Magnet School Lotteries," IZA Discussion Papers 11909, Institute of Labor Economics (IZA).
    15. Jiafeng Chen, 2021. "Nonparametric Treatment Effect Identification in School Choice," Papers 2112.03872, arXiv.org, revised Oct 2023.
    16. Park, Albert & Shi, Xinzheng & Hsieh, Chang-tai & An, Xuehui, 2015. "Magnet high schools and academic performance in China: A regression discontinuity design," Journal of Comparative Economics, Elsevier, vol. 43(4), pages 825-843.
    17. Grenet, Julien & He, Yinghua & Kübler, Dorothea, 2019. "Decentralizing centralized matching markets: Implications from early offers in university admissions," Discussion Papers, Research Unit: Market Behavior SP II 2019-208, WZB Berlin Social Science Center.
    18. Gandil, Mikkel Høst, 2021. "Substitution Effects in College Admissions," Memorandum 3/2021, Oslo University, Department of Economics.
    19. Yusuki Narita, 2016. "(Non)Randomization: A Theory of Quasi-Experimental Evaluation of School Quality," Cowles Foundation Discussion Papers 2056R, Cowles Foundation for Research in Economics, Yale University, revised Aug 2017.
    20. Emil Chrisander & Andreas Bjerre-Nielsen, 2023. "Why Do Students Lie and Should We Worry? An Analysis of Non-truthful Reporting," Papers 2302.13718, arXiv.org, revised Mar 2023.

    More about this item

    Keywords

    RDD; PSDD; school admission effects; lottery;
    All these keywords.

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cer:papers:wp658. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lucie Vasiljevova (email available below). General contact details of provider: https://edirc.repec.org/data/eiacacz.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.