IDEAS home Printed from https://ideas.repec.org/a/gam/jstats/v4y2021i4p52-915d676608.html
   My bibliography  Save this article

Credibility of Causal Estimates from Regression Discontinuity Designs with Multiple Assignment Variables

Author

Listed:
  • Albert Whata

    (School of Natural and Applied Sciences, Sol Plaatje University, Kimberley 8301, South Africa)

  • Charles Chimedza

    (School of Statistics and Actuarial Science, University of the Witwatersrand, Johannesburg 2050, South Africa)

Abstract

In this paper, we determine treatment effects when the treatment assignment is based on two or more cut-off points of covariates rather than on one cut-off point of one assignment variable. using methods that are referred to as multivariate regression discontinuity designs (MRDD). One major finding of this paper is the discovery of new evidence that both matric points and household income have a huge impact on the probability of eligibility for funding from the National Student Financial Aid Scheme (NSFAS) to study for a bachelor’s degree program at universities in South Africa. This evidence will inform policymakers and educational practitioners on the effects of matric points and household income on the eligibility for NSFAS funding. The availability of the NSFAS grant impacts greatly students’ decisions to attend university or seek other opportunities elsewhere. Using the frontier MRDD analytical results, barely scoring matric points greater than or equal to 25 points compared to scoring matric points less than 25 for students whose household income is less than R350,000 (≈US$2500) increases the probability of eligibility for NSFAS funding by a significant 3.75 ( p -value = 0.0001 < 0.05) percentage points. Therefore, we have shown that the frontier MRDD can be employed to determine the causal effects of barely meeting the requirements of one assignment variable, among the subjects that either meet or fail to meet the requirements of the other assignment variable.

Suggested Citation

  • Albert Whata & Charles Chimedza, 2021. "Credibility of Causal Estimates from Regression Discontinuity Designs with Multiple Assignment Variables," Stats, MDPI, vol. 4(4), pages 1-23, November.
  • Handle: RePEc:gam:jstats:v:4:y:2021:i:4:p:52-915:d:676608
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-905X/4/4/52/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2571-905X/4/4/52/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    2. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2020. "Simple Local Polynomial Density Estimators," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1449-1455, July.
    3. Joshua Goodman & Julia Melkers & Amanda Pallais, 2019. "Can Online Delivery Increase Access to Education?," Journal of Labor Economics, University of Chicago Press, vol. 37(1), pages 1-34.
    4. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    5. Keele, Luke J. & Titiunik, Rocío, 2015. "Geographic Boundaries as Regression Discontinuities," Political Analysis, Cambridge University Press, vol. 23(1), pages 127-155, January.
    6. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    7. Thomas J. Kane, 2003. "A Quasi-Experimental Estimate of the Impact of Financial Aid on College-Going," NBER Working Papers 9703, National Bureau of Economic Research, Inc.
    8. Sebastian Calonico & Matias D. Cattaneo & Max H. Farrell & Roc ́ıo Titiunik, 2017. "rdrobust: Software for regression-discontinuity designs," Stata Journal, StataCorp LP, vol. 17(2), pages 372-404, June.
    9. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    10. Papay, John P. & Willett, John B. & Murnane, Richard J., 2011. "Extending the regression-discontinuity approach to multiple assignment variables," Journal of Econometrics, Elsevier, vol. 161(2), pages 203-207, April.
    11. Matsudaira, Jordan D., 2008. "Mandatory summer school and student achievement," Journal of Econometrics, Elsevier, vol. 142(2), pages 829-850, February.
    12. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2018. "Manipulation testing based on density discontinuity," Stata Journal, StataCorp LP, vol. 18(1), pages 234-261, March.
    13. Neil Garrod & Angelique Wildschut, 2021. "How large is the missing middle and what would it cost to fund?," Development Southern Africa, Taylor & Francis Journals, vol. 38(3), pages 484-491, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    2. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    3. Kämpfen, F.; & Gómez-Olivé, X.; & O’Donnell, O.; & Riumallo Herl, C.;, 2023. "Effectiveness of Population-Based Hypertension Screening: A Multidimensional Regression Discontinuity Design," Health, Econometrics and Data Group (HEDG) Working Papers 23/15, HEDG, c/o Department of Economics, University of York.
    4. Giuseppe Francesco Gori & Patrizia Lattarulo & Marco Mariani, 2021. "The Expediting Effect of Monitoring on Infrastructural Works. A Regression-Discontinuity Approach with Multiple Assignment Variables," Papers 2102.09625, arXiv.org.
    5. Vanessa Cirulli & Giuliano Resce & Marco Ventura, 2021. "Co-payment exemption and healthcare consumption. Quasi-experimental evidence from Italy," Working Papers in Public Economics 203, University of Rome La Sapienza, Department of Economics and Law.
    6. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    7. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    8. Pasquini, Ricardo A., 2021. "Effects of regulating the brokerage commission in the rental market: Evidence from Buenos Aires," Journal of Housing Economics, Elsevier, vol. 54(C).
    9. Sacha Kapoor & Matthijs Oosterveen & Dinand Webbink, 2021. "The price of forced attendance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(2), pages 209-227, March.
    10. Federico Crippa, 2024. "Manipulation Test for Multidimensional RDD," Papers 2402.10836, arXiv.org.
    11. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    12. Burgherr, David, 2022. "Behavioral Responses to a Pension Savings Mandate : Quasi-experimental Evidence from Swiss Tax Data," CAGE Online Working Paper Series 645, Competitive Advantage in the Global Economy (CAGE).
    13. Yiqi Liu & Yuan Qi, 2023. "Using Forests in Multivariate Regression Discontinuity Designs," Papers 2303.11721, arXiv.org.
    14. Eibich, Peter & Siedler, Thomas, 2020. "Retirement, intergenerational time transfers, and fertility," European Economic Review, Elsevier, vol. 124(C).
    15. Mellace, Giovanni & Ventura, Marco, 2019. "Intended and unintended effects of public incentives for innovation. Quasi-experimental evidence from Italy," Discussion Papers on Economics 9/2019, University of Southern Denmark, Department of Economics.
    16. Sebastian Calonico & Matias D Cattaneo & Max H Farrell, 2020. "Optimal bandwidth choice for robust bias-corrected inference in regression discontinuity designs [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 192-210.
    17. Bergantino, Angela S. & Intini, Mario & Percoco, Marco, 2021. "New car taxation and its unintended environmental consequences," Transportation Research Part A: Policy and Practice, Elsevier, vol. 148(C), pages 36-48.
    18. Luís Felipe Batista de Oliveira & Rafael Terra, 2016. "Impact of school day extension on educational outcomes: evidence from Mais Educação in Brazil," One Pager 329, International Policy Centre for Inclusive Growth.
    19. Gurgand, Marc & Lorenceau, Adrien & Mélonio, Thomas, 2023. "Student loans: Credit constraints and higher education in South Africa," Journal of Development Economics, Elsevier, vol. 161(C).
    20. Crespo Cristian, 2020. "Beyond Manipulation: Administrative Sorting in Regression Discontinuity Designs," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 164-181, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jstats:v:4:y:2021:i:4:p:52-915:d:676608. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.