IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp15414.html
   My bibliography  Save this paper

Mean Convergence, Combinatorics, and Grade-Point Averages

Author

Listed:
  • Waddell, Glen R.

    (University of Oregon)

  • McDonough, Robert

    (University of Oregon)

Abstract

While comparing students across large differences in GPA follows one's intuition that higher GPAs correlate positively with higher-performing students, this need not be the case locally. Grade-point averaging is fundamentally a combinatorics problem, and thereby challenges inference based on local comparisons—this is especially true when students have experienced only small numbers of classes. While the effect of combinatorics diminishes in larger numbers of classes, mean convergence then has us jeopardize local comparability as GPA better delineates students of different ability. Given these two characteristics in decoding GPA, we discuss the advantages of machine-learning approaches to identifying treatment in educational settings.

Suggested Citation

  • Waddell, Glen R. & McDonough, Robert, 2022. "Mean Convergence, Combinatorics, and Grade-Point Averages," IZA Discussion Papers 15414, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp15414
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp15414.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alan I. Barreca & Jason M. Lindo & Glen R. Waddell, 2016. "Heaping-Induced Bias In Regression-Discontinuity Designs," Economic Inquiry, Western Economic Association International, vol. 54(1), pages 268-293, January.
    2. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    3. Alan I. Barreca & Melanie Guldi & Jason M. Lindo & Glen R. Waddell, 2011. "Saving Babies? Revisiting the effect of very low birth weight classification," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 2117-2123.
    4. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    5. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    6. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    7. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    8. Michal Kolesár & Christoph Rothe, 2018. "Inference in Regression Discontinuity Designs with a Discrete Running Variable," American Economic Review, American Economic Association, vol. 108(8), pages 2277-2304, August.
    9. Lee, David S. & Card, David, 2008. "Regression discontinuity inference with specification error," Journal of Econometrics, Elsevier, vol. 142(2), pages 655-674, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    2. Alessio Gaggero & Getinet Haile, 2020. "Does class size matter in postgraduate education?," Manchester School, University of Manchester, vol. 88(3), pages 489-505, June.
    3. Lee, Ajin, 2020. "How do hospitals respond to managed care? Evidence from at-risk newborns," Journal of Public Economics, Elsevier, vol. 184(C).
    4. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    5. Heinesen, Eskil, 2018. "Admission to higher education programmes and student educational outcomes and earnings–Evidence from Denmark," Economics of Education Review, Elsevier, vol. 63(C), pages 1-19.
    6. Bartalotti Otávio, 2019. "Regression Discontinuity and Heteroskedasticity Robust Standard Errors: Evidence from a Fixed-Bandwidth Approximation," Journal of Econometric Methods, De Gruyter, vol. 8(1), pages 1-26, January.
    7. Lochmann, Alexia & Rapoport, Hillel & Speciale, Biagio, 2019. "The effect of language training on immigrants’ economic integration: Empirical evidence from France," European Economic Review, Elsevier, vol. 113(C), pages 265-296.
    8. Di Giacomo, Marina & Piacenza, Massimiliano & Siciliani, Luigi & Turati, Gilberto, 2022. "The effect of co-payments on the take-up of prenatal tests," Journal of Health Economics, Elsevier, vol. 81(C).
    9. Meyer, Andrew G., 2017. "The impact of education on political ideology: Evidence from European compulsory education reforms," Economics of Education Review, Elsevier, vol. 56(C), pages 9-23.
    10. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    11. Davezies, Laurent & Le Barbanchon, Thomas, 2017. "Regression discontinuity design with continuous measurement error in the running variable," Journal of Econometrics, Elsevier, vol. 200(2), pages 260-281.
    12. Li, Han & Li, Jiangyi & Lu, Yi & Xie, Huihua, 2020. "Housing wealth and labor supply: Evidence from a regression discontinuity design," Journal of Public Economics, Elsevier, vol. 183(C).
    13. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    14. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    15. Gaggero, Alessio & Gil, Joan & Jiménez-Rubio, Dolores & Zucchelli, Eugenio, 2022. "Does health information affect lifestyle behaviours? The impact of a diabetes diagnosis," Social Science & Medicine, Elsevier, vol. 314(C).
    16. Xu, Ke-Li, 2017. "Regression discontinuity with categorical outcomes," Journal of Econometrics, Elsevier, vol. 201(1), pages 1-18.
    17. Atay, Salim & Asik, Gunes A. & Tumen, Semih, 2023. "Impact of Graduating with Honors on Entry Wages of Economics Majors," IZA Discussion Papers 16080, Institute of Labor Economics (IZA).
    18. Adam C. Sales & Ben B. Hansen, 2020. "Limitless Regression Discontinuity," Journal of Educational and Behavioral Statistics, , vol. 45(2), pages 143-174, April.
    19. Matti Sarvimäki & Kari Hämäläinen, 2016. "Integrating Immigrants: The Impact of Restructuring Active Labor Market Programs," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 479-508.
    20. Matteo Picchio & Jan C. van Ours, 2020. "Mental Health Effects of Retirement," De Economist, Springer, vol. 168(3), pages 419-452, September.

    More about this item

    Keywords

    GPA; grades; program evaluation; random forest; regression discontinuity;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp15414. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.