IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2309.10642.html
   My bibliography  Save this paper

Correcting Sample Selection Bias in PISA Rankings

Author

Listed:
  • Onil Boussim

Abstract

This paper addresses the critical issue of sample selection bias in cross-country comparisons based on international assessments such as the Programme for International Student Assessment (PISA). Although PISA is widely used to benchmark educational performance across countries, it samples only students who remain enrolled in school at age 15. This introduces survival bias, particularly in countries with high dropout rates, potentially leading to distorted comparisons. To correct for this bias, I develop a simple adjustment of the classical Heckman selection model tailored to settings with fully truncated outcome data. My approach exploits the joint normality of latent errors and leverages information on the selection rate, allowing identification of the counterfactual mean outcome for the full population of 15-year-olds. Applying this method to PISA 2018 data, I show that adjusting for selection bias results in substantial changes in country rankings based on average performance. These results highlight the importance of accounting for non-random sample selection to ensure accurate and policy-relevant international comparisons of educational outcomes.

Suggested Citation

  • Onil Boussim, 2023. "Correcting Sample Selection Bias in PISA Rankings," Papers 2309.10642, arXiv.org, revised Oct 2025.
  • Handle: RePEc:arx:papers:2309.10642
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2309.10642
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:hal:pseose:halshs-01030825 is not listed on IDEAS
    2. Manuel Arellano & Stéphane Bonhomme, 2017. "Quantile Selection Models With an Application to Understanding Changes in Wage Inequality," Econometrica, Econometric Society, vol. 85, pages 1-28, January.
    3. Hanushek, Eric A. & Woessmann, Ludger, 2011. "Sample selectivity and the validity of international student achievement tests in economic research," Economics Letters, Elsevier, vol. 110(2), pages 79-82, February.
    4. Francisco H. G. Ferreira & Jérémie Gignoux, 2014. "The Measurement of Educational Inequality: Achievement and Opportunity," The World Bank Economic Review, World Bank, vol. 28(2), pages 210-246.
    5. Victor Chernozhukov & Ivan Fernandez-Val & Siyi Luo, 2023. "Distribution regression with sample selection and UK wage decomposition," CeMMAP working papers 09/23, Institute for Fiscal Studies.
    6. Patrick Mcewan & Jeffery Marshall, 2004. "Why does academic achievement vary across countries? Evidence from Cuba and Mexico," Education Economics, Taylor & Francis Journals, vol. 12(3), pages 205-217.
    7. Ministry of Human Resource Development, GOI, 2020. "National Education Policy 2020," Working Papers id:13106, eSocialSciences.
    8. Heckman, James J, 1974. "Shadow Prices, Market Wages, and Labor Supply," Econometrica, Econometric Society, vol. 42(4), pages 679-694, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Iván Fernández‐Val & Aico van Vuuren & Francis Vella & Franco Peracchi, 2023. "Selection and the distribution of female real hourly wages in the United States," Quantitative Economics, Econometric Society, vol. 14(2), pages 571-607, May.
    2. Victor Chernozhukov & Ivan Fernandez-Val & Siyi Luo, 2023. "Distribution regression with sample selection and UK wage decomposition," CeMMAP working papers 09/23, Institute for Fiscal Studies.
    3. Roger Koenker, 2017. "Quantile regression 40 years on," CeMMAP working papers 36/17, Institute for Fiscal Studies.
    4. Fortin, Nicole & Lemieux, Thomas & Firpo, Sergio, 2011. "Decomposition Methods in Economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 1, pages 1-102, Elsevier.
    5. Seonho Shin, 2022. "To work or not? Wages or subsidies?: Copula-based evidence of subsidized refugees’ negative selection into employment," Empirical Economics, Springer, vol. 63(4), pages 2209-2252, October.
    6. Iv'an Fern'andez-Val & Franco Peracchi & Aico van Vuuren & Francis Vella, 2018. "Selection and the Distribution of Female Hourly Wages in the U.S," Papers 1901.00419, arXiv.org, revised Jan 2022.
    7. Mustafizur Rahman & Md. Al-Hasan, 2022. "The Reverse Gender Wage Gap in Bangladesh: Demystifying the Counterintuitive," The Indian Journal of Labour Economics, Springer;The Indian Society of Labour Economics (ISLE), vol. 65(4), pages 929-950, December.
    8. Liu, Ruixuan & Yu, Zhengfei, 2022. "Sample selection models with monotone control functions," Journal of Econometrics, Elsevier, vol. 226(2), pages 321-342.
    9. Maasoumi, Esfandiar & Wang, Le, 2017. "What can we learn about the racial gap in the presence of sample selection?," Journal of Econometrics, Elsevier, vol. 199(2), pages 117-130.
    10. Kenza Elass, 2022. "The multiple dimensions of selection into employment," Working Papers hal-03788508, HAL.
    11. Elass, Kenza, 2024. "Male and female selection effects on gender wage gaps in three countries," Labour Economics, Elsevier, vol. 87(C).
    12. Mustafizur Rahman & Md. Al-Hasan, 2021. "Explaining Pro-Women Gender Wage Gap in Bangladesh," CPD Report 19, Centre for Policy Dialogue (CPD).
    13. Masayuki Hirukawa & Di Liu & Irina Murtazashvili & Artem Prokhorov, 2024. "DS-HECK: double-lasso estimation of Heckman selection model," Advanced Studies in Theoretical and Applied Econometrics, in: Subal C. Kumbhakar & Robin C. Sickles & Hung-Jen Wang (ed.), Advances in Applied Econometrics, pages 711-739, Springer.
    14. Kenza Elass, 2022. "The multiple dimensions of selection into employment," French Stata Users' Group Meetings 2022 06, Stata Users Group.
    15. Kenza Elass, 2022. "The multiple dimensions of selection into employment," AMSE Working Papers 2219, Aix-Marseille School of Economics, France.
    16. Roger Koenker, 2017. "Quantile regression 40 years on," CeMMAP working papers CWP36/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Katherine L. Nelson & Byron J. Powell & Brent Langellier & Félice Lê-Scherban & Paul Shattuck & Kimberly Hoagwood & Jonathan Purtle, "undated". "State Policies that Impact the Design of Children’s Mental Health Services: A Modified Delphi Study," Mathematica Policy Research Reports 27128eeb589049fca3f36053b, Mathematica Policy Research.
    18. Ercio Muñoz & Mariel Siravegna, 2021. "Implementing quantile selection models in Stata," Stata Journal, StataCorp LLC, vol. 21(4), pages 952-971, December.
    19. Michelle Sheran Sylvester, 2007. "The Career and Family Choices of Women: A Dynamic Analysis of Labor Force Participation, Schooling, Marriage and Fertility Decisions," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 10(3), pages 367-399, July.
    20. Jeremy T. Fox, 2010. "Estimating the Employer Switching Costs and Wage Responses of Forward-Looking Engineers," Journal of Labor Economics, University of Chicago Press, vol. 28(2), pages 357-412, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2309.10642. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.