IDEAS home Printed from https://ideas.repec.org/a/kap/jeczfn/v129y2020i3d10.1007_s00712-019-00682-8.html
   My bibliography  Save this article

Exploring the robustness of country rankings by educational attainment

Author

Listed:
  • Carsten Schroeder

    (Free University Berlin)

  • Shlomo Yitzhaki

    (Hebrew University)

Abstract

The measurement scale of exam scores is ordinal. This ordinal measurement implies that monotonic transformations of published scales convey the same information. Hence, countries should not be ranked according to averaged scores because there may be transformations that would change the mean-based rankings. We suggest alternatives to the mean-based ranking procedure that yield informative and robust rankings. An implementation of these procedures, using PISA 2012 math scores, suggests that previous mean-based country rankings are sensitive to the aforementioned transformations.

Suggested Citation

  • Carsten Schroeder & Shlomo Yitzhaki, 2020. "Exploring the robustness of country rankings by educational attainment," Journal of Economics, Springer, vol. 129(3), pages 271-296, April.
    • Handle: RePEc:kap:jeczfn:v:129:y:2020:i:3:d:10.1007_s00712-019-00682-8
    DOI: 10.1007/s00712-019-00682-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00712-019-00682-8
    File Function: Abstract
    Download Restriction: no
    File URL: https://libkey.io/10.1007/s00712-019-00682-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Schröder, Carsten & Yitzhaki, Shlomo, 2017. "Revisiting the evidence for cardinal treatment of ordinal variables," European Economic Review, Elsevier, vol. 92(C), pages 337-358.
    2. Elizabeth U. Cascio & Douglas O. Staiger, 2012. "Knowledge, Tests, and Fadeout in Educational Interventions," NBER Working Papers 18038, National Bureau of Economic Research, Inc.
    3. Jeffrey Penney, 2017. "Test Score Measurement and the Black-White Test Score Gap," The Review of Economics and Statistics, MIT Press, vol. 99(4), pages 652-656, July.
    4. Timothy N. Bond & Kevin Lang, 2013. "The Evolution of the Black-White Test Score Gap in Grades K–3: The Fragility of Results," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1468-1479, December.
    5. Kevin Lang, 2010. "Measurement Matters: Perspectives on Education Policy from an Economist and School Board Member," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 167-182, Summer.
    6. G. Hanoch & H. Levy, 1969. "The Efficiency Analysis of Choices Involving Risk," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 36(3), pages 335-346.
    7. Frederic Lord, 1975. "The ‘ability’ scale in item characteristic curve theory," Psychometrika, Springer;The Psychometric Society, vol. 40(2), pages 205-217, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Avvisati, Francesco & Givord, Pauline, 2023. "The learning gain over one school year among 15-year-olds: An international comparison based on PISA," Labour Economics, Elsevier, vol. 84(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jeffrey R. Bloem & Andrew J. Oswald, 2022. "The Analysis of Human Feelings: A Practical Suggestion for a Robustness Test," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 68(3), pages 689-710, September.
    2. Eric R. Nielsen, 2015. "Achievement Gap Estimates and Deviations from Cardinal Comparability," Finance and Economics Discussion Series 2015-40, Board of Governors of the Federal Reserve System (U.S.).
    3. Shuo Liu & Nick Netzer, 2023. "Happy Times: Measuring Happiness Using Response Times," American Economic Review, American Economic Association, vol. 113(12), pages 3289-3322, December.
    4. Wan, Sirui & Bond, Timothy N. & Lang, Kevin & Clements, Douglas H. & Sarama, Julie & Bailey, Drew H., 2021. "Is intervention fadeout a scaling artefact?," Economics of Education Review, Elsevier, vol. 82(C).
    5. Nirav Mehta, 2019. "Measuring quality for use in incentive schemes: The case of “shrinkage” estimators," Quantitative Economics, Econometric Society, vol. 10(4), pages 1537-1577, November.
    6. Eric R. Nielsen, 2015. "The Income-Achievement Gap and Adult Outcome Inequality," Finance and Economics Discussion Series 2015-41, Board of Governors of the Federal Reserve System (U.S.).
    7. Sonia Bhalotra & Martin Karlsson & Therese Nilsson & Nina Schwarz, 2022. "Infant Health, Cognitive Performance, and Earnings: Evidence from Inception of the Welfare State in Sweden," The Review of Economics and Statistics, MIT Press, vol. 104(6), pages 1138-1156, November.
    8. Monique De Haan & Edwin Leuven, 2020. "Head Start and the Distribution of Long-Term Education and Labor Market Outcomes," Journal of Labor Economics, University of Chicago Press, vol. 38(3), pages 727-765.
    9. Maggie Jones & Michael Barber, 2019. "Inequalities in Test Scores between Indigenous and Non-Indigenous Youth in Canada," Department Discussion Papers 1904, Department of Economics, University of Victoria.
    10. Hull, Marie & Norris, Jonathan, 2020. "The skill development of children of immigrants," Economics of Education Review, Elsevier, vol. 78(C).
    11. Xavier Cirera & Diego A. Comin & Marcio Cruz & Kyung Min Lee, 2020. "Anatomy of Technology in the Firm," NBER Working Papers 28080, National Bureau of Economic Research, Inc.
    12. Schwerdt, Guido & West, Martin R. & Winters, Marcus A., 2017. "The effects of test-based retention on student outcomes over time: Regression discontinuity evidence from Florida," Journal of Public Economics, Elsevier, vol. 152(C), pages 154-169.
    13. Jeffrey Penney, 2017. "Racial Interaction Effects and Student Achievement," Education Finance and Policy, MIT Press, vol. 12(4), pages 447-467, Fall.
    14. Byrne, Kieran & Plekhanov, Alexander, 2021. "Education reforms and adult skills: Evidence from Estonia," Economics of Education Review, Elsevier, vol. 82(C).
    15. Domicolo, Carly & Nielsen, Eric, 2022. "Male–female achievement variance comparisons are not robust," Economics Letters, Elsevier, vol. 220(C).
    16. Sloczynski, Tymon, 2018. "Average Gaps and Oaxaca's Blinder Decompositions: A Cautionary Tale about Regression Estimates of Racial Differences in Labor Market Outcomes," IZA Discussion Papers 12041, Institute of Labor Economics (IZA).
    17. Tymon Słoczyński, 2020. "Average Gaps and Oaxaca–Blinder Decompositions: A Cautionary Tale about Regression Estimates of Racial Differences in Labor Market Outcomes," ILR Review, Cornell University, ILR School, vol. 73(3), pages 705-729, May.
    18. Eric R. Nielsen, 2019. "Test Questions, Economic Outcomes, and Inequality," Finance and Economics Discussion Series 2019-013, Board of Governors of the Federal Reserve System (U.S.).
    19. Schröder, Carsten & Yitzhaki, Shlomo, 2017. "Revisiting the evidence for cardinal treatment of ordinal variables," European Economic Review, Elsevier, vol. 92(C), pages 337-358.
    20. Elizabeth U. Cascio & Douglas O. Staiger, 2012. "Knowledge, Tests, and Fadeout in Educational Interventions," NBER Working Papers 18038, National Bureau of Economic Research, Inc.

    More about this item

    Keywords

    Latent ability; PISA; Test scores; Education; Schooling;
    All these keywords.

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • D04 - Microeconomics - - General - - - Microeconomic Policy: Formulation; Implementation; Evaluation
    • D30 - Microeconomics - - Distribution - - - General
    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement
    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jeczfn:v:129:y:2020:i:3:d:10.1007_s00712-019-00682-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.