IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v170y2007i3p623-646.html
   My bibliography  Save this article

International surveys of educational achievement: how robust are the findings?

Author

Listed:
  • Giorgina Brown
  • John Micklewright
  • Sylke V. Schnepf
  • Robert Waldmann

Abstract

International surveys of educational achievement and functional literacy are increasingly common. We consider two aspects of the robustness of their results. First, we compare results from four surveys: the Trends in International Maths and Science Study, the Programme for International Student Assessment, the Progress in International Reading Literacy Study and the International Adult Literacy Survey. This contrasts with the standard approach which is to analyse just one survey in isolation. Second, we investigate whether results are sensitive to the choice of item response model that is used by survey organizers to aggregate respondents' answers into a single score. In both cases we focus on countries' average scores, the within-country differences in scores and on the association between the two. Copyright 2007 Royal Statistical Society.

Suggested Citation

  • Giorgina Brown & John Micklewright & Sylke V. Schnepf & Robert Waldmann, 2007. "International surveys of educational achievement: how robust are the findings?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(3), pages 623-646.
  • Handle: RePEc:bla:jorssa:v:170:y:2007:i:3:p:623-646
    as

    Download full text from publisher

    File URL: http://www.blackwell-synergy.com/doi/abs/10.1111/j.1467-985X.2006.00439.x
    File Function: link to full text
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kevin Denny, 2002. "New methods for comparing literacy across populations: insights from the measurement of poverty," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 165(3), pages 481-493.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Leading with my chin, I commented on Matthew Yglesias's blog
      by Robert in Robert's Stochastic Thoughts on 2010-08-18 22:56:00
    2. Matthew Yglesias is so broad that he even writes about things I
      by Robert in Robert's Stochastic Thoughts on 2008-12-13 06:54:00
    3. Kevin Drum on the kids these days

      THE KIDS THESE DAYS....PART

      by Robert in Robert's Stochastic Thoughts on 2008-12-10 07:07:00
    4. Ah Something I actually know something about.

      Kevin Drum has 2

      by Robert in Robert's Stochastic Thoughts on 2007-12-05 18:43:00
    5. The Company You Keep
      by Robert in angry bear on 2008-08-02 01:41:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alessandra Bonfiglioli & Gino Gancia, 2019. "Heterogeneity, selection and labor market disparities," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 31, pages 305-325, January.
    2. Matilde Bombardini & Giovanni Gallipoli & German Pupato, 2012. "Skill Dispersion and Trade Flows," American Economic Review, American Economic Association, vol. 102(5), pages 2327-2348, August.
    3. Lauri Peterson, 2014. "The Measurement of Non-economic Inequality in Well-Being Indices," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 119(2), pages 581-598, November.
    4. Schnepf, Sylke, 2018. "Insights into survey errors of large scale educational achievement surveys," Working Papers 2018-05, Joint Research Centre, European Commission (Ispra site).
    5. Francisco H. G. Ferreira & Jérémie Gignoux, 2011. "The Measurement of Educational Inequality: Achievement and Opportunity," Working Papers halshs-00646594, HAL.
    6. Micklewright, John & Schnepf, Sylke V., 2006. "Inequality of Learning in Industrialised Countries," IZA Discussion Papers 2517, Institute of Labor Economics (IZA).
    7. Schnepf, Sylke Viola, 2008. "Inequality of learning amongst immigrant children in industrialised countries," HWWI Research Papers 1-12, Hamburg Institute of International Economics (HWWI).
    8. Sylke Schnepf, 2007. "Immigrants’ educational disadvantage: an examination across ten countries and three surveys," Journal of Population Economics, Springer;European Society for Population Economics, vol. 20(3), pages 527-545, July.
    9. Mark Bailey & Vani Borooah, 2010. "What enhances mathematical ability? A cross-country analysis based on test scores of 15-year-olds," Applied Economics, Taylor & Francis Journals, vol. 42(29), pages 3723-3733.
    10. Luongo Patrizia, 2015. "Inequality of Opportunity in Educational Achievements: Cross-country and Intertemporal Comparisons," WIDER Working Paper Series 043, World Institute for Development Economic Research (UNU-WIDER).
    11. Cebreros Zurita Carlos Alfonso, 2018. "Labor Heterogeneity and the Pattern of Trade," Working Papers 2018-01, Banco de México.
    12. Svend Kreiner & Karl Christensen, 2014. "Analyses of Model Fit and Robustness. A New Look at the PISA Scaling Model Underlying Ranking of Countries According to Reading Literacy," Psychometrika, Springer;The Psychometric Society, vol. 79(2), pages 210-231, April.
    13. Marco Francesconi & Holly Sutherland & Francesca Zantomio, 2011. "A comparison of earnings measures from longitudinal and cross‐sectional surveys: evidence from the UK," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 297-326, April.
    14. Víctor Giménez & Claudio Thieme & Diego Prior & Emili Tortosa-Ausina, 2017. "An international comparison of educational systems: a temporal analysis in presence of bad outputs," Journal of Productivity Analysis, Springer, vol. 47(1), pages 83-101, February.
    15. John Jerrim & Álvaro Choi, 2013. "The mathematics skills of school children: how does England compare to the high performing east Asian jurisdictions?," Working Papers 2013/12, Institut d'Economia de Barcelona (IEB).
    16. Francisco H. G. Ferreira & Jérémie Gignoux, 2014. "The Measurement of Educational Inequality: Achievement and Opportunity," World Bank Economic Review, World Bank Group, vol. 28(2), pages 210-246.
    17. John Jerrim & Álvaro Choi, 2013. "The mathematics skills of school children: how does England compare to the high performing east Asian jurisdictions?," Working Papers 2013/12, Institut d'Economia de Barcelona (IEB).
    18. Jakubowski, Maciej & Pokropek, Artur, 2015. "Reading achievement progress across countries," International Journal of Educational Development, Elsevier, vol. 45(C), pages 77-88.
    19. John Jerrim & Alvaro Choi, 2013. "The mathematics skills of school children: How does England compare to the high performing East Asian jurisdictions?," DoQSS Working Papers 13-03, Department of Quantitative Social Science - UCL Institute of Education, University College London.
    20. Álvaro Choi & John Jerrim, 2015. "The use (and misuse) of Pisa in guiding policy reform: the case of Spain," Working Papers 2015/6, Institut d'Economia de Barcelona (IEB).
    21. Ã lvaro Choi & John Jerrim, 2015. "The use (and misuse) of PISA in guiding policy reform: the case of Spain?," DoQSS Working Papers 15-04, Department of Quantitative Social Science - UCL Institute of Education, University College London.
    22. repec:spr:soinre:v:138:y:2018:i:3:d:10.1007_s11205-017-1701-6 is not listed on IDEAS
    23. Agasisti, Tommaso & Gil-Izquierdo, María & Han, Seong Won, 2017. "ICT use at home for school-related tasks: what is the effect on a student’s achievement? Empirical evidence from OECD PISA data," MPRA Paper 81343, University Library of Munich, Germany.
    24. Álvaro Choi & María Gil & Mauro Mediavilla & Javier Valbuena, 2016. "Double toil and trouble: grade retention and academic performance," Working Papers 2016/7, Institut d'Economia de Barcelona (IEB).
    25. Zhang, Liang & Khan, Gulab & Tahirsylaj, Armend, 2015. "Student performance, school differentiation, and world cultures: Evidence from PISA 2009," International Journal of Educational Development, Elsevier, vol. 42(C), pages 43-53.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:170:y:2007:i:3:p:623-646. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley Content Delivery). General contact details of provider: http://edirc.repec.org/data/rssssea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.