IDEAS home Printed from https://ideas.repec.org/p/qss/dqsswp/1504.html
   My bibliography  Save this paper

The use (and misuse) of PISA in guiding policy reform: the case of Spain?

Author

Listed:
  • Ã lvaro Choi

    (Department of Public Economics, Political Economy and Spanish Economy, Faculty of Economics and Business, University of Barcelona)

  • John Jerrim

    (Department of Quantitative Social Science, Institute of Education, University College London)

Abstract

In 2013 Spain introduced a series of educational reforms explicitly inspired by the Programme for International Student Assessment (PISA) 2012 results. These reforms were mainly implemented in secondary education based upon the assumption that this is where Spain's educational problems lie. This paper questions this assumption by attempting to identify the point where Spanish children fall behind young people in other developed counties in terms of their reading skills. Specifically, by drawing data from multiple international assessments, we are able to explore how cross-national differences in reading skills change as children age. Consideration is given to both the average level of achievement and the evolution of educational inequalities. Our conclusion is that policymakers have focused their efforts on the wrong part of the education system; educational achievement is low in Spain (and educational inequalities large) long before children enter secondary school. This study therefore serves as a note of caution against simplistic interpretation of the PISA rankings; policymakers must take a more nuanced approach when enacting important educational reforms.

Suggested Citation

  • Ã lvaro Choi & John Jerrim, 2015. "The use (and misuse) of PISA in guiding policy reform: the case of Spain?," DoQSS Working Papers 15-04, Quantitative Social Science - UCL Social Research Institute, University College London.
    • Handle: RePEc:qss:dqsswp:1504
    as

    Download full text from publisher

    File URL: https://repec.ucl.ac.uk/REPEc/pdf/qsswp1504.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), 2011. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 4, number 4, June.
    2. Francisco H. G. Ferreira & Jérémie Gignoux, 2014. "The Measurement of Educational Inequality: Achievement and Opportunity," The World Bank Economic Review, World Bank, vol. 28(2), pages 210-246.
    3. Hanushek, Eric A. & Woessmann, Ludger, 2011. "The Economics of International Differences in Educational Achievement," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 2, pages 89-200, Elsevier.
    4. John Jerrim & John Micklewright, 2012. "Socioeconomic gradients in children's cognitive skills: Are cross-country comparisons robust to who reports family background?," DoQSS Working Papers 12-06, Quantitative Social Science - UCL Social Research Institute, University College London.
    5. Prokic-Breuer, T. & Dronkers, J., 2012. "The high performance of Dutch and Flemish 15-year-old native pupils: explaining country differences in math scores between highly stratified educational systems," ROA Research Memorandum 008, Maastricht University, Research Centre for Education and the Labour Market (ROA).
    6. Giorgina Brown & John Micklewright & Sylke V. Schnepf & Robert Waldmann, 2007. "International surveys of educational achievement: how robust are the findings?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(3), pages 623-646, July.
    7. Veruska Oppedisano & Gilberto Turati, 2015. "What are the causes of educational inequality and of its evolution over time in Europe? Evidence from PISA," Education Economics, Taylor & Francis Journals, vol. 23(1), pages 3-24, February.
    8. John Jerrim, 2012. "The socio-economic gradient in teenagers' literacy skills: how does England compare to other countries?," DoQSS Working Papers 12-04, Quantitative Social Science - UCL Social Research Institute, University College London.
    9. Goldthorpe, John H. & McKnight, Abigail, 2004. "The economic basis of social class," LSE Research Online Documents on Economics 6312, London School of Economics and Political Science, LSE Library.
    10. John Jerrim & Anna Vignoles, 2013. "Social mobility, regression to the mean and the cognitive development of high ability children from disadvantaged homes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(4), pages 887-906, October.
    11. John H Goldthorpe & Abigail McKnight, 2004. "The Economic Basis of Social Class," CASE Papers 080, Centre for Analysis of Social Exclusion, LSE.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zlata Bruckauf & Yekaterina Chzhen & UNICEF Innocenti Research Centre, 2016. "Education for All? Measuring inequality of educational outcomes among 15-year-olds across 39 industrialized nations," Papers inwopa843, Innocenti Working Papers.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Álvaro Choi & John Jerrim, 2015. "The use (and misuse) of Pisa in guiding policy reform: the case of Spain," Working Papers 2015/6, Institut d'Economia de Barcelona (IEB).
    2. Engzell, Per, 2017. "What Do Books in the Home Proxy For? A Cautionary Tale," Working Paper Series 1/2016, Stockholm University, Swedish Institute for Social Research.
    3. Álvaro Choi & María Gil & Mauro Mediavilla & Javier Valbuena, 2018. "The Evolution of Educational Inequalities in Spain: Dynamic Evidence from Repeated Cross-Sections," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 138(3), pages 853-872, August.
    4. Álvaro Choi & María Gil & Mauro Mediavilla & Javier Valbuena, 2016. "The evolution of educational inequalities in Spain: dynamic evidence from repeated cross-sections," Working Papers 2016/25, Institut d'Economia de Barcelona (IEB).
    5. John Jerrim & Álvaro Choi, 2013. "The mathematics skills of school children: how does England compare to the high performing east Asian jurisdictions?," Working Papers 2013/12, Institut d'Economia de Barcelona (IEB).
    6. Tommaso Agasisti & Sergio Longobardi & Vincenzo Prete & Felice Russo, 2018. "Multidimensional poverty measures for analysing educational poverty in European countries," Working papers 73, Società Italiana di Economia Pubblica.
    7. John Jerrim & Álvaro Choi, 2013. "The mathematics skills of school children: how does England compare to the high performing east Asian jurisdictions?," Working Papers 2013/12, Institut d'Economia de Barcelona (IEB).
    8. John Jerrim & Alvaro Choi, 2013. "The mathematics skills of school children: How does England compare to the high performing East Asian jurisdictions?," DoQSS Working Papers 13-03, Quantitative Social Science - UCL Social Research Institute, University College London.
    9. Catherine Haeck & Pierre Lefebvre, 2020. "The Evolution of Cognitive Skills Inequalities by Socioeconomic Status across Canada," Working Papers 20-04, Research Group on Human Capital, University of Quebec in Montreal's School of Management.
    10. Jo Blanden & Matthias Doepke & Jan Stuhler, 2022. "Education inequality," CEP Discussion Papers dp1849, Centre for Economic Performance, LSE.
    11. Tommaso Agasisti & Francesco Avvisati & Francesca Borgonovi & Sergio Longobardi, 2021. "What School Factors are Associated with the Success of Socio-Economically Disadvantaged Students? An Empirical Investigation Using PISA Data," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 157(2), pages 749-781, September.
    12. Gregorio Gimenez & Luis Vargas-Montoya, 2021. "ICT Use and Successful Learning: The Role of the Stock of Human Capital," Mathematics, MDPI, vol. 9(14), pages 1-15, July.
    13. Paul Anand & Jere R. Behrman & Hai-Anh H. Dang & Sam Jones, 2018. "Inequality of opportunity in education: Accounting for the contributions of Sibs, schools and sorting across East Africa," Working Papers 480, ECINEQ, Society for the Study of Economic Inequality.
    14. Cattaneo, Maria Alejandra & Wolter, Stefan C., 2012. "Migration Policy Can Boost PISA Results: Findings from a Natural Experiment," IZA Discussion Papers 6300, Institute of Labor Economics (IZA).
    15. Eric A. Hanushek & Jacob D. Light & Paul E. Peterson & Laura M. Talpey & Ludger Woessmann, 2022. "Long-run Trends in the U.S. SES-Achievement Gap," Education Finance and Policy, MIT Press, vol. 17(4), pages 608-640, Fall.
    16. Eyles, Andrew & Machin, Stephen & McNally, Sandra, 2017. "Unexpected school reform: Academisation of primary schools in England," Journal of Public Economics, Elsevier, vol. 155(C), pages 108-121.
    17. Eric A. Hanushek & Guido Schwerdt & Ludger Woessmann & Lei Zhang, 2017. "General Education, Vocational Education, and Labor-Market Outcomes over the Lifecycle," Journal of Human Resources, University of Wisconsin Press, vol. 52(1), pages 48-87.
    18. Elena Sochirca & Pedro Cunha Neves, 2018. "Optimal policies, middle class development and human capital accumulation under elite rivalry," CEFAGE-UE Working Papers 2018_04, University of Evora, CEFAGE-UE (Portugal).
    19. Åsa Johansson, 2016. "Public Finance, Economic Growth and Inequality: A Survey of the Evidence," OECD Economics Department Working Papers 1346, OECD Publishing.
    20. Altinok, Nadir & Aydemir, Abdurrahman, 2017. "Does one size fit all? The impact of cognitive skills on economic growth," Journal of Macroeconomics, Elsevier, vol. 53(C), pages 176-190.

    More about this item

    Keywords

    Educational policy; academic performance; PISA; PIRLS.;
    All these keywords.

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:qss:dqsswp:1504. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dr Neus Bover Fonts (email available below). General contact details of provider: https://edirc.repec.org/data/dqioeuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.