IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/9537.html
   My bibliography  Save this paper

Do Large-Scale Student Assessments Really Capture Cognitive Skills ?

Author

Listed:
  • De Hoyos Navarro,Rafael E.
  • Estrada,Ricardo
  • Vargas Mancera,Maria Jose

Abstract

This paper studies the relationship between test scores and cognitive skills using two longitudinal data sets that track student performance on a national standardized exam in grades 6, 9, and 12 and post-secondary school outcomes in Mexico. Using a large sample of twins, the analysis finds that primary school test scores are a strong predictor of secondary education outcomes and that this association is mainly driven by the relationship between test scores and cognitive skills, as opposed to family background and other general skills. Using a data set that links results in the national standardized test to later outcomes, the paper finds that secondary school test scores predict university enrollment and hourly wages. These results indicate that, despite their limitations, large-scale student assessments can capture the skills they are meant to measure and can therefore be used to monitor learning in education systems.

Suggested Citation

  • De Hoyos Navarro,Rafael E. & Estrada,Ricardo & Vargas Mancera,Maria Jose, 2021. "Do Large-Scale Student Assessments Really Capture Cognitive Skills ?," Policy Research Working Paper Series 9537, The World Bank.
  • Handle: RePEc:wbk:wbrwps:9537
    as

    Download full text from publisher

    File URL: http://documents.worldbank.org/curated/en/767821612448367170/pdf/Do-Large-Scale-Student-Assessments-Really-Capture-Cognitive-Skills.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Andrew Dustan & Alain de Janvry & Elisabeth Sadoulet, 2017. "Flourish or Fail?: The Risky Reward of Elite High School Admission in Mexico City," Journal of Human Resources, University of Wisconsin Press, vol. 52(3), pages 756-799.
    2. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    3. Estrada, Ricardo & Gignoux, Jérémie, 2017. "Benefits to elite schools and the expected returns to education: Evidence from Mexico City," European Economic Review, Elsevier, vol. 95(C), pages 168-194.
    4. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    5. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    6. Eunsik Chang & María Padilla-Romo, 2019. "The Effects of Local Violent Crime on High-Stakes Tests," Working Papers 2019-03, University of Tennessee, Department of Economics.
    7. Avitabile, Ciro & de Hoyos, Rafael, 2018. "The heterogeneous effect of information on student performance: Evidence from a randomized control trial in Mexico," Journal of Development Economics, Elsevier, vol. 135(C), pages 318-348.
    8. Pelin Akyol & Kala Krishna & Jinwen Wang, 2021. "Taking PISA Seriously: How Accurate are Low-Stakes Exams?," Journal of Labor Research, Springer, vol. 42(2), pages 184-243, June.
    9. Ricardo Estrada & Jérémie Gignoux, 2014. "Benefits to elite schools and the formation of expected returns to education: Evidence from Mexico City," PSE Working Papers halshs-00951763, HAL.
    10. Ricardo Estrada, 2019. "Rules versus Discretion in Public Service: Teacher Hiring in Mexico," Journal of Labor Economics, University of Chicago Press, vol. 37(2), pages 545-579.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Hoyos, Rafael & Estrada, Ricardo & Vargas, María José, 2021. "What do test scores really capture? Evidence from a large-scale student assessment in Mexico," World Development, Elsevier, vol. 146(C).
    2. Bobba, Matteo & Frisancho, Veronica & Pariguana, Marco, 2016. "Perceived Ability and School Choices: Experimental Evidence and Scale-up Effects," TSE Working Papers 16-660, Toulouse School of Economics (TSE), revised May 2023.
    3. Cabrera-Hernández, Francisco & Padilla-Romo, María & Peluffo, Cecilia, 2023. "Full-time schools and educational trajectories: Evidence from high-stakes exams," Economics of Education Review, Elsevier, vol. 96(C).
    4. Eunsik Chang & María Padilla-Romo, 2019. "The Effects of Local Violent Crime on High-Stakes Tests," Working Papers 2019-03, University of Tennessee, Department of Economics.
    5. Dustan, Andrew & Ngo, Diana K.L., 2018. "Commuting to educational opportunity? School choice effects of mass transit expansion in Mexico City," Economics of Education Review, Elsevier, vol. 63(C), pages 116-133.
    6. Michaelsen, Maren M. & Salardi, Paola, 2020. "Violence, psychological stress and educational performance during the “war on drugs” in Mexico," Journal of Development Economics, Elsevier, vol. 143(C).
    7. Avitabile,Ciro & Bobba,Matteo & Pariguana,Marco, 2015. "High school track choice and financial constraints : evidence from urban Mexico," Policy Research Working Paper Series 7427, The World Bank.
    8. Dustan, Andrew, 2018. "Family networks and school choice," Journal of Development Economics, Elsevier, vol. 134(C), pages 372-391.
    9. Wu, Jia & Wei, Xiangdong & Zhang, Hongliang & Zhou, Xiang, 2019. "Elite schools, magnet classes, and academic performances: Regression-discontinuity evidence from China," China Economic Review, Elsevier, vol. 55(C), pages 143-167.
    10. Yann Algan & Elizabeth Beasley & Frank Vitaro & Richard Tremblay, 2014. "The Impact of Non-Cognitive Skills Training on Academic and Non-academic Trajectories: From Childhood to Early Adulthood," Working Papers hal-03429906, HAL.
    11. Fanny Landaud & Son Thierry Ly & Éric Maurin, 2020. "Competitive Schools and the Gender Gap in the Choice of Field of Study," Journal of Human Resources, University of Wisconsin Press, vol. 55(1), pages 278-308.
    12. Holla,Alaka & Bendini,Maria Magdalena & Dinarte Diaz,Lelys Ileana & Trako,Iva, 2021. "Is Investment in Preprimary Education Too Low ? Lessons from (Quasi) ExperimentalEvidence across Countries," Policy Research Working Paper Series 9723, The World Bank.
    13. Fort, Margherita & Ichino, Andrea & Rettore, Enrico & Zanella, Giulio, 2022. "Multi-cutoff RD designs with observations located at each cutoff: problems and solutions," CEPR Discussion Papers 16974, C.E.P.R. Discussion Papers.
    14. Sonia Bhalotra & Martin Karlsson & Therese Nilsson & Nina Schwarz, 2022. "Infant Health, Cognitive Performance, and Earnings: Evidence from Inception of the Welfare State in Sweden," The Review of Economics and Statistics, MIT Press, vol. 104(6), pages 1138-1156, November.
    15. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    16. Marie Connolly & Catherine Haeck, 2018. "Le lien entre la taille des classes et les compétences cognitives et non cognitives," CIRANO Project Reports 2018rp-18, CIRANO.
    17. Shoji, Masahiro, 2020. "Early-Life Circumstances and Adult Locus of Control: Evidence from 46 Developing Countries," MPRA Paper 99987, University Library of Munich, Germany.
    18. Hans‐Peter Y. Qvist & Anders Holm & Martin D. Munk, 2021. "Demand and Supply Effects and Returns to College Education: Evidence from a Natural Experiment with Engineers in Denmark," Scandinavian Journal of Economics, Wiley Blackwell, vol. 123(2), pages 676-704, April.
    19. Lin, Dajun & Lutter, Randall & Ruhm, Christopher J., 2018. "Cognitive performance and labour market outcomes," Labour Economics, Elsevier, vol. 51(C), pages 121-135.
    20. Attanasio, Orazio & Blundell, Richard & Conti, Gabriella & Mason, Giacomo, 2020. "Inequality in socio-emotional skills: A cross-cohort comparison," Journal of Public Economics, Elsevier, vol. 191(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:9537. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.