IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/9537.html
   My bibliography  Save this paper

Do Large-Scale Student Assessments Really Capture Cognitive Skills ?

Author

Listed:
  • De Hoyos Navarro,Rafael E.
  • Estrada,Ricardo
  • Vargas Mancera,Maria Jose

Abstract

This paper studies the relationship between test scores and cognitive skills using two longitudinal data sets that track student performance on a national standardized exam in grades 6, 9, and 12 and post-secondary school outcomes in Mexico. Using a large sample of twins, the analysis finds that primary school test scores are a strong predictor of secondary education outcomes and that this association is mainly driven by the relationship between test scores and cognitive skills, as opposed to family background and other general skills. Using a data set that links results in the national standardized test to later outcomes, the paper finds that secondary school test scores predict university enrollment and hourly wages. These results indicate that, despite their limitations, large-scale student assessments can capture the skills they are meant to measure and can therefore be used to monitor learning in education systems.

Suggested Citation

  • De Hoyos Navarro,Rafael E. & Estrada,Ricardo & Vargas Mancera,Maria Jose, 2021. "Do Large-Scale Student Assessments Really Capture Cognitive Skills ?," Policy Research Working Paper Series 9537, The World Bank.
  • Handle: RePEc:wbk:wbrwps:9537
    as

    Download full text from publisher

    File URL: http://documents.worldbank.org/curated/en/767821612448367170/pdf/Do-Large-Scale-Student-Assessments-Really-Capture-Cognitive-Skills.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Andrew Dustan & Alain de Janvry & Elisabeth Sadoulet, 2017. "Flourish or Fail?: The Risky Reward of Elite High School Admission in Mexico City," Journal of Human Resources, University of Wisconsin Press, vol. 52(3), pages 756-799.
    2. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, Oxford University Press, vol. 126(4), pages 1593-1660.
    3. Estrada, Ricardo & Gignoux, Jérémie, 2017. "Benefits to elite schools and the expected returns to education: Evidence from Mexico City," European Economic Review, Elsevier, vol. 95(C), pages 168-194.
    4. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    5. Estrada, Ricardo & Gignoux, Jérémie, 2017. "Benefits to elite schools and the expected returns to education: Evidence from Mexico City," European Economic Review, Elsevier, vol. 95(C), pages 168-194.
    6. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    7. Eunsik Chang & María Padilla-Romo, 2019. "The Effects of Local Violent Crime on High-Stakes Tests," Working Papers 2019-03, University of Tennessee, Department of Economics.
    8. Avitabile, Ciro & de Hoyos, Rafael, 2018. "The heterogeneous effect of information on student performance: Evidence from a randomized control trial in Mexico," Journal of Development Economics, Elsevier, vol. 135(C), pages 318-348.
    9. Pelin Akyol & Kala Krishna & Jinwen Wang, 2021. "Taking PISA Seriously: How Accurate are Low-Stakes Exams?," Journal of Labor Research, Springer, vol. 42(2), pages 184-243, June.
    10. Ricardo Estrada & Jérémie Gignoux, 2014. "Benefits to elite schools and the formation of expected returns to education: Evidence from Mexico City," PSE Working Papers halshs-00951763, HAL.
    11. Ricardo Estrada, 2019. "Rules versus Discretion in Public Service: Teacher Hiring in Mexico," Journal of Labor Economics, University of Chicago Press, vol. 37(2), pages 545-579.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Hoyos, Rafael & Estrada, Ricardo & Vargas, María José, 2021. "What do test scores really capture? Evidence from a large-scale student assessment in Mexico," World Development, Elsevier, vol. 146(C).
    2. Bobba, Matteo & Frisancho, Veronica & Pariguana, Marco, 2016. "Perceived Ability and School Choices: Experimental Evidence and Scale-up Effects," TSE Working Papers 16-660, Toulouse School of Economics (TSE), revised May 2023.
    3. Cabrera-Hernández, Francisco & Padilla-Romo, María & Peluffo, Cecilia, 2022. "Full-Time Schools and Educational Trajectories: Evidence from High-Stakes Exams," IZA Discussion Papers 15602, Institute of Labor Economics (IZA).
    4. Eunsik Chang & María Padilla-Romo, 2019. "The Effects of Local Violent Crime on High-Stakes Tests," Working Papers 2019-03, University of Tennessee, Department of Economics.
    5. Dustan, Andrew & Ngo, Diana K.L., 2018. "Commuting to educational opportunity? School choice effects of mass transit expansion in Mexico City," Economics of Education Review, Elsevier, vol. 63(C), pages 116-133.
    6. Dustan, Andrew, 2018. "Family networks and school choice," Journal of Development Economics, Elsevier, vol. 134(C), pages 372-391.
    7. Wu, Jia & Wei, Xiangdong & Zhang, Hongliang & Zhou, Xiang, 2019. "Elite schools, magnet classes, and academic performances: Regression-discontinuity evidence from China," China Economic Review, Elsevier, vol. 55(C), pages 143-167.
    8. Fort, Margherita & Ichino, Andrea & Rettore, Enrico & Zanella, Giulio, 2022. "Multi-cutoff RD designs with observations located at each cutoff: problems and solutions," CEPR Discussion Papers 16974, C.E.P.R. Discussion Papers.
    9. Hans‐Peter Y. Qvist & Anders Holm & Martin D. Munk, 2021. "Demand and Supply Effects and Returns to College Education: Evidence from a Natural Experiment with Engineers in Denmark," Scandinavian Journal of Economics, Wiley Blackwell, vol. 123(2), pages 676-704, April.
    10. Eréndira León Bravo, 2022. "Three essays on education, wages, and the labour market in Mexico," Economics PhD Theses 0322, Department of Economics, University of Sussex Business School.
    11. Michaelsen, Maren M. & Salardi, Paola, 2020. "Violence, psychological stress and educational performance during the “war on drugs” in Mexico," Journal of Development Economics, Elsevier, vol. 143(C).
    12. Ibtihal Ferwana & Suyoung Park & Ting-Yi Wu & Lav R. Varshney, 2023. "Designing Discontinuities," Papers 2305.08559, arXiv.org, revised Aug 2023.
    13. Padilla-Romo, María & Peluffo, Cecilia, 2023. "Persistence of the Spillover Effects of Violence and Educational Trajectories," IZA Discussion Papers 16374, Institute of Labor Economics (IZA).
    14. Avitabile,Ciro & Bobba,Matteo & Pariguana,Marco, 2015. "High school track choice and financial constraints : evidence from urban Mexico," Policy Research Working Paper Series 7427, The World Bank.
    15. Estrada, Ricardo, 2022. "The effect of the demand for elite schools on stratification," Economics Letters, Elsevier, vol. 215(C).
    16. Yann Algan & Elizabeth Beasley & Frank Vitaro & Richard Tremblay, 2014. "The Impact of Non-Cognitive Skills Training on Academic and Non-academic Trajectories: From Childhood to Early Adulthood," Working Papers hal-03429906, HAL.
    17. Fanny Landaud & Son Thierry Ly & Éric Maurin, 2020. "Competitive Schools and the Gender Gap in the Choice of Field of Study," Journal of Human Resources, University of Wisconsin Press, vol. 55(1), pages 278-308.
    18. Holla,Alaka & Bendini,Maria Magdalena & Dinarte Diaz,Lelys Ileana & Trako,Iva, 2021. "Is Investment in Preprimary Education Too Low ? Lessons from (Quasi) ExperimentalEvidence across Countries," Policy Research Working Paper Series 9723, The World Bank.
    19. Sonia Bhalotra & Martin Karlsson & Therese Nilsson & Nina Schwarz, 2022. "Infant Health, Cognitive Performance, and Earnings: Evidence from Inception of the Welfare State in Sweden," The Review of Economics and Statistics, MIT Press, vol. 104(6), pages 1138-1156, November.
    20. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:9537. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.