IDEAS home Printed from https://ideas.repec.org/p/idb/brikps/8445.html
   My bibliography  Save this paper

Do Tests Applied to Teachers Predict their Effectiveness?

Author

Listed:
  • Cruz-Aguayo, Yyannu
  • Ibarrarán, Pablo
  • Schady, Norbert

Abstract

Teachers vary considerably in their effectiveness, but identifying teacher characteristics that predict their impact on learning outcomes has been elusive. We analyze a teacher evaluation that is used to make teacher tenure decisions in Ecuador. The evaluation includes a written test, a demonstration class, and a points system that gives higher scores to teachers with more experience, degrees, and in-service training. We find no evidence that children taught by teachers with higher scores on the evaluation learn more. Our estimates are very precise: We can rule out that teachers with one-standard deviation higher evaluation scores raise child test scores in math by 0.03 standard deviations or more, and language scores by 0.02 standard deviations or more. We conclude that the effort that is being placed by policy-makers in Latin America to design and “improve” teacher tests is unlikely to result in large improvements in child learning.

Suggested Citation

  • Cruz-Aguayo, Yyannu & Ibarrarán, Pablo & Schady, Norbert, 2017. "Do Tests Applied to Teachers Predict their Effectiveness?," IDB Publications (Working Papers) 8445, Inter-American Development Bank.
  • Handle: RePEc:idb:brikps:8445
    DOI: http://dx.doi.org/10.18235/0000763
    as

    Download full text from publisher

    File URL: https://publications.iadb.org/publications/english/document/Do-Tests-Applied-to-Teachers-Predict-their-Effectiveness.pdf
    Download Restriction: no

    File URL: https://libkey.io/http://dx.doi.org/10.18235/0000763?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    2. Hanushek, Eric A. & Woessmann, Ludger, 2012. "Schooling, educational achievement, and the Latin American growth puzzle," Journal of Development Economics, Elsevier, vol. 99(2), pages 497-512.
    3. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    4. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    5. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    6. Christina Paxson & Norbert Schady, 2007. "Cognitive Development among Young Children in Ecuador: The Roles of Wealth, Health, and Parenting," Journal of Human Resources, University of Wisconsin Press, vol. 42(1).
    7. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    8. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, Oxford University Press, vol. 131(3), pages 1415-1453.
    9. Christina Paxson & Norbert Schady, 2010. "Does Money Matter? The Effects of Cash Transfers on Child Development in Rural Ecuador," Economic Development and Cultural Change, University of Chicago Press, vol. 59(1), pages 187-229, October.
    10. Eric A. Hanushek & Steven G. Rivkin, 2012. "The Distribution of Teacher Quality and Implications for Policy," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 131-157, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Brutti, Zelda & Sánchez Torres, Fabio, 2022. "Turning around teacher quality in Latin America: Renewed confidence and lessons from Colombia," Economic Analysis and Policy, Elsevier, vol. 73(C), pages 62-93.
    2. Araujo P., María Daniela & Heineck, Guido & Cruz-Aguayo, Yyannú, 2021. "Does Test-Based Teacher Recruitment Work in the Developing World? Experimental Evidence from Ecuador," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242448, Verein für Socialpolitik / German Economic Association.
    3. Evans, David K. & Yuan, Fei & Filmer, Deon, 2022. "Teacher pay in Africa: Evidence from 15 countries," World Development, Elsevier, vol. 155(C).
    4. Henriques, C.O. & Chavez, J.M. & Gouveia, M.C. & Marcenaro-Gutierrez, O.D., 2022. "Efficiency of secondary schools in Ecuador: A value based DEA approach," Socio-Economic Planning Sciences, Elsevier, vol. 82(PA).
    5. Lee Crawfurd & Todd Pugatch, 2020. "Teacher Labor Markets in Developing Countries," Working Papers 546, Center for Global Development.
    6. Escribano, Rosario & Treviño, Ernesto & Nussbaum, Miguel & Torres Irribarra, David & Carrasco, Diego, 2020. "How much does the quality of teaching vary at under-performing schools? Evidence from classroom observations in Chile," International Journal of Educational Development, Elsevier, vol. 72(C).
    7. Araujo P., Maria Daniela & Heineck, Guido & Cruz Aguayo, Yyannú, 2020. "Does test-based teacher recruitment work in the developing world? Experimental evidence from Ecuador," BERG Working Paper Series 165, Bamberg University, Bamberg Economic Research Group.
    8. Filmer,Deon P. & Nahata,Vatsal & Sabarwal,Shwetlena, 2021. "Preparation, Practice, and Beliefs : A Machine Learning Approach to Understanding Teacher Effectiveness," Policy Research Working Paper Series 9847, The World Bank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cruz-Aguayo, Yyannú & Carneiro, Pedro & Intriago, Ruthy & Ponce, Juan & Schady, Norbert & Schodt, Sarah, 2022. "When Promising Interventions Fail: Personalized Coaching for Teachers in a Middle-Income Country," IZA Discussion Papers 15021, Institute of Labor Economics (IZA).
    2. Samuel Berlinski & Norbert Schady, 2015. "Daycare Services: It’s All about Quality," Palgrave Macmillan Books, in: Samuel Berlinski & Norbert Schady (ed.), The Early Years, chapter 4, pages 91-119, Palgrave Macmillan.
    3. M. Caridad Araujo & Yyannu Cruz-Aguayo & Analia Jaimovich & Sharon Lynn Kagan, 2015. "Drawing Up an Institutional Architecture," IDB Publications (Book Chapters), in: Samuel Berlinski & Norbert Schady (ed.), The Early Years: Child Well-Being and the Role of Public Policy, edition 1, chapter 7, pages 179-202, Inter-American Development Bank.
    4. Stephen Machin & Sandra McNally & Martina Viarengo, 2018. "Changing How Literacy Is Taught: Evidence on Synthetic Phonics," American Economic Journal: Economic Policy, American Economic Association, vol. 10(2), pages 217-241, May.
    5. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    6. Arlen Guarín & Carlos Medina & Christian Posso, 2018. "Calidad, cobertura y costo ocultos de la educación secundaria pública y privada en Colombia," Revista Desarrollo y Sociedad, Universidad de los Andes,Facultad de Economía, CEDE, vol. 81(2), August.
    7. Marc Steeg & Sander Gerritsen, 2016. "Teacher Evaluations and Pupil Achievement Gains: Evidence from Classroom Observations," De Economist, Springer, vol. 164(4), pages 419-443, December.
    8. Arlen Guarín & Carlos Medina & Christian Posso, 2017. "Calidad y Cobertura de la Educación Secundaria Pública y Privada en Colombia, y sus Costos Ocultos," Borradores de Economia 1006, Banco de la Republica de Colombia.
    9. Jacob, Brian A. & Rockoff, Jonah E. & Taylor, Eric S. & Lindy, Benjamin & Rosen, Rachel, 2018. "Teacher applicant hiring and teacher performance: Evidence from DC public schools," Journal of Public Economics, Elsevier, vol. 166(C), pages 81-97.
    10. Thijssen, Maximiliaan W.P. & Rege, Mari & Solheim, Oddny J., 2022. "Teacher relationship skills and student learning," Economics of Education Review, Elsevier, vol. 89(C).
    11. Goel, Deepti & Barooah, Bidisha, 2018. "Drivers of Student Performance: Evidence from Higher Secondary Public Schools in Delhi," GLO Discussion Paper Series 231, Global Labor Organization (GLO).
    12. Sun, Yucheng & Zhou, Xianbo, 2022. "The effect of teacher's concurrent administrative position on students' academic outcomes: Evidence and mechanisms," China Economic Review, Elsevier, vol. 71(C).
    13. Seth Gershenson & Cassandra M. D. Hart & Joshua Hyman & Constance A. Lindsay & Nicholas W. Papageorge, 2022. "The Long-Run Impacts of Same-Race Teachers," American Economic Journal: Economic Policy, American Economic Association, vol. 14(4), pages 300-342, November.
    14. Ferreira, Francisco H. G. & Galasso, Emanuela & Negre, Mario, 2018. "Shared Prosperity: Concepts, Data, and Some Policy Examples," IZA Discussion Papers 11571, Institute of Labor Economics (IZA).
    15. Maria Daniela Araujo P., 2019. "Measuring the Effect of Competitive Teacher Recruitment on Student Achievement: Evidence from Ecuador," Documentos de Trabajo 17285, The Latin American and Caribbean Economic Association (LACEA).
    16. Gregory Elacqua & Diana Hincapie & Isabel Hincapie & Veronica Montalva, 2022. "Can Financial Incentives Help Disadvantaged Schools to Attract and Retain High‐Performing Teachers? Evidence from Chile," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(2), pages 603-631, March.
    17. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    18. Johnston, Andrew C., 2021. "Preferences, Selection, and the Structure of Teacher Pay," IZA Discussion Papers 14831, Institute of Labor Economics (IZA).
    19. Wang, Lei & Qian, Yiwei & Warrinnier, Nele & Attanasio, Orazio & Rozelle, Scott & Sylvia, Sean, 2023. "Parental investment, school choice, and the persistent benefits of an early childhood intervention," Journal of Development Economics, Elsevier, vol. 165(C).
    20. Araujo P., Maria Daniela, 2019. "Measuring the effect of competitive teacher recruitment on student achievement: Evidence from Ecuador," BERG Working Paper Series 150, Bamberg University, Bamberg Economic Research Group.

    More about this item

    Keywords

    Teacher effectiveness; teacher evaluation;

    JEL classification:

    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:idb:brikps:8445. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Felipe Herrera Library (email available below). General contact details of provider: https://edirc.repec.org/data/iadbbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.