IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/9365.html
   My bibliography  Save this paper

Identifying Effective Teachers : Lessons from Four Classroom Observation Tools

Author

Listed:
  • Filmer,Deon P.
  • Molina,Ezequiel
  • Wane,Waly

Abstract

Four different classroom observation instruments -- from the Service Delivery Indicators, the Stallings Observation System, the Classroom Assessment Scoring System, and the Teach classroom observation instrument -- were implemented in about 100 schools across four regions of Tanzania. The research design is such that various combinations of tools were administered to various combinations of teachers, so these data can be used to explore the commonalities and differences in the behaviors and practices captured by each tool, the internal properties of the tools (for example, how stable they are across enumerators, or how various indicators relate to one another), and how variables collected by the various tools compare to each other. Analysis shows that inter-rater reliability can be low, especially for some of the subjective ratings; principal components analysis suggests that lower-level constructs do not map neatly to predetermined higher-level ones and suggest that the data have only few dimensions. Measures collected during teacher observations are associated with student test scores, but patterns differ for teachers with lower versus higher subject content knowledge.

Suggested Citation

  • Filmer,Deon P. & Molina,Ezequiel & Wane,Waly, 2020. "Identifying Effective Teachers : Lessons from Four Classroom Observation Tools," Policy Research Working Paper Series 9365, The World Bank.
  • Handle: RePEc:wbk:wbrwps:9365
    as

    Download full text from publisher

    File URL: http://documents.worldbank.org/curated/en/215241598376994051/pdf/Identifying-Effective-Teachers-Lessons-from-Four-Classroom-Observation-Tools.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nazmul Chaudhury & Jeffrey Hammer & Michael Kremer & Karthik Muralidharan & F. Halsey Rogers, 2006. "Missing in Action: Teacher and Health Worker Absence in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 91-116, Winter.
    2. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    3. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    4. Metzler, Johannes & Woessmann, Ludger, 2012. "The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation," Journal of Development Economics, Elsevier, vol. 99(2), pages 486-496.
    5. Will Dobbie & Roland G. Fryer Jr., 2013. "Getting beneath the Veil of Effective Schools: Evidence from New York City," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 28-60, October.
    6. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, Oxford University Press, vol. 131(3), pages 1415-1453.
    7. Aslam, Monazza & Kingdon, Geeta, 2011. "What can teachers do to raise pupil achievement?," Economics of Education Review, Elsevier, vol. 30(3), pages 559-574, June.
    8. Montenegro, Claudio E. & Patrinos, Harry Anthony, 2014. "Comparable estimates of returns to schooling around the world," Policy Research Working Paper Series 7020, The World Bank.
    9. Thomas J. Kane & Eric S. Taylor & John H. Tyler & Amy L. Wooten, 2011. "Identifying Effective Classroom Practices Using Student Achievement Data," Journal of Human Resources, University of Wisconsin Press, vol. 46(3), pages 587-613.
    10. Jishnu Das & Stefan Dercon & James Habyarimana & Pramila Krishnan, 2007. "Teacher Shocks and Student Learning: Evidence from Zambia," Journal of Human Resources, University of Wisconsin Press, vol. 42(4).
    11. Barbara Bruns & Javier Luque, 2015. "Great Teachers : How to Raise Student Learning in Latin America and the Caribbean," World Bank Publications - Books, The World Bank Group, number 20488, December.
    12. Bacher-Hicks, Andrew & Chin, Mark J. & Kane, Thomas J. & Staiger, Douglas O., 2019. "An experimental evaluation of three teacher quality measures: Value-added, classroom observations, and student surveys," Economics of Education Review, Elsevier, vol. 73(C).
    13. Molina,Ezequiel & Fatima,Syeda Farwa & Ho,Andrew Dean Y C & Melo Hurtado,Carolina Eugenia & Wilichowksi,Tracy & Pushparatnam,Adelle, 2018. "Measuring Teaching Practices at Scale : Results from the Development and Validation of the Teach Classroom Observation Tool," Policy Research Working Paper Series 8653, The World Bank.
    14. repec:idb:brikps:7259 is not listed on IDEAS
    15. Azigwe, J.B. & Kyriakides, L. & Panayiotou, A. & Creemers, B.P.M., 2016. "The impact of effective teaching characteristics in promoting student achievement in Ghana," International Journal of Educational Development, Elsevier, vol. 51(C), pages 51-61.
    16. Samuel Berlinski & Norbert Schady (ed.), 2015. "The Early Years," Palgrave Macmillan Books, Palgrave Macmillan, number 978-1-137-53649-5.
    17. Mae Chu Chang & Sheldon Shaeffer & Samer Al-Samarrai & Andrew B. Ragatz & Joppe de Ree & Ritchie Stevenson, 2014. "Teacher Reform in Indonesia : The Role of Politics and Evidence in Policy Making," World Bank Publications - Books, The World Bank Group, number 16355, December.
    18. Coflan,Andrew Moore & Ragatz,Andrew B. & Hasan,Amer & Pan,Yilin, 2018. "Understanding effective teaching practices in Chinese classrooms : evidence from a pilot study of primary and junior secondary schools in Guangdong, China," Policy Research Working Paper Series 8396, The World Bank.
    19. Tessa Bold & Deon Filmer & Gayle Martin & Ezequiel Molina & Brian Stacy & Christophe Rockmore & Jakob Svensson & Waly Wane, 2017. "Enrollment without Learning: Teacher Effort, Knowledge, and Skill in Primary Schools in Africa," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 185-204, Fall.
    20. María Caridad Araujo & Martín Ardanaz & Edna Armendáriz & Jere R. Behrman & Samuel Berlinski & Julian P. Cristia & Yyannu Cruz-Aguayo & Luca Flabbi & Diana Hincapie & Analía Jalmovich & Sharon Lynn Ka, 2015. "The Early Years: Child Well-being and the Role of Public Policy," IDB Publications (Books), Inter-American Development Bank, number 91496 edited by Samuel Berlinski & Norbert Schady, February.
    21. Jonah E. Rockoff & Brian A. Jacob & Thomas J. Kane & Douglas O. Staiger, 2011. "Can You Recognize an Effective Teacher When You Recruit One?," Education Finance and Policy, MIT Press, vol. 6(1), pages 43-74, January.
    22. World Bank, 2018. "World Development Report 2018 [Rapport sur le développement dans le monde 2018]," World Bank Publications - Books, The World Bank Group, number 28340, December.
    23. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    24. Araujo, María Caridad & Ardanaz, Martín & Armendáriz, Edna & Behrman, Jere R. & Berlinski, Samuel & Cristia, Julian P. & Flabbi, Luca & Hincapie, Diana & Jalmovich, Analía & Kagan, Sharon Lynn & Lopez, 2015. "The Early Years: Child Well-being and the Role of Public Policy," IDB Publications (Books), Inter-American Development Bank, number 7259.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Filmer,Deon P. & Nahata,Vatsal & Sabarwal,Shwetlena, 2021. "Preparation, Practice, and Beliefs : A Machine Learning Approach to Understanding Teacher Effectiveness," Policy Research Working Paper Series 9847, The World Bank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    2. Simon Briole, 2019. "From Teacher Quality to Teaching Quality: Instructional Productivity and Teaching Practices in the US," Working Papers halshs-01993616, HAL.
    3. Ansari, Ali H., 2020. "Comparing teaching practices, teacher content knowledge and pay in Punjab," International Journal of Educational Development, Elsevier, vol. 79(C).
    4. Cruz-Aguayo, Yyannú & Carneiro, Pedro & Intriago, Ruthy & Ponce, Juan & Schady, Norbert & Schodt, Sarah, 2022. "When Promising Interventions Fail: Personalized Coaching for Teachers in a Middle-Income Country," IZA Discussion Papers 15021, Institute of Labor Economics (IZA).
    5. Lombardi, María, 2019. "Is the remedy worse than the disease? The impact of teacher remediation on teacher and student performance in Chile," Economics of Education Review, Elsevier, vol. 73(C).
    6. Araujo P., Maria Daniela & Heineck, Guido & Cruz Aguayo, Yyannú, 2020. "Does test-based teacher recruitment work in the developing world? Experimental evidence from Ecuador," BERG Working Paper Series 165, Bamberg University, Bamberg Economic Research Group.
    7. Metzler, Johannes & Woessmann, Ludger, 2012. "The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation," Journal of Development Economics, Elsevier, vol. 99(2), pages 486-496.
    8. Francesca Marchetta & Tom Dilly, 2019. "Supporting Education in Africa: Opportunities and Challenges for an Impact Investor," Working Papers hal-02288103, HAL.
    9. Araujo P., María Daniela & Heineck, Guido & Cruz-Aguayo, Yyannú, 2021. "Does Test-Based Teacher Recruitment Work in the Developing World? Experimental Evidence from Ecuador," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242448, Verein für Socialpolitik / German Economic Association.
    10. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    11. Christopher Neilson & Sebastian Gallegos & Franco Calle, 2019. "Screening and Recruiting Talent At Teacher Colleges Using Pre-College Academic Achievement," Working Papers 636, Princeton University, Department of Economics, Industrial Relations Section..
    12. Bold, Tessa & Molina, Ezequiel & Filmer, Deon & Svensson, Jakob, 2018. "The Lost Human Capital: Teacher Knowledge and Student Learning in Africa," CEPR Discussion Papers 12956, C.E.P.R. Discussion Papers.
    13. Marc Steeg & Sander Gerritsen, 2016. "Teacher Evaluations and Pupil Achievement Gains: Evidence from Classroom Observations," De Economist, Springer, vol. 164(4), pages 419-443, December.
    14. Araujo P., Maria Daniela & Quis, Johanna Sophie, 2021. "Parents can tell! Evidence on classroom quality differences in German primary schools," BERG Working Paper Series 172, Bamberg University, Bamberg Economic Research Group.
    15. Araujo P., María Daniela & Quis, Johanna Sophie, 2021. "Teacher Effects in Germany: Evidence from Elementary School," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242457, Verein für Socialpolitik / German Economic Association.
    16. Goel, Deepti & Barooah, Bidisha, 2018. "Drivers of Student Performance: Evidence from Higher Secondary Public Schools in Delhi," GLO Discussion Paper Series 231, Global Labor Organization (GLO).
    17. Ajzenman, Nicolás & Elacqua, Gregory & Marotta, Luana & Westh Olsen, Anne Sofie, 2021. "Order Effects and Employment Decisions: Experimental Evidence from a Nationwide Program," IDB Publications (Working Papers) 11541, Inter-American Development Bank.
    18. Canales, Andrea & Maldonado, Luis, 2018. "Teacher quality and student achievement in Chile: Linking teachers' contribution and observable characteristics," International Journal of Educational Development, Elsevier, vol. 60(C), pages 33-50.
    19. Jacobus Cilliers & Brahm Fleisch & Cas Prinsloo & Stephen Taylor, 2020. "How to Improve Teaching Practice?: An Experimental Comparison of Centralized Training and In-Classroom Coaching," Journal of Human Resources, University of Wisconsin Press, vol. 55(3), pages 926-962.
    20. Simon Briole & Marc Gurgand & Eric Maurin & Sandra McNally & Jenifer Ruiz-Valenzuela & Daniel Santin, 2022. "The making of civic virtues: a school-based experiment in three countries," CEP Discussion Papers dp1830, Centre for Economic Performance, LSE.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:9365. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.