IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/9365.html

Identifying Effective Teachers : Lessons from Four Classroom Observation Tools

Author

Listed:
  • Filmer,Deon P.
  • Molina,Ezequiel
  • Wane,Waly

Abstract

Four different classroom observation instruments -- from the Service Delivery Indicators, the Stallings Observation System, the Classroom Assessment Scoring System, and the Teach classroom observation instrument -- were implemented in about 100 schools across four regions of Tanzania. The research design is such that various combinations of tools were administered to various combinations of teachers, so these data can be used to explore the commonalities and differences in the behaviors and practices captured by each tool, the internal properties of the tools (for example, how stable they are across enumerators, or how various indicators relate to one another), and how variables collected by the various tools compare to each other. Analysis shows that inter-rater reliability can be low, especially for some of the subjective ratings; principal components analysis suggests that lower-level constructs do not map neatly to predetermined higher-level ones and suggest that the data have only few dimensions. Measures collected during teacher observations are associated with student test scores, but patterns differ for teachers with lower versus higher subject content knowledge.

Suggested Citation

  • Filmer,Deon P. & Molina,Ezequiel & Wane,Waly, 2020. "Identifying Effective Teachers : Lessons from Four Classroom Observation Tools," Policy Research Working Paper Series 9365, The World Bank.
  • Handle: RePEc:wbk:wbrwps:9365
    as

    Download full text from publisher

    File URL: http://documents.worldbank.org/curated/en/215241598376994051/pdf/Identifying-Effective-Teachers-Lessons-from-Four-Classroom-Observation-Tools.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    2. Nazmul Chaudhury & Jeffrey Hammer & Michael Kremer & Karthik Muralidharan & F. Halsey Rogers, 2006. "Missing in Action: Teacher and Health Worker Absence in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 91-116, Winter.
    3. Molina,Ezequiel & Fatima,Syeda Farwa & Ho,Andrew Dean Y C & Melo Hurtado,Carolina Eugenia & Wilichowksi,Tracy & Pushparatnam,Adelle, 2018. "Measuring Teaching Practices at Scale : Results from the Development and Validation of the Teach Classroom Observation Tool," Policy Research Working Paper Series 8653, The World Bank.
    4. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    5. repec:idb:brikps:7259 is not listed on IDEAS
    6. Will Dobbie & Roland G. Fryer Jr., 2013. "Getting beneath the Veil of Effective Schools: Evidence from New York City," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 28-60, October.
    7. Azigwe, J.B. & Kyriakides, L. & Panayiotou, A. & Creemers, B.P.M., 2016. "The impact of effective teaching characteristics in promoting student achievement in Ghana," International Journal of Educational Development, Elsevier, vol. 51(C), pages 51-61.
    8. Samuel Berlinski & Norbert Schady (ed.), 2015. "The Early Years," Palgrave Macmillan Books, Palgrave Macmillan, number 978-1-137-53649-5, April.
    9. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, Oxford University Press, vol. 131(3), pages 1415-1453.
    10. repec:wbk:wbpubs:16355 is not listed on IDEAS
    11. Coflan,Andrew Moore & Ragatz,Andrew B. & Hasan,Amer & Pan,Yilin, 2018. "Understanding effective teaching practices in Chinese classrooms : evidence from a pilot study of primary and junior secondary schools in Guangdong, China," Policy Research Working Paper Series 8396, The World Bank.
    12. Tessa Bold & Deon Filmer & Gayle Martin & Ezequiel Molina & Brian Stacy & Christophe Rockmore & Jakob Svensson & Waly Wane, 2017. "Enrollment without Learning: Teacher Effort, Knowledge, and Skill in Primary Schools in Africa," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 185-204, Fall.
    13. Metzler, Johannes & Woessmann, Ludger, 2012. "The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation," Journal of Development Economics, Elsevier, vol. 99(2), pages 486-496.
    14. Aslam, Monazza & Kingdon, Geeta, 2011. "What can teachers do to raise pupil achievement?," Economics of Education Review, Elsevier, vol. 30(3), pages 559-574, June.
    15. María Caridad Araujo & Martín Ardanaz & Edna Armendáriz & Jere R. Behrman & Samuel Berlinski & Julian P. Cristia & Yyannu Cruz-Aguayo & Luca Flabbi & Diana Hincapie & Analía Jalmovich & Sharon Lynn Ka, 2015. "The Early Years: Child Well-being and the Role of Public Policy," IDB Publications (Books), Inter-American Development Bank, number 91496 edited by Samuel Berlinski & Norbert Schady, February.
    16. Jonah E. Rockoff & Brian A. Jacob & Thomas J. Kane & Douglas O. Staiger, 2011. "Can You Recognize an Effective Teacher When You Recruit One?," Education Finance and Policy, MIT Press, vol. 6(1), pages 43-74, January.
    17. repec:wbk:wbpubs:28340 is not listed on IDEAS
    18. Montenegro, Claudio E. & Patrinos, Harry Anthony, 2014. "Comparable estimates of returns to schooling around the world," Policy Research Working Paper Series 7020, The World Bank.
    19. Thomas J. Kane & Eric S. Taylor & John H. Tyler & Amy L. Wooten, 2011. "Identifying Effective Classroom Practices Using Student Achievement Data," Journal of Human Resources, University of Wisconsin Press, vol. 46(3), pages 587-613.
    20. Jishnu Das & Stefan Dercon & James Habyarimana & Pramila Krishnan, 2007. "Teacher Shocks and Student Learning: Evidence from Zambia," Journal of Human Resources, University of Wisconsin Press, vol. 42(4).
    21. Daniel Aaronson & Lisa Barrow & William Sander, 2007. "Teachers and Student Achievement in the Chicago Public High Schools," Journal of Labor Economics, University of Chicago Press, vol. 25(1), pages 95-135.
    22. repec:wbk:wbpubs:20488 is not listed on IDEAS
    23. Bacher-Hicks, Andrew & Chin, Mark J. & Kane, Thomas J. & Staiger, Douglas O., 2019. "An experimental evaluation of three teacher quality measures: Value-added, classroom observations, and student surveys," Economics of Education Review, Elsevier, vol. 73(C).
    24. Araujo, María Caridad & Ardanaz, Martín & Armendáriz, Edna & Behrman, Jere R. & Berlinski, Samuel & Cristia, Julian P. & Flabbi, Luca & Hincapie, Diana & Jalmovich, Analía & Kagan, Sharon Lynn & Lopez, 2015. "The Early Years: Child Well-being and the Role of Public Policy," IDB Publications (Books), Inter-American Development Bank, number 7259.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Biswas, Kumar & de Galbert, Pierre & Sabarwal, Shwetlena & Glave, Carla Z. & Asaduzzaman, T.M., 2025. "Online training and financial incentives for teachers: Evidence from Bangladesh," Journal of Economic Behavior & Organization, Elsevier, vol. 229(C).
    2. Filmer,Deon P. & Nahata,Vatsal & Sabarwal,Shwetlena, 2021. "Preparation, Practice, and Beliefs : A Machine Learning Approach to Understanding Teacher Effectiveness," Policy Research Working Paper Series 9847, The World Bank.
    3. Rogel A. Martinez & Dr. James L. Paglinawan, 2026. "Struggle of Long-Serving Teachers in Classroom Observation," International Journal of Research and Innovation in Applied Science, RSIS International, vol. 11(6), pages 3191-3202, June.
    4. Hoadley, Ursula, 2024. "How do structured pedagogy programmes affect reading instruction in African early grade classrooms?," International Journal of Educational Development, Elsevier, vol. 107(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    2. Simon Briole, 2025. "From Teacher Quality to Teaching Quality: Instructional Productivity and Teaching Practices," Working Papers halshs-01993616, HAL.
    3. Ansari, Ali H., 2020. "Comparing teaching practices, teacher content knowledge and pay in Punjab," International Journal of Educational Development, Elsevier, vol. 79(C).
    4. Briole, Simon, 2026. "From teacher quality to teaching quality: Instructional productivity and teaching practices," Economics of Education Review, Elsevier, vol. 111(C).
    5. Iva Trako & Ezequiel Molina & Salman Asim, 2019. "Making Great Strides Yet a Learning Crisis Remains in Tanzania," World Bank Publications - Reports 35980, The World Bank Group.
    6. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, IZA Network @ LISER.
    7. Araujo P., Maria Daniela & Quis, Johanna Sophie, 2021. "Parents can tell! Evidence on classroom quality differences in German primary schools," BERG Working Paper Series 172, Bamberg University, Bamberg Economic Research Group.
    8. Araujo P., María Daniela & Quis, Johanna Sophie, 2021. "Teacher Effects in Germany: Evidence from Elementary School," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242457, Verein für Socialpolitik / German Economic Association.
    9. Bold, Tessa & Molina, Ezequiel & Filmer, Deon & Svensson, Jakob, 2018. "The Lost Human Capital: Teacher Knowledge and Student Learning in Africa," CEPR Discussion Papers 12956, Centre for Economic Policy Research.
    10. Marc Steeg & Sander Gerritsen, 2016. "Teacher Evaluations and Pupil Achievement Gains: Evidence from Classroom Observations," De Economist, Springer, vol. 164(4), pages 419-443, December.
    11. Amaro Da Costa Luz Carneiro,Pedro Manuel & Cruz-Aguayo,Yyannu & Intriago,Ruthy & Ponce,Juan & Schady,Norbert Rudiger & Schodt,Sarah, 2022. "When Promising Interventions Fail : Personalized Coaching for Teachers in a Middle-Income Country," Policy Research Working Paper Series 9926, The World Bank.
    12. Mikkel Aagaard Houmark & Mathias Mørk, 2026. "Teachers and Inequality in Student Performance - Estimating Value Added and Sorting Under Endogenous Mobility," CESifo Working Paper Series 12895, CESifo.
    13. Ajzenman, Nicolás & Elacqua, Gregory & Marotta, Luana & Westh Olsen, Anne Sofie, 2021. "Order Effects and Employment Decisions: Experimental Evidence from a Nationwide Program," IDB Publications (Working Papers) 11541, Inter-American Development Bank.
    14. Jacobus Cilliers & Brahm Fleisch & Cas Prinsloo & Stephen Taylor, 2020. "How to Improve Teaching Practice?: An Experimental Comparison of Centralized Training and In-Classroom Coaching," Journal of Human Resources, University of Wisconsin Press, vol. 55(3), pages 926-962.
    15. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    16. Metzler, Johannes & Woessmann, Ludger, 2012. "The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation," Journal of Development Economics, Elsevier, vol. 99(2), pages 486-496.
    17. Goel, Deepti & Barooah, Bidisha, 2018. "Drivers of Student Performance: Evidence from Higher Secondary Public Schools in Delhi," IZA Discussion Papers 11670, IZA Network @ LISER.
    18. Nicolás Ajzenman & Eleonora Bertoni & Gregory Elacqua & Luana Marotta & Carolina Méndez Vargas, 2024. "Altruism or Money? Reducing Teacher Sorting Using Behavioral Strategies in Peru," Journal of Labor Economics, University of Chicago Press, vol. 42(4), pages 1049-1091.
    19. Torsten Figueiredo Walter, 2020. "Misallocation in the Public Sector? Cross-Country Evidence from Two Million Primary Schools," STICERD - Economic Organisation and Public Policy Discussion Papers Series 70, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    20. Djaker, Sharnic & Ganimian, Alejandro J. & Sabarwal, Shwetlena, 2024. "Out of sight, out of mind? The gap between students’ test performance and teachers’ estimations in India and Bangladesh," Economics of Education Review, Elsevier, vol. 102(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:9365. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.