IDEAS home Printed from https://ideas.repec.org/a/eee/injoed/v84y2021ics0738059321000754.html
   My bibliography  Save this article

Does teaching to the test improve student learning?

Author

Listed:
  • Zakharov, Andrey
  • Carnoy, Martin

Abstract

A central concern surrounding test-based accountability is that teachers may narrow teaching practices to improve test performance on a curriculum-based specific knowledge test rather than student learning more broadly. Two of the most common teaching practices that “teach to the test” are providing test-specific classwork and increasing the frequency with which students take practice tests. Whether such teaching practices improve student learning—both in terms of learning the content associated with a specific knowledge test as well as more general learning—is a largely unanswered question. To approach this question, this paper uses a student fixed effects approach to analyze the impact of these kinds of narrow teaching practices on student performance on a specific test as well as a general knowledge test. We find that test-specific classwork and practice tests with specific test items tend to have little or negative impacts on curriculum specific or general knowledge test performance, except for male students, and that subject practice tests (without emphasizing test-specific items) have positive effects on student outcomes on both kinds of tests, but larger on the curriculum-specific than on the general test, and much larger on the curriculum-specific test for male students. We discuss the logic for these results and what they tell us about the effectiveness of test-focused teaching practices more generally.

Suggested Citation

  • Zakharov, Andrey & Carnoy, Martin, 2021. "Does teaching to the test improve student learning?," International Journal of Educational Development, Elsevier, vol. 84(C).
  • Handle: RePEc:eee:injoed:v:84:y:2021:i:c:s0738059321000754
    DOI: 10.1016/j.ijedudev.2021.102422
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0738059321000754
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijedudev.2021.102422?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Van Klaveren, Chris, 2011. "Lecturing style teaching and student performance," Economics of Education Review, Elsevier, vol. 30(4), pages 729-739, August.
    2. Schwerdt, Guido & Wuppermann, Amelie C., 2011. "Is traditional teaching really all that bad? A within-student between-subject approach," Economics of Education Review, Elsevier, vol. 30(2), pages 365-379, April.
    3. Steven G. Rivkin & Jeffrey C. Schiman, 2015. "Instruction Time, Classroom Quality, and Academic Achievement," Economic Journal, Royal Economic Society, vol. 125(588), pages 425-448, November.
    4. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    5. Bishop, John H, 1997. "The Effect of National Standards and Curriculum-Based Exams on Achievement," American Economic Review, American Economic Association, vol. 87(2), pages 260-264, May.
    6. Victor Lavy, 2015. "Do Differences in Schools' Instruction Time Explain International Achievement Gaps? Evidence from Developed and Developing Countries," Economic Journal, Royal Economic Society, vol. 125(588), pages 397-424, November.
    7. Yulia Koreshnikova & Andrey Zakharov & Fedor Dudyrev, 2018. "Differences in General Education in Vocational and High Schools: Characteristics of Teachers and Teaching Practices in Mathematics," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 2, pages 228-253.
    8. Thomas S. Dee, 2005. "A Teacher Like Me: Does Race, Ethnicity, or Gender Matter?," American Economic Review, American Economic Association, vol. 95(2), pages 158-165, May.
    9. Thomas S. Dee, 2007. "Teachers and the Gender Gaps in Student Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 42(3).
    10. Steven G. Rivkin & Jeffrey C. Schiman, 2015. "Instruction Time, Classroom Quality, and Academic Achievement," Economic Journal, Royal Economic Society, vol. 0(588), pages 425-448, November.
    11. Kingdon, Geeta & Teal, Francis, 2010. "Teacher unions, teacher pay and student performance in India: A pupil fixed effects approach," Journal of Development Economics, Elsevier, vol. 91(2), pages 278-288, March.
    12. Thomas S. Dee & Sarah R. Cohodes, 2008. "Out-of-Field Teachers and Student Achievement," Public Finance Review, , vol. 36(1), pages 7-32, January.
    13. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2010. "Teacher Credentials and Student Achievement in High School: A Cross-Subject Analysis with Student Fixed Effects," Journal of Human Resources, University of Wisconsin Press, vol. 45(3).
    14. Bishop, J., 1997. "The Effect of national Standards and Curriculum-Based Exams on Achievement," Papers 97-01, Cornell - Center for Advanced Human Resource Studies.
    15. Edward P. Lazear, 2006. "Speeding, Terrorism, and Teaching to the Test," The Quarterly Journal of Economics, Oxford University Press, vol. 121(3), pages 1029-1061.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrey Zakharov & Martin Carnoy & Prashant Loyalka, 2013. "Which teaching practices improve student performance on high-stakes exams? Evidence from Russia," HSE Working papers WP BRP 13/EDU/2013, National Research University Higher School of Economics.
    2. Ludger Woessmann, 2016. "The Importance of School Systems: Evidence from International Differences in Student Achievement," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 3-32, Summer.
    3. Chu, Jessica Hsiaochieh & Loyalka, Prashant & Chu, James & Qu, Qinghe & Shi, Yaojiang & Li, Guirong, 2015. "The impact of teacher credentials on student achievement in China," China Economic Review, Elsevier, vol. 36(C), pages 14-24.
    4. Loyalka, Prashant & Zakharov, Andrey, 2016. "Does shadow education help students prepare for college? Evidence from Russia," International Journal of Educational Development, Elsevier, vol. 49(C), pages 22-30.
    5. Zakharov, Andrey & Tsheko, Gaelebale & Carnoy, Martin, 2016. "Do “better” teachers and classroom resources improve student achievement? A causal comparative approach in Kenya, South Africa, and Swaziland," International Journal of Educational Development, Elsevier, vol. 50(C), pages 108-124.
    6. Comi, Simona Lorena & Argentin, Gianluca & Gui, Marco & Origo, Federica & Pagani, Laura, 2017. "Is it the way they use it? Teachers, ICT and student achievement," Economics of Education Review, Elsevier, vol. 56(C), pages 24-39.
    7. Atsushi Inoue & Ryuichi Tanaka, 2023. "Do teachers’ college majors affect students’ academic achievement in the sciences? A cross-subfields analysis with student-teacher fixed effects," Education Economics, Taylor & Francis Journals, vol. 31(5), pages 617-631, September.
    8. Metzler, Johannes & Woessmann, Ludger, 2012. "The impact of teacher subject knowledge on student achievement: Evidence from within-teacher within-student variation," Journal of Development Economics, Elsevier, vol. 99(2), pages 486-496.
    9. Motegi, Hiroyuki & Oikawa, Masato, 2019. "The effect of instructional quality on student achievement: Evidence from Japan," Japan and the World Economy, Elsevier, vol. 52(C).
    10. Simon Briole, 2019. "From Teacher Quality to Teaching Quality: Instructional Productivity and Teaching Practices in the US," Working Papers halshs-01993616, HAL.
    11. José M. Cordero & Víctor Cristóbal & Daniel Santín, 2018. "Causal Inference On Education Policies: A Survey Of Empirical Studies Using Pisa, Timss And Pirls," Journal of Economic Surveys, Wiley Blackwell, vol. 32(3), pages 878-915, July.
    12. Bingley, Paul & Heinesen, Eskil & Krassel, Karl Fritjof & Kristensen, Nicolai, 2018. "The Timing of Instruction Time: Accumulated Hours, Timing and Pupil Achievement," IZA Discussion Papers 11807, Institute of Labor Economics (IZA).
    13. Johan Coenen & Ilja Cornelisz & Wim Groot & Henriette Maassen van den Brink & Chris Van Klaveren, 2018. "Teacher Characteristics And Their Effects On Student Test Scores: A Systematic Review," Journal of Economic Surveys, Wiley Blackwell, vol. 32(3), pages 848-877, July.
    14. Cordero, José Manuel & Gil, María & Pedraja Chaparro, Francisco, 2016. "Exploring the effect of financial literacy courses on student achievement: a cross-country approach using PISA 2012 data," MPRA Paper 75474, University Library of Munich, Germany.
    15. Sancassani, Pietro, 2023. "The effect of teacher subject-specific qualifications on student science achievement," Labour Economics, Elsevier, vol. 80(C).
    16. Daniela Del Boca & Chiara Monfardini & Sarah Grace See, 2022. "Early Childcare Duration and Student' Later Outcomes in Europe," Working Papers 2022-021, Human Capital and Economic Opportunity Working Group.
    17. Cordero, Jose M. & Gil-Izquierdo, María, 2018. "The effect of teaching strategies on student achievement: An analysis using TALIS-PISA-link," Journal of Policy Modeling, Elsevier, vol. 40(6), pages 1313-1331.
    18. Huebener, Mathias & Kuger, Susanne & Marcus, Jan, 2017. "Increased instruction hours and the widening gap in student performance," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 47, pages 15-34.
    19. Jan Bietenbeck & Marc Piopiunik & Simon Wiederhold, 2018. "Africa’s Skill Tragedy: Does Teachers’ Lack of Knowledge Lead to Low Student Performance?," Journal of Human Resources, University of Wisconsin Press, vol. 53(3), pages 553-578.
    20. Torberg Falch & Marte Rønning, 2011. "Homework assignment and student achievement in OECD countries," Working Paper Series 11411, Department of Economics, Norwegian University of Science and Technology.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:injoed:v:84:y:2021:i:c:s0738059321000754. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/international-journal-of-educational-development .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.