IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/9414.html
   My bibliography  Save this paper

Catching Cheating Teachers: The Results of an Unusual Experiment in Implementing Theory

Author

Listed:
  • Brian A. Jacob
  • Steven D. Levitt

Abstract

This paper reports on the results of a prospective implementation of methods for detecting teacher cheating. In Spring 2002, over 100 Chicago Public Schools elementary classrooms were selected for retesting based on the cheating detection algorithm. Classrooms prospectively identified as likely cheaters experienced large test score declines. In contrast, classes that had large test score gains on the original test, but were prospectively identified as being unlikely to have cheated, maintained their original gains. Randomly selected classrooms also maintained their gains. The cheating detection tools were thus demonstrated to be effective in distinguishing between classrooms that achieved large test-score gains as a consequence of cheating versus those whose gains were the result of outstanding teaching. In addition, the data generated by the implementation experiment highlight numerous ways in which the original cheating detection methods can be improved in the future.

Suggested Citation

  • Brian A. Jacob & Steven D. Levitt, 2003. "Catching Cheating Teachers: The Results of an Unusual Experiment in Implementing Theory," NBER Working Papers 9414, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:9414
    Note: CH LE PE ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w9414.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    2. Richards, Craig E. & Sheu, Tian Ming, 1992. "The South Carolina school incentive reward program: A policy analysis," Economics of Education Review, Elsevier, vol. 11(1), pages 71-86, March.
    3. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joshua B. Gilbert & Zachary Himmelsbach & James Soland & Mridul Joshi & Benjamin W. Domingue, 2024. "Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory," Papers 2405.00161, arXiv.org, revised Jan 2025.
    2. MacCoun Robert & Cook Philip J. & Muschkin Clara & Vigdor Jacob L, 2008. "Distinguishing Spurious and Real Peer Effects: Evidence from Artificial Societies, Small-Group Experiments, and Real Schoolyards," Review of Law & Economics, De Gruyter, vol. 4(3), pages 695-714, December.
    3. Sah, Raaj, 2007. "Corruption across countries and regions: Some consequences of local osmosis," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2573-2598, August.
    4. Kaoru Nabeshima, 2003. "Raising the quality of secondary education in East Asia," Policy Research Working Paper Series 3140, The World Bank.
    5. Wim J. van der Linden & Minjeong Jeon, 2012. "Modeling Answer Changes on Test Items," Journal of Educational and Behavioral Statistics, , vol. 37(1), pages 180-199, February.
    6. Supanika Leurcharusmee, 2012. "Is penalty for academic cheating an incredible threat?," The Empirical Econometrics and Quantitative Economics Letters, Faculty of Economics, Chiang Mai University, vol. 1(2), pages 81-96, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    2. Victor Lavy, 2009. "Performance Pay and Teachers' Effort, Productivity, and Grading Ethics," American Economic Review, American Economic Association, vol. 99(5), pages 1979-2011, December.
    3. Brian A. Jacob, 2007. "Test-Based Accountability and Student Achievement: An Investigation of Differential Performance on NAEP and State Assessments," NBER Working Papers 12817, National Bureau of Economic Research, Inc.
    4. Jesse Rothstein, 2015. "Teacher Quality Policy When Supply Matters," American Economic Review, American Economic Association, vol. 105(1), pages 100-130, January.
    5. Christophe Lemiére & Gaute Torsvik & Ottar Mæstad & Christopher H. Herbst & Kenneth L. Leonard, 2013. "Evaluating the Impact of Results-Based Financing on Health Worker Performance: Theory, Tools and Variables to Inform an Impact Evaluation," Health, Nutrition and Population (HNP) Discussion Paper Series 98269, The World Bank.
    6. Paul H. Jensen & Robin E. Stonecash, 2004. "The Efficiency of Public Sector Outsourcing Contracts: A Literature Review," Melbourne Institute Working Paper Series wp2004n29, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    7. Maria Cotofan, 2019. "Learning from Praise: Evidence from a Field Experiment with Teachers," Tinbergen Institute Discussion Papers 19-082/V, Tinbergen Institute.
    8. Rosario Macera, 2024. "The roles of selection and practice in mitigating negative responses to high-powered incentives," Experimental Economics, Springer;Economic Science Association, vol. 27(5), pages 973-1000, November.
    9. Cadena, Brian C. & Smith, Austin C., 2022. "Performance pay, productivity, and strategic opt-out: Evidence from a community health center," Journal of Public Economics, Elsevier, vol. 206(C).
    10. Roland G. Fryer, 2013. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," Journal of Labor Economics, University of Chicago Press, vol. 31(2), pages 373-407.
    11. Vegas, E & Ganimian, A. J., 2013. "Theory and Evidence on Teacher Policies in Developed and Developing Countries," Working Paper 104291, Harvard University OpenScholar.
    12. Choi, Heeick & Karim, Khondkar & Liu, Yin, 2025. "Tournament incentives, corporate overinvestment, and economic consequences," International Review of Financial Analysis, Elsevier, vol. 102(C).
    13. Lombardi, María, 2019. "Is the remedy worse than the disease? The impact of teacher remediation on teacher and student performance in Chile," Economics of Education Review, Elsevier, vol. 73(C).
    14. Rebitzer, James B. & Taylor, Lowell J., 2011. "Extrinsic Rewards and Intrinsic Motives: Standard and Behavioral Approaches to Agency and Labor Markets," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 8, pages 701-772, Elsevier.
    15. Blonz, Joshua, 2018. "The Welfare Costs of Misaligned Incentives: Energy Inefficiency and the Principal-Agent Problem," RFF Working Paper Series 18-28, Resources for the Future.
    16. Derek Neal, 2011. "The Design of Performance Pay in Education," NBER Working Papers 16710, National Bureau of Economic Research, Inc.
    17. Joshua Blonz, 2019. "The Welfare Costs of Misaligned Incentives: Energy Inefficiency and the Principal-Agent Problem," Finance and Economics Discussion Series 2019-071, Board of Governors of the Federal Reserve System (U.S.).
    18. Suárez Serrato, Juan Carlos & Wang, Xiao Yu & Zhang, Shuang, 2019. "The limits of meritocracy: Screening bureaucrats under imperfect verifiability," Journal of Development Economics, Elsevier, vol. 140(C), pages 223-241.
    19. Sarena F. Goodman & Lesley J. Turner, 2013. "The Design of Teacher Incentive Pay and Educational Outcomes: Evidence from the New York City Bonus Program," Journal of Labor Economics, University of Chicago Press, vol. 31(2), pages 409-420.
    20. Courty, Pascal & Marschke, Gerald, 2004. "A General Test of Gaming," CEPR Discussion Papers 4514, C.E.P.R. Discussion Papers.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • K42 - Law and Economics - - Legal Procedure, the Legal System, and Illegal Behavior - - - Illegal Behavior and the Enforcement of Law

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:9414. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.