IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/9414.html
   My bibliography  Save this paper

Catching Cheating Teachers: The Results of an Unusual Experiment in Implementing Theory

Author

Listed:
  • Brian A. Jacob
  • Steven D. Levitt

Abstract

This paper reports on the results of a prospective implementation of methods for detecting teacher cheating. In Spring 2002, over 100 Chicago Public Schools elementary classrooms were selected for retesting based on the cheating detection algorithm. Classrooms prospectively identified as likely cheaters experienced large test score declines. In contrast, classes that had large test score gains on the original test, but were prospectively identified as being unlikely to have cheated, maintained their original gains. Randomly selected classrooms also maintained their gains. The cheating detection tools were thus demonstrated to be effective in distinguishing between classrooms that achieved large test-score gains as a consequence of cheating versus those whose gains were the result of outstanding teaching. In addition, the data generated by the implementation experiment highlight numerous ways in which the original cheating detection methods can be improved in the future.

Suggested Citation

  • Brian A. Jacob & Steven D. Levitt, 2003. "Catching Cheating Teachers: The Results of an Unusual Experiment in Implementing Theory," NBER Working Papers 9414, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:9414
    Note: CH LE PE ED
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w9414.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Richards, Craig E. & Sheu, Tian Ming, 1992. "The South Carolina school incentive reward program: A policy analysis," Economics of Education Review, Elsevier, vol. 11(1), pages 71-86, March.
    2. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    3. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joshua B. Gilbert & Zachary Himmelsbach & James Soland & Mridul Joshi & Benjamin W. Domingue, 2024. "Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory," Papers 2405.00161, arXiv.org, revised Jan 2025.
    2. MacCoun Robert & Cook Philip J. & Muschkin Clara & Vigdor Jacob L, 2008. "Distinguishing Spurious and Real Peer Effects: Evidence from Artificial Societies, Small-Group Experiments, and Real Schoolyards," Review of Law & Economics, De Gruyter, vol. 4(3), pages 695-714, December.
    3. Sah, Raaj, 2007. "Corruption across countries and regions: Some consequences of local osmosis," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2573-2598, August.
    4. Kaoru Nabeshima, 2003. "Raising the quality of secondary education in East Asia," Policy Research Working Paper Series 3140, The World Bank.
    5. Wim J. van der Linden & Minjeong Jeon, 2012. "Modeling Answer Changes on Test Items," Journal of Educational and Behavioral Statistics, , vol. 37(1), pages 180-199, February.
    6. Supanika Leurcharusmee, 2012. "Is penalty for academic cheating an incredible threat?," The Empirical Econometrics and Quantitative Economics Letters, Faculty of Economics, Chiang Mai University, vol. 1(2), pages 81-96, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    2. Brian A. Jacob, 2007. "Test-Based Accountability and Student Achievement: An Investigation of Differential Performance on NAEP and State Assessments," NBER Working Papers 12817, National Bureau of Economic Research, Inc.
    3. Victor Lavy, 2009. "Performance Pay and Teachers' Effort, Productivity, and Grading Ethics," American Economic Review, American Economic Association, vol. 99(5), pages 1979-2011, December.
    4. Paul H. Jensen & Robin E. Stonecash, 2004. "The Efficiency of Public Sector Outsourcing Contracts: A Literature Review," Melbourne Institute Working Paper Series wp2004n29, Melbourne Institute of Applied Economic and Social Research, The University of Melbourne.
    5. Maria Cotofan, 2019. "Learning from Praise: Evidence from a Field Experiment with Teachers," Tinbergen Institute Discussion Papers 19-082/V, Tinbergen Institute.
    6. Vegas, E & Ganimian, A. J., 2013. "Theory and Evidence on Teacher Policies in Developed and Developing Countries," Working Paper 104291, Harvard University OpenScholar.
    7. Blonz, Joshua, 2018. "The Welfare Costs of Misaligned Incentives: Energy Inefficiency and the Principal-Agent Problem," RFF Working Paper Series 18-28, Resources for the Future.
    8. Joshua Blonz, 2019. "The Welfare Costs of Misaligned Incentives: Energy Inefficiency and the Principal-Agent Problem," Finance and Economics Discussion Series 2019-071, Board of Governors of the Federal Reserve System (U.S.).
    9. Sarena F. Goodman & Lesley J. Turner, 2013. "The Design of Teacher Incentive Pay and Educational Outcomes: Evidence from the New York City Bonus Program," Journal of Labor Economics, University of Chicago Press, vol. 31(2), pages 409-420.
    10. Jones, Michael D., 2013. "Teacher behavior under performance pay incentives," Economics of Education Review, Elsevier, vol. 37(C), pages 148-164.
    11. Sims, David P., 2008. "Strategic responses to school accountability measures: It's all in the timing," Economics of Education Review, Elsevier, vol. 27(1), pages 58-68, February.
    12. Karachiwalla, Naureen & Park, Albert, 2017. "Promotion incentives in the public sector: Evidence from Chinese schools," Journal of Public Economics, Elsevier, vol. 146(C), pages 109-128.
    13. Rajashri Chakrabarti, 2013. "Vouchers, Public School Response, And The Role Of Incentives: Evidence From Florida," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 500-526, January.
    14. Roland G. Fryer, Jr & Steven D. Levitt & John List & Sally Sadoff, 2012. "Enhancing the Efficacy of Teacher Incentives through Loss Aversion: A Field Experiment," NBER Working Papers 18237, National Bureau of Economic Research, Inc.
    15. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    16. Christian Zehnder & Holger Herz & Jean-Philippe Bonardi, 2016. "A Productive Clash of Cultures: Injecting Economics into Leadership Research," CESifo Working Paper Series 6175, CESifo.
    17. Roland G. Fryer, 2011. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," NBER Working Papers 16850, National Bureau of Economic Research, Inc.
    18. Gadi Barlevy & Derek Neal, 2012. "Pay for Percentile," American Economic Review, American Economic Association, vol. 102(5), pages 1805-1831, August.
    19. Kuhn, Michael & Siciliani, Luigi, 2013. "Manipulation and auditing of public sector contracts," European Journal of Political Economy, Elsevier, vol. 32(C), pages 251-267.
    20. Carolyn J. Heinrich & Gerald Marschke, 2010. "Incentives and their dynamics in public sector performance management systems," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(1), pages 183-208.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • K42 - Law and Economics - - Legal Procedure, the Legal System, and Illegal Behavior - - - Illegal Behavior and the Enforcement of Law

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:9414. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.