IDEAS home Printed from https://ideas.repec.org/p/qss/dqsswp/1102.html
   My bibliography  Save this paper

Do Performance Targets Affect Behaviour? Evidence from Discontinuities in Test Scores in England

Author

Listed:
  • Marcello Sartarelli

    (Department of Quantitative Social Science, Institute of Education, University of London. 20 Bedford Way, London WC1H 0AL, UK.)

Abstract

Performance targets are ubiquitous in all areas of an individual's life such as education, jobs, sport competitions and charity donations. In this paper I assess whether meeting performance targets in tests at school has an effect on students' subsequent behaviour. This is helpful to test whether motivation and effort by students, parents and schools that the targets may induce, contribute to explain observed behaviour. I address potentially spurious correlations between test scores and behaviour by exploiting a regression discontinuity design in tests and a linked dataset of test scores and subsequent behaviour by students in compulsory education in England. I find that meeting a target that the government sets for students at age 11 has an insignificant effect on outcomes such as the probability of absence from school or of a police warning. I also find that meeting other targets for high and low ability students decreases the probability of being bullied by up to 34% with respect to the mean probability of such outcomes. The effects are heterogeneous as they vary by gender, parents' education level and type of behaviour. Overall, the research design offers a valuable test to assess unintended consequences that meeting the target or failing to meet it may lead to. The lack of a significant effect of targets on suspension and expulsion from school, as well as police warnings, suggests no adverse behavioural effect of performance targets, which is reassuring evidence on the design of tests in compulsory education. By using Probit estimates, one would conclude that meeting a target has an impact on behaviour. Regression discontinuity estimates show instead an insignificant effect at the expected target and a significant one at other targets for certain outcomes, although smaller than Probit estimates.

Suggested Citation

  • Marcello Sartarelli, 2011. "Do Performance Targets Affect Behaviour? Evidence from Discontinuities in Test Scores in England," DoQSS Working Papers 11-02, Quantitative Social Science - UCL Social Research Institute, University College London.
  • Handle: RePEc:qss:dqsswp:1102
    as

    Download full text from publisher

    File URL: https://repec.ucl.ac.uk/REPEc/pdf/qsswp1102.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Azmat, Ghazala & Iriberri, Nagore, 2010. "The importance of relative performance feedback information: Evidence from a natural experiment using high school students," Journal of Public Economics, Elsevier, vol. 94(7-8), pages 435-452, August.
    2. Canice Prendergast, 1999. "The Provision of Incentives in Firms," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 7-63, March.
    3. Steve Bradley & Robert Crouchley & Jim Millington & Jim Taylor, 2000. "Testing for Quasi‐Market Forces in Secondary Education," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 62(3), pages 357-390, July.
    4. Brian A. Jacob & Lars Lefgren, 2004. "Remedial Education and Student Achievement: A Regression-Discontinuity Analysis," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 226-244, February.
    5. Justine S. Hastings & Jeffrey M. Weinstein, 2007. "No Child Left Behind: Estimating the Impact on Choices and Student Outcomes," NBER Working Papers 13009, National Bureau of Economic Research, Inc.
    6. Grossman, Michael, 2006. "Education and Nonmarket Outcomes," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 1, chapter 10, pages 577-633, Elsevier.
    7. Janet Currie & Enrico Moretti, 2003. "Mother's Education and the Intergenerational Transmission of Human Capital: Evidence from College Openings," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1495-1532.
    8. Dee, Thomas S., 2004. "Are there civic returns to education?," Journal of Public Economics, Elsevier, vol. 88(9-10), pages 1697-1720, August.
    9. Alejandro Gaviria & Steven Raphael, 2001. "School-Based Peer Effects And Juvenile Behavior," The Review of Economics and Statistics, MIT Press, vol. 83(2), pages 257-268, May.
    10. Stephen Gibbons & Olmo Silva & Felix Weinhardt, 2010. "Do Neighbours Affect Teenage Outcomes? Evidence from Neighbourhood Changes in England," SERC Discussion Papers 0063, Centre for Economic Performance, LSE.
    11. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    12. Joseph E. Stiglitz, 2000. "The Contributions of the Economics of Information to Twentieth Century Economics," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(4), pages 1441-1478.
    13. Alessandro Lizzeri & Marciano Siniscalchi, 2008. "Parental Guidance and Supervised Learning," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(3), pages 1161-1195.
    14. Francis Green & Stephen Machin & Richard Murphy & Yu Zhu, 2012. "The Changing Economic Advantage from Private Schools," Economica, London School of Economics and Political Science, vol. 79(316), pages 658-679, October.
    15. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    16. Acemoglu, Daron & Pischke, J. -S., 2001. "Changes in the wage structure, family income, and children's education," European Economic Review, Elsevier, vol. 45(4-6), pages 890-904, May.
    17. Randall Eberts & Kevin Hollenbeck & Joe Stone, 2002. "Teacher Performance Incentives and Student Outcomes," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 913-927.
    18. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    19. Philip Oreopoulos & Kjell G. Salvanes, 2009. "How large are returns to schooling? Hint: Money isn't everything," NBER Working Papers 15339, National Bureau of Economic Research, Inc.
    20. Lee, David S. & Card, David, 2008. "Regression discontinuity inference with specification error," Journal of Econometrics, Elsevier, vol. 142(2), pages 655-674, February.
    21. Arnaud Chevalier & Gauthier Lanot, 2002. "The Relative Effect of Family Characteristics and Financial Situation on Educational Achievement," Education Economics, Taylor & Francis Journals, vol. 10(2), pages 165-181.
    22. Ladd, Helen F. & Walsh, Randall P., 2002. "Implementing value-added measures of school effectiveness: getting the incentives right," Economics of Education Review, Elsevier, vol. 21(1), pages 1-17, February.
    23. Francesca Foliano & Elena Meschi & Anna Vignoles, 2010. "Why do children become disengaged from school?," DoQSS Working Papers 10-06, Quantitative Social Science - UCL Social Research Institute, University College London.
    24. Deborah Wilson, 2004. "Which Ranking? The Impact of a 'Value-Added' Measure of Secondary School Performance," Public Money & Management, Taylor & Francis Journals, vol. 24(1), pages 37-45.
    25. Gianni De Fraja & Tania Oliveira & Luisa Zanchi, 2010. "Must Try Harder: Evaluating the Role of Effort in Educational Attainment," The Review of Economics and Statistics, MIT Press, vol. 92(3), pages 577-597, August.
    26. Randall Reback, 2010. "Schools' mental health services and young children's emotions, behavior, and learning," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(4), pages 698-725.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jake Anders & John Micklewright, 2013. "Teenagers' expectations of applying to university: how do they change?," DoQSS Working Papers 13-13, Quantitative Social Science - UCL Social Research Institute, University College London.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    2. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    3. Bahadır Dursun & Resul Cesur, 2016. "Transforming lives: the impact of compulsory schooling on hope and happiness," Journal of Population Economics, Springer;European Society for Population Economics, vol. 29(3), pages 911-956, July.
    4. Kalena E. Cortes & Joshua S. Goodman & Takako Nomi, 2015. "Intensive Math Instruction and Educational Attainment: Long-Run Impacts of Double-Dose Algebra," Journal of Human Resources, University of Wisconsin Press, vol. 50(1), pages 108-158.
    5. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    6. Jiang, Wei & Lu, Yi & Xie, Huihua, 2020. "Education and mental health: Evidence and mechanisms," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 407-437.
    7. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    8. Cortes, Kalena E. & Goodman, Joshua Samuel & Nomi, Takako, 2015. "Intensive Math Instruction and Educational Attainment," Scholarly Articles 34298862, Harvard Kennedy School of Government.
    9. Tafreschi, Darjusch & Thiemann, Petra, 2016. "Doing it twice, getting it right? The effects of grade retention and course repetition in higher education," Economics of Education Review, Elsevier, vol. 55(C), pages 198-219.
    10. Mahmoud A. A. Elsayed, 2019. "Keeping Kids in School: The Long-Term Effects of Extending Compulsory Education," Education Finance and Policy, MIT Press, vol. 14(2), pages 242-271, Spring.
    11. Onda, Masayuki & Seyler, Edward, 2020. "English learners reclassification and academic achievement: Evidence from Minnesota," Economics of Education Review, Elsevier, vol. 79(C).
    12. Damon Clark & Heather Royer, 2010. "The Effect of Education on Adult Health and Mortality: Evidence from Britain," NBER Working Papers 16013, National Bureau of Economic Research, Inc.
    13. Kamhon Kan & Myoung‐Jae Lee, 2018. "The Effects Of Education On Fertility: Evidence From Taiwan," Economic Inquiry, Western Economic Association International, vol. 56(1), pages 343-357, January.
    14. Guido Imbens & Stefan Wager, 2019. "Optimized Regression Discontinuity Designs," The Review of Economics and Statistics, MIT Press, vol. 101(2), pages 264-278, May.
    15. Dong, Yingying, 2010. "Jumpy or Kinky? Regression Discontinuity without the Discontinuity," MPRA Paper 25461, University Library of Munich, Germany.
    16. Jason M. Lindo & Nicholas J. Sanders & Philip Oreopoulos, 2010. "Ability, Gender, and Performance Standards: Evidence from Academic Probation," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 95-117, April.
    17. Otávio Bartalotti, 2013. "Theory and Practice of Inference in Regression Discontinuity: A Fixed-Bandwidth Asymptotics Approach," Working Papers 1302, Tulane University, Department of Economics, revised Nov 2013.
    18. María F. Prada & Graciana Rucci & Sergio S. Urzúa, 2015. "The Effect of Mandated Child Care on Female Wages in Chile," NBER Working Papers 21080, National Bureau of Economic Research, Inc.
    19. Joaquín Artés & Ignacio Jurado, 2018. "Government fragmentation and fiscal deficits: a regression discontinuity approach," Public Choice, Springer, vol. 175(3), pages 367-391, June.
    20. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.

    More about this item

    Keywords

    Absence; ullying; education; performance targets; police warning; regression discontinuity; suspension; test scores;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:qss:dqsswp:1102. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dr Neus Bover Fonts (email available below). General contact details of provider: https://edirc.repec.org/data/dqioeuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.