IDEAS home Printed from https://ideas.repec.org/p/uwo/hcuwoc/201725.html
   My bibliography  Save this paper

Measuring Quality for Use in Incentive Schemes: The Case of "Shrinkage" Estimators

Author

Abstract

Researchers commonly "shrink" raw quality measures based on statistical criteria. This paper studies when and how this transformation’s statistical properties would confer economic benefits to a utility-maximizing decisionmaker, for many asymmetric information environments. The presence of an econometric endogeneity could cause the data transformation to do either worse or better than the untransformed data. I develop the results for an application measuring teacher quality. I use data from Los Angeles to confirm the presence of the econometric endogeneity and show that the simpler raw measure would outperform the one most commonly used in teacher incentive schemes.

Suggested Citation

  • Nirav Mehta, 2017. "Measuring Quality for Use in Incentive Schemes: The Case of "Shrinkage" Estimators," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 201725, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).
  • Handle: RePEc:uwo:hcuwoc:201725
    as

    Download full text from publisher

    File URL: https://ir.lib.uwo.ca/cgi/viewcontent.cgi?article=1137&context=economicscibc
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Daniel Player, 2010. "Nonmonetary Compensation in the Public Teacher Labor Market," Education Finance and Policy, MIT Press, vol. 5(1), pages 82-103, January.
    2. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    3. Buddin, Richard, 2011. "Measuring teacher and school effectiveness at improving student achievement in Los Angeles elementary schools," MPRA Paper 31963, University Library of Munich, Germany.
    4. Weili Ding & Steven F. Lehrer, 2010. "Estimating Treatment Effects from Contaminated Multiperiod Education Experiments: The Dynamic Impacts of Class Size Reductions," The Review of Economics and Statistics, MIT Press, vol. 92(1), pages 31-42, February.
    5. Joseph E. Stiglitz, 1991. "Symposium on Organizations and Economics," Journal of Economic Perspectives, American Economic Association, vol. 5(2), pages 15-24, Spring.
    6. Daniel F. McCaffrey & Tim R. Sass & J. R. Lockwood & Kata Mihaly, 2009. "The Intertemporal Variability of Teacher Effect Estimates," Education Finance and Policy, MIT Press, vol. 4(4), pages 572-606, October.
    7. Jere R. Behrman & Michela M. Tincani & Petra E. Todd & Kenneth I. Wolpin, 2016. "Teacher Quality in Public and Private Schools under a Voucher System: The Case of Chile," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 319-362.
    8. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja & Tristan Zajonc, 2011. "Do Value-Added Estimates Add Value? Accounting for Learning Dynamics," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 29-54, July.
    9. Cassandra M. Guarino & Mark D. Reckase & Jeffrey M. Woolrdige, 2014. "Can Value-Added Measures of Teacher Performance Be Trusted?," Education Finance and Policy, MIT Press, vol. 10(1), pages 117-156, November.
    10. Christopher Ferrall & Bruce Shearer, 1999. "Incentives and Transactions Costs Within the Firm: Estimating an Agency Model Using Payroll Records," Review of Economic Studies, Oxford University Press, vol. 66(2), pages 309-338.
    11. C. Kirabo Jackson, 2014. "Teacher Quality at the High School Level: The Importance of Accounting for Tracks," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 645-684.
    12. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    13. repec:oup:qjecon:v:132:y:2017:i:4:p:2061-2062. is not listed on IDEAS
    14. Thomas Dohmen & Armin Falk, 2010. "You Get What You Pay For: Incentives and Selection in the Education System," Economic Journal, Royal Economic Society, vol. 120(546), pages 256-271, August.
    15. repec:eee:ecoedu:v:66:y:2018:i:c:p:67-72 is not listed on IDEAS
    16. Lippman, Steven A & McCall, John J, 1976. "The Economics of Job Search: A Survey: Part I," Economic Inquiry, Western Economic Association International, vol. 14(2), pages 155-189, June.
    17. Imberman, Scott A. & Lovenheim, Michael F., 2016. "Does the market value value-added? Evidence from housing prices after a public release of school and teacher value-added," Journal of Urban Economics, Elsevier, vol. 91(C), pages 104-121.
    18. Timothy N. Bond & Kevin Lang, 2013. "The Evolution of the Black-White Test Score Gap in Grades K–3: The Fragility of Results," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1468-1479, December.
    19. Andrew Clausen, 2013. "Moral Hazard with Counterfeit Signals," ESE Discussion Papers 225, Edinburgh School of Economics, University of Edinburgh.
    20. Oakes, J. Michael, 2004. "The (mis)estimation of neighborhood effects: causal inference for a practicable social epidemiology," Social Science & Medicine, Elsevier, vol. 58(10), pages 1929-1952, May.
    21. Alma Cohen & Liran Einav, 2007. "Estimating Risk Preferences from Deductible Choice," American Economic Review, American Economic Association, vol. 97(3), pages 745-788, June.
    22. Cory Koedel & Julian Betts, 2010. "Value Added to What? How a Ceiling in the Testing Instrument Influences Value-Added Estimation," Education Finance and Policy, MIT Press, vol. 5(1), pages 54-81, January.
    23. Holmstrom, Bengt & Milgrom, Paul, 1987. "Aggregation and Linearity in the Provision of Intertemporal Incentives," Econometrica, Econometric Society, vol. 55(2), pages 303-328, March.
    24. Michael Rothschild, 1974. "Searching for the Lowest Price When the Distribution of Prices Is Unknown: A Summary," NBER Chapters,in: Annals of Economic and Social Measurement, Volume 3, number 1, pages 293-294 National Bureau of Economic Research, Inc.
    25. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2006. "Teacher-Student Matching and the Assessment of Teacher Effectiveness," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    26. Joshua D. Angrist & Peter D. Hull & Parag A. Pathak & Christopher R. Walters, 2017. "Leveraging Lotteries for School Value-Added: Testing and Estimation," The Quarterly Journal of Economics, Oxford University Press, vol. 132(2), pages 871-919.
    27. Roland G. Fryer & Steven D. Levitt, 2004. "Understanding the Black-White Test Score Gap in the First Two Years of School," The Review of Economics and Statistics, MIT Press, vol. 86(2), pages 447-464, May.
    28. Mehta, Nirav, 2018. "The potential output gains from using optimal teacher incentives: An illustrative calibration of a hidden action model," Economics of Education Review, Elsevier, vol. 66(C), pages 67-72.
    29. Rothschild, Michael, 1974. "Searching for the Lowest Price When the Distribution of Prices Is Unknown," Journal of Political Economy, University of Chicago Press, vol. 82(4), pages 689-711, July/Aug..
    30. Babcock, Bruce A. & Choi, E. Kwan & Feinerman, Eli, 1993. "Risk And Probability Premiums For Cara Utility Functions," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 18(1), pages 1-8, July.
    31. Stinebrickner, Todd R, 2001. "A Dynamic Model of Teacher Labor Supply," Journal of Labor Economics, University of Chicago Press, vol. 19(1), pages 196-230, January.
    32. Eric A. Hanushek, 1979. "Conceptual and Empirical Issues in the Estimation of Educational Production Functions," Journal of Human Resources, University of Wisconsin Press, vol. 14(3), pages 351-388.
    33. Christopher Jepsen & Steven Rivkin, 2009. "Class Size Reduction and Student Achievement: The Potential Tradeoff between Teacher Quality and Class Size," Journal of Human Resources, University of Wisconsin Press, vol. 44(1).
    34. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    35. Cassandra M. Guarino & Michelle Maxfield & Mark D. Reckase & Paul N. Thompson & Jeffrey M. Wooldridge, 2015. "An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures," Journal of Educational and Behavioral Statistics, , vol. 40(2), pages 190-222, April.
    36. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    37. repec:tpr:restat:v:99:y:2017:i:4:p:652-656 is not listed on IDEAS
    38. repec:mpr:mprres:6829 is not listed on IDEAS
    39. Lippman, Steven A & McCall, John J, 1976. "The Economics of Job Search: A Survey," Economic Inquiry, Western Economic Association International, vol. 14(3), pages 347-368, September.
    40. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, July.
    41. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    42. Wiswall, Matthew, 2013. "The dynamics of teacher quality," Journal of Public Economics, Elsevier, vol. 100(C), pages 61-78.
    Full references (including those not matched with items on IDEAS)

    More about this item

    JEL classification:

    • J01 - Labor and Demographic Economics - - General - - - Labor Economics: General
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uwo:hcuwoc:201725. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: https://economics.uwo.ca/research/research_papers/chcp_workingpapers.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.