IDEAS home Printed from https://ideas.repec.org/p/nya/albaec/04-03.html
   My bibliography  Save this paper

Making Government Accountable: Lessons from a Federal Job Training Program

Author

Listed:
  • Gerald Marschke
  • Pascal Courty

Abstract

We describe the evolution of a performance measurement system in a government job-training program. In this program, a federal agency establishes performance measures and standards for sub-state agencies. We show that the performance measurement system's evolution is at least partly explained as a process of trial-and-error, characterized by a feedback loop: the federal agency establishes performance measures, the local managers learn how to game them, the federal agency learns about gaming and reformulates the performance measures, leading to possibly new gaming, and so on. The dynamics suggest that implementing a performance measurement system in government is not a one-time challenge but benefits from careful monitoring and perhaps frequent revision.

Suggested Citation

  • Gerald Marschke & Pascal Courty, 2004. "Making Government Accountable: Lessons from a Federal Job Training Program," Discussion Papers 04-03, University at Albany, SUNY, Department of Economics.
    • Handle: RePEc:nya:albaec:04-03
    as

    Download full text from publisher

    File URL: http://www.albany.edu/economics/research/workingp/2004/training.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    2. Cragg, Michael, 1997. "Performance Incentives in the Public Sector: Evidence from the Job Training Partnership Act," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 13(1), pages 147-168, April.
    3. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    4. Pascal Courty & Gerald Marschke, 2004. "An Empirical Investigation of Gaming Responses to Explicit Performance Incentives," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 23-56, January.
    5. Coleman, James S., 1993. "The Design of Schools as Output-Driven Organizations," Working Papers 88, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    6. Pascal Courty & Gerald Marschke, 2003. "Dynamics of Performance-Measurement Systems," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 19(2), pages 268-284, Summer.
    7. Heckman, James J & Heinrich, Carolyn & Smith, Jeffrey, 1997. "Assessing the Performance of Performance Standards in Public Bureaucracies," American Economic Review, American Economic Association, vol. 87(2), pages 389-395, May.
    8. Card, David, 1999. "The causal effect of education on earnings," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 30, pages 1801-1863, Elsevier.
    9. Burt S Barnow, 2000. "Exploring the relationship between performance management and program impact: A case study of the job training partnership act," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 19(1), pages 118-141.
    10. James J. Heckman & Carolyn Heinrich & Jeffrey Smith, 2002. "The Performance of Performance Standards," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 778-811.
    11. James J. Heckman, 2001. "Micro Data, Heterogeneity, and the Evaluation of Public Policy: Nobel Lecture," Journal of Political Economy, University of Chicago Press, vol. 109(4), pages 673-748, August.
    12. David Dranove & Daniel Kessler & Mark McClellan & Mark Satterthwaite, 2003. "Is More Information Better? The Effects of "Report Cards" on Health Care Providers," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 555-588, June.
    13. Kathryn H. Anderson & Richard V. Burkhauser & Jennie E. Raymond, 1993. "The Effect of Creaming on Placement Rates under the Job Training Partnership Act," ILR Review, Cornell University, ILR School, vol. 46(4), pages 613-624, July.
    14. Maria Goddard & Russell Mannion & Peter Smith, 2000. "Enhancing performance in health care: a theoretical perspective on agency and the role of information," Health Economics, John Wiley & Sons, Ltd., vol. 9(2), pages 95-107, March.
    15. Lynch, Lisa M, 1992. "Private-Sector Training and the Earnings of Young Workers," American Economic Review, American Economic Association, vol. 82(1), pages 299-312, March.
    16. James J. Heckman & Jeffrey A. Smith & Christopher Taber, 1996. "What Do Bureaucrats Do? The Effects of Performance Standards and Bureaucratic Preferences on Acceptance into the JTPA Program," NBER Working Papers 5535, National Bureau of Economic Research, Inc.
    17. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
    18. Healy, Paul M., 1985. "The effect of bonus schemes on accounting decisions," Journal of Accounting and Economics, Elsevier, vol. 7(1-3), pages 85-107, April.
    19. Heckman, James J & Smith, Jeffrey A, 1999. "The Pre-programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation Strategies," Economic Journal, Royal Economic Society, vol. 109(457), pages 313-348, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carolyn J. Heinrich & Gerald Marschke, 2010. "Incentives and their dynamics in public sector performance management systems," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(1), pages 183-208.
    2. Andrea Doneschi & Rossana Patron, 2011. "Assessing incentives and risks in training decisions. A methodological note applied to the Uruguayan case," Documentos de Trabajo (working papers) 1511, Department of Economics - dECON.
    3. Bruttel, Oliver, 2005. "Contracting-out and governance mechanisms in the public employment service," Discussion Papers, Research Unit: Labor Market Policy and Employment SP I 2005-109, WZB Berlin Social Science Center.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kuhn, Michael & Siciliani, Luigi, 2007. "Performance Indicators for Quality with Adverse Selection, Gaming and Inequality Aversion," CEPR Discussion Papers 6261, C.E.P.R. Discussion Papers.
    2. Courty, Pascal & Kim, Do Han & Marschke, Gerald, 2011. "Curbing cream-skimming: Evidence on enrolment incentives," Labour Economics, Elsevier, vol. 18(5), pages 643-655, October.
    3. Courty, Pascal & Marschke, Gerald, 2004. "A General Test of Gaming," CEPR Discussion Papers 4514, C.E.P.R. Discussion Papers.
    4. Burt S. Barnow & Jeffrey Smith, 2015. "Employment and Training Programs," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 127-234, National Bureau of Economic Research, Inc.
    5. Michael Kuhn & Luigi Siciliani, 2009. "Performance Indicators for Quality with Costly Falsification," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 18(4), pages 1137-1154, December.
    6. Andersson, Fredrik W. & Holzer, Harry J. & Lane, Julia & Rosenblum, David & Smith, Jeffrey A., 2013. "Does Federally-Funded Job Training Work? Nonexperimental Estimates of WIA Training Impacts Using Longitudinal Data on Workers and Firms," IZA Discussion Papers 7621, Institute of Labor Economics (IZA).
    7. Pascal Courty & Gerald Marschke, 2004. "An Empirical Investigation of Gaming Responses to Explicit Performance Incentives," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 23-56, January.
    8. Carolyn J. Heinrich & Gerald Marschke, 2010. "Incentives and their dynamics in public sector performance management systems," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(1), pages 183-208.
    9. Gerald Marschke & Pascal Courty, 2000. "An Empirical Investigation of Gaming Responses to Performance Incentives," Discussion Papers 00-12, University at Albany, SUNY, Department of Economics.
    10. Paul Ryan, 2001. "The School-to-Work Transition: A Cross-National Perspective," Journal of Economic Literature, American Economic Association, vol. 39(1), pages 34-92, March.
    11. Julie Berry Cullen & Randall Reback, 2006. "Tinkering Toward Accolades: School Gaming Under a Performance Accountability System," NBER Working Papers 12286, National Bureau of Economic Research, Inc.
    12. James J. Heckman & Jeffrey A. Smith, 2004. "The Determinants of Participation in a Social Program: Evidence from a Prototypical Job Training Program," Journal of Labor Economics, University of Chicago Press, vol. 22(2), pages 243-298, April.
    13. Deborah A. Cobb‐Clark & Thomas Crossley, 2003. "Econometrics for Evaluations: An Introduction to Recent Developments," The Economic Record, The Economic Society of Australia, vol. 79(247), pages 491-511, December.
    14. Carolyn J. Heinrich & Laurence E. Lynn Jr., 1999. "Governance And Performance: The Influence of Program Structure and Management on Job Training Partnership Act (JTPA) Program Outcomes," JCPR Working Papers 107, Northwestern University/University of Chicago Joint Center for Poverty Research.
    15. S. Avdasheva & S. Golovanova & Y. Katsoulacos, 2019. "Optimal Institutional Structure of Competition Authorities Under Reputation Maximization: A Model and Empirical Evidence from the Case of Russia," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 54(2), pages 251-282, March.
    16. Oscar Mitnik, 2008. "How do Training Programs Assign Participants to Training? Characterizing the Assignment Rules of Government Agencies for Welfare-to-Work Programs in California," Working Papers 0907, University of Miami, Department of Economics.
    17. Robert J. LaLonde, 2003. "Employment and Training Programs," NBER Chapters, in: Means-Tested Transfer Programs in the United States, pages 517-586, National Bureau of Economic Research, Inc.
    18. Jeffrey Smith, 2000. "A Critical Survey of Empirical Methods for Evaluating Active Labor Market Policies," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 136(III), pages 247-268, September.
    19. Edward P. Lazear, 1995. "Personnel Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262121883, December.
    20. Simon Burgess & Carol Propper & Marisa Ratto & Emma Tominey, 2017. "Incentives in the Public Sector: Evidence from a Government Agency," Economic Journal, Royal Economic Society, vol. 127(605), pages 117-141, October.

    More about this item

    JEL classification:

    • J33 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Compensation Packages; Payment Methods
    • L14 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Transactional Relationships; Contracts and Reputation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nya:albaec:04-03. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Byoung Park (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.