IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/17892.html
   My bibliography  Save this paper

Should Aid Reward Performance? Evidence from a Field Experiment on Health and Education in Indonesia

Author

Listed:
  • Benjamin A. Olken
  • Junko Onishi
  • Susan Wong

Abstract

This paper reports an experiment in over 3,000 Indonesian villages designed to test the role of performance incentives in improving the efficacy of aid programs. Villages in a randomly-chosen one-third of subdistricts received a block grant to improve 12 maternal and child health and education indicators, with the size of the subsequent year's block grant depending on performance relative to other villages in the subdistrict. Villages in remaining subdistricts were randomly assigned to either an otherwise identical block grant program with no financial link to performance, or to a pure control group. We find that the incentivized villages performed better on health than the non-incentivized villages, particularly in less developed areas, but found no impact of incentives on education. We find no evidence of negative spillovers from the incentives to untargeted outcomes, and no evidence that villagers manipulated scores. The relative performance design was crucial in ensuring that incentives did not result in a net transfer of funds toward richer areas. Incentives led to what appear to be more efficient spending of block grants, and led to an increase in labor from health providers, who are partially paid fee-for-service, but not teachers. On net, between 50-75% of the total impact of the block grant program on health indicators can be attributed to the performance incentives.

Suggested Citation

  • Benjamin A. Olken & Junko Onishi & Susan Wong, 2012. "Should Aid Reward Performance? Evidence from a Field Experiment on Health and Education in Indonesia," NBER Working Papers 17892, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:17892
    Note: CH ED EH PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w17892.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lazear, Edward P & Rosen, Sherwin, 1981. "Rank-Order Tournaments as Optimum Labor Contracts," Journal of Political Economy, University of Chicago Press, vol. 89(5), pages 841-864, October.
    2. Robert Gibbons & Kevin J. Murphy, 1990. "Relative Performance Evaluation for Chief Executive Officers," ILR Review, Cornell University, ILR School, vol. 43(3), pages 30, April.
    3. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    4. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    5. Dilip Mookherjee, 1984. "Optimal Incentive Schemes with Many Agents," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 51(3), pages 433-446.
    6. Martin L. Weitzman, 1980. "The "Ratchet Principle" and Performance Incentives," Bell Journal of Economics, The RAND Corporation, vol. 11(1), pages 302-308, Spring.
    7. Paul Gertler, 2004. "Do Conditional Cash Transfers Improve Child Health? Evidence from PROGRESA's Control Randomized Experiment," American Economic Review, American Economic Association, vol. 94(2), pages 336-341, May.
    8. Bengt Holmstrom, 1979. "Moral Hazard and Observability," Bell Journal of Economics, The RAND Corporation, vol. 10(1), pages 74-91, Spring.
    9. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, vol. 74(1), pages 199-250, June.
    10. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    11. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1709-1753.
    12. Ballard, Charles L & Shoven, John B & Whalley, John, 1985. "General Equilibrium Computations of the Marginal Welfare Costs of Taxes in the United States," American Economic Review, American Economic Association, vol. 75(1), pages 128-138, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    2. Nancy Qian, 2015. "Making Progress on Foreign Aid," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 277-308, August.
    3. repec:spo:wpmain:info:hdl:2441/4pmvo3bm7m9claao2gl0337ip4 is not listed on IDEAS
    4. de Walque, Damien & Gertler, Paul J. & Bautista-Arredondo, Sergio & Kwan, Ada & Vermeersch, Christel & de Dieu Bizimana, Jean & Binagwaho, Agnès & Condo, Jeanine, 2015. "Using provider performance incentives to increase HIV testing and counseling services in Rwanda," Journal of Health Economics, Elsevier, vol. 40(C), pages 1-9.
    5. repec:spo:wpecon:info:hdl:2441/4pmvo3bm7m9claao2gl0337ip4 is not listed on IDEAS
    6. Kusuma, Dian & Cohen, Jessica & McConnell, Margaret & Berman, Peter, 2016. "Can cash transfers improve determinants of maternal mortality? Evidence from the household and community programs in Indonesia," Social Science & Medicine, Elsevier, vol. 163(C), pages 10-20.
    7. Elise Huillery & Juliette Seban, 2014. "Performance-Based Financing, Motivation and Final Output in the Health Sector: Experimental Evidence from the Democratic Republic of Congo," SciencePo Working papers hal-01071880, HAL.
    8. repec:hal:spmain:info:hdl:2441/4pmvo3bm7m9claao2gl0337ip4 is not listed on IDEAS
    9. Khemani, Stuti, 2013. "Buying votes vs. supplying public services : political incentives to under-invest in pro-poor policies," Policy Research Working Paper Series 6339, The World Bank.
    10. repec:hal:wpspec:info:hdl:2441/4pmvo3bm7m9claao2gl0337ip4 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin A. Olken & Junko Onishi & Susan Wong, 2014. "Should Aid Reward Performance? Evidence from a Field Experiment on Health and Education in Indonesia," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 1-34, October.
    2. World Bank, 2011. "Indonesia's PNPM Generasi Program : Final Impact Evaluation Report," World Bank Publications - Reports 21595, The World Bank Group.
    3. repec:eee:labchp:v:3:y:1999:i:pb:p:2373-2437 is not listed on IDEAS
    4. repec:eee:labchp:v:3:y:1999:i:pb:p:2485-2563 is not listed on IDEAS
    5. Oindrila Dey & Swapnendu Banerjee, 2022. "Incentives, Status and Thereafter: A Critical Survey," South Asian Journal of Macroeconomics and Public Finance, , vol. 11(1), pages 95-115, June.
    6. Edward P. Lazear & Paul Oyer, 2012. "Personnel Economics [The Handbook of Organizational Economics]," Introductory Chapters,, Princeton University Press.
    7. Edward P. Lazear, 1995. "Personnel Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262121883, April.
    8. Zabel, Astrid & Roe, Brian, 2009. "Optimal design of pro-conservation incentives," Ecological Economics, Elsevier, vol. 69(1), pages 126-134, November.
    9. Dey, Oindrila & Banerjee, Swapnendu, 2014. "Status and incentives: A critical survey," MPRA Paper 57658, University Library of Munich, Germany.
    10. Agranov, Marina & Tergiman, Chloe, 2013. "Incentives and compensation schemes: An experimental study," International Journal of Industrial Organization, Elsevier, vol. 31(3), pages 238-247.
    11. Rajesh K. Aggarwal & Andrew A. Samwick, 1999. "Executive Compensation, Strategic Competition, and Relative Performance Evaluation: Theory and Evidence," Journal of Finance, American Finance Association, vol. 54(6), pages 1999-2043, December.
    12. Oyer, Paul & Schaefer, Scott, 2011. "Personnel Economics: Hiring and Incentives," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 20, pages 1769-1823, Elsevier.
    13. Canice Prendergast, 2000. "The Tenuous Tradeoff Between Risk and Incentives," NBER Working Papers 7815, National Bureau of Economic Research, Inc.
    14. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    15. Bartling, Björn & von Siemens, Ferdinand A., 2010. "The intensity of incentives in firms and markets: Moral hazard with envious agents," Labour Economics, Elsevier, vol. 17(3), pages 598-607, June.
    16. Potters, Jan & Rockenbach, Bettina & Sadrieh, Abdolkarim & van Damme, Eric, 2004. "Collusion under yardstick competition: an experimental study," International Journal of Industrial Organization, Elsevier, vol. 22(7), pages 1017-1038, September.
    17. Michael Waldman, 2012. "Theory and Evidence in Internal LaborMarkets [The Handbook of Organizational Economics]," Introductory Chapters,, Princeton University Press.
    18. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    19. Schady, Norbert & Rosero, José, 2008. "Are cash transfers made to women spent like other sources of income?," Economics Letters, Elsevier, vol. 101(3), pages 246-248, December.
    20. Sung Wook Joh, 1999. "Strategic Managerial Incentive Compensation In Japan: Relative Performance Evaluation And Product Market Collusion," The Review of Economics and Statistics, MIT Press, vol. 81(2), pages 303-313, May.
    21. Ola Kvaløy & Trond E. Olsen, 2012. "The Rise of Individual Performance Pay," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 21(2), pages 493-518, June.
    22. Grant, Simon & King, Stephen & Polak, Ben, 1996. "Information Externalities, Share-Price Based Incentives and Managerial Behaviour," Journal of Economic Surveys, Wiley Blackwell, vol. 10(1), pages 1-21, March.

    More about this item

    JEL classification:

    • I15 - Health, Education, and Welfare - - Health - - - Health and Economic Development
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:17892. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.