IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v186y2025ics0305750x24002997.html
   My bibliography  Save this article

The impact of independence on reported aid performance

Author

Listed:
  • Wood, Terence
  • Howes, Stephen

Abstract

In this paper we test whether the reported performance of aid projects changes when the process of producing project appraisals is made more independent. We do this using a dataset of Australian aid appraisals and take advantage of a change that occurred when a more independent process involving the central aid evaluation unit of the Department of Foreign Affairs and Trade (DFAT) and external contractors was put in place to review appraisals of recently completed projects. Using difference-in-differences and contrasting assessments of ongoing projects, which the appraisal process was not changed for, and completed projects, where the process was changed, we show that introducing more independence led to a substantial fall in how successful projects were deemed to be. We also show that the change probably led to more accurate recording of COVID-19′s impact on Australian aid, as well as more accurate assessments of the quality of Australia’s aid to Papua New Guinea, its largest aid partner. As we do this, we take care to demonstrate that our findings are robust to the types of methodological issues that can affect difference-in-differences studies.

Suggested Citation

  • Wood, Terence & Howes, Stephen, 2025. "The impact of independence on reported aid performance," World Development, Elsevier, vol. 186(C).
    • Handle: RePEc:eee:wdevel:v:186:y:2025:i:c:s0305750x24002997
    DOI: 10.1016/j.worlddev.2024.106829
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X24002997
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.worlddev.2024.106829?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. ., 2021. "Australia: Metropolitan partnerships - Victoria," Chapters, in: Strategic Community Partnerships, Philanthropy, and Nongovernmental Organization, chapter 15, pages 106-111, Edward Elgar Publishing.
    2. Dollar, David & Svensson, Jakob, 2000. "What Explains the Success or Failure of Structural Adjustment Programmes?," Economic Journal, Royal Economic Society, vol. 110(466), pages 894-917, October.
    3. Axel Dreher & Stephan Klasen & James Raymond Vreeland & Eric Werker, 2013. "The Costs of Favoritism: Is Politically Driven Aid Less Effective?," Economic Development and Cultural Change, University of Chicago Press, vol. 62(1), pages 157-191.
    4. Martens,Bertin & Mummert,Uwe & Murrell,Peter & Seabright,Paul, 2008. "The Institutional Economics of Foreign Aid," Cambridge Books, Cambridge University Press, number 9780521055390, June.
    5. Terence Wood & Camilla Burkot & Stephen Howes, 2017. "Gauging Change in Australian Aid: Stakeholder Perceptions of the Government Aid Program," Asia and the Pacific Policy Studies, Wiley Blackwell, vol. 4(2), pages 237-250, May.
    6. David Bulman & Walter Kolkma & Aart Kraay, 2017. "Good countries or good projects? Comparing macro and micro correlates of World Bank and Asian Development Bank project performance," The Review of International Organizations, Springer, vol. 12(3), pages 335-363, September.
    7. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    8. Stephen G. Donald & Kevin Lang, 2007. "Inference with Difference-in-Differences and Other Panel Data," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 221-233, May.
    9. Simon Feeny, 2005. "The Impact of Foreign Aid on Economic Growth in Papua New Guinea," Journal of Development Studies, Taylor & Francis Journals, vol. 41(6), pages 1092-1117.
    10. Claryn S. J. Kung & Johannes S. Kunz & Michael A. Shields, 2021. "Economic Aspects of Loneliness in Australia," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 54(1), pages 147-163, March.
    11. Dietrich,Simone, 2021. "States, Markets, and Foreign Aid," Cambridge Books, Cambridge University Press, number 9781316519202, June.
    12. Kilby, Christopher, 2000. "Supervision and performance: the case of World Bank projects," Journal of Development Economics, Elsevier, vol. 62(1), pages 233-259, June.
    13. Honig, Dan, 2019. "When Reporting Undermines Performance: The Costs of Politically Constrained Organizational Autonomy in Foreign Aid Implementation," International Organization, Cambridge University Press, vol. 73(1), pages 171-201, January.
    14. Christopher Kilby & Katharina Michaelowa, 2019. "What Influences World Bank Project Evaluations?," Springer Books, in: Nabamita Dutta & Claudia R. Williamson (ed.), Lessons on Foreign Aid and Economic Development, chapter 0, pages 109-150, Springer.
    15. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    16. Denizer, Cevdet & Kaufmann, Daniel & Kraay, Aart, 2013. "Good countries or good projects? Macro and micro correlates of World Bank project performance," Journal of Development Economics, Elsevier, vol. 105(C), pages 288-302.
    17. Feeny, Simon & Vuong, Vu, 2017. "Explaining Aid Project and Program Success: Findings from Asian Development Bank Interventions," World Development, Elsevier, vol. 90(C), pages 329-343.
    18. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    19. Dietrich,Simone, 2021. "States, Markets, and Foreign Aid," Cambridge Books, Cambridge University Press, number 9781009001755, June.
    20. Isham, Jonathan & Kaufmann, Daniel & Pritchett, Lant H, 1997. "Civil Liberties, Democracy, and the Performance of Government Projects," The World Bank Economic Review, World Bank, vol. 11(2), pages 219-242, May.
    21. Terence Wood & Sabit Otor & Matthew Dornan, 2020. "Australian aid projects: What works, where projects work and how Australia compares," Asia and the Pacific Policy Studies, Wiley Blackwell, vol. 7(2), pages 171-186, May.
    22. Gibson, Clark C. & Andersson, Krister & Ostrom, The late Elinor & Shivakumar, Sujai, 2005. "The Samaritan's Dilemma: The Political Economy of Development Aid," OUP Catalogue, Oxford University Press, number 9780199278855, Decembrie.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Heinzel, Mirko & Reinsberg, Bernhard, 2024. "Trust funds and the sub-national effectiveness of development aid: Evidence from the World Bank," World Development, Elsevier, vol. 179(C).
    2. Terence Wood & Sabit Otor & Matthew Dornan, 2022. "Why are aid projects less effective in the Pacific?," Development Policy Review, Overseas Development Institute, vol. 40(3), May.
    3. Mirko Heinzel & Andrea Liese, 2021. "Managing performance and winning trust: how World Bank staff shape recipient performance," The Review of International Organizations, Springer, vol. 16(3), pages 625-653, July.
    4. Silvia Marchesi & Tania Masi, 2021. "Delegation of implementation in project aid," The Review of International Organizations, Springer, vol. 16(3), pages 655-687, July.
    5. Eilers, Yota & Kluve, Jochen & Langbein, Jörg & Reiners, Lennart, 2023. "Volume, Risk, Complexity: What Makes Development Finance Projects Succeed or Fail?," IZA Discussion Papers 16691, Institute of Labor Economics (IZA).
    6. Ryan C. Briggs, 2020. "Results from single-donor analyses of project aid success seem to generalize pretty well across donors," The Review of International Organizations, Springer, vol. 15(4), pages 947-963, October.
    7. repec:dau:papers:123456789/14817 is not listed on IDEAS
    8. Terence Wood & Sabit Otor & Matthew Dornan, 2020. "Australian aid projects: What works, where projects work and how Australia compares," Asia and the Pacific Policy Studies, Wiley Blackwell, vol. 7(2), pages 171-186, May.
    9. Lisa Chauvet & Paul Collier & Andreas Fuster, 2015. "Supervision and Project Performance: A Principal-Agent Approach," Working Papers DT/2015/04, DIAL (Développement, Institutions et Mondialisation).
    10. Steffen Eckhard & Vytautas Jankauskas & Elena Leuschner & Ian Burton & Tilman Kerl & Rita Sevastjanova, 2023. "The performance of international organizations: a new measure and dataset based on computational text analysis of evaluation reports," The Review of International Organizations, Springer, vol. 18(4), pages 753-776, October.
    11. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    12. David Bulman & Walter Kolkma & Aart Kraay, 2017. "Good countries or good projects? Comparing macro and micro correlates of World Bank and Asian Development Bank project performance," The Review of International Organizations, Springer, vol. 12(3), pages 335-363, September.
    13. McLean, Elena V., 2023. "Looking for advice: The politics of consulting services procurement in the World Bank," World Development, Elsevier, vol. 161(C).
    14. Kilby, Christopher, 2013. "The political economy of project preparation: An empirical analysis of World Bank projects," Journal of Development Economics, Elsevier, vol. 105(C), pages 211-225.
    15. Lodewijk Smets & Stephen Knack & Nadia Molenaers, 2013. "Political ideology, quality at entry and the success of economic reform programs," The Review of International Organizations, Springer, vol. 8(4), pages 447-476, December.
    16. Martorano, Bruno & Metzger, Laura & Sanfilippo, Marco, 2020. "Chinese development assistance and household welfare in Sub-Saharan Africa," World Development, Elsevier, vol. 129(C).
    17. Denizer, Cevdet & Kaufmann, Daniel & Kraay, Aart, 2013. "Good countries or good projects? Macro and micro correlates of World Bank project performance," Journal of Development Economics, Elsevier, vol. 105(C), pages 288-302.
    18. Kilby, Christopher, 2015. "Assessing the impact of World Bank preparation on project outcomes," Journal of Development Economics, Elsevier, vol. 115(C), pages 111-123.
    19. Christopher Kilby, 2012. "Assessing the contribution of donor agencies to aid effectiveness: The impact of World Bank preparation on project outcomes," Villanova School of Business Department of Economics and Statistics Working Paper Series 20, Villanova School of Business Department of Economics and Statistics.
    20. Heinzel, Mirko & Reinsberg, Bernhard, 2024. "Trust funds and the sub-national effectiveness of development aid: evidence from the World Bank," LSE Research Online Documents on Economics 122593, London School of Economics and Political Science, LSE Library.
    21. Bulman,David Janoff & Kolkma,Walter & Kraay,Aart C., 2015. "Good Countries or Good Projects ? Comparing Macro and Micro Correlates of World Bank and Asian Development Bank Project Performance," Policy Research Working Paper Series 7245, The World Bank.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:186:y:2025:i:c:s0305750x24002997. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.