IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/4944.html
   My bibliography  Save this paper

Impact assessments in finance and private sector development : what have we learned and what should we learn ?

Author

Listed:
  • McKenzie, David

Abstract

Until recently rigorous impact evaluations have been rare in the area of finance and private sector development. One reason for this is the perception that many policies and projects in this area lend themselves less to formal evaluations. However, a vanguard of new impact evaluations on areas as diverse as fostering microenterprise growth, microfinance, rainfall insurance, and regulatory reform demonstrates that in many circumstances serious evaluation is possible. The purpose of this paper is to synthesize and distil the policy and implementation lessons emerging from these studies, use them to demonstrate the feasibility of impact evaluations in a broader array of topics, and thereby help prompt new impact evaluations for projects going forward.

Suggested Citation

  • McKenzie, David, 2009. "Impact assessments in finance and private sector development : what have we learned and what should we learn ?," Policy Research Working Paper Series 4944, The World Bank.
  • Handle: RePEc:wbk:wbrwps:4944
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2009/05/27/000158349_20090527130847/Rendered/PDF/WPS4944.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Xavier Giné & Inessa Love, 2010. "Do Reorganization Costs Matter for Efficiency? Evidence from a Bankruptcy Reform in Colombia," Journal of Law and Economics, University of Chicago Press, vol. 53(4), pages 833-864.
    2. Dean Karlan & Martin Valdivia, 2011. "Teaching Entrepreneurship: Impact of Business Training on Microfinance Clients and Institutions," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 510-527, May.
    3. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    4. Dean Karlan & Jonathan Zinman, 2010. "Expanding Credit Access: Using Randomized Supply Decisions to Estimate the Impacts," Review of Financial Studies, Society for Financial Studies, vol. 23(1), pages 433-464, January.
    5. Adriana Kugler & Juan F. Jimeno & Virginia Hernanz, "undated". "Employment Consequences of Restrictive Permanent Contracts: Evidence from Spanish Labor Market Reforms," Working Papers 2003-14, FEDEA.
    6. de Mel, Suresh & McKenzie, David & Woodruff, Christopher, 2008. "Who are the microenterprise owners ? Evidence from Sri Lanka on Tokman v. de Soto," Policy Research Working Paper Series 4635, The World Bank.
    7. Inha Oh & Jeong-Dong Lee & Almas Heshmati & Gyoung-Gyu Choi, 2009. "Evaluation of credit guarantee policy using propensity score matching," Small Business Economics, Springer, vol. 33(3), pages 335-351, October.
    8. Banerjee, Abhijit V & Newman, Andrew F, 1993. "Occupational Choice and the Process of Development," Journal of Political Economy, University of Chicago Press, vol. 101(2), pages 274-298, April.
    9. Douglas Gollin, 2002. "Getting Income Shares Right," Journal of Political Economy, University of Chicago Press, vol. 110(2), pages 458-474, April.
    10. Abhijit V. Banerjee & Esther Duflo, 2007. "The Economic Lives of the Poor," Journal of Economic Perspectives, American Economic Association, vol. 21(1), pages 141-168, Winter.
    11. Gin, Xavier & Yang, Dean, 2009. "Insurance, credit, and technology adoption: Field experimental evidencefrom Malawi," Journal of Development Economics, Elsevier, vol. 89(1), pages 1-11, May.
    12. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    13. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    14. McKenzie, David & Seynabou Sakho, Yaye, 2010. "Does it pay firms to register for taxes? The impact of formality on firm profitability," Journal of Development Economics, Elsevier, vol. 91(1), pages 15-24, January.
    15. Xavier Giné & Robert Townsend & James Vickery, 2008. "Patterns of Rainfall Insurance Participation in Rural India," The World Bank Economic Review, World Bank Group, vol. 22(3), pages 539-566, October.
    16. Rodrik, Dani, 2008. "The New Development Economics: We Shall Experiment, but How Shall We Learn?," Working Paper Series rwp08-055, Harvard University, John F. Kennedy School of Government.
    17. Mark M. Pitt & Shahidur R. Khandker, 1998. "The Impact of Group-Based Credit Programs on Poor Households in Bangladesh: Does the Gender of Participants Matter?," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 958-996, October.
    18. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
    19. Shahidur R. Khandker, 1998. "Using Microcredit to Advance Women," World Bank Publications - Reports 11523, The World Bank Group.
    20. Marco Leonardi & Giovanni Pica, 2007. "Employment Protection Legislation and Wages," CSEF Working Papers 175, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    21. Kaplan, David S. & Piedra, Eduardo & Seira, Enrique, 2011. "Entry regulation and business start-ups: Evidence from Mexico," Journal of Public Economics, Elsevier, vol. 95(11), pages 1501-1515.
    22. Dean Karlan & Jonathan Zinman, 2009. "Observing Unobservables: Identifying Information Asymmetries With a Consumer Credit Field Experiment," Econometrica, Econometric Society, vol. 77(6), pages 1993-2008, November.
    23. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    24. Abidoye, Babatunde & Orazem, Peter & Vodopivec, Milan, 2008. "Firing Cost and Firm Size: A Study of Sri Lanka's Severance Pay System," Staff General Research Papers Archive 12922, Iowa State University, Department of Economics.
    25. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009.pdf is not listed on IDEAS
    26. Robert E. Lucas Jr., 1978. "On the Size Distribution of Business Firms," Bell Journal of Economics, The RAND Corporation, vol. 9(2), pages 508-523, Autumn.
    27. Robert Cull & Asli Demirgüç-Kunt & Jonathan Morduch, 2009. "Microfinance Meets the Market," Journal of Economic Perspectives, American Economic Association, vol. 23(1), pages 167-192, Winter.
    28. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    29. Shawn Cole & Xavier Gine & Jeremy Tobacman & Petia Topalova & Robert Townsend & James Vickery, 2013. "Barriers to Household Risk Management: Evidence from India," American Economic Journal: Applied Economics, American Economic Association, vol. 5(1), pages 104-135, January.
    30. Marco Leonardi & Giovanni Pica, 2013. "Who Pays for it? The Heterogeneous Wage Effects of Employment Protection Legislation," Economic Journal, Royal Economic Society, vol. 123(12), pages 1236-1278, December.
    31. repec:pri:rpdevs:instruments_of_development.pdf is not listed on IDEAS
    32. Suresh de Mel & David McKenzie & Christopher Woodruff, 2009. "Are Women More Credit Constrained? Experimental Evidence on Gender and Microenterprise Returns," American Economic Journal: Applied Economics, American Economic Association, vol. 1(3), pages 1-32, July.
    33. de Mel, Suresh & McKenzie, David J. & Woodruff, Christopher, 2009. "Measuring microenterprise profits: Must we ask how the sausage is made?," Journal of Development Economics, Elsevier, vol. 88(1), pages 19-31, January.
    34. Miriam Bruhn, 2011. "License to Sell: The Effect of Business Registration Reform on Entrepreneurial Activity in Mexico," The Review of Economics and Statistics, MIT Press, vol. 93(1), pages 382-386, February.
    35. David McKenzie & Christopher Woodruff, 2008. "Experimental Evidence on Returns to Capital and Access to Finance in Mexico," The World Bank Economic Review, World Bank Group, vol. 22(3), pages 457-482, November.
    36. Ravallion Martin, 2009. "Should the Randomistas Rule?," The Economists' Voice, De Gruyter, vol. 6(2), pages 1-5, February.
    37. Ariel Fiszbein & Norbert Schady & Francisco H.G. Ferreira & Margaret Grosh & Niall Keleher & Pedro Olinto & Emmanuel Skoufias, 2009. "Conditional Cash Transfers : Reducing Present and Future Poverty," World Bank Publications - Books, The World Bank Group, number 2597.
    38. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009 is not listed on IDEAS
    39. Almeida, Rita K. & Galasso, Emanuela, 2007. "Jump-Starting Self-Employment? Evidence among Welfare Participants in Argentina," IZA Discussion Papers 2902, Institute of Labor Economics (IZA).
    40. Fajnzylber, Pablo & Maloney, William F. & Rojas, Gabriel V. Montes, 2006. "Releasing constraints to growth or pushing on a string ? the impact of credit, training, business associations, and taxes on the performance of Mexican micro-firms," Policy Research Working Paper Series 3807, The World Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lage de Sousa, Filipe & Ottaviano, Gianmarco I.P., 2018. "Relaxing credit constraints in emerging economies: The impact of public loans on the productivity of Brazilian manufacturers," International Economics, Elsevier, vol. 154(C), pages 23-47.
    2. Nicholas Bloom & Benn Eifert & Aprajit Mahajan & David McKenzie & John Roberts, 2013. "Does Management Matter? Evidence from India," The Quarterly Journal of Economics, Oxford University Press, vol. 128(1), pages 1-51.
    3. David McKenzie & Christopher Woodruff, 2014. "What Are We Learning from Business Training and Entrepreneurship Evaluations around the Developing World?," The World Bank Research Observer, World Bank Group, vol. 29(1), pages 48-82.
    4. Reeg, Caroline, 2015. "Micro and small enterprises as drivers for job creation and decent work," IDOS Discussion Papers 10/2015, German Institute of Development and Sustainability (IDOS).
    5. Agnes Gössinger & Werner G. Raza, 2011. "Bilaterale Entwicklungsfinanzierung in Europa," Working Paper Reihe der AK Wien - Materialien zu Wirtschaft und Gesellschaft 109, Kammer für Arbeiter und Angestellte für Wien, Abteilung Wirtschaftswissenschaft und Statistik.
    6. Kafle, Kashi & Songsermsawas, Tisorn & Winters, Paul, 2021. "Decomposing the impacts of an agricultural value chain investment by gender and ethnicity: The case of Nepal," 2021 Annual Meeting, August 1-3, Austin, Texas 313941, Agricultural and Applied Economics Association.
    7. Benhassine, Najy & Raballand, Gaël, 2009. "Beyond ideological cleavages: A unifying framework for industrial policies and other public interventions," Economic Systems, Elsevier, vol. 33(4), pages 293-309, December.
    8. Cadot, Olivier & Fernandes, Ana M. & Gourdon, Julien & Mattoo, Aaditya, 2011. "Impact evaluation of trade interventions : paving the way," Policy Research Working Paper Series 5877, The World Bank.
    9. Grabrucker, Katharina & Grimm, Michael, 2018. "Does crime deter South Africans from self-employment?," Journal of Comparative Economics, Elsevier, vol. 46(2), pages 413-435.
    10. David McKenzie & Christopher Woodruff, 2014. "What Are We Learning from Business Training and Entrepreneurship Evaluations around the Developing World?," World Bank Research Observer, World Bank Group, vol. 29(1), pages 48-82.
    11. Grimm, Michael & Paffhausen, Anna Luisa, 2015. "Do interventions targeted at micro-entrepreneurs and small and medium-sized firms create jobs? A systematic review of the evidence for low and middle income countries," Labour Economics, Elsevier, vol. 32(C), pages 67-85.
    12. World Bank, 2012. "In Search of Opportunities : How a More Mobile Workforce Can Propel Ukraine’s Prosperity (Vol. 2 of 2) : Technical Report," World Bank Publications - Reports 12287, The World Bank Group.
    13. Espen Villanger, 2015. "Entrepreneurial Abilities and Barriers to Microenterprise Growth: A Case Study in Nepal," Journal of Entrepreneurship and Innovation in Emerging Economies, Entrepreneurship Development Institute of India, vol. 24(2), pages 115-147, September.
    14. Şeker, Murat & Yang, Judy S., 2014. "Bribery solicitations and firm performance in the Latin America and Caribbean region," Journal of Comparative Economics, Elsevier, vol. 42(1), pages 246-264.
    15. World Bank, 2011. "Measuring Changes in Client Lives through Microfinance : Contributions of Different Approaches," World Bank Publications - Reports 9452, The World Bank Group.
    16. Inha Oh & Dongnyok Shim, 2020. "IT Adoption and Sustainable Growth of Firms in Different Industries—Are the Benefits Still Expected?," Sustainability, MDPI, vol. 12(22), pages 1-29, November.
    17. Bruhn, Miriam & Lara Ibarra, Gabriel & McKenzie, David, 2013. "Why is voluntary financial education so unpopular ? Experimental evidence from Mexico," Policy Research Working Paper Series 6439, The World Bank.
    18. Campos, Francisco & Coville, Aidan & Fernandes, Ana M. & Goldstein, Markus & McKenzie, David, 2014. "Learning from the experiments that never happened: Lessons from trying to conduct randomized evaluations of matching grant programs in Africa," Journal of the Japanese and International Economies, Elsevier, vol. 33(C), pages 4-24.
    19. Montgomery, Heather & Weiss, John, 2011. "Can Commercially-oriented Microfinance Help Meet the Millennium Development Goals? Evidence from Pakistan," World Development, Elsevier, vol. 39(1), pages 87-109, January.
    20. J. Gourdon & J.M. Marchat & S. Sharma & T. Vishwanath, 2011. "Ex-Post Impact Evaluation of an Export Promotion Matching Grant : Tunisia's Second EMAF," World Bank Publications - Reports 10890, The World Bank Group.
    21. Sara Johansson de Silva & Pierella Paci & Josefina Posadas, 2014. "Lessons Learned and Not Yet Learned from a Multicountry Initiative on Women's Economic Empowerment," World Bank Publications - Books, The World Bank Group, number 16377.
    22. Rahman, Aminur, 2014. "Investment climate reforms and job creation in developing countries : what do we know and what should we do ?," Policy Research Working Paper Series 7025, The World Bank.
    23. McKenzie, David, 2011. "How can we learn whether firm policies are working in africa ? challenges (and solutions?) for experiments and structural models," Policy Research Working Paper Series 5632, The World Bank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cho, Yoonyoung & Honorati, Maddalena, 2014. "Entrepreneurship programs in developing countries: A meta regression analysis," Labour Economics, Elsevier, vol. 28(C), pages 110-130.
    2. Gutiérrez-Nieto, Begoña & Serrano-Cinca, Carlos, 2019. "20 years of research in microfinance: An information management approach," International Journal of Information Management, Elsevier, vol. 47(C), pages 183-197.
    3. Nakano, Yuko & Magezi, Eustadius F., 2020. "The impact of microcredit on agricultural technology adoption and productivity: Evidence from randomized control trial in Tanzania," World Development, Elsevier, vol. 133(C).
    4. Francisco J. Buera & Joseph P. Kaboski & Yongseok Shin, 2015. "Entrepreneurship and Financial Frictions: A Macrodevelopment Perspective," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 409-436, August.
    5. Khandker, Shahidur R. & Samad, Hussain A., 2014. "Microfinance Growth and Poverty Reduction in Bangladesh: What Does the Longitudinal Data Say?," Bangladesh Development Studies, Bangladesh Institute of Development Studies (BIDS), vol. 37(1-2), pages 127-157, March-Jun.
    6. Karlan, Dean & Morduch, Jonathan, 2010. "Access to Finance," Handbook of Development Economics, in: Dani Rodrik & Mark Rosenzweig (ed.), Handbook of Development Economics, edition 1, volume 5, chapter 0, pages 4703-4784, Elsevier.
    7. Grimm, Michael & Paffhausen, Anna Luisa, 2015. "Do interventions targeted at micro-entrepreneurs and small and medium-sized firms create jobs? A systematic review of the evidence for low and middle income countries," Labour Economics, Elsevier, vol. 32(C), pages 67-85.
    8. Todd, Petra E., 2012. "Effectiveness of interventions aimed at improving women's employability and quality of work : a critical review," Policy Research Working Paper Series 6189, The World Bank.
    9. Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, May.
    10. Field, Erica & Holland, Abraham & Pande, Rohini, 2016. "Microcredit: Points of Promise," Working Paper Series 16-036, Harvard University, John F. Kennedy School of Government.
    11. Cadot, Olivier & Fernandes, Ana & Gourdon, Julien & Mattoo, Aaditya, 2011. "Impact Evaluation of Trade Interventions: Paving the Way," CEPR Discussion Papers 8638, C.E.P.R. Discussion Papers.
    12. McKenzie, David, 2012. "Beyond baseline and follow-up: The case for more T in experiments," Journal of Development Economics, Elsevier, vol. 99(2), pages 210-221.
    13. Caio Piza & Tulio Antonio Cravo & Linnet Taylor & Lauro Gonzalez & Isabel Musse & Isabela Furtado & Ana C. Sierra & Samer Abdelnour, 2016. "The Impact of Business Support Services for Small and Medium Enterprises on Firm Performance in Low‐ and Middle‐Income Countries: A Systematic Review," Campbell Systematic Reviews, John Wiley & Sons, vol. 12(1), pages 1-167.
    14. Fafchamps, Marcel & McKenzie, David J. & Quinn, Simon & Woodruff, Christopher, 2011. "When is capital enough to get female microenterprises growing? Evidence from a randomized experiment in Ghana," CEPR Discussion Papers 8466, C.E.P.R. Discussion Papers.
    15. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    16. Beaman, Lori & Magruder, Jeremy & Robinson, Jonathan, 2014. "Minding small change among small firms in Kenya," Journal of Development Economics, Elsevier, vol. 108(C), pages 69-86.
    17. repec:msm:wpaper:2014/20 is not listed on IDEAS
    18. Fafchamps, Marcel & McKenzie, David & McKenzie, David & Quinn, Simon & Woodruff, Christopher, 2011. "When is capital enough to get female enterprises growing ? evidence from a randomized experiment in Ghana," Policy Research Working Paper Series 5706, The World Bank.
    19. Tarek Azzam & Michael Bates & David Fairris, 2019. "Do Learning Communities Increase First Year College Retention? Testing Sample Selection and External Validity of Randomized Control Trials," Working Papers 202002, University of California at Riverside, Department of Economics.
    20. F. Meier zu Selhausen & E. Stam, 2013. "Husbands and Wives. The powers and perils of participation in a microfinance cooperative for female entrepreneurs," Working Papers 13-10, Utrecht School of Economics.
    21. Asli Demirgüç-Kunt & Ross Levine, 2009. "Finance and Inequality: Theory and Evidence," Annual Review of Financial Economics, Annual Reviews, vol. 1(1), pages 287-318, November.

    More about this item

    Keywords

    Access to Finance; Debt Markets; Banks&Banking Reform; Microfinance;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:4944. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.