IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v128y2020ics0305750x1930422x.html
   My bibliography  Save this article

What do we know about the impact of microfinance? The problems of statistical power and precision

Author

Listed:
  • Dahal, Mahesh
  • Fiala, Nathan

Abstract

We review all eight randomized control trial studies of microfinance published in peer-reviewed journals. The studies generally show no or minimal impact from providing microloans to clients and have led many researchers and policy makers to conclude that microfinance has been proven to have little or no positive impacts on people’s lives. We review these studies in detail and find four main results. First, we are able to replicate the results using the researcher’s original data. Second, we observe that while the results are generally insignificant at traditional levels, most estimated coefficients are large. Third, every one of the studies is underpowered to detect reasonable effect sizes, often due to low take-up of the financial product offered. Pooling the data from the studies together improves power for most outcomes, but minimum detectable effect sizes are still large. Finally, when we run analysis on a pooled sample, we find a treatment effect on business profits, business revenue and household assets, significant at the 1% level. We argue that existing research on the impact of microfinance is generally underpowered to identify impacts reliably and suggests that we still know very little about the impact of microfinance. We end by discussing ways to improve future research.

Suggested Citation

  • Dahal, Mahesh & Fiala, Nathan, 2020. "What do we know about the impact of microfinance? The problems of statistical power and precision," World Development, Elsevier, vol. 128(C).
  • Handle: RePEc:eee:wdevel:v:128:y:2020:i:c:s0305750x1930422x
    DOI: 10.1016/j.worlddev.2019.104773
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X1930422X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.worlddev.2019.104773?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, July.
    2. Alessandro Tarozzi & Jaikishan Desai & Kristin Johnson, 2015. "The Impacts of Microcredit: Evidence from Ethiopia," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 54-89, January.
    3. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    4. Bruno Crépon & Florencia Devoto & Esther Duflo & William Parienté, 2015. "Estimating the Impact of Microcredit on Those Who Take It Up: Evidence from a Randomized Experiment in Morocco," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 123-150, January.
    5. Bruce Wydick, 2016. "Microfinance on the margin: why recent impact studies may understate average treatment effects," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 8(2), pages 257-265, June.
    6. Britta Augsburg & Ralph De Haas & Heike Harmgart & Costas Meghir, 2015. "The Impacts of Microcredit: Evidence from Bosnia and Herzegovina," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 183-203, January.
    7. Abhijit Banerjee & Esther Duflo & Rachel Glennerster & Cynthia Kinnan, 2015. "The Miracle of Microfinance? Evidence from a Randomized Evaluation," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 22-53, January.
    8. Bédécarrats, Florent & Guérin, Isabelle & Morvant-Roux, Solène & Roubaud, François, 2019. "Estimating microcredit impact with low take-up, contamination and inconsistent data. A replication study of Crépon, Devoto, Duflo, and Parienté (American Economic Journal: Applied Economics, 2015)," International Journal for Re-Views in Empirical Economics (IREE), ZBW - Leibniz Information Centre for Economics, vol. 3(2019-3), pages 1-22.
    9. Manuela Angelucci & Dean Karlan & Jonathan Zinman, 2015. "Microcredit Impacts: Evidence from a Randomized Microcredit Program Placement Experiment by Compartamos Banco," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 151-182, January.
    10. David McKenzie & Christopher Woodruff, 2014. "What Are We Learning from Business Training and Entrepreneurship Evaluations around the Developing World?," The World Bank Research Observer, World Bank Group, vol. 29(1), pages 48-82.
    11. McKenzie, David, 2012. "Beyond baseline and follow-up: The case for more T in experiments," Journal of Development Economics, Elsevier, vol. 99(2), pages 210-221.
    12. Abhijit Banerjee & Dean Karlan & Jonathan Zinman, 2015. "Six Randomized Evaluations of Microcredit: Introduction and Further Steps," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 1-21, January.
    13. Erica Field & Rohini Pande & John Papp & Natalia Rigol, 2013. "Does the Classic Microfinance Model Discourage Entrepreneurship among the Poor? Experimental Evidence from India," American Economic Review, American Economic Association, vol. 103(6), pages 2196-2226, October.
    14. Battaglia, Marianna & Gulesci, Selim & Madestam, Andreas, 2018. "Repayment Flexibility and Risk Taking: Experimental Evidence from Credit Contracts," CEPR Discussion Papers 13329, C.E.P.R. Discussion Papers.
    15. Rachael Meager, 2019. "Understanding the Average Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of Seven Randomized Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 57-91, January.
    16. Orazio Attanasio & Britta Augsburg & Ralph De Haas & Emla Fitzsimons & Heike Harmgart, 2015. "The Impacts of Microfinance: Evidence from Joint-Liability Lending in Mongolia," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 90-122, January.
    17. Mark M. Pitt & Shahidur R. Khandker, 1998. "The Impact of Group-Based Credit Programs on Poor Households in Bangladesh: Does the Gender of Participants Matter?," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 958-996, October.
    18. Meager, Rachael, 2019. "Understanding the average impact of microcredit expansions: a Bayesian hierarchical analysis of seven randomized experiments," LSE Research Online Documents on Economics 88190, London School of Economics and Political Science, LSE Library.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Schoofs, Annekathrin, 2022. "Promoting financial inclusion for savings groups: A financial education programme in rural Rwanda," Journal of Behavioral and Experimental Finance, Elsevier, vol. 34(C).
    2. Fiala, Nathan & Neubauer, Florian & Peters, Jörg, 2022. "Do economists replicate?," Ruhr Economic Papers 939, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    3. Banna, Hasanul & Mia, Md Aslam & Nourani, Mohammad & Yarovaya, Larisa, 2022. "Fintech-based Financial Inclusion and Risk-taking of Microfinance Institutions (MFIs): Evidence from Sub-Saharan Africa," Finance Research Letters, Elsevier, vol. 45(C).
    4. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do Economists Replicate?," I4R Discussion Paper Series 13, The Institute for Replication (I4R).
    5. Deshpande, Ashwini & Khanna, Shantanu, 2021. "Can weak ties create social capital? Evidence from Self-Help Groups in rural India," World Development, Elsevier, vol. 146(C).
    6. Ahmad, Syedah & Lensink, Robert & Mueller, Annika, 2020. "The double bottom line of microfinance: A global comparison between conventional and Islamic microfinance," World Development, Elsevier, vol. 136(C).
    7. Choda, Amreen & Schoofs, Annekathrin & Verrinder, Noel, 2020. "Improving housing conditions: Labelled loans in Kenya and Uganda," Ruhr Economic Papers 878, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    8. Bensch, Gunther & Kluve, Jochen & Stöterau, Jonathan, 2021. "The market-based dissemination of energy-access technologies as a business model for rural entrepreneurs: Evidence from Kenya," Resource and Energy Economics, Elsevier, vol. 66(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dahal, Mahesh & Fiala, Nathan, 2018. "What do we know about the impact of microfinance? The problems of power and precision," Ruhr Economic Papers 756, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    2. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials [Microcredit impacts: Evidence from a randomized microcredit program placement experiment by Compartamos Banco]," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    3. Ahlin, Christian & Gulesci, Selim & Madestam, Andreas & Stryjan, Miri, 2020. "Loan contract structure and adverse selection: Survey evidence from Uganda," Journal of Economic Behavior & Organization, Elsevier, vol. 172(C), pages 180-195.
    4. Nakano, Yuko & Magezi, Eustadius F., 2020. "The impact of microcredit on agricultural technology adoption and productivity: Evidence from randomized control trial in Tanzania," World Development, Elsevier, vol. 133(C).
    5. Chowdhury, Shyamal & Smits, Joeri & Sun, Qigang, 2020. "Contract structure, time preference, and technology adoption," GLO Discussion Paper Series 633, Global Labor Organization (GLO).
    6. Morduch, Jonathan, 2020. "Why RCTs failed to answer the biggest questions about microcredit impact," World Development, Elsevier, vol. 127(C).
    7. Meager, Rachael, 2022. "Aggregating distributional treatment effects: a Bayesian hierarchical analysis of the microcredit literature," LSE Research Online Documents on Economics 115559, London School of Economics and Political Science, LSE Library.
    8. Chowdhury, Shyamal & Smits, Joeri & Sun, Qigang, 2020. "Contract Structure, Time Preference, and Technology Adoption," IZA Discussion Papers 13590, Institute of Labor Economics (IZA).
    9. Lucia Dalla Pellegrina & Giorgio Di Maio & Paolo Landoni & Emanuele Rusinà, 2021. "Money management and entrepreneurial training in microfinance: impact on beneficiaries and institutions," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(3), pages 1049-1085, October.
    10. Emily Breza & Cynthia Kinnan, 2018. "Measuring the Equilibrium Impacts of Credit: Evidence from the Indian Microfinance Crisis," Working Papers id:12587, eSocialSciences.
    11. Abhijit Banerjee & Emily Breza & Esther Duflo & Cynthia Kinnan, 2019. "Can Microfinance Unlock a Poverty Trap for Some Entrepreneurs?," NBER Working Papers 26346, National Bureau of Economic Research, Inc.
    12. Daniel Bjorkegren & Joshua Blumenstock & Omowunmi Folajimi-Senjobi & Jacqueline Mauro & Suraj R. Nair, 2022. "Instant Loans Can Lift Subjective Well-Being: A Randomized Evaluation of Digital Credit in Nigeria," Papers 2202.13540, arXiv.org.
    13. Tamara Broderick & Ryan Giordano & Rachael Meager, 2020. "An Automatic Finite-Sample Robustness Metric: When Can Dropping a Little Data Make a Big Difference?," Papers 2011.14999, arXiv.org, revised Mar 2023.
    14. Bernardus Van Doornik & Armando Gomes & David Schoenherr & Janis Skrastins, 2021. "Financial Access and Labor Market Outcomes: Evidence from Credit Lotteries," Working Papers 2021-56, Princeton University. Economics Department..
    15. Oriana Bandiera & Robin Burgess & Erika Deserranno & Ricardo Morel & Imran Rasul & Munshi Sulaiman & Jack Thiemel, 2022. "Microfinance and Diversification," Economica, London School of Economics and Political Science, vol. 89(S1), pages 239-275, June.
    16. Erhardt, Eva, 2017. "Microfinance beyond self-employment: Evidence for firms in Bulgaria," MPRA Paper 79294, University Library of Munich, Germany.
    17. Bernardus F Nazar Van Doornik & Armando Gomes & David Schoenherr & Janis Skrastins, 2023. "Financial access and labor market outcomes: evidence from credit lotteries," BIS Working Papers 1071, Bank for International Settlements.
    18. Farah Said, 2016. "Access to Finance and Agency: An Overview of the Constraints to Female-Run Enterprises," Lahore Journal of Economics, Department of Economics, The Lahore School of Economics, vol. 21(Special E), pages 331-349, September.
    19. Julian Proctor & Paul Anand, 2017. "Is credit associated with a higher quality of life? A capability approach," Progress in Development Studies, , vol. 17(4), pages 322-346, October.
    20. Hoffmann, Vivian & Rao, Vijayendra & Surendra, Vaishnavi & Datta, Upamanyu, 2021. "Relief from usury: Impact of a self-help group lending program in rural India," Journal of Development Economics, Elsevier, vol. 148(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:128:y:2020:i:c:s0305750x1930422x. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.elsevier.com/locate/worlddev .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.