IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v128y2020ics0305750x1930422x.html
   My bibliography  Save this article

What do we know about the impact of microfinance? The problems of statistical power and precision

Author

Listed:
  • Dahal, Mahesh
  • Fiala, Nathan

Abstract

We review all eight randomized control trial studies of microfinance published in peer-reviewed journals. The studies generally show no or minimal impact from providing microloans to clients and have led many researchers and policy makers to conclude that microfinance has been proven to have little or no positive impacts on people’s lives. We review these studies in detail and find four main results. First, we are able to replicate the results using the researcher’s original data. Second, we observe that while the results are generally insignificant at traditional levels, most estimated coefficients are large. Third, every one of the studies is underpowered to detect reasonable effect sizes, often due to low take-up of the financial product offered. Pooling the data from the studies together improves power for most outcomes, but minimum detectable effect sizes are still large. Finally, when we run analysis on a pooled sample, we find a treatment effect on business profits, business revenue and household assets, significant at the 1% level. We argue that existing research on the impact of microfinance is generally underpowered to identify impacts reliably and suggests that we still know very little about the impact of microfinance. We end by discussing ways to improve future research.

Suggested Citation

  • Dahal, Mahesh & Fiala, Nathan, 2020. "What do we know about the impact of microfinance? The problems of statistical power and precision," World Development, Elsevier, vol. 128(C).
  • Handle: RePEc:eee:wdevel:v:128:y:2020:i:c:s0305750x1930422x
    DOI: 10.1016/j.worlddev.2019.104773
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X1930422X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.worlddev.2019.104773?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, July.
    2. Alessandro Tarozzi & Jaikishan Desai & Kristin Johnson, 2015. "The Impacts of Microcredit: Evidence from Ethiopia," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 54-89, January.
    3. Bruce Wydick, 2016. "Microfinance on the margin: why recent impact studies may understate average treatment effects," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 8(2), pages 257-265, June.
    4. Britta Augsburg & Ralph De Haas & Heike Harmgart & Costas Meghir, 2015. "The Impacts of Microcredit: Evidence from Bosnia and Herzegovina," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 183-203, January.
    5. Bédécarrats, Florent & Guérin, Isabelle & Morvant-Roux, Solène & Roubaud, François, 2019. "Estimating microcredit impact with low take-up, contamination and inconsistent data. A replication study of Crépon, Devoto, Duflo, and Parienté (American Economic Journal: Applied Economics, 2015)," International Journal for Re-Views in Empirical Economics (IREE), ZBW - Leibniz Information Centre for Economics, vol. 3(2019-3), pages 1-22.
    6. Manuela Angelucci & Dean Karlan & Jonathan Zinman, 2015. "Microcredit Impacts: Evidence from a Randomized Microcredit Program Placement Experiment by Compartamos Banco," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 151-182, January.
    7. Bruno Crépon & Florencia Devoto & Esther Duflo & William Parienté, 2015. "Estimating the Impact of Microcredit on Those Who Take It Up: Evidence from a Randomized Experiment in Morocco," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 123-150, January.
    8. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    9. David McKenzie & Christopher Woodruff, 2014. "What Are We Learning from Business Training and Entrepreneurship Evaluations around the Developing World?," The World Bank Research Observer, World Bank, vol. 29(1), pages 48-82.
    10. Erica Field & Rohini Pande & John Papp & Natalia Rigol, 2013. "Does the Classic Microfinance Model Discourage Entrepreneurship among the Poor? Experimental Evidence from India," American Economic Review, American Economic Association, vol. 103(6), pages 2196-2226, October.
    11. Rachael Meager, 2019. "Understanding the Average Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of Seven Randomized Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 57-91, January.
    12. Orazio Attanasio & Britta Augsburg & Ralph De Haas & Emla Fitzsimons & Heike Harmgart, 2015. "The Impacts of Microfinance: Evidence from Joint-Liability Lending in Mongolia," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 90-122, January.
    13. Mark M. Pitt & Shahidur R. Khandker, 1998. "The Impact of Group-Based Credit Programs on Poor Households in Bangladesh: Does the Gender of Participants Matter?," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 958-996, October.
    14. Meager, Rachael, 2019. "Understanding the average impact of microcredit expansions: a Bayesian hierarchical analysis of seven randomized experiments," LSE Research Online Documents on Economics 88190, London School of Economics and Political Science, LSE Library.
    15. Abhijit Banerjee & Esther Duflo & Rachel Glennerster & Cynthia Kinnan, 2015. "The Miracle of Microfinance? Evidence from a Randomized Evaluation," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 22-53, January.
    16. McKenzie, David, 2012. "Beyond baseline and follow-up: The case for more T in experiments," Journal of Development Economics, Elsevier, vol. 99(2), pages 210-221.
    17. Abhijit Banerjee & Dean Karlan & Jonathan Zinman, 2015. "Six Randomized Evaluations of Microcredit: Introduction and Further Steps," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 1-21, January.
    18. Gulesci, Selim & Battaglia, Marianna & Madestam, Andreas, 2018. "Repayment Flexibility and Risk Taking: Experimental Evidence from Credit Contracts," CEPR Discussion Papers 13329, C.E.P.R. Discussion Papers.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do economists replicate?," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
    2. Deshpande, Ashwini & Khanna, Shantanu, 2021. "Can weak ties create social capital? Evidence from Self-Help Groups in rural India," World Development, Elsevier, vol. 146(C).
    3. Catherine Bros & Fozan Fareed & Julie Lochard, 2023. "Climbing the economic ladder: The role of microfinance institutions in promoting entrepreneurship in Pakistan," Journal of International Development, John Wiley & Sons, Ltd., vol. 35(6), pages 1143-1162, August.
    4. Ahmad, Syedah & Lensink, Robert & Mueller, Annika, 2020. "The double bottom line of microfinance: A global comparison between conventional and Islamic microfinance," World Development, Elsevier, vol. 136(C).
    5. Villalba, Roberto & Venus, Terese E. & Sauer, Johannes, 2023. "The ecosystem approach to agricultural value chain finance: A framework for rural credit," World Development, Elsevier, vol. 164(C).
    6. Evan Borkum & Paolo Abarcar & Laura Meyer & Matthew Spitzer, "undated". "Jordan Refugee Livelihoods Development Impact Bond Evaluation Framework," Mathematica Policy Research Reports 602dafe521fe4467854dcd45e, Mathematica Policy Research.
    7. Nicholas Sabin, 2023. "Choosing partners: selection priorities of joint liability group leaders," Empirical Economics, Springer, vol. 64(1), pages 323-348, January.
    8. Hartarska, Valentina M. & Zhang, Jingfang & Nadolnyak, Denis A., 2023. "Scope Economies from Rural and Urban Microfinance Services," 2023 Annual Meeting, July 23-25, Washington D.C. 335439, Agricultural and Applied Economics Association.
    9. Choda, Amreen & Schoofs, Annekathrin & Verrinder, Noel, 2020. "Improving housing conditions: Labelled loans in Kenya and Uganda," Ruhr Economic Papers 878, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    10. Godsway Korku Tetteh, 2023. "Local digital lending development and the incidence of deprivation in Kenya," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 9(1), pages 1-26, December.
    11. Schoofs, Annekathrin, 2022. "Promoting financial inclusion for savings groups: A financial education programme in rural Rwanda," Journal of Behavioral and Experimental Finance, Elsevier, vol. 34(C).
    12. Valentina Hartarska & Jingfang Zhang & Denis A. Nadolnyak, 2023. "Scope economies from rural and urban microfinance services," Southern Economic Journal, John Wiley & Sons, vol. 89(4), pages 1138-1167, April.
    13. Bettoni, Luis & Santos, Marcelo & Filho, Gilberto Oliveira, 2023. "The impact of microcredit on small firms in Brazil: A potential to promote investment, growth and inclusion," Journal of Policy Modeling, Elsevier, vol. 45(3), pages 592-608.
    14. Bensch, Gunther & Kluve, Jochen & Stöterau, Jonathan, 2021. "The market-based dissemination of energy-access technologies as a business model for rural entrepreneurs: Evidence from Kenya," Resource and Energy Economics, Elsevier, vol. 66(C).
    15. Jongwoo Chung & Booyuel Kim, 2024. "Impact of microfinance on income generation: Evidence from a rural community‐driven development programme in Myanmar," Journal of International Development, John Wiley & Sons, Ltd., vol. 36(3), pages 1866-1879, April.
    16. Banna, Hasanul & Mia, Md Aslam & Nourani, Mohammad & Yarovaya, Larisa, 2022. "Fintech-based Financial Inclusion and Risk-taking of Microfinance Institutions (MFIs): Evidence from Sub-Saharan Africa," Finance Research Letters, Elsevier, vol. 45(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Oriana Bandiera & Robin Burgess & Erika Deserranno & Ricardo Morel & Imran Rasul & Munshi Sulaiman & Jack Thiemel, 2022. "Microfinance and Diversification," Economica, London School of Economics and Political Science, vol. 89(S1), pages 239-275, June.
    2. Dahal, Mahesh & Fiala, Nathan, 2018. "What do we know about the impact of microfinance? The problems of power and precision," Ruhr Economic Papers 756, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    3. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials [Microcredit impacts: Evidence from a randomized microcredit program placement experiment by Compartamos Banco]," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    4. Ahlin, Christian & Gulesci, Selim & Madestam, Andreas & Stryjan, Miri, 2020. "Loan contract structure and adverse selection: Survey evidence from Uganda," Journal of Economic Behavior & Organization, Elsevier, vol. 172(C), pages 180-195.
    5. Nakano, Yuko & Magezi, Eustadius F., 2020. "The impact of microcredit on agricultural technology adoption and productivity: Evidence from randomized control trial in Tanzania," World Development, Elsevier, vol. 133(C).
    6. Chowdhury, Shyamal & Smits, Joeri & Sun, Qigang, 2020. "Contract structure, time preference, and technology adoption," GLO Discussion Paper Series 633, Global Labor Organization (GLO).
    7. Morduch, Jonathan, 2020. "Why RCTs failed to answer the biggest questions about microcredit impact," World Development, Elsevier, vol. 127(C).
    8. Meager, Rachael, 2022. "Aggregating distributional treatment effects: a Bayesian hierarchical analysis of the microcredit literature," LSE Research Online Documents on Economics 115559, London School of Economics and Political Science, LSE Library.
    9. Chowdhury, Shyamal & Smits, Joeri & Sun, Qigang, 2020. "Contract Structure, Time Preference, and Technology Adoption," IZA Discussion Papers 13590, Institute of Labor Economics (IZA).
    10. Lucia Dalla Pellegrina & Giorgio Di Maio & Paolo Landoni & Emanuele Rusinà, 2021. "Money management and entrepreneurial training in microfinance: impact on beneficiaries and institutions," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 38(3), pages 1049-1085, October.
    11. Emily Breza & Cynthia Kinnan, 2021. "Measuring the Equilibrium Impacts of Credit: Evidence from the Indian Microfinance Crisis," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(3), pages 1447-1497.
    12. Abhijit Banerjee & Emily Breza & Esther Duflo & Cynthia Kinnan, 2019. "Can Microfinance Unlock a Poverty Trap for Some Entrepreneurs?," NBER Working Papers 26346, National Bureau of Economic Research, Inc.
    13. Daniel Bjorkegren & Joshua Blumenstock & Omowunmi Folajimi-Senjobi & Jacqueline Mauro & Suraj R. Nair, 2022. "Instant Loans Can Lift Subjective Well-Being: A Randomized Evaluation of Digital Credit in Nigeria," Papers 2202.13540, arXiv.org.
    14. Tamara Broderick & Ryan Giordano & Rachael Meager, 2020. "An Automatic Finite-Sample Robustness Metric: When Can Dropping a Little Data Make a Big Difference?," Papers 2011.14999, arXiv.org, revised Jul 2023.
    15. Bernardus Van Doornik & Armando Gomes & David Schoenherr & Janis Skrastins, 2021. "Financial Access and Labor Market Outcomes: Evidence from Credit Lotteries," Working Papers 2021-56, Princeton University. Economics Department..
    16. Erhardt, Eva, 2017. "Microfinance beyond self-employment: Evidence for firms in Bulgaria," MPRA Paper 79294, University Library of Munich, Germany.
    17. Bernardus F Nazar Van Doornik & Armando Gomes & David Schoenherr & Janis Skrastins, 2023. "Financial access and labor market outcomes: evidence from credit lotteries," BIS Working Papers 1071, Bank for International Settlements.
    18. Farah Said, 2016. "Access to Finance and Agency: An Overview of the Constraints to Female-Run Enterprises," Lahore Journal of Economics, Department of Economics, The Lahore School of Economics, vol. 21(Special E), pages 331-349, September.
    19. Julian Proctor & Paul Anand, 2017. "Is credit associated with a higher quality of life? A capability approach," Progress in Development Studies, , vol. 17(4), pages 322-346, October.
    20. Hoffmann, Vivian & Rao, Vijayendra & Surendra, Vaishnavi & Datta, Upamanyu, 2021. "Relief from usury: Impact of a self-help group lending program in rural India," Journal of Development Economics, Elsevier, vol. 148(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:128:y:2020:i:c:s0305750x1930422x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.