IDEAS home Printed from https://ideas.repec.org/a/taf/jdevst/v48y2012i12p1864-1880.html
   My bibliography  Save this article

High Noon for Microfinance Impact Evaluations: Re-investigating the Evidence from Bangladesh

Author

Listed:
  • Maren Duvendack
  • Richard Palmer-Jones

Abstract

Recently, microfinance has come under increasing criticism raising questions of the validity of iconic studies which have justified it, such as Pitt and Khandker. Chemin applied propensity score matching to the Pitt and Khandker data, finding different impacts, but does not disaggregate by gender of borrower. We first replicate Chemin and extend his analysis in two ways. We test the robustness of propensity score matching results to selection on unobservables using sensitivity analysis, and we investigate propensity score matching estimates of impacts by gender of borrowers. The mainly insignificant impacts of microfinance differ greatly by gender of borrower, but are all vulnerable to selection on unobservables. We are therefore not convinced that the relationships between microfinance and outcomes are causal with these data.

Suggested Citation

  • Maren Duvendack & Richard Palmer-Jones, 2012. "High Noon for Microfinance Impact Evaluations: Re-investigating the Evidence from Bangladesh," Journal of Development Studies, Taylor & Francis Journals, vol. 48(12), pages 1864-1880, December.
  • Handle: RePEc:taf:jdevst:v:48:y:2012:i:12:p:1864-1880
    DOI: 10.1080/00220388.2011.646989
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/00220388.2011.646989
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/00220388.2011.646989?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hala Abou-Ali & Hesham El-Azony & Heba El-Laithy & Jonathan Haughton & Shahid Khandker, 2010. "Evaluating the impact of Egyptian Social Fund for Development programmes," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 2(4), pages 521-555.
    2. Marco Caliendo & Reinhard Hujer, 2006. "The microeconometric estimation of treatment effects—An overview," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 90(1), pages 199-215, March.
    3. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    4. Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2008. "From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 305-327.
    5. Karlan, Dean S. & Zinman, Jonathan, 2009. "Expanding Microenterprise Credit Access: Using Randomized Supply Decisions to Estimate the Impacts in Manila," Center Discussion Papers 52600, Yale University, Economic Growth Center.
    6. Matthieu Chemin, 2008. "The Benefits and Costs of Microfinance: Evidence from Bangladesh," Journal of Development Studies, Taylor & Francis Journals, vol. 44(4), pages 463-484, April.
    7. Sascha O. Becker & Marco Caliendo, 2007. "Sensitivity analysis for average treatment effects," Stata Journal, StataCorp LP, vol. 7(1), pages 71-83, February.
    8. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LP, vol. 7(3), pages 334-350, September.
    9. Karlan, Dean & Zinman, Jonathan, 2009. "Expanding Microenterprise Credit Access: Randomized Supply Decisions to Estimate the Impacts in Manila," Working Papers 68, Yale University, Department of Economics.
    10. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    11. Signe-Mary McKernan, 2002. "The Impact Of Microcredit Programs On Self-Employment Profits: Do Noncredit Program Aspects Matter?," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 93-115, February.
    12. DiPrete, Thomas A. & Gangl, Markus, 2004. "Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments," Discussion Papers, Research Unit: Labor Market Policy and Employment SP I 2004-101, WZB Berlin Social Science Center.
    13. repec:pri:rpdevs:morduch_microfinance_poor is not listed on IDEAS
    14. Jonathan Morduch, 1999. "The Microfinance Promise," Journal of Economic Literature, American Economic Association, vol. 37(4), pages 1569-1614, December.
    15. Mark Pin & Shahidur Khandker & Signe-Mary Mckernan & M. Latif, 1999. "Credit programs for the poor and reproductive behavior in low-income countries: Are the reported causal relationships the result of heterogeneity bias?," Demography, Springer;Population Association of America (PAA), vol. 36(1), pages 1-21, February.
    16. T. Paul Schultz & John A. Strauss (ed.), 2008. "Handbook of Development Economics," Handbook of Development Economics, Elsevier, edition 1, volume 4, number 5.
    17. Daniel S. Hamermesh, 2007. "Replication in Economics," NBER Working Papers 13026, National Bureau of Economic Research, Inc.
    18. Mark M. Pitt & Shahidur R. Khandker, 1998. "The Impact of Group-Based Credit Programs on Poor Households in Bangladesh: Does the Gender of Participants Matter?," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 958-996, October.
    19. Mark M. Pitt & Shahidur R. Khandker & Omar Haider Chowdhury & Daniel L. Millimet, 1998. "Credit Programs for the Poor and the Nutritional Status of Children in Rural Bangladesh," Working Papers 98-4, Brown University, Department of Economics, revised 16 Jan 1998.
    20. Shahidur R. Khandker, 2005. "Microfinance and Poverty: Evidence Using Panel Data from Bangladesh," World Bank Economic Review, World Bank Group, vol. 19(2), pages 263-286.
    21. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    22. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846, Elsevier.
    23. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    24. Mark M. Pitt & Shahidur R. Khandker & Omar Haider Chowdhury & Daniel L. Millimet, 2003. "Credit Programs for the Poor And the Health Status of Children in Rural Bangladesh," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(1), pages 87-118, February.
    25. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009.pdf is not listed on IDEAS
    26. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    27. Coleman, Brett E., 1999. "The impact of group lending in Northeast Thailand," Journal of Development Economics, Elsevier, vol. 60(1), pages 105-141, October.
    28. Jonathan Morduch, 1998. "Does Microfinance Really Help the Poor? New Evidence from Flagship Programs in Bangladesh," Working Papers 198, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
    29. Tommaso Nannicini, 2007. "A simulation-based sensitivity for matching estimators," United Kingdom Stata Users' Group Meetings 2007 15, Stata Users Group.
    30. Nidhiya Menon, 2006. "Non-linearities in returns to participation in Grameen Bank programs," Journal of Development Studies, Taylor & Francis Journals, vol. 42(8), pages 1379-1400.
    31. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    32. Sascha O. Becker & Andrea Ichino, 2002. "Estimation of average treatment effects based on propensity scores," Stata Journal, StataCorp LP, vol. 2(4), pages 358-377, November.
    33. repec:pri:rpdevs:instruments_of_development.pdf is not listed on IDEAS
    34. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
    35. M. M. Pitt & S. R. Khandker, 2002. "Credit Programmes for the Poor and Seasonality in Rural Bangladesh," Journal of Development Studies, Taylor & Francis Journals, vol. 39(2), pages 1-24.
    36. Leamer, Edward E, 1983. "Let's Take the Con Out of Econometrics," American Economic Review, American Economic Association, vol. 73(1), pages 31-43, March.
    37. Khandker , Shahidur R., 2000. "Savings, Informal Borrowing, and Microfinance," Bangladesh Development Studies, Bangladesh Institute of Development Studies (BIDS), vol. 26(2-3), pages 49-78, June-Sept.
    38. Goetz, Anne Marie & Gupta, Rina Sen, 1996. "Who takes the credit? Gender, power, and control over loan use in rural credit programs in Bangladesh," World Development, Elsevier, vol. 24(1), pages 45-63, January.
    39. David Roodman & Jonathan Morduch, 2014. "The Impact of Microcredit on the Poor in Bangladesh: Revisiting the Evidence," Journal of Development Studies, Taylor & Francis Journals, vol. 50(4), pages 583-604, April.
    40. Pitt, Mark M & Khandker, Shahidur R & Cartwright, Jennifer, 2006. "Empowering Women with Micro Finance: Evidence from Bangladesh," Economic Development and Cultural Change, University of Chicago Press, vol. 54(4), pages 791-831, July.
    41. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009 is not listed on IDEAS
    42. Khandker, Shahidur R., 1996. "Role of Targeted Credit in Rural Non-farm Growth," Bangladesh Development Studies, Bangladesh Institute of Development Studies (BIDS), vol. 24(3-4), pages 181-193, Sept-Dec.
    43. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," Review of Economic Studies, Oxford University Press, vol. 65(2), pages 261-294.
    44. Coleman, Brett E., 2006. "Microfinance in Northeast Thailand: Who benefits and how much?," World Development, Elsevier, vol. 34(9), pages 1612-1638, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Duvendack, Maren & Palmer-Jones, Richard, 2011. "The microfinance of reproduction and the reproduction of microfinance: understanding the connections between microfinance, empowerment, contraception and fertility in Bangladesh in the 1990s," MPRA Paper 32384, University Library of Munich, Germany.
    2. Duvendack, Maren, 2010. "Smoke and Mirrors: Evidence of Microfinance Impact from an Evaluation of SEWA Bank in India," MPRA Paper 24511, University Library of Munich, Germany.
    3. Erhardt, Eva, 2017. "Microfinance beyond self-employment: Evidence for firms in Bulgaria," MPRA Paper 79294, University Library of Munich, Germany.
    4. Erhardt, Eva Christine, 2017. "Microfinance beyond self-employment: Evidence for firms in Bulgaria," Labour Economics, Elsevier, vol. 47(C), pages 75-95.
    5. Orso, Cristina, 2011. "Microcredit and poverty. An overview of the principal statistical methods used to measure the program net impacts," POLIS Working Papers 154, Institute of Public Policy and Public Choice - POLIS.
    6. Katsushi S. Imai & MD. Shafiul Azam, 2011. "Does Microfinance Reduce Poverty in Bangladesh? New Evidence from Household Panel Data," Journal of Development Studies, Taylor & Francis Journals, vol. 48(5), pages 633-653, October.
    7. Hermes, Niels & Lensink, Robert, 2011. "Microfinance: Its Impact, Outreach, and Sustainability," World Development, Elsevier, vol. 39(6), pages 875-881, June.
    8. Hisaki KONO & Kazushi TAKAHASHI, 2010. "Microfinance Revolution: Its Effects, Innovations, And Challenges," The Developing Economies, Institute of Developing Economies, vol. 48(1), pages 15-73, March.
    9. Islam, Asadul & Nguyen, Chau & Smyth, Russell, 2015. "Does microfinance change informal lending in village economies? Evidence from Bangladesh," Journal of Banking & Finance, Elsevier, vol. 50(C), pages 141-156.
    10. Mathilde Maîtrot & Miguel Niño-Zarazúa, 2017. "Poverty and wellbeing impacts of microfinance: What do we know?," WIDER Working Paper Series wp-2017-190, World Institute for Development Economic Research (UNU-WIDER).
    11. Akotey, Joseph Oscar & Adjasi, Charles K.D., 2016. "Does Microcredit Increase Household Welfare in the Absence of Microinsurance?," World Development, Elsevier, vol. 77(C), pages 380-394.
    12. Islam, Asadul, 2015. "Heterogeneous effects of microcredit: Evidence from large-scale programs in Bangladesh," Journal of Asian Economics, Elsevier, vol. 37(C), pages 48-58.
    13. Asad K. Ghalib & Issam Malki & Katsushi S. Imai, 2012. "Microfinance and its role in household poverty reduction: findings from Pakistan," Global Development Institute Working Paper Series 17312, GDI, The University of Manchester.
    14. Gutiérrez-Nieto, Begoña & Serrano-Cinca, Carlos, 2019. "20 years of research in microfinance: An information management approach," International Journal of Information Management, Elsevier, vol. 47(C), pages 183-197.
    15. Dean Karlan & Jonathan Zinman, 2010. "Expanding Credit Access: Using Randomized Supply Decisions to Estimate the Impacts," Review of Financial Studies, Society for Financial Studies, vol. 23(1), pages 433-464, January.
    16. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    17. Origo, Federica, 2009. "Flexible pay, firm performance and the role of unions. New evidence from Italy," Labour Economics, Elsevier, vol. 16(1), pages 64-78, January.
    18. Caliendo, Marco & Künn, Steffen, 2011. "Start-up subsidies for the unemployed: Long-term evidence and effect heterogeneity," Journal of Public Economics, Elsevier, vol. 95(3), pages 311-331.
    19. Reza Pishghadam & Golshan Shakeebaee & Nasim Boustani, 2017. "Conceptualizing Sensory Emotioncy as a Source of Group Formation," European Journal of Multidisciplinary Studies Articles, Revistia Research and Publishing, vol. 2, September.
    20. Emanuele Millemaci & Dario Sciulli, 2014. "The long-term impact of family difficulties during childhood on labor market outcomes," Review of Economics of the Household, Springer, vol. 12(4), pages 663-687, December.

    More about this item

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. High Noon for Microfinance Impact Evaluations: Re-investigating the Evidence from Bangladesh (JDS 2012) in ReplicationWiki

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jdevst:v:48:y:2012:i:12:p:1864-1880. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.tandfonline.com/FJDS20 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/FJDS20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.