IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/24511.html
   My bibliography  Save this paper

Smoke and Mirrors: Evidence of Microfinance Impact from an Evaluation of SEWA Bank in India

Author

Listed:
  • Duvendack, Maren

Abstract

Microfinance has been on the development agenda for more than 30 years, heralded as the wondrous tool that reduces poverty and empowers women (Hulme and Mosley, 1996; Rutherford, 2001; Morduch and Haley, 2002; Khandker, 1998). Doubts, however, have recently been raised about the success of microfinance (Dichter and Harper, 2007; Banerjee et al, 2009; Roodman and Morduch, 2009; Karlan and Zinman, 2009; Bateman and Chang, 2009). Given this context, this paper re-examines the microfinance impact evaluation of SEWA Bank conducted by the United States Agency for International Development (USAID) in India in 1998 and 2000. The USAID panel and a new cross-section data set are analysed using propensity score matching (PSM) and panel data techniques to address selection bias. Sensitivity analysis of the matching results is used to explore their reliability. Various sub-group comparisons between borrowers, savers and controls are also conducted to shed some light on the impact of savings versus credit. The paper concludes that doubts remain about the quality of the impact estimates obtained through advanced econometric techniques. Direct observation and the outcome of sensitivity analysis of the PSM analysis suggest that the application of PSM and differences-in-differences (DID) to these observational data were probably unable to account for selection on unobservables.

Suggested Citation

  • Duvendack, Maren, 2010. "Smoke and Mirrors: Evidence of Microfinance Impact from an Evaluation of SEWA Bank in India," MPRA Paper 24511, University Library of Munich, Germany.
    • Handle: RePEc:pra:mprapa:24511
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/24511/1/MPRA_paper_24511.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Marco Caliendo & Reinhard Hujer, 2006. "The microeconometric estimation of treatment effects—An overview," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 90(1), pages 199-215, March.
    2. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    3. Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2008. "From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 305-327.
    4. Karlan, Dean S. & Zinman, Jonathan, 2009. "Expanding Microenterprise Credit Access: Using Randomized Supply Decisions to Estimate the Impacts in Manila," Center Discussion Papers 52600, Yale University, Economic Growth Center.
    5. Matthieu Chemin, 2008. "The Benefits and Costs of Microfinance: Evidence from Bangladesh," Journal of Development Studies, Taylor & Francis Journals, vol. 44(4), pages 463-484, April.
    6. Sascha O. Becker & Marco Caliendo, 2007. "Sensitivity analysis for average treatment effects," Stata Journal, StataCorp LP, vol. 7(1), pages 71-83, February.
    7. Ashraf, Nava & Karlan, Dean & Yin, Wesley, 2010. "Female Empowerment: Impact of a Commitment Savings Product in the Philippines," World Development, Elsevier, vol. 38(3), pages 333-344, March.
    8. Karlan, Dean & Zinman, Jonathan, 2009. "Expanding Microenterprise Credit Access: Randomized Supply Decisions to Estimate the Impacts in Manila," Working Papers 68, Yale University, Department of Economics.
    9. Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
    10. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    11. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    12. DiPrete, Thomas A. & Gangl, Markus, 2004. "Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments," Discussion Papers, Research Unit: Labor Market Policy and Employment SP I 2004-101, WZB Berlin Social Science Center.
    13. Pascaline Dupas & Jonathan Robinson, 2013. "Savings Constraints and Microenterprise Development: Evidence from a Field Experiment in Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 5(1), pages 163-192, January.
    14. Martin Browning & Annamaria Lusardi, 1996. "Household Saving: Micro Theories and Micro Facts," Journal of Economic Literature, American Economic Association, vol. 34(4), pages 1797-1855, December.
    15. Daniel S. Hamermesh, 2007. "Replication in Economics," NBER Working Papers 13026, National Bureau of Economic Research, Inc.
    16. Mark M. Pitt & Shahidur R. Khandker, 1998. "The Impact of Group-Based Credit Programs on Poor Households in Bangladesh: Does the Gender of Participants Matter?," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 958-996, October.
    17. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    18. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    19. Bryson, Alex & Dorsett, Richard & Purdon, Susan, 2002. "The use of propensity score matching in the evaluation of active labour market policies," LSE Research Online Documents on Economics 4993, London School of Economics and Political Science, LSE Library.
    20. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    21. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009.pdf is not listed on IDEAS
    22. MR Rosenzweig, 2001. "Savings behaviour in low-income countries," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 17(1), pages 40-54, Spring.
    23. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    24. Coleman, Brett E., 1999. "The impact of group lending in Northeast Thailand," Journal of Development Economics, Elsevier, vol. 60(1), pages 105-141, October.
    25. Adams, Dale W, 1978. "Mobilizing Household Savings through Rural Financial Markets," Economic Development and Cultural Change, University of Chicago Press, vol. 26(3), pages 547-560, April.
    26. repec:pri:rpdevs:instruments_of_development.pdf is not listed on IDEAS
    27. Steven D. Levitt & John A. List, 2011. "Was There Really a Hawthorne Effect at the Hawthorne Plant? An Analysis of the Original Illumination Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 3(1), pages 224-238, January.
    28. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    29. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
    30. Marco Caliendo, 2006. "Microeconometric Evaluation of Labour Market Policies," Lecture Notes in Economics and Mathematical Systems, Springer, number 978-3-540-28708-7, December.
    31. Rajeev H. Dehejia & Sadek Wahba, 1998. "Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs," NBER Working Papers 6586, National Bureau of Economic Research, Inc.
    32. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    33. Priya Basu, 2006. "Improving Access to Finance for India's Rural Poor," World Bank Publications - Books, The World Bank Group, number 6927, December.
    34. Maxine Molyneux, 2002. "Gender and the Silences of Social Capital: Lessons from Latin America," Development and Change, International Institute of Social Studies, vol. 33(2), pages 167-188, April.
    35. David Roodman & Jonathan Morduch, 2014. "The Impact of Microcredit on the Poor in Bangladesh: Revisiting the Evidence," Journal of Development Studies, Taylor & Francis Journals, vol. 50(4), pages 583-604, April.
    36. Robin Burgess & Rohini Pande, 2005. "Do Rural Banks Matter? Evidence from the Indian Social Banking Experiment," American Economic Review, American Economic Association, vol. 95(3), pages 780-795, June.
    37. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009 is not listed on IDEAS
    38. Christian S. Rogg, 2000. "The Impact of Access to Credit on the Saving Behavior of Microentrepreneurs: Evidence from 3 Latin American Countries," IDB Publications (Working Papers) 34663, Inter-American Development Bank.
    39. Christiaan Grootaert & Thierry Van Bastelar, 2002. "Understanding and Measuring Social Capital : A Multidisciplinary Tool for Practitioners," World Bank Publications - Books, The World Bank Group, number 14098, December.
    40. Thankom Arun & Katsushi Imai & Frances Sinha, 2006. "Does the Microfinance Reduce Poverty in India? Propensity Score Matching based on a National-level Household Data," Economics Discussion Paper Series 0625, Economics, The University of Manchester.
    41. Hulme, David, 2000. "Impact Assessment Methodologies for Microfinance: Theory, Experience and Better Practice," World Development, Elsevier, vol. 28(1), pages 79-98, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gyorgy Molnar & Attila Havas, 2019. "Escaping from the poverty trap with social innovation: a social microcredit programme in Hungary," CERS-IE WORKING PAPERS 1912, Institute of Economics, Centre for Economic and Regional Studies.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maren Duvendack & Richard Palmer-Jones, 2012. "High Noon for Microfinance Impact Evaluations: Re-investigating the Evidence from Bangladesh," Journal of Development Studies, Taylor & Francis Journals, vol. 48(12), pages 1864-1880, December.
    2. Duvendack, Maren & Palmer-Jones, Richard, 2011. "The microfinance of reproduction and the reproduction of microfinance: understanding the connections between microfinance, empowerment, contraception and fertility in Bangladesh in the 1990s," MPRA Paper 32384, University Library of Munich, Germany.
    3. Erhardt, Eva Christine, 2017. "Microfinance beyond self-employment: Evidence for firms in Bulgaria," Labour Economics, Elsevier, vol. 47(C), pages 75-95.
    4. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    5. Erhardt, Eva, 2017. "Microfinance beyond self-employment: Evidence for firms in Bulgaria," MPRA Paper 79294, University Library of Munich, Germany.
    6. Asad K. Ghalib & Issam Malki & Katsushi S. Imai, 2012. "Microfinance and its role in household poverty reduction: findings from Pakistan," Global Development Institute Working Paper Series 17312, GDI, The University of Manchester.
    7. Singh, Nirvikar, 2018. "Financial Inclusion: Concepts, Issues and Policies for India," MPRA Paper 91047, University Library of Munich, Germany.
    8. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    9. Liane Faltermeier & Awudu Abdulai, 2009. "The impact of water conservation and intensification technologies: empirical evidence for rice farmers in Ghana," Agricultural Economics, International Association of Agricultural Economists, vol. 40(3), pages 365-379, May.
    10. Roberto ESPOSTI, 2014. "To match, not to match, how to match: Estimating the farm-level impact of the CAP-first pillar reform (or: How to Apply Treatment-Effect Econometrics when the Real World is;a Mess)," Working Papers 403, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    11. Riccardo Turati, 2020. "Network-based Connectedness and the Diffusion of Cultural Traits," LIDAM Discussion Papers IRES 2020012, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
    12. Dahoun, Dieudonné Bleossi & Manlan, Olivier & Vodonou, Cosme & Mongan, Saint-Martin & Mededji, Damien & Alofa, Janvier P., 2013. "Microcrédit, pauvreté et autonomisation des femmes au Bénin," PEP Working Papers 160426, Partnership for Economic Policy (PEP).
    13. Krishnaiah Krishnaiah, 2018. "The Role of Folk Songs in Social Movements: A Case Study on the Separate Telangana State Formation in India," European Journal of Multidisciplinary Studies Articles, Revistia Research and Publishing, vol. 3, January -.
    14. Hermes, Niels & Lensink, Robert, 2011. "Microfinance: Its Impact, Outreach, and Sustainability," World Development, Elsevier, vol. 39(6), pages 875-881, June.
    15. Bagnoli, Lisa, 2019. "Does health insurance improve health for all? Heterogeneous effects on children in Ghana," World Development, Elsevier, vol. 124(C), pages 1-1.
    16. Dieudonné Bleossi Dahoun & Olivier Manlan & Cosme Vodonou & Saint-Martin Mongan & Damien Mededji & Janvier P. Alofa, 2013. "Microcrédit, pauvreté et autonomisation des femmes au Bénin," Working Papers PMMA 2013-13, PEP-PMMA.
    17. Kazushi TAKAHASHI & Takayuki HIGASHIKATA & Kazunari TSUKADA, 2010. "The Short‐Term Poverty Impact Of Small‐Scale, Collateral‐Free Microcredit In Indonesia: A Matching Estimator Approach," The Developing Economies, Institute of Developing Economies, vol. 48(1), pages 128-155, March.
    18. Todd, Petra E., 2012. "Effectiveness of interventions aimed at improving women's employability and quality of work : a critical review," Policy Research Working Paper Series 6189, The World Bank.
    19. Karlan, Dean & Morduch, Jonathan, 2010. "Access to Finance," Handbook of Development Economics, in: Dani Rodrik & Mark Rosenzweig (ed.), Handbook of Development Economics, edition 1, volume 5, chapter 0, pages 4703-4784, Elsevier.
    20. Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2008. "From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 305-327.

    More about this item

    Keywords

    Impact evaluation; evaluation methods; selection bias; microfinance; India;
    All these keywords.

    JEL classification:

    • O1 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development
    • O16 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Financial Markets; Saving and Capital Investment; Corporate Finance and Governance
    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:24511. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.