IDEAS home Printed from https://ideas.repec.org/p/bwp/bwppap/10709.html
   My bibliography  Save this paper

Using Mixed Methods in Monitoring and Evaluation: Experiences from International Development’

Author

Listed:
  • Michael Bamberger
  • Vijayendra Rao
  • Michael Woolcock

Abstract

This paper reviews the main challenges and opportunities for incorporating mixed method approaches into research and evaluation on the effectiveness and impacts of international development. It draws on the authors’ experience over several decades working in both academia and with a wide range of multilateral and bilateral development agencies, non-profit organisations and developing country governments on the evaluation of the effectiveness and impacts of development interventions. Development research is informed by current research trends in Northern countries, but it is often conducted within very distinct economic, political, cultural and organisational contexts. While certainly not unique to the international context, many development evaluations are subject to a range of budget, time, data, political and organisational constraints that tend to be more severe than those faced by researchers working in industrialised nations. Moreover, due to the more limited opportunities to conduct research in developing countries, individual studies or evaluations are often required to address a broader set of questions. So while a researcher in the US may be able to focus exclusively on a rigorous summative evaluation designed to address a limited range of questions on quantitative impacts, the same researcher evaluating a major development intervention in Latin America, Africa or Asia may be asked to address a wider range of summative and formative questions. We argue that the demand for multi-purpose evaluations in developing countries opens up opportunities for a broader application of mixed method approaches than is usually the case in ‘mainstream’ mixed method research. We hope that this paper will help readers to understand the unique challenges, and also the great

Suggested Citation

  • Michael Bamberger & Vijayendra Rao & Michael Woolcock, 2009. "Using Mixed Methods in Monitoring and Evaluation: Experiences from International Development’," Global Development Institute Working Paper Series 10709, GDI, The University of Manchester.
  • Handle: RePEc:bwp:bwppap:10709
    as

    Download full text from publisher

    File URL: http://hummedia.manchester.ac.uk/institutes/gdi/publications/workingpapers/bwpi/bwpi-wp-10709.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Abhijit Vinayak Banerjee & Alice H. Amsden & Robert H. Bates & Jagdish Bhagwati & Angus Deaton & Nicholas Stern, 2007. "Making Aid Work," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262026155, December.
    2. François Bourguignon & Maurizio Bussolo & Luiz A. Pereira da Silva, 2008. "The Impact of Macroeconomic Policies on Poverty and Income Distribution : Macro-Micro Evaluation Techniques and Tools," World Bank Publications - Books, The World Bank Group, number 6586, December.
    3. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    4. Rao, Vijayendra & Gupta, Indrani & Jana, Smarajit, 2000. "Sex workers and the cost of safe sex - the compensating differential for condom use in Calcutta," Policy Research Working Paper Series 2334, The World Bank.
    5. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846, Elsevier.
    6. Linda G. Morra Imas & Ray C. Rist, . "The Road to Results : Designing and Conducting Effective Development Evaluations," World Bank Publications, The World Bank, number 2699, September.
    7. Vijayendra Rao & Paromita Sanyal, 2010. "Dignity through Discourse: Poverty and the Culture of Deliberation in Indian Village Democracies," The ANNALS of the American Academy of Political and Social Science, , vol. 629(1), pages 146-172, May.
    8. T. Paul Schultz & John A. Strauss (ed.), 2008. "Handbook of Development Economics," Handbook of Development Economics, Elsevier, edition 1, volume 4, number 5.
    9. Ban, Radu & Rao, Vijayendra, 2009. "Is deliberation equitable ? evidence from transcripts of village meetings in south India," Policy Research Working Paper Series 4928, The World Bank.
    10. Jha, Saumitra & Rao, Vijayendra & Woolcock, Michael, 2007. "Governance in the Gullies: Democratic Responsiveness and Leadership in Delhi's Slums," World Development, Elsevier, vol. 35(2), pages 230-246, February.
    11. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009 is not listed on IDEAS
    12. Christopher Gibson & Michael Woolcock, 2007. "Empowerment, Deliberative Development and Local Level Politics in Indonesia: Participatory Projects as a Source of Countervailing Power," Global Development Institute Working Paper Series 0807, GDI, The University of Manchester.
    13. Vijayendra Rao, 2000. "Price Heterogeneity And “Real” Inequality: A Case Study Of Prices And Poverty In Rural South India," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 46(2), pages 201-211, June.
    14. Rao, Vijayendra & Gupta, Indrani & Lokshin, Michael & Jana, Smarajit, 2003. "Sex workers and the cost of safe sex: the compensating differential for condom use among Calcutta prostitutes," Journal of Development Economics, Elsevier, vol. 71(2), pages 585-603, August.
    15. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009.pdf is not listed on IDEAS
    16. Benjamin A. Olken, 2007. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 115(2), pages 200-249.
    17. Lant Pritchett, 2002. "It pays to be ignorant: A simple political economy of rigorous program evaluation," Journal of Economic Policy Reform, Taylor & Francis Journals, vol. 5(4), pages 251-269.
    18. repec:pri:rpdevs:instruments_of_development.pdf is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gisselquist, Rachel & Niño-Zarazúa, Miguel, 2013. "What can experiments tell us about how to improve governance?," MPRA Paper 49300, University Library of Munich, Germany.
    2. Lant Pritchett & Salimah Samji & Jeffrey S. Hammer, 2012. "It's All about MeE: Using Structured Experiential Learning ('e') to Crawl the Design Space," WIDER Working Paper Series wp-2012-104, World Institute for Development Economic Research (UNU-WIDER).
    3. Gisselquist, Rachel & Niño-Zarazúa, Miguel, 2013. "What can experiments tell us about how to improve governance?," MPRA Paper 49300, University Library of Munich, Germany.
    4. Lant Pritchett & Salimah Samji & Jeffrey Hammer, 2012. "It’s All About MeE: Using Structured Experiential Learning (‘e’) to Crawl the Design Space," CID Working Papers 249, Center for International Development at Harvard University.
    5. William Easterly, 2009. "Can the West Save Africa?," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 373-447, June.
    6. Antonio Estache, 2010. "A survey of impact evaluations of infrastructure projects, programs and policies," Working Papers ECARES 2010_005, ULB -- Universite Libre de Bruxelles.
    7. Marina Giusta & Maria Tommaso & Steinar Strøm, 2009. "Who is watching? The market for prostitution services," Journal of Population Economics, Springer;European Society for Population Economics, vol. 22(2), pages 501-516, April.
    8. World Bank Group, 2014. "Strategic Framework for Mainstreaming Citizen Engagement in World Bank Group Operations," World Bank Publications - Books, The World Bank Group, number 21113, December.
    9. Sara Nadel and Lant Pritchett, 2016. "Searching for the Devil in the Details: Learning about Development Program Design," Working Papers 434, Center for Global Development.
    10. Maredia, Mywish K., 2009. "Improving the proof: Evolution of and emerging trends in impact assessment methods and approaches in agricultural development," IFPRI discussion papers 929, International Food Policy Research Institute (IFPRI).
    11. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    12. Daniel Zaga, 2014. "The Impact of Three Mexican Nutritional Programs: The Case of Dif-Puebla," CFD Working Papers 09-2015, Centre for Finance and Development, The Graduate Institute.
    13. Benedikte Bjerge & Nathan Clark & Peter Fisker & Emmanuel Raju, 2016. "Technology and Information Sharing in Disaster Relief," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-20, September.
    14. Niklas Jakobsson & Andreas Kotsadam, 2013. "The law and economics of international sex slavery: prostitution laws and trafficking for sexual exploitation," European Journal of Law and Economics, Springer, vol. 35(1), pages 87-107, February.
    15. Corduneanu-Huci, Cristina & Dorsch, Michael T. & Maarek, Paul, 2021. "The politics of experimentation: Political competition and randomized controlled trials," Journal of Comparative Economics, Elsevier, vol. 49(1), pages 1-21.
    16. Mazzutti, Caio Cícero Toledo Piza da Costa, 2016. "Three essays on the causal impacts of child labour laws in Brazil," Economics PhD Theses 0616, Department of Economics, University of Sussex Business School.
    17. Abhijit V. Banerjee & Esther Duflo, 2010. "Giving Credit Where It Is Due," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 61-80, Summer.
    18. Reinikka, Ritva & Svensson, Jakob, 2011. "The power of information in public services: Evidence from education in Uganda," Journal of Public Economics, Elsevier, vol. 95(7), pages 956-966.
    19. Maren Duvendack & Richard Palmer-Jones, 2012. "High Noon for Microfinance Impact Evaluations: Re-investigating the Evidence from Bangladesh," Journal of Development Studies, Taylor & Francis Journals, vol. 48(12), pages 1864-1880, December.
    20. Mattoo, Aaditya & Cadot, Olivier & Gourdon, Julien & Fernandes, Ana Margarida, 2011. "Impact Evaluation of Trade Interventions: Paving the Way," CEPR Discussion Papers 8638, C.E.P.R. Discussion Papers.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bwp:bwppap:10709. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Rowena Harding (email available below). General contact details of provider: https://edirc.repec.org/data/wpmanuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.