IDEAS home Printed from https://ideas.repec.org/p/ags/iaae12/126398.html
   My bibliography  Save this paper

Accounting for selection bias in impact analysis of a rural development program: An application using propensity score matching

Author

Listed:
  • Peralta, Maria Alexandra
  • Swinton, Scott M.
  • Maredia, Mywish K.

Abstract

When evaluating the impact of a program, the effects of interventions on program outcomes must be measured against a valid counterfactual case. Constructing a valid counterfactual is especially important when experimental data is not available. Building a baseline ensuring that treatment and comparison groups are similar as well as identifying potential sources of bias are essential first steps towards constructing a valid counterfactual. This paper assesses the comparability of groups of participants and non-participants for conducting an impact evaluation of the Agriculture for Basic Needs (A4N) program in Nicaragua. We examine the degree of similarity between A4N participant and non-participant comparison households using propensity scores (estimated probability of program placement). Propensity scores are matched for the two groups, comparing results from using caliper matching and nearest neighbor matching without and with replacement. The analysis uses the pretreatment characteristics of households belonging to the treatment (participant) and comparison (non-participant) groups in order to verify whether the comparison group is statistically similar to the treatment group.

Suggested Citation

  • Peralta, Maria Alexandra & Swinton, Scott M. & Maredia, Mywish K., 2011. "Accounting for selection bias in impact analysis of a rural development program: An application using propensity score matching," 2012 Conference, August 18-24, 2012, Foz do Iguacu, Brazil 126398, International Association of Agricultural Economists.
    • Handle: RePEc:ags:iaae12:126398
    DOI: 10.22004/ag.econ.126398
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/126398/files/Accounting%20for%20Selection%20Bias%20-IAAE_Submitted%20June18%202011.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.126398?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, vol. 74(1), pages 199-250, June.
    2. Klinger, Bailey & Schündeln, Matthias, 2011. "Can Entrepreneurial Activity be Taught? Quasi-Experimental Evidence from Central America," World Development, Elsevier, vol. 39(9), pages 1592-1610, September.
    3. David P. Coady & Susan W. Parker, 2009. "Targeting Performance under Self-selection and Administrative Targeting Methods," Economic Development and Cultural Change, University of Chicago Press, vol. 57(3), pages 559-587, April.
    4. Lalive, Rafael, 2008. "How do extended benefits affect unemployment duration A regression discontinuity approach," Journal of Econometrics, Elsevier, vol. 142(2), pages 785-806, February.
    5. Mendola, Mariapia, 2007. "Agricultural technology adoption and poverty reduction: A propensity-score matching analysis for rural Bangladesh," Food Policy, Elsevier, vol. 32(3), pages 372-393, June.
    6. Andrew Dillon, 2011. "Do Differences in the Scale of Irrigation Projects Generate Different Impacts on Poverty and Production?," Journal of Agricultural Economics, Wiley Blackwell, vol. 62(2), pages 474-492, June.
    7. Jalan, Jyotsna & Ravallion, Martin, 2003. "Estimating the Benefit Incidence of an Antipoverty Program by Propensity-Score Matching," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(1), pages 19-30, January.
    8. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    9. James J. Heckman & Jeffrey A. Smith, 2004. "The Determinants of Participation in a Social Program: Evidence from a Prototypical Job Training Program," Journal of Labor Economics, University of Chicago Press, vol. 22(2), pages 243-298, April.
    10. Carrell, Scott E. & Hoekstra, Mark & West, James E., 2011. "Does drinking impair college performance? Evidence from a regression discontinuity approach," Journal of Public Economics, Elsevier, vol. 95(1), pages 54-62.
    11. Butcher, Kristin F. & McEwan, Patrick J. & Taylor, Corrine H., 2010. "The effects of quantitative skills training on college outcomes and peers," Economics of Education Review, Elsevier, vol. 29(2), pages 187-199, April.
    12. Becerril, Javier & Abdulai, Awudu, 2010. "The Impact of Improved Maize Varieties on Poverty in Mexico: A Propensity Score-Matching Approach," World Development, Elsevier, vol. 38(7), pages 1024-1035, July.
    13. Chowa, Gina A.N. & Elliott III, William, 2011. "An asset approach to increasing perceived household economic stability among families in Uganda," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 40(1), pages 81-87, February.
    14. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    15. Boris E. Bravo‐Ureta & Alexandre Nunes Almeida & Daniel Solís & Aarón Inestroza, 2011. "The Economic Impact of Marena’s Investments on Sustainable Agricultural Systems in Honduras," Journal of Agricultural Economics, Wiley Blackwell, vol. 62(2), pages 429-448, June.
    16. Romina Cavatassi & Lina Salazar & Mario González‐Flores & Paul Winters, 2011. "How do Agricultural Programmes Alter Crop Production? Evidence from Ecuador," Journal of Agricultural Economics, Wiley Blackwell, vol. 62(2), pages 403-428, June.
    17. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, April.
    18. Centeno, Luis & Centeno, Mário & Novo, Álvaro A., 2009. "Evaluating job-search programs for old and young individuals: Heterogeneous impact on unemployment duration," Labour Economics, Elsevier, vol. 16(1), pages 12-25, January.
    19. Ximena V. Del Carpio & Norman Loayza & Gayatri Datar, 2011. "Is Irrigation Rehabilitation Good for Poor Farmers? An Impact Evaluation of a Non‐Experimental Irrigation Project in Peru," Journal of Agricultural Economics, Wiley Blackwell, vol. 62(2), pages 449-473, June.
    20. Abebaw, Degnet & Fentie, Yibeltal & Kassa, Belay, 2010. "The impact of a food security program on household food consumption in Northwestern Ethiopia: A matching estimator approach," Food Policy, Elsevier, vol. 35(4), pages 286-293, August.
    21. Buddelmeyer, Hielke & Skoufias, Emmanuel, 2003. "An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA," IZA Discussion Papers 827, Institute of Labor Economics (IZA).
    22. Heckman, James J & Smith, Jeffrey A, 1999. "The Pre-programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation Strategies," Economic Journal, Royal Economic Society, vol. 109(457), pages 313-348, July.
    23. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 59, pages 3787-3846, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arraiz, Irani & Calero, Carla & Jon, Songqing & Peralta, Alexandra, 2015. "Planting the seeds: The impact of training on mando producers in Haiti," 2015 Conference, August 9-14, 2015, Milan, Italy 212622, International Association of Agricultural Economists.
    2. De los Santos-Montero, Luis A. & Bravo-Ureta, Boris E., 2017. "Natural Resource Management and Household Well-being: The Case of POSAF-II in Nicaragua," World Development, Elsevier, vol. 99(C), pages 42-59.
    3. Arraiz, Irani & Calero, Carla & Jon, Songqing & Peralta, Alexandra, 2015. "Planting the seeds: The impact of training on mando producers in Haiti," 2015 Conference, August 9-14, 2015, Milan, Italy 212622, International Association of Agricultural Economists.
    4. Bola Awotide & Arega Alene & Tahirou Abdoulaye & Victor Manyong, 2015. "Impact of agricultural technology adoption on asset ownership: the case of improved cassava varieties in Nigeria," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 7(6), pages 1239-1258, December.
    5. Amarendra Sharma, 2019. "Indira Awas Yojana and Housing Adequacy: An Evaluation using Propensity Score Matching," ASARC Working Papers 2019-05, The Australian National University, Australia South Asia Research Centre.
    6. Maren Radeny & Elizaphan J. O. Rao & Maurice Juma Ogada & John W. Recha & Dawit Solomon, 2022. "Impacts of climate-smart crop varieties and livestock breeds on the food security of smallholder farmers in Kenya," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 14(6), pages 1511-1535, December.
    7. Deschamps-Laporte, Jean-Philippe, 2013. "The impact of extension services on farming households in Western Kenya: A propensity score approach," Working Papers 2013:5, Örebro University, School of Business, revised 10 Jun 2013.
    8. Ashok K. Mishra & Anjani Kumar & Pramod K. Joshi & Alwin D'Souza, 2018. "Cooperatives, contract farming, and farm size: The case of tomato producers in Nepal," Agribusiness, John Wiley & Sons, Ltd., vol. 34(4), pages 865-886, October.
    9. Garbero, A. & Marion, P., 2018. "IFAD RESEARCH SERIES 28 - Understanding the dynamics of adoption decisions and their poverty impacts: the case of improved maize seeds in Uganda," IFAD Research Series 280077, International Fund for Agricultural Development (IFAD).
    10. Jianxin Guo & Songqing Jin & Lei Chen & Jichun Zhao, 2018. "Impacts of Distance Education on Agricultural Performance and Household Income: Micro-Evidence from Peri-Urban Districts in Beijing," Sustainability, MDPI, vol. 10(11), pages 1-19, October.
    11. Yan-ying Chen & Long Wu & Qing-guo Zhai, 2019. "Does ISO 9000 Certification Benefit Service Firms?," Sustainability, MDPI, vol. 11(21), pages 1-18, October.
    12. Ainembabazi, John Herbert & Abdoulaye, Tahirou & Feleke, Shiferaw & Alene, Arega & Dontsop-Nguezet, Paul M. & Ndayisaba, Pierre Celestin & Hicintuka, Cyrille & Mapatano, Sylvain & Manyong, Victor, 2018. "Who benefits from which agricultural research-for-development technologies? Evidence from farm household poverty analysis in Central Africa," World Development, Elsevier, vol. 108(C), pages 28-46.
    13. Mishra, Ashok K. & Kumar, Anjani & Joshi, Pramod K. & D'souza, Alwin, 2016. "Impact of contracts in high yielding varieties seed production on profits and yield: The case of Nepal," Food Policy, Elsevier, vol. 62(C), pages 110-121.
    14. Islam, Abu Hayat, 2015. "Can Integrated Rice-Fish System Increase Welfare of the Marginalized Extreme Poor in Bangladesh? A DID Matching Approach," 2015 Conference, August 9-14, 2015, Milan, Italy 211792, International Association of Agricultural Economists.
    15. Alexandra Peralta & Scott M. Swinton & Songqing Jin, 2018. "The Secret to Getting Ahead Is Getting Started: Early Impacts of a Rural Development Project," Sustainability, MDPI, vol. 10(8), pages 1-20, July.
    16. Peralta, M. Alexandra & Swinton, Scott M., 2013. "Impact Assessment with Opt-in Treatments: Evidence from a rural development project in Nicaragua," 2013 Annual Meeting, August 4-6, 2013, Washington, D.C. 150988, Agricultural and Applied Economics Association.
    17. Cunguara, Benedito & Darnhofer, Ika, 2011. "Assessing the impact of improved agricultural technologies on household income in rural Mozambique," Food Policy, Elsevier, vol. 36(3), pages 378-390, June.
    18. Abdoulaye Diagne Author-Name: Fran ois J. Cabral, 2017. "Agricultural Transformation in Senegal: Impacts of an integrated program," Working Papers PMMA 2017-09, PEP-PMMA.
    19. Nguezet, Paul Martin Dontsop & Diagne, Aliou & Okoruwa, Victor Olusegun & Ojehomon, Vivian, 2011. "Impact of Improved Rice Technology (NERICA varieties) on Income and Poverty among Rice Farming Households in Nigeria: A Local Average Treatment Effect (LATE) Approach," Quarterly Journal of International Agriculture, Humboldt-Universitaat zu Berlin, vol. 50(3), pages 1-25.
    20. David Coady & César Martinelli & Susan W. Parker, 2013. "Information and Participation in Social Programs," The World Bank Economic Review, World Bank, vol. 27(1), pages 149-170.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:iaae12:126398. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/iaaeeea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.