IDEAS home Printed from https://ideas.repec.org/p/ags/iaae12/126398.html
   My bibliography  Save this paper

Accounting for selection bias in impact analysis of a rural development program: An application using propensity score matching

Author

Listed:
  • Peralta, Maria Alexandra
  • Swinton, Scott M.
  • Maredia, Mywish K.

Abstract

When evaluating the impact of a program, the effects of interventions on program outcomes must be measured against a valid counterfactual case. Constructing a valid counterfactual is especially important when experimental data is not available. Building a baseline ensuring that treatment and comparison groups are similar as well as identifying potential sources of bias are essential first steps towards constructing a valid counterfactual. This paper assesses the comparability of groups of participants and non-participants for conducting an impact evaluation of the Agriculture for Basic Needs (A4N) program in Nicaragua. We examine the degree of similarity between A4N participant and non-participant comparison households using propensity scores (estimated probability of program placement). Propensity scores are matched for the two groups, comparing results from using caliper matching and nearest neighbor matching without and with replacement. The analysis uses the pretreatment characteristics of households belonging to the treatment (participant) and comparison (non-participant) groups in order to verify whether the comparison group is statistically similar to the treatment group.

Suggested Citation

  • Peralta, Maria Alexandra & Swinton, Scott M. & Maredia, Mywish K., 2011. "Accounting for selection bias in impact analysis of a rural development program: An application using propensity score matching," 2012 Conference, August 18-24, 2012, Foz do Iguacu, Brazil 126398, International Association of Agricultural Economists.
  • Handle: RePEc:ags:iaae12:126398
    as

    Download full text from publisher

    File URL: http://purl.umn.edu/126398
    Download Restriction: no

    References listed on IDEAS

    as
    1. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, vol. 74(1), pages 199-250, June.
    2. Klinger, Bailey & Schündeln, Matthias, 2011. "Can Entrepreneurial Activity be Taught? Quasi-Experimental Evidence from Central America," World Development, Elsevier, vol. 39(9), pages 1592-1610, September.
    3. Mendola, Mariapia, 2007. "Agricultural technology adoption and poverty reduction: A propensity-score matching analysis for rural Bangladesh," Food Policy, Elsevier, vol. 32(3), pages 372-393, June.
    4. Jalan, Jyotsna & Ravallion, Martin, 2003. "Estimating the Benefit Incidence of an Antipoverty Program by Propensity-Score Matching," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(1), pages 19-30, January.
    5. Lalive, Rafael, 2008. "How do extended benefits affect unemployment duration A regression discontinuity approach," Journal of Econometrics, Elsevier, vol. 142(2), pages 785-806, February.
    6. Carrell, Scott E. & Hoekstra, Mark & West, James E., 2011. "Does drinking impair college performance? Evidence from a regression discontinuity approach," Journal of Public Economics, Elsevier, vol. 95(1-2), pages 54-62, February.
    7. James J. Heckman & Jeffrey A. Smith, 2004. "The Determinants of Participation in a Social Program: Evidence from a Prototypical Job Training Program," Journal of Labor Economics, University of Chicago Press, vol. 22(2), pages 243-298, April.
    8. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    9. Andrew Dillon, 2011. "Do Differences in the Scale of Irrigation Projects Generate Different Impacts on Poverty and Production?," Journal of Agricultural Economics, Wiley Blackwell, vol. 62(2), pages 474-492, June.
    10. Chowa, Gina A.N. & Elliott III, William, 2011. "An asset approach to increasing perceived household economic stability among families in Uganda," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 40(1), pages 81-87, February.
    11. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
    12. Boris E. Bravo‐Ureta & Alexandre Nunes Almeida & Daniel Solís & Aarón Inestroza, 2011. "The Economic Impact of Marena’s Investments on Sustainable Agricultural Systems in Honduras," Journal of Agricultural Economics, Wiley Blackwell, vol. 62(2), pages 429-448, June.
    13. Romina Cavatassi & Lina Salazar & Mario González‐Flores & Paul Winters, 2011. "How do Agricultural Programmes Alter Crop Production? Evidence from Ecuador," Journal of Agricultural Economics, Wiley Blackwell, vol. 62(2), pages 403-428, June.
    14. Centeno, Luis & Centeno, Mário & Novo, Álvaro A., 2009. "Evaluating job-search programs for old and young individuals: Heterogeneous impact on unemployment duration," Labour Economics, Elsevier, vol. 16(1), pages 12-25, January.
    15. Buddelmeyer, Hielke & Skoufias, Emmanuel, 2003. "An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA," IZA Discussion Papers 827, Institute for the Study of Labor (IZA).
    16. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, Elsevier.
    17. David P. Coady & Susan W. Parker, 2009. "Targeting Performance under Self-selection and Administrative Targeting Methods," Economic Development and Cultural Change, University of Chicago Press, vol. 57(3), pages 559-587, April.
    18. Butcher, Kristin F. & McEwan, Patrick J. & Taylor, Corrine H., 2010. "The effects of quantitative skills training on college outcomes and peers," Economics of Education Review, Elsevier, vol. 29(2), pages 187-199, April.
    19. Becerril, Javier & Abdulai, Awudu, 2010. "The Impact of Improved Maize Varieties on Poverty in Mexico: A Propensity Score-Matching Approach," World Development, Elsevier, vol. 38(7), pages 1024-1035, July.
    20. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, July.
    21. Ximena V. Del Carpio & Norman Loayza & Gayatri Datar, 2011. "Is Irrigation Rehabilitation Good for Poor Farmers? An Impact Evaluation of a Non‐Experimental Irrigation Project in Peru," Journal of Agricultural Economics, Wiley Blackwell, vol. 62(2), pages 449-473, June.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    Propensity Score Matching; Impact Evaluation; Selection Bias; Nicaragua; International Development; Research Methods/ Statistical Methods; C01; O19;

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • O19 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - International Linkages to Development; Role of International Organizations

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:iaae12:126398. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (AgEcon Search). General contact details of provider: http://edirc.repec.org/data/iaaeeea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.