IDEAS home Printed from https://ideas.repec.org/a/bla/agecon/v51y2020i6p871-886.html
   My bibliography  Save this article

A stochastic dominance approach to program evaluation with an application to child nutritional status in Kenya

Author

Listed:
  • Felix Naschold
  • Christopher B. Barrett

Abstract

Most existing program evaluation methods examine the average impact of a program. This necessarily overlooks the potential for different program impacts over different parts of the distribution of the variable of interest. To overcome this limitation, we develop a novel methodology for program evaluation which combines stochastic dominance with difference‐in‐differences methods. We use this new method to evaluate the impact of a large decentralization program in Kenya on changes in child nutritional status, where one's primary concern is about sharp adverse (i.e., negative) changes. Using standard difference‐in‐differences regression as a baseline, we find , no statistically or practically significant mean impact. In contrast, our stochastic dominance estimations reveal that project expenditures have had different impacts on different parts of the distribution. In particular, they are associated with less deterioration in children's nutritional status among the worst‐off children, indicating that the program effectively functions as a nutritional safety net.

Suggested Citation

  • Felix Naschold & Christopher B. Barrett, 2020. "A stochastic dominance approach to program evaluation with an application to child nutritional status in Kenya," Agricultural Economics, International Association of Agricultural Economists, vol. 51(6), pages 871-886, November.
  • Handle: RePEc:bla:agecon:v:51:y:2020:i:6:p:871-886
    DOI: 10.1111/agec.12597
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/agec.12597
    Download Restriction: no

    File URL: https://libkey.io/10.1111/agec.12597?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dirk Van de gaer & Joost Vandenbossche & José Luis Figueroa, 2014. "Children's Health Opportunities and Project Evaluation: Mexico's Oportunidades Program," The World Bank Economic Review, World Bank, vol. 28(2), pages 282-310.
    2. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    3. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    4. Paolo Verme, 2010. "Stochastic Dominance, Poverty and the Treatment Effect Curve," Economics Bulletin, AccessEcon, vol. 30(1), pages 365-373.
    5. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    6. Bauer, Jan M. & Mburu, Samuel, 2017. "Effects of drought on child health in Marsabit District, Northern Kenya," Economics & Human Biology, Elsevier, vol. 24(C), pages 74-79.
    7. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    8. Felix Naschold & Christopher B. Barrett, 2011. "Do Short‐Term Observed Income Changes Overstate Structural Economic Mobility?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 73(5), pages 705-717, October.
    9. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-1193, September.
    10. Paul J. Gertler & Sebastian Martinez & Patrick Premand & Laura B. Rawlings & Christel M. J. Vermeersch, 2016. "Impact Evaluation in Practice, Second Edition," World Bank Publications - Books, The World Bank Group, number 25030, April.
    11. Russell Davidson & Jean-Yves Duclos, 2000. "Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality," Econometrica, Econometric Society, vol. 68(6), pages 1435-1464, November.
    12. Martin Ravallion, 2018. "Should the Randomistas (Continue to) Rule?," Working Papers 492, Center for Global Development, revised 17 Jan 2019.
    13. Mude, Andrew G. & Barrett, Christopher B. & McPeak, John G. & Kaitho, Robert & Kristjanson, Patti, 2009. "Empirical forecasting of slow-onset disasters for improved emergency response: An application to Kenya's arid north," Food Policy, Elsevier, vol. 34(4), pages 329-339, August.
    14. Ravallion, Martin, 2001. "Growth, Inequality and Poverty: Looking Beyond Averages," World Development, Elsevier, vol. 29(11), pages 1803-1815, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pinar, Mehmet & Stengos, Thanasis & Topaloglou, Nikolas, 2020. "On the construction of a feasible range of multidimensional poverty under benchmark weight uncertainty," European Journal of Operational Research, Elsevier, vol. 281(2), pages 415-427.
    2. Donald, Stephen G. & Hsu, Yu-Chin, 2014. "Estimation and inference for distribution functions and quantile functions in treatment effect models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
    3. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    4. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Wang, 2002. "Consistent testing for stochastic dominance: a subsampling approach," CeMMAP working papers 03/02, Institute for Fiscal Studies.
    5. Hooi Hooi Lean & Michael McAleer & Wing-Keung Wong, 2013. "Risk-averse and Risk-seeking Investor Preferences for Oil Spot and Futures," Documentos de Trabajo del ICAE 2013-31, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico, revised Aug 2013.
    6. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    7. Maasoumi, Esfandiar & Almas Heshmati, 2003. "Evaluating Dominance Ranking of PSID Incomes by various Household Attributes," Departmental Working Papers 0509, Southern Methodist University, Department of Economics.
    8. Marcel Voia, 2008. "A Distributional Analysis Of Treatment Effects In Randomized Experiments," Economics Bulletin, AccessEcon, vol. 3(36), pages 1-9.
    9. M. Azhar Hussain & Nikolaj Siersbæk & Lars Peter Østerdal, 2020. "Multidimensional welfare comparisons of EU member states before, during, and after the financial crisis: a dominance approach," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 55(4), pages 645-686, December.
    10. Grönqvist, Charlotta, 2009. "Empirical studies on the private value of Finnish patents," Bank of Finland Scientific Monographs, Bank of Finland, volume 0, number sm2009_041, December.
    11. Wen-Hao Chen & Jean-Yves Duclos, 2011. "Testing for poverty dominance: an application to Canada," Canadian Journal of Economics, Canadian Economics Association, vol. 44(3), pages 781-803, August.
    12. Lee, Kyungho & Linton, Oliver & Whang, Yoon-Jae, 2023. "Testing for time stochastic dominance," Journal of Econometrics, Elsevier, vol. 235(2), pages 352-371.
    13. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2012. "Is there an Optimal Forecast Combination? A Stochastic Dominance Approach to Forecast Combination Puzzle," Working Paper series 17_12, Rimini Centre for Economic Analysis.
    14. Guo, Xu & Wong, Wing-Keung & Zhu, Lixing, 2013. "Make Almost Stochastic Dominance really Almost," MPRA Paper 49745, University Library of Munich, Germany.
    15. Ian Crawford, 2005. "A nonparametric test of stochastic dominance in multivariate distributions," School of Economics Discussion Papers 1205, School of Economics, University of Surrey.
    16. Mehmet Pinar & Thanasis Stengos & Nikolas Topaloglou, 2022. "Stochastic dominance spanning and augmenting the human development index with institutional quality," Annals of Operations Research, Springer, vol. 315(1), pages 341-369, August.
    17. Gordon Anderson & Teng Wah Leo, 2014. "Ranking Alternative Non-Combinable Prospects: A Stochastic Dominance Based Route to the Second Best Solution," Working Papers tecipa-520, University of Toronto, Department of Economics.
    18. Frank A. Cowell & Emmanuel Flachaire, 2014. "Statistical Methods for Distributional Analysis," Working Papers halshs-01115996, HAL.
    19. Hooi Hooi Lean & Michael McAleer & Wing-Keung Wong, 2010. "Market Efficiency of Oil Spot and Futures: A Stochastic Dominance Approach," CIRJE F-Series CIRJE-F-705, CIRJE, Faculty of Economics, University of Tokyo.
    20. Lean, H.H. & McAleer, M.J. & Wong, W.-K., 2010. "Investor preferences for oil spot and futures based on mean-variance and stochastic dominance," Econometric Institute Research Papers EI 2010-37, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:agecon:v:51:y:2020:i:6:p:871-886. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/iaaeeea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.