IDEAS home Printed from https://ideas.repec.org/a/bla/agecon/v51y2020i6p871-886.html

A stochastic dominance approach to program evaluation with an application to child nutritional status in Kenya

Author

Listed:
  • Felix Naschold
  • Christopher B. Barrett

Abstract

Most existing program evaluation methods examine the average impact of a program. This necessarily overlooks the potential for different program impacts over different parts of the distribution of the variable of interest. To overcome this limitation, we develop a novel methodology for program evaluation which combines stochastic dominance with difference‐in‐differences methods. We use this new method to evaluate the impact of a large decentralization program in Kenya on changes in child nutritional status, where one's primary concern is about sharp adverse (i.e., negative) changes. Using standard difference‐in‐differences regression as a baseline, we find , no statistically or practically significant mean impact. In contrast, our stochastic dominance estimations reveal that project expenditures have had different impacts on different parts of the distribution. In particular, they are associated with less deterioration in children's nutritional status among the worst‐off children, indicating that the program effectively functions as a nutritional safety net.

Suggested Citation

  • Felix Naschold & Christopher B. Barrett, 2020. "A stochastic dominance approach to program evaluation with an application to child nutritional status in Kenya," Agricultural Economics, International Association of Agricultural Economists, vol. 51(6), pages 871-886, November.
  • Handle: RePEc:bla:agecon:v:51:y:2020:i:6:p:871-886
    DOI: 10.1111/agec.12597
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/agec.12597
    Download Restriction: no

    File URL: https://libkey.io/10.1111/agec.12597?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Paul J. Gertler & Sebastian Martinez & Patrick Premand & Laura B. Rawlings & Christel M. J. Vermeersch, 2016. "Impact Evaluation in Practice, Second Edition," World Bank Publications - Books, The World Bank Group, number 25030, April.
    2. Dirk Van de gaer & Joost Vandenbossche & José Luis Figueroa, 2014. "Children's Health Opportunities and Project Evaluation: Mexico's Oportunidades Program," The World Bank Economic Review, World Bank, vol. 28(2), pages 282-310.
    3. Martin Ravallion, 2018. "Should the Randomistas (Continue to) Rule?," Working Papers 492, Center for Global Development, revised 17 Jan 2019.
    4. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    5. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    6. Mude, Andrew G. & Barrett, Christopher B. & McPeak, John G. & Kaitho, Robert & Kristjanson, Patti, 2009. "Empirical forecasting of slow-onset disasters for improved emergency response: An application to Kenya's arid north," Food Policy, Elsevier, vol. 34(4), pages 329-339, August.
    7. Russell Davidson & Jean-Yves Duclos, 2000. "Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality," Econometrica, Econometric Society, vol. 68(6), pages 1435-1464, November.
    8. Ronan M. Conroy, 2012. "What hypotheses do "nonparametric" two-group tests actually test?," Stata Journal, StataCorp LLC, vol. 12(2), pages 182-190, June.
    9. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    10. Ravallion, Martin, 2001. "Growth, Inequality and Poverty: Looking Beyond Averages," World Development, Elsevier, vol. 29(11), pages 1803-1815, November.
    11. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    12. Paolo Verme, 2010. "Stochastic Dominance, Poverty and the Treatment Effect Curve," Economics Bulletin, AccessEcon, vol. 30(1), pages 365-373.
    13. Bauer, Jan M. & Mburu, Samuel, 2017. "Effects of drought on child health in Marsabit District, Northern Kenya," Economics & Human Biology, Elsevier, vol. 24(C), pages 74-79.
    14. Felix Naschold & Christopher B. Barrett, 2011. "Do Short‐Term Observed Income Changes Overstate Structural Economic Mobility?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 73(5), pages 705-717, October.
    15. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-1193, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pinar, Mehmet & Stengos, Thanasis & Topaloglou, Nikolas, 2020. "On the construction of a feasible range of multidimensional poverty under benchmark weight uncertainty," European Journal of Operational Research, Elsevier, vol. 281(2), pages 415-427.
    2. Donald, Stephen G. & Hsu, Yu-Chin, 2014. "Estimation and inference for distribution functions and quantile functions in treatment effect models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
    3. Sokbae (Simon) Lee & Yoon-Jae Whang, 2009. "Nonparametric tests of conditional treatment effects," CeMMAP working papers CWP36/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Hooi Hooi Lean & Michael McAleer & Wing-Keung Wong, 2013. "Risk-averse and Risk-seeking Investor Preferences for Oil Spot and Futures," Documentos de Trabajo del ICAE 2013-31, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico, revised Aug 2013.
    5. Maasoumi, Esfandiar & Almas Heshmati, 2003. "Evaluating Dominance Ranking of PSID Incomes by various Household Attributes," Departmental Working Papers 0509, Southern Methodist University, Department of Economics.
    6. Marcel Voia, 2008. "A Distributional Analysis Of Treatment Effects In Randomized Experiments," Economics Bulletin, AccessEcon, vol. 3(36), pages 1-9.
    7. Chunling Luo & Piao Chen & Patrick Jaillet, 2025. "Portfolio Optimization Based on Almost Second-Degree Stochastic Dominance," Management Science, INFORMS, vol. 71(8), pages 7029-7055, August.
    8. Grönqvist, Charlotta, 2009. "Empirical studies on the private value of Finnish patents," Bank of Finland Scientific Monographs, Bank of Finland, volume 0, number sm2009_041, December.
    9. Lee, Kyungho & Linton, Oliver & Whang, Yoon-Jae, 2023. "Testing for time stochastic dominance," Journal of Econometrics, Elsevier, vol. 235(2), pages 352-371.
    10. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2012. "Is there an Optimal Forecast Combination? A Stochastic Dominance Approach to Forecast Combination Puzzle," Working Paper series 17_12, Rimini Centre for Economic Analysis.
    11. Guo, Xu & Wong, Wing-Keung & Zhu, Lixing, 2013. "Make Almost Stochastic Dominance really Almost," MPRA Paper 49745, University Library of Munich, Germany.
    12. Ian Crawford, 2005. "A nonparametric test of stochastic dominance in multivariate distributions," School of Economics Discussion Papers 1205, School of Economics, University of Surrey.
    13. Mehmet Pinar & Thanasis Stengos & Nikolas Topaloglou, 2022. "Stochastic dominance spanning and augmenting the human development index with institutional quality," Annals of Operations Research, Springer, vol. 315(1), pages 341-369, August.
    14. Gordon Anderson & Teng Wah Leo, 2014. "Ranking Alternative Non-Combinable Prospects: A Stochastic Dominance Based Route to the Second Best Solution," Working Papers tecipa-520, University of Toronto, Department of Economics.
    15. Frank A. Cowell & Emmanuel Flachaire, 2014. "Statistical Methods for Distributional Analysis," Working Papers halshs-01115996, HAL.
    16. Hooi Hooi Lean & Michael McAleer & Wing-Keung Wong, 2010. "Market Efficiency of Oil Spot and Futures: A Stochastic Dominance Approach," CIRJE F-Series CIRJE-F-705, CIRJE, Faculty of Economics, University of Tokyo.
    17. Lean, H.H. & McAleer, M.J. & Wong, W.-K., 2010. "Investor preferences for oil spot and futures based on mean-variance and stochastic dominance," Econometric Institute Research Papers EI 2010-37, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    18. Dominic Gasbarro & Wing-Keung Wong & J. Kenton Zumwalt, 2007. "Stochastic Dominance Analysis of iShares," The European Journal of Finance, Taylor & Francis Journals, vol. 13(1), pages 89-101.
    19. repec:stn:sotoec:1311 is not listed on IDEAS
    20. Evren Ors & Frédéric Palomino & Eloïc Peyrache, 2013. "Performance Gender Gap: Does Competition Matter?," Journal of Labor Economics, University of Chicago Press, vol. 31(3), pages 443-499.
    21. Stengos, Thanasis & Thompson, Brennan S., 2012. "Testing for bivariate stochastic dominance using inequality restrictions," Economics Letters, Elsevier, vol. 115(1), pages 60-62.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:agecon:v:51:y:2020:i:6:p:871-886. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/iaaeeea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.