IDEAS home Printed from https://ideas.repec.org/a/bla/agecon/v51y2020i6p871-886.html
   My bibliography  Save this article

A stochastic dominance approach to program evaluation with an application to child nutritional status in Kenya

Author

Listed:
  • Felix Naschold
  • Christopher B. Barrett

Abstract

Most existing program evaluation methods examine the average impact of a program. This necessarily overlooks the potential for different program impacts over different parts of the distribution of the variable of interest. To overcome this limitation, we develop a novel methodology for program evaluation which combines stochastic dominance with difference‐in‐differences methods. We use this new method to evaluate the impact of a large decentralization program in Kenya on changes in child nutritional status, where one's primary concern is about sharp adverse (i.e., negative) changes. Using standard difference‐in‐differences regression as a baseline, we find , no statistically or practically significant mean impact. In contrast, our stochastic dominance estimations reveal that project expenditures have had different impacts on different parts of the distribution. In particular, they are associated with less deterioration in children's nutritional status among the worst‐off children, indicating that the program effectively functions as a nutritional safety net.

Suggested Citation

  • Felix Naschold & Christopher B. Barrett, 2020. "A stochastic dominance approach to program evaluation with an application to child nutritional status in Kenya," Agricultural Economics, International Association of Agricultural Economists, vol. 51(6), pages 871-886, November.
  • Handle: RePEc:bla:agecon:v:51:y:2020:i:6:p:871-886
    DOI: 10.1111/agec.12597
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/agec.12597
    Download Restriction: no

    File URL: https://libkey.io/10.1111/agec.12597?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Paul J. Gertler & Sebastian Martinez & Patrick Premand & Laura B. Rawlings & Christel M. J. Vermeersch, 2016. "Impact Evaluation in Practice, Second Edition," World Bank Publications - Books, The World Bank Group, number 25030, December.
    2. Dirk Van de gaer & Joost Vandenbossche & José Luis Figueroa, 2014. "Children's Health Opportunities and Project Evaluation: Mexico's Oportunidades Program," The World Bank Economic Review, World Bank, vol. 28(2), pages 282-310.
    3. James J. Heckman & Sergio Urzua & Edward Vytlacil, 2006. "Understanding Instrumental Variables in Models with Essential Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 88(3), pages 389-432, August.
    4. Russell Davidson & Jean-Yves Duclos, 2000. "Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality," Econometrica, Econometric Society, vol. 68(6), pages 1435-1464, November.
    5. Martin Ravallion, 2018. "Should the Randomistas (Continue to) Rule?," Working Papers 492, Center for Global Development, revised 17 Jan 2019.
    6. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    7. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    8. Mude, Andrew G. & Barrett, Christopher B. & McPeak, John G. & Kaitho, Robert & Kristjanson, Patti, 2009. "Empirical forecasting of slow-onset disasters for improved emergency response: An application to Kenya's arid north," Food Policy, Elsevier, vol. 34(4), pages 329-339, August.
    9. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    10. Ravallion, Martin, 2001. "Growth, Inequality and Poverty: Looking Beyond Averages," World Development, Elsevier, vol. 29(11), pages 1803-1815, November.
    11. Paolo Verme, 2010. "Stochastic Dominance, Poverty and the Treatment Effect Curve," Economics Bulletin, AccessEcon, vol. 30(1), pages 365-373.
    12. Bauer, Jan M. & Mburu, Samuel, 2017. "Effects of drought on child health in Marsabit District, Northern Kenya," Economics & Human Biology, Elsevier, vol. 24(C), pages 74-79.
    13. Felix Naschold & Christopher B. Barrett, 2011. "Do Short‐Term Observed Income Changes Overstate Structural Economic Mobility?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 73(5), pages 705-717, October.
    14. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-1193, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pinar, Mehmet & Stengos, Thanasis & Topaloglou, Nikolas, 2020. "On the construction of a feasible range of multidimensional poverty under benchmark weight uncertainty," European Journal of Operational Research, Elsevier, vol. 281(2), pages 415-427.
    2. Donald, Stephen G. & Hsu, Yu-Chin, 2014. "Estimation and inference for distribution functions and quantile functions in treatment effect models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
    3. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    4. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Wang, 2002. "Consistent testing for stochastic dominance: a subsampling approach," CeMMAP working papers 03/02, Institute for Fiscal Studies.
    5. Hooi Hooi Lean & Michael McAleer & Wing-Keung Wong, 2013. "Risk-averse and Risk-seeking Investor Preferences for Oil Spot and Futures," Documentos de Trabajo del ICAE 2013-31, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico, revised Aug 2013.
    6. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    7. Jesus Gonzalo & Jose Olmo, 2014. "Conditional Stochastic Dominance Tests In Dynamic Settings," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 55(3), pages 819-838, August.
    8. Maasoumi, Esfandiar & Almas Heshmati, 2003. "Evaluating Dominance Ranking of PSID Incomes by various Household Attributes," Departmental Working Papers 0509, Southern Methodist University, Department of Economics.
    9. David Lander & David Gunawan & William Griffiths & Duangkamon Chotikapanich, 2020. "Bayesian assessment of Lorenz and stochastic dominance," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(2), pages 767-799, May.
    10. Lean, Hooi Hooi & McAleer, Michael & Wong, Wing-Keung, 2015. "Preferences of risk-averse and risk-seeking investors for oil spot and futures before, during and after the Global Financial Crisis," International Review of Economics & Finance, Elsevier, vol. 40(C), pages 204-216.
    11. Tsang, Chun-Kei & Wong, Wing-Keung & Horowitz, Ira, 2016. "A stochastic-dominance approach to determining the optimal home-size purchase: The case of Hong Kong," MPRA Paper 69175, University Library of Munich, Germany.
    12. M. Azhar Hussain & Nikolaj Siersbæk & Lars Peter Østerdal, 2020. "Multidimensional welfare comparisons of EU member states before, during, and after the financial crisis: a dominance approach," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 55(4), pages 645-686, December.
    13. Higgins, Sean & Lustig, Nora, 2016. "Can a poverty-reducing and progressive tax and transfer system hurt the poor?," Journal of Development Economics, Elsevier, vol. 122(C), pages 63-75.
    14. Grönqvist, Charlotta, 2009. "Empirical studies on the private value of Finnish patents," Bank of Finland Scientific Monographs, Bank of Finland, volume 0, number sm2009_041.
    15. Miguel A. Delgado & Juan Carlos Escanciano, 2013. "Conditional Stochastic Dominance Testing," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 16-28, January.
    16. Wong, Wing-Keung & Phoon, Kok Fai & Lean, Hooi Hooi, 2008. "Stochastic dominance analysis of Asian hedge funds," Pacific-Basin Finance Journal, Elsevier, vol. 16(3), pages 204-223, June.
    17. Wen-Hao Chen & Jean-Yves Duclos, 2011. "Testing for poverty dominance: an application to Canada," Canadian Journal of Economics, Canadian Economics Association, vol. 44(3), pages 781-803, August.
    18. Lee, Kyungho & Linton, Oliver & Whang, Yoon-Jae, 2023. "Testing for time stochastic dominance," Journal of Econometrics, Elsevier, vol. 235(2), pages 352-371.
    19. Khaled, Mohamad A. & Makdissi, Paul & Yazbeck, Myra, 2018. "Income-related health transfers principles and orderings of joint distributions of income and health," Journal of Health Economics, Elsevier, vol. 57(C), pages 315-331.
    20. Lean, Hooi Hooi & McAleer, Michael & Wong, Wing-Keung, 2010. "Market efficiency of oil spot and futures: A mean-variance and stochastic dominance approach," Energy Economics, Elsevier, vol. 32(5), pages 979-986, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:agecon:v:51:y:2020:i:6:p:871-886. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/iaaeeea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.