IDEAS home Printed from
MyIDEAS: Login to save this paper or follow this series

Nonparametric Tests of Conditional Treatment Effects

  • Sokbae Lee

    (University College London)

  • Yoon-Jae Whang

    (Seoul National University)

We develop a general class of nonparametric tests for treatment effects conditional on covariates. We consider a wide spectrum of null and alternative hypotheses regarding conditional treatment effects, including (i) the null hypothesis of the conditional stochastic dominance between treatment and control groups; (ii) the null hypothesis that the conditional average treatment effect is positive for each value of covariates; and (iii) the null hypothesis of no distributional (or average) treatment effect conditional on covariates against a one-sided (or two-sided) alternative hypothesis. The test statistics are based on L_{1}-type functionals of uniformly consistent nonparametric kernel estimators of conditional expectations that characterize the null hypotheses. Using the Poissionization technique of Gine et al. (2003), we show that suitably studentized versions of our test statistics are asymptotically standard normal under the null hypotheses and also show that the proposed nonparametric tests are consistent against general fixed alternatives. Furthermore, it turns out that our tests have non-negligible powers against some local alternatives that are n^{-1/2} different from the null hypotheses, where n is the sample size. We provide a more powerful test for the case when the null hypothesis may be binding only on a strict subset of the support and also consider an extension to testing for quantile treatment effects. We illustrate the usefulness of our tests by applying them to data from a randomized, job training program (LaLonde (1986)) and by carrying out Monte Carlo experiments based on this dataset.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by Cowles Foundation for Research in Economics, Yale University in its series Cowles Foundation Discussion Papers with number 1740.

in new window

Length: 68 pages
Date of creation: Nov 2009
Date of revision:
Handle: RePEc:cwl:cwldpp:1740
Contact details of provider: Postal: Yale University, Box 208281, New Haven, CT 06520-8281 USA
Phone: (203) 432-3702
Fax: (203) 432-6167
Web page:

More information through EDIRC

Order Information: Postal: Cowles Foundation, Yale University, Box 208281, New Haven, CT 06520-8281 USA

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Jeffrey Smith & Petra Todd, 2003. "Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators?," University of Western Ontario, CIBC Centre for Human Capital and Productivity Working Papers 20035, University of Western Ontario, CIBC Centre for Human Capital and Productivity.
  2. Esther Duflo & Raghabendra Chattopadhyay, 2004. "Women as policy makers: Evidence from a randomized policy experiment in india," Framed Field Experiments 00224, The Field Experiments Website.
  3. Russell Davidson & Jean-Yves Duclos, 1997. "Statistical Inference for the Measurement of the Incidence of Taxes and Transfers," Econometrica, Econometric Society, vol. 65(6), pages 1453-1466, November.
  4. Jiti Gao & Irene Gijbels, 2009. "Bandwidth Selection in Nonparametric Kernel Testing," School of Economics Working Papers 2009-01, University of Adelaide, School of Economics.
  5. Guido Imbens & Jeffrey Wooldridge, 2008. "Recent developments in the econometrics of program evaluation," CeMMAP working papers CWP24/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  6. Mitnik, Oscar K. & Imbens, Guido & Hotz, V. Joseph & Crump, Richard K., 2008. "Nonparametric Tests for Treatment Effect Heterogeneity," Scholarly Articles 3039049, Harvard University Department of Economics.
  7. Kyungchul Song, 2007. "Testing Conditional Independence via Rosenblatt Transforms," PIER Working Paper Archive 07-026, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
  8. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects and Econometric Policy Evaluation," NBER Technical Working Papers 0306, National Bureau of Economic Research, Inc.
  9. Guido Imbens, 2000. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometric Society World Congress 2000 Contributed Papers 1166, Econometric Society.
  10. Victor Chernozhukov & Ivan Fernandez-Val & Blaise Melly, 2013. "Inference on counterfactual distributions," CeMMAP working papers CWP17/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  11. Hilary W. Hoynes & Marianne P Bitler & Jonah Gelbach, 2005. "What Mean Impacts Miss:Distributional Effects of Welfare Reform Experiments," Working Papers 531, University of California, Davis, Department of Economics.
  12. Lavergne, Pascal, 1998. "An equality test across nonparametric regressions," SFB 373 Discussion Papers 1998,79, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
  13. Charles F. Manski, 2003. "Statistical treatment rules for heterogeneous populations," CeMMAP working papers CWP03/03, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  14. Oliver Linton & Kyungchul Song & Yoon-Jae Whang, 2009. "An Improved Bootstrap Test of Stochastic Dominance," Cowles Foundation Discussion Papers 1713, Cowles Foundation for Research in Economics, Yale University.
  15. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
  16. Kaur, Amarjot & Prakasa Rao, B.L.S. & Singh, Harshinder, 1994. "Testing for Second-Order Stochastic Dominance of Two Distributions," Econometric Theory, Cambridge University Press, vol. 10(05), pages 849-866, December.
  17. Angrist, Joshua & Kuersteiner, Guido M., 2008. "Causal Effects of Monetary Shocks: Semiparametric Conditional Independence Tests with a Multinomial Propensity Score," IZA Discussion Papers 3606, Institute for the Study of Labor (IZA).
  18. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2008. "Distributional impacts of the Self-Sufficiency Project," Journal of Public Economics, Elsevier, vol. 92(3-4), pages 748-765, April.
  19. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
  20. Stefan Hoderlein & Enno Mammen, 2009. "Identification and estimation of local average derivatives in non-separable models without monotonicity," Econometrics Journal, Royal Economic Society, vol. 12(1), pages 1-25, 03.
  21. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," Review of Economic Studies, Oxford University Press, vol. 65(2), pages 261-294.
  22. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, 01.
  23. Rajeev H. Dehejia & Sadek Wahba, 1998. "Propensity Score Matching Methods for Non-experimental Causal Studies," NBER Working Papers 6829, National Bureau of Economic Research, Inc.
  24. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, 01.
  25. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
  26. David Card & Dean R. Hyslop, 2005. "Estimating the Effects of a Time-Limited Earnings Subsidy for Welfare-Leavers," Econometrica, Econometric Society, vol. 73(6), pages 1723-1770, November.
  27. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March.
  28. Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
  29. Victor Chernozhukov & Sokbae (Simon) Lee & Adam Rosen, 2009. "Intersection Bounds: estimation and inference," CeMMAP working papers CWP19/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  30. Jeffrey R. Kling & Jeffrey B. Liebman & Lawrence F. Katz, 2005. "Experimental Analysis of Neighborhood Effects," NBER Working Papers 11577, National Bureau of Economic Research, Inc.
  31. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
  32. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
  33. Su, Liangjun & White, Halbert, 2008. "A Nonparametric Hellinger Metric Test For Conditional Independence," Econometric Theory, Cambridge University Press, vol. 24(04), pages 829-864, August.
  34. Horvath, Lajos & Kokoszka, Piotr & Zitikis, Ricardas, 2006. "Testing for stochastic dominance using the weighted McFadden-type statistic," Journal of Econometrics, Elsevier, vol. 133(1), pages 191-205, July.
  35. Myoung-jae Lee, 2009. "Non-parametric tests for distributional treatment effect for randomly censored responses," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(1), pages 243-264.
  36. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-93, September.
  37. Joshua D. Angrist & Guido M. Kuersteiner, 2004. "Semiparametric Causality Tests Using the Policy Propensity Score," NBER Working Papers 10975, National Bureau of Economic Research, Inc.
  38. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:1740. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Glena Ames)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.