IDEAS home Printed from
MyIDEAS: Login to save this paper or follow this series

Nonparametric tests of conditional treatment effects

  • Sokbae (Simon) Lee


    (Institute for Fiscal Studies)

  • Yoon-Jae Whang


    (Institute for Fiscal Studies and SNU)

We develop a general class of nonparametric tests for treatment effects conditional on covariates. We consider a wide spectrum of null and alternative hypotheses regarding conditional treatment effects, including (i) the null hypothesis of the conditional stochastic dominance between treatment and control groups; ii) the null hypothesis that the conditional average treatment effect is positive for each value of covariates; and (iii) the null hypothesis of no distributional (or average) treatment effect conditional on covariates against a one-sided (or two-sided) alternative hypothesis. The test statistics are based on L1-type functionals of uniformly consistent nonparametric kernel estimators of conditional expectations that characterize the null hypotheses. Using the Poissionization technique of Giné et al. (2003), we show that suitably studentized versions of our test statistics are asymptotically standard normal under the null hypotheses and also show that the proposed nonparametric tests are consistent against general fixed alternatives. Furthermore, it turns out that our tests have non-negligible powers against some local alternatives that are n−½ different from the null hypotheses, where n is the sample size. We provide a more powerful test for the case when the null hypothesis may be binding only on a strict subset of the support and also consider an extension to testing for quantile treatment effects. We illustrate the usefulness of our tests by applying them to data from a randomized, job training program (LaLonde, 1986) and by carrying out Monte Carlo experiments based on this dataset.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by Centre for Microdata Methods and Practice, Institute for Fiscal Studies in its series CeMMAP working papers with number CWP36/09.

in new window

Date of creation: Dec 2009
Date of revision:
Handle: RePEc:ifs:cemmap:36/09
Contact details of provider: Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE
Phone: (+44) 020 7291 4800
Fax: (+44) 020 7323 4780
Web page:

More information through EDIRC

Order Information: Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2005. "Distributional Impacts of the Self-Sufficiency Project," NBER Working Papers 11626, National Bureau of Economic Research, Inc.
  2. Charles F. Manski, 2003. "Statistical treatment rules for heterogeneous populations," CeMMAP working papers CWP03/03, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  3. Myoung-jae Lee, 2009. "Non-parametric tests for distributional treatment effect for randomly censored responses," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(1), pages 243-264.
  4. Victor Chernozhukov & Ivan Fernandez-Val & Blaise Melly, 2012. "Inference on counterfactual distributions," CeMMAP working papers CWP05/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  5. Imbens, Guido W. & Wooldridge, Jeffrey M., 2008. "Recent Developments in the Econometrics of Program Evaluation," IZA Discussion Papers 3640, Institute for the Study of Labor (IZA).
  6. Victor Chernozhukov & Sokbae (Simon) Lee & Adam Rosen, 2012. "Intersection bounds: estimation and inference," CeMMAP working papers CWP33/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  7. Jeffrey Smith & Petra Todd, 2003. "Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators?," University of Western Ontario, CIBC Centre for Human Capital and Productivity Working Papers 20035, University of Western Ontario, CIBC Centre for Human Capital and Productivity.
  8. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March.
  9. Davidson, R. & Duclos, J.Y., 1995. "Statistical Inference for the Measurement of the Incidence of Taxes and Transfers," G.R.E.Q.A.M. 95a30, Universite Aix-Marseille III.
  10. Su, Liangjun & White, Halbert, 2008. "A Nonparametric Hellinger Metric Test For Conditional Independence," Econometric Theory, Cambridge University Press, vol. 24(04), pages 829-864, August.
  11. Jeffrey R. Kling & Jeffrey B. Liebman & Lawrence F. Katz, 2005. "Experimental Analysis of Neighborhood Effects," NBER Working Papers 11577, National Bureau of Economic Research, Inc.
  12. Guido Imbens, 2000. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometric Society World Congress 2000 Contributed Papers 1166, Econometric Society.
  13. Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
  14. Lavergne, Pascal, 2001. "An equality test across nonparametric regressions," Journal of Econometrics, Elsevier, vol. 103(1-2), pages 307-344, July.
  15. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2005. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," IZA Discussion Papers 1728, Institute for the Study of Labor (IZA).
  16. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, 01.
  17. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Nonparametric Tests for Treatment Effect Heterogeneity," NBER Technical Working Papers 0324, National Bureau of Economic Research, Inc.
  18. Joshua D. Angrist & Guido M. Kuersteiner, 2011. "Causal Effects of Monetary Shocks: Semiparametric Conditional Independence Tests with a Multinomial Propensity Score," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 725-747, August.
  19. David Card & Dean R. Hyslop, 2004. "Estimating the Effects of a Time Limited Earnings Subsidy for Welfare Leavers," NBER Working Papers 10647, National Bureau of Economic Research, Inc.
  20. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects and Econometric Policy Evaluation," NBER Working Papers 11259, National Bureau of Economic Research, Inc.
  21. Oliver Linton & Kyungchul Song & Yoon-Jae Whang, 2009. "An Improved Bootstrap Test of Stochastic Dominance," Cowles Foundation Discussion Papers 1713, Cowles Foundation for Research in Economics, Yale University.
  22. Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, 09.
  23. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
  24. Kaur, Amarjot & Prakasa Rao, B.L.S. & Singh, Harshinder, 1994. "Testing for Second-Order Stochastic Dominance of Two Distributions," Econometric Theory, Cambridge University Press, vol. 10(05), pages 849-866, December.
  25. Rajeev H. Dehejia & Sadek Wahba, 1998. "Propensity Score Matching Methods for Non-experimental Causal Studies," NBER Working Papers 6829, National Bureau of Economic Research, Inc.
  26. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-93, September.
  27. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, 01.
  28. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
  29. Jiti Gao & Irene Gijbels, 2009. "Bandwidth Selection in Nonparametric Kernel Testing," School of Economics Working Papers 2009-01, University of Adelaide, School of Economics.
  30. Stefan Hoderlein & Enno Mammen, 2009. "Identification and estimation of local average derivatives in non-separable models without monotonicity," Econometrics Journal, Royal Economic Society, vol. 12(1), pages 1-25, 03.
  31. Alberto Abadie & Joshua Angrist & Guido Imbens, 1999. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Working papers 99-16, Massachusetts Institute of Technology (MIT), Department of Economics.
  32. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
  33. Heckman, James J & Ichimura, Hidehiko & Todd, Petra, 1998. "Matching as an Econometric Evaluation Estimator," Review of Economic Studies, Wiley Blackwell, vol. 65(2), pages 261-94, April.
  34. Horvath, Lajos & Kokoszka, Piotr & Zitikis, Ricardas, 2006. "Testing for stochastic dominance using the weighted McFadden-type statistic," Journal of Econometrics, Elsevier, vol. 133(1), pages 191-205, July.
  35. Kyungchul Song, 2007. "Testing Conditional Independence via Rosenblatt Transforms," PIER Working Paper Archive 07-026, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
  36. Joshua D. Angrist & Guido M. Kuersteiner, 2004. "Semiparametric Causality Tests Using the Policy Propensity Score," NBER Working Papers 10975, National Bureau of Economic Research, Inc.
  37. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
  38. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:36/09. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Benita Rajania)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.