IDEAS home Printed from
MyIDEAS: Log in (now much improved!) to save this paper

Nonparametric tests of conditional treatment effects

  • Sokbae Lee


    (Institute for Fiscal Studies and Institute for Fiscal Studies)

  • Yoon-Jae Whang


    (Institute for Fiscal Studies and SNU)

We develop a general class of nonparametric tests for treatment effects conditional on covariates. We consider a wide spectrum of null and alternative hypotheses regarding conditional treatment effects, including (i) the null hypothesis of the conditional stochastic dominance between treatment and control groups; ii) the null hypothesis that the conditional average treatment effect is positive for each value of covariates; and (iii) the null hypothesis of no distributional (or average) treatment effect conditional on covariates against a one-sided (or two-sided) alternative hypothesis. The test statistics are based on L1-type functionals of uniformly consistent nonparametric kernel estimators of conditional expectations that characterize the null hypotheses. Using the Poissionization technique of Giné et al. (2003), we show that suitably studentized versions of our test statistics are asymptotically standard normal under the null hypotheses and also show that the proposed nonparametric tests are consistent against general fixed alternatives. Furthermore, it turns out that our tests have non-negligible powers against some local alternatives that are n−½ different from the null hypotheses, where n is the sample size. We provide a more powerful test for the case when the null hypothesis may be binding only on a strict subset of the support and also consider an extension to testing for quantile treatment effects. We illustrate the usefulness of our tests by applying them to data from a randomized, job training program (LaLonde, 1986) and by carrying out Monte Carlo experiments based on this dataset.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by Centre for Microdata Methods and Practice, Institute for Fiscal Studies in its series CeMMAP working papers with number CWP36/09.

in new window

Date of creation: 06 Dec 2009
Date of revision:
Handle: RePEc:ifs:cemmap:36/09
Contact details of provider: Postal:
The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE

Phone: (+44) 020 7291 4800
Fax: (+44) 020 7323 4780
Web page:

More information through EDIRC

Order Information: Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects and Econometric Policy Evaluation," NBER Working Papers 11259, National Bureau of Economic Research, Inc.
  2. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2008. "Distributional impacts of the Self-Sufficiency Project," Journal of Public Economics, Elsevier, vol. 92(3-4), pages 748-765, April.
  3. Victor Chernozhukov & Ivan Fernandez-Val & Blaise Melly, 2013. "Inference on counterfactual distributions," CeMMAP working papers CWP17/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  4. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March.
  5. Rajeev H. Dehejia & Sadek Wahba, 1998. "Propensity Score Matching Methods for Non-experimental Causal Studies," NBER Working Papers 6829, National Bureau of Economic Research, Inc.
  6. Jeffrey R. Kling & Jeffrey B. Liebman & Lawrence F. Katz, 2005. "Experimental Analysis of Neighborhood Effects," NBER Working Papers 11577, National Bureau of Economic Research, Inc.
  7. Jiti Gao & Irene Gijbels, 2009. "Bandwidth Selection in Nonparametric Kernel Testing," School of Economics Working Papers 2009-01, University of Adelaide, School of Economics.
  8. DAVIDSON, Russell & DUCLOS, Jean-Yves, 1995. "Statistical Inference for the Measurement of the Incidences of Taxes and Transfers," Cahiers de recherche 9521, Université Laval - Département d'économique.
  9. Stefan Hoderlein & Enno Mammen, 2009. "Identification and estimation of local average derivatives in non-separable models without monotonicity," Econometrics Journal, Royal Economic Society, vol. 12(1), pages 1-25, 03.
  10. Hilary W. Hoynes & Marianne P Bitler & Jonah Gelbach, 2005. "What Mean Impacts Miss:Distributional Effects of Welfare Reform Experiments," Working Papers 531, University of California, Davis, Department of Economics.
  11. Victor Chernozhukov & Sokbae Lee & Adam Rosen, 2012. "Intersection bounds: estimation and inference," CeMMAP working papers CWP33/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  12. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2000. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," NBER Technical Working Papers 0251, National Bureau of Economic Research, Inc.
  13. Joshua D. Angrist & Guido M. Kuersteiner, 2004. "Semiparametric Causality Tests Using the Policy Propensity Score," NBER Working Papers 10975, National Bureau of Economic Research, Inc.
  14. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," Review of Economic Studies, Oxford University Press, vol. 65(2), pages 261-294.
  15. Esther Duflo & Raghabendra Chattopadhyay, 2004. "Women as policy makers: Evidence from a randomized policy experiment in india," Framed Field Experiments 00224, The Field Experiments Website.
  16. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, 07.
  17. David Card & Dean R. Hyslop, 2004. "Estimating the Effects of a Time Limited Earnings Subsidy for Welfare Leavers," NBER Working Papers 10647, National Bureau of Economic Research, Inc.
  18. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-93, September.
  19. Linton, Oliver & Song, Kyungchul & Whang, Yoon-Jae, 2010. "An improved bootstrap test of stochastic dominance," Journal of Econometrics, Elsevier, vol. 154(2), pages 186-202, February.
  20. David Reiley & John List, 2008. "Field experiments," Artefactual Field Experiments 00091, The Field Experiments Website.
  21. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, 01.
  22. Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
  23. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
  24. Horvath, Lajos & Kokoszka, Piotr & Zitikis, Ricardas, 2006. "Testing for stochastic dominance using the weighted McFadden-type statistic," Journal of Econometrics, Elsevier, vol. 133(1), pages 191-205, July.
  25. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Nonparametric Tests for Treatment Effect Heterogeneity," NBER Technical Working Papers 0324, National Bureau of Economic Research, Inc.
  26. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
  27. Guido W. Imbens, 2003. "Nonparametric Estimation of Average Treatment Effects under Exogeneity: A Review," NBER Technical Working Papers 0294, National Bureau of Economic Research, Inc.
  28. Kyungchul Song, 2007. "Testing Conditional Independence via Rosenblatt Transforms," PIER Working Paper Archive 07-026, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
  29. Su, Liangjun & White, Halbert, 2008. "A Nonparametric Hellinger Metric Test For Conditional Independence," Econometric Theory, Cambridge University Press, vol. 24(04), pages 829-864, August.
  30. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
  31. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
  32. Joshua D. Angrist & Guido M. Kuersteiner, 2011. "Causal Effects of Monetary Shocks: Semiparametric Conditional Independence Tests with a Multinomial Propensity Score," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 725-747, August.
  33. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, 01.
  34. Myoung-jae Lee, 2009. "Non-parametric tests for distributional treatment effect for randomly censored responses," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(1), pages 243-264.
  35. Lavergne, Pascal, 1998. "An equality test across nonparametric regressions," SFB 373 Discussion Papers 1998,79, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
  36. Kaur, Amarjot & Prakasa Rao, B.L.S. & Singh, Harshinder, 1994. "Testing for Second-Order Stochastic Dominance of Two Distributions," Econometric Theory, Cambridge University Press, vol. 10(05), pages 849-866, December.
  37. Alberto Abadie & Joshua Angrist & Guido Imbens, 1999. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Working papers 99-16, Massachusetts Institute of Technology (MIT), Department of Economics.
  38. Imbens, Guido W. & Wooldridge, Jeffrey M., 2008. "Recent Developments in the Econometrics of Program Evaluation," IZA Discussion Papers 3640, Institute for the Study of Labor (IZA).
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:36/09. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Emma Hyman)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.