IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Nonparametric tests of conditional treatment effects

  • Sokbae Lee

    ()

    (Institute for Fiscal Studies and cemmap and SNU)

  • Yoon-Jae Whang

    ()

    (Institute for Fiscal Studies and SNU)

We develop a general class of nonparametric tests for treatment effects conditional on covariates. We consider a wide spectrum of null and alternative hypotheses regarding conditional treatment effects, including (i) the null hypothesis of the conditional stochastic dominance between treatment and control groups; ii) the null hypothesis that the conditional average treatment effect is positive for each value of covariates; and (iii) the null hypothesis of no distributional (or average) treatment effect conditional on covariates against a one-sided (or two-sided) alternative hypothesis. The test statistics are based on L1-type functionals of uniformly consistent nonparametric kernel estimators of conditional expectations that characterize the null hypotheses. Using the Poissionization technique of Giné et al. (2003), we show that suitably studentized versions of our test statistics are asymptotically standard normal under the null hypotheses and also show that the proposed nonparametric tests are consistent against general fixed alternatives. Furthermore, it turns out that our tests have non-negligible powers against some local alternatives that are n−½ different from the null hypotheses, where n is the sample size. We provide a more powerful test for the case when the null hypothesis may be binding only on a strict subset of the support and also consider an extension to testing for quantile treatment effects. We illustrate the usefulness of our tests by applying them to data from a randomized, job training program (LaLonde, 1986) and by carrying out Monte Carlo experiments based on this dataset.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://cemmap.ifs.org.uk/wps/cwp3609.pdf
Download Restriction: no

Paper provided by Centre for Microdata Methods and Practice, Institute for Fiscal Studies in its series CeMMAP working papers with number CWP36/09.

as
in new window

Length:
Date of creation: Dec 2009
Date of revision:
Handle: RePEc:ifs:cemmap:36/09
Contact details of provider: Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE
Phone: (+44) 020 7291 4800
Fax: (+44) 020 7323 4780
Web page: http://cemmap.ifs.org.uk
Email:


More information through EDIRC

Order Information: Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE
Email:


References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, 07.
  2. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2005. "Distributional Impacts of the Self-Sufficiency Project," NBER Working Papers 11626, National Bureau of Economic Research, Inc.
  3. Victor Chernozhukov & Ivan Fernandez-Val & Blaise Melly, 2009. "Inference on counterfactual distributions," CeMMAP working papers CWP09/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  4. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-93, September.
  5. Guido Imbens & Jeffrey Wooldridge, 2008. "Recent developments in the econometrics of program evaluation," CeMMAP working papers CWP24/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  6. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2005. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," IZA Discussion Papers 1728, Institute for the Study of Labor (IZA).
  7. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
  8. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
  9. Mitnik, Oscar K. & Imbens, Guido & Hotz, V. Joseph & Crump, Richard K., 2008. "Nonparametric Tests for Treatment Effect Heterogeneity," Scholarly Articles 3039049, Harvard University Department of Economics.
  10. Jiti Gao & Irene Gijbels, 2009. "Bandwidth Selection in Nonparametric Kernel Testing," School of Economics Working Papers 2009-01, University of Adelaide, School of Economics.
  11. David Card & Dean R. Hyslop, 2005. "Estimating the Effects of a Time-Limited Earnings Subsidy for Welfare-Leavers," Econometrica, Econometric Society, vol. 73(6), pages 1723-1770, November.
  12. Myoung-jae Lee, 2009. "Non-parametric tests for distributional treatment effect for randomly censored responses," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(1), pages 243-264.
  13. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March.
  14. Alberto Abadie & Joshua Angrist & Guido Imbens, 1999. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Working papers 99-16, Massachusetts Institute of Technology (MIT), Department of Economics.
  15. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
  16. Lavergne, Pascal, 2001. "An equality test across nonparametric regressions," Journal of Econometrics, Elsevier, vol. 103(1-2), pages 307-344, July.
  17. Linton, Oliver & Song, Kyungchul & Whang, Yoon-Jae, 2010. "An improved bootstrap test of stochastic dominance," Journal of Econometrics, Elsevier, vol. 154(2), pages 186-202, February.
  18. Victor Chernozhukov & Sokbae Lee & Adam Rosen, 2009. "Intersection Bounds: estimation and inference," CeMMAP working papers CWP19/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  19. Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, 09.
  20. Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
  21. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects and Econometric Policy Evaluation," NBER Technical Working Papers 0306, National Bureau of Economic Research, Inc.
  22. Heckman, James J & Ichimura, Hidehiko & Todd, Petra, 1998. "Matching as an Econometric Evaluation Estimator," Review of Economic Studies, Wiley Blackwell, vol. 65(2), pages 261-94, April.
  23. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
  24. Joshua D. Angrist & Guido M. Kuersteiner, 2011. "Causal Effects of Monetary Shocks: Semiparametric Conditional Independence Tests with a Multinomial Propensity Score," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 725-747, August.
  25. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, 01.
  26. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
  27. Horvath, Lajos & Kokoszka, Piotr & Zitikis, Ricardas, 2006. "Testing for stochastic dominance using the weighted McFadden-type statistic," Journal of Econometrics, Elsevier, vol. 133(1), pages 191-205, July.
  28. Davidson, R. & Duclos, J.Y., 1995. "Statistical Inference for the Measurement of the Incidence of Taxes and Transfers," Papers 9521, Laval - Recherche en Politique Economique.
  29. Joshua D. Angrist & Guido M. Kuersteiner, 2004. "Semiparametric Causality Tests Using the Policy Propensity Score," NBER Working Papers 10975, National Bureau of Economic Research, Inc.
  30. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
  31. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, 01.
  32. Guido Imbens, 2000. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometric Society World Congress 2000 Contributed Papers 1166, Econometric Society.
  33. Sergio Firpo, 2004. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometric Society 2004 North American Summer Meetings 605, Econometric Society.
  34. Stefan Hoderlein & Enno Mammen, 2009. "Identification and estimation of local average derivatives in non-separable models without monotonicity," Econometrics Journal, Royal Economic Society, vol. 12(1), pages 1-25, 03.
  35. Su, Liangjun & White, Halbert, 2008. "A Nonparametric Hellinger Metric Test For Conditional Independence," Econometric Theory, Cambridge University Press, vol. 24(04), pages 829-864, August.
  36. Kaur, Amarjot & Prakasa Rao, B.L.S. & Singh, Harshinder, 1994. "Testing for Second-Order Stochastic Dominance of Two Distributions," Econometric Theory, Cambridge University Press, vol. 10(05), pages 849-866, December.
  37. Kyungchul Song, 2007. "Testing Conditional Independence via Rosenblatt Transforms," PIER Working Paper Archive 07-026, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
  38. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:36/09. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Benita Rajania)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.