IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Nonparametric tests of conditional treatment effects

  • Sokbae 'Simon' Lee

    ()

    (Institute for Fiscal Studies and University College London)

  • Yoon-Jae Whang

    (Institute for Fiscal Studies and Seoul National University)

We develop a general class of nonparametric tests for treatment effects conditional on covariates. We consider a wide spectrum of null and alternative hypotheses regarding conditional treatment effects, including (i) the null hypothesis of the conditional stochastic dominance between treatment and control groups; ii) the null hypothesis that the conditional average treatment effect is positive for each value of covariates; and (iii) the null hypothesis of no distributional (or average) treatment effect conditional on covariates against a one-sided (or two-sided) alternative hypothesis. The test statistics are based on L1-type functionals of uniformly consistent nonparametric kernel estimators of conditional expectations that characterize the null hypotheses. Using the Poissionization technique of Giné et al. (2003), we show that suitably studentized versions of our test statistics are asymptotically standard normal under the null hypotheses and also show that the proposed nonparametric tests are consistent against general fixed alternatives. Furthermore, it turns out that our tests have non-negligible powers against some local alternatives that are n−½ different from the null hypotheses, where n is the sample size. We provide a more powerful test for the case when the null hypothesis may be binding only on a strict subset of the support and also consider an extension to testing for quantile treatment effects. We illustrate the usefulness of our tests by applying them to data from a randomized, job training program (LaLonde, 1986) and by carrying out Monte Carlo experiments based on this dataset.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://cemmap.ifs.org.uk/wps/cwp3609.pdf
Download Restriction: no

Paper provided by Centre for Microdata Methods and Practice, Institute for Fiscal Studies in its series CeMMAP working papers with number CWP36/09.

as
in new window

Length:
Date of creation: Dec 2009
Date of revision:
Handle: RePEc:ifs:cemmap:36/09
Contact details of provider: Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE
Phone: (+44) 020 7291 4800
Fax: (+44) 020 7323 4780
Web page: http://cemmap.ifs.org.uk
Email:


More information through EDIRC

Order Information: Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE
Email:


References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March.
  2. Esther Duflo & Raghabendra Chattopadhyay, 2004. "Women as policy makers: Evidence from a randomized policy experiment in india," Framed Field Experiments 00224, The Field Experiments Website.
  3. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
  4. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Nonparametric Tests for Treatment Effect Heterogeneity," Working Papers 0609, University of Miami, Department of Economics.
  5. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
  6. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, 01.
  7. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2000. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," NBER Technical Working Papers 0251, National Bureau of Economic Research, Inc.
  8. Angrist, Joshua & Kuersteiner, Guido M., 2008. "Causal Effects of Monetary Shocks: Semiparametric Conditional Independence Tests with a Multinomial Propensity Score," IZA Discussion Papers 3606, Institute for the Study of Labor (IZA).
  9. Bitler, Marianne P. & Gelbach, Jonah B. & Hoynes, Hilary W., 2005. "What Mean Impacts Miss: Distributional Effects of Welfare Reform Experiments," IZA Discussion Papers 1728, Institute for the Study of Labor (IZA).
  10. Horvath, Lajos & Kokoszka, Piotr & Zitikis, Ricardas, 2006. "Testing for stochastic dominance using the weighted McFadden-type statistic," Journal of Econometrics, Elsevier, vol. 133(1), pages 191-205, July.
  11. Marianne P. Bitler & Jonah B. Gelbach & Hilary W. Hoynes, 2005. "Distributional Impacts of the Self-Sufficiency Project," NBER Working Papers 11626, National Bureau of Economic Research, Inc.
  12. Kyungchul Song, 2007. "Testing Conditional Independence via Rosenblatt Transforms," PIER Working Paper Archive 07-026, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
  13. Rajeev H. Dehejia & Sadek Wahba, 2002. "Propensity Score-Matching Methods For Nonexperimental Causal Studies," The Review of Economics and Statistics, MIT Press, vol. 84(1), pages 151-161, February.
  14. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, 01.
  15. Victor Chernozhukov & Ivan Fernandez-Val & Blaise Melly, 2008. "Inference On Counterfactual Distributions," Boston University - Department of Economics - Working Papers Series wp2008-005, Boston University - Department of Economics.
  16. Joshua D. Angrist & Guido M. Kuersteiner, 2004. "Semiparametric Causality Tests Using the Policy Propensity Score," NBER Working Papers 10975, National Bureau of Economic Research, Inc.
  17. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, 05.
  18. David Reiley & John List, 2008. "Field experiments," Artefactual Field Experiments 00091, The Field Experiments Website.
  19. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
  20. Lavergne, Pascal, 1998. "An equality test across nonparametric regressions," SFB 373 Discussion Papers 1998,79, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
  21. Davidson, R. & Duclos, J.Y., 1995. "Statistical Inference for the Measurement of the Incidence of Taxes and Transfers," G.R.E.Q.A.M. 95a30, Universite Aix-Marseille III.
  22. Victor Chernozhukov & Sokbae 'Simon' Lee & Adam Rosen, 2012. "Intersection bounds: estimation and inference," CeMMAP working papers CWP33/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  23. Charles F. Manski, 2004. "Statistical Treatment Rules for Heterogeneous Populations," Econometrica, Econometric Society, vol. 72(4), pages 1221-1246, 07.
  24. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
  25. Stefan Hoderlein & Enno Mammen, 2009. "Identification and estimation of local average derivatives in non-separable models without monotonicity," Econometrics Journal, Royal Economic Society, vol. 12(1), pages 1-25, 03.
  26. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
  27. Su, Liangjun & White, Halbert, 2008. "A Nonparametric Hellinger Metric Test For Conditional Independence," Econometric Theory, Cambridge University Press, vol. 24(04), pages 829-864, August.
  28. Linton, Oliver & Song, Kyungchul & Whang, Yoon-Jae, 2010. "An improved bootstrap test of stochastic dominance," Journal of Econometrics, Elsevier, vol. 154(2), pages 186-202, February.
  29. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-93, September.
  30. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
  31. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, 01.
  32. Guido W. Imbens, 2003. "Nonparametric Estimation of Average Treatment Effects under Exogeneity: A Review," NBER Technical Working Papers 0294, National Bureau of Economic Research, Inc.
  33. Myoung-jae Lee, 2009. "Non-parametric tests for distributional treatment effect for randomly censored responses," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(1), pages 243-264.
  34. Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
  35. Gao, Jiti & Gijbels, Irène, 2008. "Bandwidth Selection in Nonparametric Kernel Testing," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1584-1594.
  36. David Card & Dean R. Hyslop, 2004. "Estimating the Effects of a Time Limited Earnings Subsidy for Welfare Leavers," NBER Working Papers 10647, National Bureau of Economic Research, Inc.
  37. Kaur, Amarjot & Prakasa Rao, B.L.S. & Singh, Harshinder, 1994. "Testing for Second-Order Stochastic Dominance of Two Distributions," Econometric Theory, Cambridge University Press, vol. 10(05), pages 849-866, December.
  38. Heckman, James J & Ichimura, Hidehiko & Todd, Petra, 1998. "Matching as an Econometric Evaluation Estimator," Review of Economic Studies, Wiley Blackwell, vol. 65(2), pages 261-94, April.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:36/09. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Stephanie Seavers)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.