IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/05-12.html
   My bibliography  Save this paper

Inference on counterfactual distributions

Author

Listed:
  • Victor Chernozhukov

    () (Institute for Fiscal Studies and MIT)

  • Ivan Fernandez-Val

    (Institute for Fiscal Studies and Boston University)

  • Blaise Melly

    (Institute for Fiscal Studies)

Abstract

We develop inference procedures for policy analysis based on regression methods. We consider policy interventions that correspond to either changes in the distribution of covariates, or changes in the conditional distribution of the outcome given covariates, or both. Under either of these policy scenarios, we derive functional central limit theorems for regression-based estimators of the status quo and counterfactual marginal distributions. This result allows us to construct simultaneous con?dence sets for function-valued policy e?ects, including the e?ects on the marginal distribution function, quantile function, and other related functionals. We use these con?dence sets to test functional hypotheses such as no-e?ect, positive e?ect, or stochastic dominance. Our theory applies to general policy interventions and covers the main regression methods including classical, quantile, duration, and distribution regressions. We illustrate the results with an empirical application on wage decompositions using data for the United States. Of independent interest is the use of distribution regression as a tool for modeling the entire conditional distribution, encompassing duration/transformation regression, and representing an alternative to quantile regression. This is a revision of CWP09/09.

Suggested Citation

  • Victor Chernozhukov & Ivan Fernandez-Val & Blaise Melly, 2012. "Inference on counterfactual distributions," CeMMAP working papers CWP05/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:05/12
    as

    Download full text from publisher

    File URL: http://cemmap.ifs.org.uk/wps/cwp051212.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Linton, Oliver & Song, Kyungchul & Whang, Yoon-Jae, 2010. "An improved bootstrap test of stochastic dominance," Journal of Econometrics, Elsevier, vol. 154(2), pages 186-202, February.
    2. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    3. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, January.
    4. DiNardo, John & Fortin, Nicole M & Lemieux, Thomas, 1996. "Labor Market Institutions and the Distribution of Wages, 1973-1992: A Semiparametric Approach," Econometrica, Econometric Society, vol. 64(5), pages 1001-1044, September.
    5. Christoph Rothe, 2012. "Partial Distributional Policy Effects," Econometrica, Econometric Society, vol. 80(5), pages 2269-2301, September.
    6. Chernozhukov, Victor & Fernández-Val, Iván & Kowalski, Amanda E., 2015. "Quantile regression with censoring and endogeneity," Journal of Econometrics, Elsevier, vol. 186(1), pages 201-221.
    7. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    8. Christoph Rothe & Dominik Wied, 2013. "Misspecification Testing in a Class of Conditional Distributional Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(501), pages 314-324, March.
    9. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    10. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6b, January.
    11. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 487-535.
    12. Radulovic, Dragan & Wegkamp, Marten, 2003. "Necessary and sufficient conditions for weak convergence of smoothed empirical processes," Statistics & Probability Letters, Elsevier, vol. 61(3), pages 321-336, February.
    13. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    14. Sokbae Lee & Oliver Linton & Yoon-Jae Whang, 2009. "Testing for Stochastic Monotonicity," Econometrica, Econometric Society, vol. 77(2), pages 585-602, March.
    15. Stephen G. Donald & David A. Green & Harry J. Paarsch, 2000. "Differences in Wage Distributions Between Canada and the United States: An Application of a Flexible Estimator of Distribution Functions in the Presence of Covariates," Review of Economic Studies, Oxford University Press, vol. 67(4), pages 609-633.
    16. David H. Autor & Lawrence F. Katz & Melissa S. Kearney, 2006. "The Polarization of the U.S. Labor Market," American Economic Review, American Economic Association, vol. 96(2), pages 189-194, May.
    17. Victor Chernozhukov & Iv·n Fern·ndez-Val & Alfred Galichon, 2010. "Quantile and Probability Curves Without Crossing," Econometrica, Econometric Society, vol. 78(3), pages 1093-1125, May.
    18. Koenker, Roger & Yoon, Jungmo, 2009. "Parametric links for binary choice models: A Fisherian-Bayesian colloquy," Journal of Econometrics, Elsevier, vol. 152(2), pages 120-130, October.
    19. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    20. Sergio Firpo & Nicole M. Fortin & Thomas Lemieux, 2009. "Unconditional Quantile Regressions," Econometrica, Econometric Society, vol. 77(3), pages 953-973, May.
    21. Cameron,A. Colin & Trivedi,Pravin K., 2008. "Microeconometrics," Cambridge Books, Cambridge University Press, number 9787111235767, April.
    22. Thomas Lemieux, 2006. "Increasing Residual Wage Inequality: Composition Effects, Noisy Data, or Rising Demand for Skill?," American Economic Review, American Economic Association, vol. 96(3), pages 461-498, June.
    23. Han, Aaron & Hausman, Jerry A, 1990. "Flexible Parametric Estimation of Duration and Competing Risk Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(1), pages 1-28, January-M.
    24. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    25. Rolf Aaberge & Steinar Bjerve & Kjell Doksum, 2005. "Decomposition of rank-dependent measures of inequality by subgroups," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(3), pages 493-503.
    26. Barrett, Garry F. & Donald, Stephen G., 2009. "Statistical Inference with Generalized Gini Indices of Inequality, Poverty, and Welfare," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 1-17.
    27. Amanda Gosling & Stephen Machin & Costas Meghir, 2000. "The Changing Distribution of Male Wages in the U.K," Review of Economic Studies, Oxford University Press, vol. 67(4), pages 635-666.
    28. Andrew Chesher, 2003. "Identification in Nonseparable Models," Econometrica, Econometric Society, vol. 71(5), pages 1405-1441, September.
    29. Foresi, S. & Paracchi, F., 1992. "The Conditional Distribution of Excess Returns: An Empirical Analysis," Working Papers 92-49, C.V. Starr Center for Applied Economics, New York University.
    30. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    31. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6a, January.
    32. de Jong, Robert M. & Davidson, James, 2000. "The Functional Central Limit Theorem And Weak Convergence To Stochastic Integrals I," Econometric Theory, Cambridge University Press, vol. 16(05), pages 621-642, October.
    33. Abbring, Jaap H. & Heckman, James J., 2007. "Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation," Handbook of Econometrics,in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 72 Elsevier.
    34. Albrecht, James & van Vuuren, Aico & Vroman, Susan, 2009. "Counterfactual distributions with sample selection adjustments: Econometric theory and an application to the Netherlands," Labour Economics, Elsevier, vol. 16(4), pages 383-396, August.
    35. David H. Autor & Lawrence F. Katz & Melissa S. Kearney, 2008. "Trends in U.S. Wage Inequality: Revising the Revisionists," The Review of Economics and Statistics, MIT Press, vol. 90(2), pages 300-323, May.
    36. Bhattacharya, Debopam, 2007. "Inference on inequality from household survey data," Journal of Econometrics, Elsevier, vol. 137(2), pages 674-707, April.
    37. Buchinsky, Moshe, 1994. "Changes in the U.S. Wage Structure 1963-1987: Application of Quantile Regression," Econometrica, Econometric Society, vol. 62(2), pages 405-458, March.
    38. Powell, James L., 1986. "Censored regression quantiles," Journal of Econometrics, Elsevier, vol. 32(1), pages 143-155, June.
    39. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, January.
    40. Joshua Angrist & Victor Chernozhukov & Iván Fernández-Val, 2006. "Quantile Regression under Misspecification, with an Application to the U.S. Wage Structure," Econometrica, Econometric Society, vol. 74(2), pages 539-563, March.
    41. José Mata & José A. F. Machado, 2005. "Counterfactual decomposition of changes in wage distributions using quantile regression," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(4), pages 445-465.
    42. Hahn, Jinyong, 1995. "Bootstrapping Quantile Regression Estimators," Econometric Theory, Cambridge University Press, vol. 11(01), pages 105-121, February.
    43. Roger Koenker & Zhijie Xiao, 2002. "Inference on the Quantile Regression Process," Econometrica, Econometric Society, vol. 70(4), pages 1583-1612, July.
    44. Rothe, Christoph, 2010. "Nonparametric estimation of distributional policy effects," Journal of Econometrics, Elsevier, vol. 155(1), pages 56-70, March.
    45. Andrews, Donald W K, 1988. "Chi-Square Diagnostic Tests for Econometric Models: Theory," Econometrica, Econometric Society, vol. 56(6), pages 1419-1453, November.
    46. Chernozhukov, Victor & Hansen, Christian, 2006. "Instrumental quantile regression inference for structural and treatment effect models," Journal of Econometrics, Elsevier, vol. 132(2), pages 491-525, June.
    47. Hong H. & Chernozhukov V., 2002. "Three-Step Censored Quantile Regression and Extramarital Affairs," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 872-882, September.
    Full references (including those not matched with items on IDEAS)

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:05/12. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Emma Hyman). General contact details of provider: http://edirc.repec.org/data/cmifsuk.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.