IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/17-13.html
   My bibliography  Save this paper

Inference on counterfactual distributions

Author

Listed:
  • Victor Chernozhukov

    (Institute for Fiscal Studies and MIT)

  • Ivan Fernandez-Val

    (Institute for Fiscal Studies and Boston University)

  • Blaise Melly

    (Institute for Fiscal Studies)

Abstract

Counterfactual distributions are important ingredients for policy analysis and de-composition analysis in empirical economics. In this article we develop modelling and inference tools for counterfactual distributions based on regression methods. The counterfactual scenarios that we consider consist of ceteris paribus changes in either the distribution of covariates related to the outcome of interest or the conditional distribution of the outcome given covariates. For either of these scenarios we derive joint functional central limit theorems and bootstrap validity results for regression-based estimators of the status quo and counterfactual outcome distributions. These results allow us to construct simultaneous confidence sets for function-valued effects of the counterfactual changes, including the effects on the entire distribution and quantile functions of the outcome as well as on related functionals. These confidence sets can be used to test functional hypotheses such as no-effect, positive effect or stochastic dominance. Our theory applies to general counterfactual changes and covers the main regression methods including classical, quantile, duration and distribution regressions. We illustrate the results with an empirical application to wage decompositions using data for the United States. As part of developing the main results, we introduce distribution regression as a comprehensive and flexible tool for modelling and estimating the entire conditional distribution. We show that distribution regression encompasses the Cox duration regression and represents a useful alternative to quantile regression. We establish functional central limit theorems and bootstrap validity results for the empirical distribution regression process and various related functionals. This is a revision of CWP05/12 and CWP09/09

Suggested Citation

  • Victor Chernozhukov & Ivan Fernandez-Val & Blaise Melly, 2013. "Inference on counterfactual distributions," CeMMAP working papers CWP17/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:17/13
    as

    Download full text from publisher

    File URL: http://www.cemmap.ac.uk/wps/cwp171313.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2009. "Dealing with limited overlap in estimation of average treatment effects," Biometrika, Biometrika Trust, vol. 96(1), pages 187-199.
    2. Linton, Oliver & Song, Kyungchul & Whang, Yoon-Jae, 2010. "An improved bootstrap test of stochastic dominance," Journal of Econometrics, Elsevier, vol. 154(2), pages 186-202, February.
    3. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    4. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, January.
    5. DiNardo, John & Fortin, Nicole M & Lemieux, Thomas, 1996. "Labor Market Institutions and the Distribution of Wages, 1973-1992: A Semiparametric Approach," Econometrica, Econometric Society, vol. 64(5), pages 1001-1044, September.
    6. V. Chernozhukov & I. Fernández-Val & A. Galichon, 2009. "Improving point and interval estimators of monotone functions by rearrangement," Biometrika, Biometrika Trust, vol. 96(3), pages 559-575.
    7. Maier, Michael, 2011. "Tests for distributional treatment effects under unconfoundedness," Economics Letters, Elsevier, vol. 110(1), pages 49-51, January.
    8. Guido W. Imbens & Whitney K. Newey, 2009. "Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity," Econometrica, Econometric Society, vol. 77(5), pages 1481-1512, September.
    9. Christoph Rothe, 2012. "Partial Distributional Policy Effects," Econometrica, Econometric Society, vol. 80(5), pages 2269-2301, September.
    10. Chernozhukov, Victor & Fernández-Val, Iván & Kowalski, Amanda E., 2015. "Quantile regression with censoring and endogeneity," Journal of Econometrics, Elsevier, vol. 186(1), pages 201-221.
    11. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    12. Patrick Kline & Andres Santos, 2013. "Sensitivity to missing data assumptions: Theory and an evaluation of the U.S. wage structure," Quantitative Economics, Econometric Society, vol. 4(2), pages 231-267, July.
    13. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    14. Christoph Rothe & Dominik Wied, 2013. "Misspecification Testing in a Class of Conditional Distributional Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(501), pages 314-324, March.
    15. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444606.
    16. Hahn, Jinyong, 1997. "Bayesian Bootstrap of the Quantile Regression Estimator: A Large Sample Study," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 38(4), pages 795-808, November.
    17. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    18. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 487-535.
    19. Radulovic, Dragan & Wegkamp, Marten, 2003. "Necessary and sufficient conditions for weak convergence of smoothed empirical processes," Statistics & Probability Letters, Elsevier, vol. 61(3), pages 321-336, February.
    20. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    21. Fortin, Nicole & Lemieux, Thomas & Firpo, Sergio, 2011. "Decomposition Methods in Economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 1, pages 1-102, Elsevier.
    22. Sokbae Lee & Oliver Linton & Yoon-Jae Whang, 2009. "Testing for Stochastic Monotonicity," Econometrica, Econometric Society, vol. 77(2), pages 585-602, March.
    23. Oaxaca, Ronald, 1973. "Male-Female Wage Differentials in Urban Labor Markets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 14(3), pages 693-709, October.
    24. Stephen G. Donald & David A. Green & Harry J. Paarsch, 2000. "Differences in Wage Distributions Between Canada and the United States: An Application of a Flexible Estimator of Distribution Functions in the Presence of Covariates," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(4), pages 609-633.
    25. David H. Autor & Lawrence F. Katz & Melissa S. Kearney, 2006. "The Polarization of the U.S. Labor Market," American Economic Review, American Economic Association, vol. 96(2), pages 189-194, May.
    26. Victor Chernozhukov & Iv·n Fern·ndez-Val & Alfred Galichon, 2010. "Quantile and Probability Curves Without Crossing," Econometrica, Econometric Society, vol. 78(3), pages 1093-1125, May.
    27. Chen, Xiaohong & Pouzo, Demian, 2009. "Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals," Journal of Econometrics, Elsevier, vol. 152(1), pages 46-60, September.
    28. Koenker, Roger & Yoon, Jungmo, 2009. "Parametric links for binary choice models: A Fisherian-Bayesian colloquy," Journal of Econometrics, Elsevier, vol. 152(2), pages 120-130, October.
    29. Xingdong Feng & Xuming He & Jianhua Hu, 2011. "Wild bootstrap for quantile regression," Biometrika, Biometrika Trust, vol. 98(4), pages 995-999.
    30. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    31. James J. Heckman & Vytlacil, Edward J., 2007. "Econometric Evaluation of Social Programs, Part I: Causal Models, Structural Models and Econometric Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 70, Elsevier.
    32. Sergio Firpo & Nicole M. Fortin & Thomas Lemieux, 2009. "Unconditional Quantile Regressions," Econometrica, Econometric Society, vol. 77(3), pages 953-973, May.
    33. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    34. Cameron,A. Colin & Trivedi,Pravin K., 2005. "Microeconometrics," Cambridge Books, Cambridge University Press, number 9780521848053.
    35. Thomas Lemieux, 2006. "Increasing Residual Wage Inequality: Composition Effects, Noisy Data, or Rising Demand for Skill?," American Economic Review, American Economic Association, vol. 96(3), pages 461-498, June.
    36. Han, Aaron & Hausman, Jerry A, 1990. "Flexible Parametric Estimation of Duration and Competing Risk Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(1), pages 1-28, January-M.
    37. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    38. Alan S. Blinder, 1973. "Wage Discrimination: Reduced Form and Structural Estimates," Journal of Human Resources, University of Wisconsin Press, vol. 8(4), pages 436-455.
    39. Russell Davidson & Jean-Yves Duclos, 2000. "Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality," Econometrica, Econometric Society, vol. 68(6), pages 1435-1464, November.
    40. Rolf Aaberge & Steinar Bjerve & Kjell Doksum, 2005. "Decomposition of rank-dependent measures of inequality by subgroups," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(3), pages 493-503.
    41. José Mata & José A. F. Machado, 2005. "Counterfactual decomposition of changes in wage distributions using quantile regression," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(4), pages 445-465.
    42. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444590.
    43. Barnett,William A. & Powell,James & Tauchen,George E. (ed.), 1991. "Nonparametric and Semiparametric Methods in Econometrics and Statistics," Cambridge Books, Cambridge University Press, number 9780521370905.
    44. Barrett, Garry F. & Donald, Stephen G., 2009. "Statistical Inference with Generalized Gini Indices of Inequality, Poverty, and Welfare," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 1-17.
    45. Amanda Gosling & Stephen Machin & Costas Meghir, 2000. "The Changing Distribution of Male Wages in the U.K," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(4), pages 635-666.
    46. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    47. Andrew Chesher, 2003. "Identification in Nonseparable Models," Econometrica, Econometric Society, vol. 71(5), pages 1405-1441, September.
    48. Foresi, S. & Paracchi, F., 1992. "The Conditional Distribution of Excess Returns: An Empirical Analysis," Working Papers 92-49, C.V. Starr Center for Applied Economics, New York University.
    49. Hall, Peter & Wolff, Rodney C. L. & Yao, Qiwei, 1999. "Methods for estimating a conditional distribution function," LSE Research Online Documents on Economics 6631, London School of Economics and Political Science, LSE Library.
    50. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    51. de Jong, Robert M. & Davidson, James, 2000. "The Functional Central Limit Theorem And Weak Convergence To Stochastic Integrals I," Econometric Theory, Cambridge University Press, vol. 16(5), pages 621-642, October.
    52. repec:hal:wpspec:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    53. Abbring, Jaap H. & Heckman, James J., 2007. "Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 72, Elsevier.
    54. Albrecht, James & van Vuuren, Aico & Vroman, Susan, 2009. "Counterfactual distributions with sample selection adjustments: Econometric theory and an application to the Netherlands," Labour Economics, Elsevier, vol. 16(4), pages 383-396, August.
    55. David H. Autor & Lawrence F. Katz & Melissa S. Kearney, 2008. "Trends in U.S. Wage Inequality: Revising the Revisionists," The Review of Economics and Statistics, MIT Press, vol. 90(2), pages 300-323, May.
    56. Bhattacharya, Debopam, 2007. "Inference on inequality from household survey data," Journal of Econometrics, Elsevier, vol. 137(2), pages 674-707, April.
    57. Buchinsky, Moshe, 1994. "Changes in the U.S. Wage Structure 1963-1987: Application of Quantile Regression," Econometrica, Econometric Society, vol. 62(2), pages 405-458, March.
    58. Powell, James L., 1986. "Censored regression quantiles," Journal of Econometrics, Elsevier, vol. 32(1), pages 143-155, June.
    59. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, January.
    60. Barnett,William A. & Powell,James & Tauchen,George E. (ed.), 1991. "Nonparametric and Semiparametric Methods in Econometrics and Statistics," Cambridge Books, Cambridge University Press, number 9780521424318.
    61. Juhn, Chinhui & Murphy, Kevin M & Pierce, Brooks, 1993. "Wage Inequality and the Rise in Returns to Skill," Journal of Political Economy, University of Chicago Press, vol. 101(3), pages 410-442, June.
    62. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    63. Joshua Angrist & Victor Chernozhukov & Iván Fernández-Val, 2006. "Quantile Regression under Misspecification, with an Application to the U.S. Wage Structure," Econometrica, Econometric Society, vol. 74(2), pages 539-563, March.
    64. repec:hal:spmain:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    65. Hahn, Jinyong, 1995. "Bootstrapping Quantile Regression Estimators," Econometric Theory, Cambridge University Press, vol. 11(1), pages 105-121, February.
    66. Alberto Abadie, 1997. "Changes in Spanish labor income structure during the 1980's: a quantile regression aproach," Investigaciones Economicas, Fundación SEPI, vol. 21(2), pages 253-272, May.
    67. Roger Koenker & Zhijie Xiao, 2002. "Inference on the Quantile Regression Process," Econometrica, Econometric Society, vol. 70(4), pages 1583-1612, July.
    68. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    69. Rothe, Christoph, 2010. "Nonparametric estimation of distributional policy effects," Journal of Econometrics, Elsevier, vol. 155(1), pages 56-70, March.
    70. Andrews, Donald W K, 1988. "Chi-Square Diagnostic Tests for Econometric Models: Theory," Econometrica, Econometric Society, vol. 56(6), pages 1419-1453, November.
    71. Chernozhukov, Victor & Hansen, Christian, 2006. "Instrumental quantile regression inference for structural and treatment effect models," Journal of Econometrics, Elsevier, vol. 132(2), pages 491-525, June.
    72. Victor Chernozhukov & Ivan Fernandez-Val & Alfred Galichon, 2007. "Quantile and probability curves without crossing," CeMMAP working papers CWP10/07, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    73. Hong H. & Chernozhukov V., 2002. "Three-Step Censored Quantile Regression and Extramarital Affairs," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 872-882, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fortin, Nicole & Lemieux, Thomas & Firpo, Sergio, 2011. "Decomposition Methods in Economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 1, pages 1-102, Elsevier.
    2. Ghosh, Pallab Kumar, 2014. "The contribution of human capital variables to changes in the wage distribution function," Labour Economics, Elsevier, vol. 28(C), pages 58-69.
    3. Manuel Arellano & Stéphane Bonhomme, 2017. "Quantile Selection Models With an Application to Understanding Changes in Wage Inequality," Econometrica, Econometric Society, vol. 85, pages 1-28, January.
    4. Sergio P. Firpo & Nicole M. Fortin & Thomas Lemieux, 2018. "Decomposing Wage Distributions Using Recentered Influence Function Regressions," Econometrics, MDPI, vol. 6(2), pages 1-40, May.
    5. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    6. Christoph Rothe, 2012. "Partial Distributional Policy Effects," Econometrica, Econometric Society, vol. 80(5), pages 2269-2301, September.
    7. Pereda-Fernández, Santiago, 2023. "Identification and estimation of triangular models with a binary treatment," Journal of Econometrics, Elsevier, vol. 234(2), pages 585-623.
    8. Chernozhukov, Victor & Fernández-Val, Iván & Kowalski, Amanda E., 2015. "Quantile regression with censoring and endogeneity," Journal of Econometrics, Elsevier, vol. 186(1), pages 201-221.
    9. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    10. Rothe, Christoph, 2010. "Nonparametric estimation of distributional policy effects," Journal of Econometrics, Elsevier, vol. 155(1), pages 56-70, March.
    11. Philippe Van Kerm & Seunghee Yu & Chung Choe, 2016. "Decomposing quantile wage gaps: a conditional likelihood approach," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 65(4), pages 507-527, August.
    12. Sergio Firpo & Cristine Pinto, 2016. "Identification and Estimation of Distributional Impacts of Interventions Using Changes in Inequality Measures," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 457-486, April.
    13. Martinez-Sanchis, Elena & Mora, Juan & Kandemir, Ilker, 2012. "Counterfactual distributions of wages via quantile regression with endogeneity," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3212-3229.
    14. Brantly Callaway & Weige Huang, 2020. "Distributional Effects of a Continuous Treatment with an Application on Intergenerational Mobility," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(4), pages 808-842, August.
    15. Verdugo, G. & Fraisse, H. & Horny, G., 2012. "Changes In Wage Inequality In France: The Impact Of Composition Effects (in French)," Working papers 370, Banque de France.
    16. Victor Chernozhukov & Iván Fernández‐Val & Whitney Newey & Sami Stouli & Francis Vella, 2020. "Semiparametric estimation of structural functions in nonseparable triangular models," Quantitative Economics, Econometric Society, vol. 11(2), pages 503-533, May.
    17. Halbert White & Karim Chalak, 2013. "Identification and Identification Failure for Treatment Effects Using Structural Systems," Econometric Reviews, Taylor & Francis Journals, vol. 32(3), pages 273-317, November.
    18. Sonja C. Kassenboehmer & Mathias G. Sinning, 2014. "Distributional Changes in the Gender Wage Gap," ILR Review, Cornell University, ILR School, vol. 67(2), pages 335-361, April.
    19. Richard Blundell & Amanda Gosling & Hidehiko Ichimura & Costas Meghir, 2007. "Changes in the Distribution of Male and Female Wages Accounting for Employment Composition Using Bounds," Econometrica, Econometric Society, vol. 75(2), pages 323-363, March.
    20. Victor Chernozhukov & Christian Hansen & Kaspar Wuthrich, 2020. "Instrumental Variable Quantile Regression," Papers 2009.00436, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:17/13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.