IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/05-12.html
   My bibliography  Save this paper

Inference on counterfactual distributions

Author

Listed:
  • Victor Chernozhukov

    (Institute for Fiscal Studies and MIT)

  • Ivan Fernandez-Val

    (Institute for Fiscal Studies and Boston University)

  • Blaise Melly

    (Institute for Fiscal Studies)

Abstract

We develop inference procedures for policy analysis based on regression methods. We consider policy interventions that correspond to either changes in the distribution of covariates, or changes in the conditional distribution of the outcome given covariates, or both. Under either of these policy scenarios, we derive functional central limit theorems for regression-based estimators of the status quo and counterfactual marginal distributions. This result allows us to construct simultaneous con?dence sets for function-valued policy e?ects, including the e?ects on the marginal distribution function, quantile function, and other related functionals. We use these con?dence sets to test functional hypotheses such as no-e?ect, positive e?ect, or stochastic dominance. Our theory applies to general policy interventions and covers the main regression methods including classical, quantile, duration, and distribution regressions. We illustrate the results with an empirical application on wage decompositions using data for the United States. Of independent interest is the use of distribution regression as a tool for modeling the entire conditional distribution, encompassing duration/transformation regression, and representing an alternative to quantile regression. This is a revision of CWP09/09.

Suggested Citation

  • Victor Chernozhukov & Ivan Fernandez-Val & Blaise Melly, 2012. "Inference on counterfactual distributions," CeMMAP working papers CWP05/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:05/12
    as

    Download full text from publisher

    File URL: http://cemmap.ifs.org.uk/wps/cwp051212.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2009. "Dealing with limited overlap in estimation of average treatment effects," Biometrika, Biometrika Trust, vol. 96(1), pages 187-199.
    2. Linton, Oliver & Song, Kyungchul & Whang, Yoon-Jae, 2010. "An improved bootstrap test of stochastic dominance," Journal of Econometrics, Elsevier, vol. 154(2), pages 186-202, February.
    3. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    4. Sergio Firpo, 2007. "Efficient Semiparametric Estimation of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 75(1), pages 259-276, January.
    5. DiNardo, John & Fortin, Nicole M & Lemieux, Thomas, 1996. "Labor Market Institutions and the Distribution of Wages, 1973-1992: A Semiparametric Approach," Econometrica, Econometric Society, vol. 64(5), pages 1001-1044, September.
    6. V. Chernozhukov & I. Fernández-Val & A. Galichon, 2009. "Improving point and interval estimators of monotone functions by rearrangement," Biometrika, Biometrika Trust, vol. 96(3), pages 559-575.
    7. Maier, Michael, 2011. "Tests for distributional treatment effects under unconfoundedness," Economics Letters, Elsevier, vol. 110(1), pages 49-51, January.
    8. Guido W. Imbens & Whitney K. Newey, 2009. "Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity," Econometrica, Econometric Society, vol. 77(5), pages 1481-1512, September.
    9. Christoph Rothe, 2012. "Partial Distributional Policy Effects," Econometrica, Econometric Society, vol. 80(5), pages 2269-2301, September.
    10. Chernozhukov, Victor & Fernández-Val, Iván & Kowalski, Amanda E., 2015. "Quantile regression with censoring and endogeneity," Journal of Econometrics, Elsevier, vol. 186(1), pages 201-221.
    11. Alberto Abadie & Joshua Angrist & Guido Imbens, 2002. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Econometrica, Econometric Society, vol. 70(1), pages 91-117, January.
    12. Patrick Kline & Andres Santos, 2013. "Sensitivity to missing data assumptions: Theory and an evaluation of the U.S. wage structure," Quantitative Economics, Econometric Society, vol. 4(2), pages 231-267, July.
    13. James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, May.
    14. Christoph Rothe & Dominik Wied, 2013. "Misspecification Testing in a Class of Conditional Distributional Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(501), pages 314-324, March.
    15. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444606, December.
    16. Hahn, Jinyong, 1997. "Bayesian Bootstrap of the Quantile Regression Estimator: A Large Sample Study," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 38(4), pages 795-808, November.
    17. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    18. James J. Heckman & Jeffrey Smith & Nancy Clements, 1997. "Making The Most Out Of Programme Evaluations and Social Experiments: Accounting For Heterogeneity in Programme Impacts," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 487-535.
    19. Radulovic, Dragan & Wegkamp, Marten, 2003. "Necessary and sufficient conditions for weak convergence of smoothed empirical processes," Statistics & Probability Letters, Elsevier, vol. 61(3), pages 321-336, February.
    20. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    21. Fortin, Nicole & Lemieux, Thomas & Firpo, Sergio, 2011. "Decomposition Methods in Economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 1, pages 1-102, Elsevier.
    22. Sokbae Lee & Oliver Linton & Yoon-Jae Whang, 2009. "Testing for Stochastic Monotonicity," Econometrica, Econometric Society, vol. 77(2), pages 585-602, March.
    23. Oaxaca, Ronald, 1973. "Male-Female Wage Differentials in Urban Labor Markets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 14(3), pages 693-709, October.
    24. Stephen G. Donald & David A. Green & Harry J. Paarsch, 2000. "Differences in Wage Distributions Between Canada and the United States: An Application of a Flexible Estimator of Distribution Functions in the Presence of Covariates," Review of Economic Studies, Oxford University Press, vol. 67(4), pages 609-633.
    25. David H. Autor & Lawrence F. Katz & Melissa S. Kearney, 2006. "The Polarization of the U.S. Labor Market," American Economic Review, American Economic Association, vol. 96(2), pages 189-194, May.
    26. Victor Chernozhukov & Iv·n Fern·ndez-Val & Alfred Galichon, 2010. "Quantile and Probability Curves Without Crossing," Econometrica, Econometric Society, vol. 78(3), pages 1093-1125, May.
    27. Chen, Xiaohong & Pouzo, Demian, 2009. "Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals," Journal of Econometrics, Elsevier, vol. 152(1), pages 46-60, September.
    28. Koenker, Roger & Yoon, Jungmo, 2009. "Parametric links for binary choice models: A Fisherian-Bayesian colloquy," Journal of Econometrics, Elsevier, vol. 152(2), pages 120-130, October.
    29. Xingdong Feng & Xuming He & Jianhua Hu, 2011. "Wild bootstrap for quantile regression," Biometrika, Biometrika Trust, vol. 98(4), pages 995-999.
    30. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    31. James J. Heckman & Vytlacil, Edward J., 2007. "Econometric Evaluation of Social Programs, Part I: Causal Models, Structural Models and Econometric Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 70, Elsevier.
    32. Sergio Firpo & Nicole M. Fortin & Thomas Lemieux, 2009. "Unconditional Quantile Regressions," Econometrica, Econometric Society, vol. 77(3), pages 953-973, May.
    33. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    34. Cameron,A. Colin & Trivedi,Pravin K., 2005. "Microeconometrics," Cambridge Books, Cambridge University Press, number 9780521848053, December.
    35. Thomas Lemieux, 2006. "Increasing Residual Wage Inequality: Composition Effects, Noisy Data, or Rising Demand for Skill?," American Economic Review, American Economic Association, vol. 96(3), pages 461-498, June.
    36. Han, Aaron & Hausman, Jerry A, 1990. "Flexible Parametric Estimation of Duration and Competing Risk Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 5(1), pages 1-28, January-M.
    37. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    38. Alan S. Blinder, 1973. "Wage Discrimination: Reduced Form and Structural Estimates," Journal of Human Resources, University of Wisconsin Press, vol. 8(4), pages 436-455.
    39. Russell Davidson & Jean-Yves Duclos, 2000. "Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality," Econometrica, Econometric Society, vol. 68(6), pages 1435-1464, November.
    40. Rolf Aaberge & Steinar Bjerve & Kjell Doksum, 2005. "Decomposition of rank-dependent measures of inequality by subgroups," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(3), pages 493-503.
    41. José Mata & José A. F. Machado, 2005. "Counterfactual decomposition of changes in wage distributions using quantile regression," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(4), pages 445-465.
    42. Sims,Christopher A. (ed.), 1994. "Advances in Econometrics," Cambridge Books, Cambridge University Press, number 9780521444590, December.
    43. Barnett,William A. & Powell,James & Tauchen,George E. (ed.), 1991. "Nonparametric and Semiparametric Methods in Econometrics and Statistics," Cambridge Books, Cambridge University Press, number 9780521370905, December.
    44. Barrett, Garry F. & Donald, Stephen G., 2009. "Statistical Inference with Generalized Gini Indices of Inequality, Poverty, and Welfare," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 1-17.
    45. Amanda Gosling & Stephen Machin & Costas Meghir, 2000. "The Changing Distribution of Male Wages in the U.K," Review of Economic Studies, Oxford University Press, vol. 67(4), pages 635-666.
    46. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    47. Andrew Chesher, 2003. "Identification in Nonseparable Models," Econometrica, Econometric Society, vol. 71(5), pages 1405-1441, September.
    48. Foresi, S. & Paracchi, F., 1992. "The Conditional Distribution of Excess Returns: An Empirical Analysis," Working Papers 92-49, C.V. Starr Center for Applied Economics, New York University.
    49. Hall, Peter & Wolff, Rodney C. L. & Yao, Qiwei, 1999. "Methods for estimating a conditional distribution function," LSE Research Online Documents on Economics 6631, London School of Economics and Political Science, LSE Library.
    50. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    51. de Jong, Robert M. & Davidson, James, 2000. "The Functional Central Limit Theorem And Weak Convergence To Stochastic Integrals I," Econometric Theory, Cambridge University Press, vol. 16(5), pages 621-642, October.
    52. repec:hal:wpspec:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    53. Abbring, Jaap H. & Heckman, James J., 2007. "Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 72, Elsevier.
    54. Albrecht, James & van Vuuren, Aico & Vroman, Susan, 2009. "Counterfactual distributions with sample selection adjustments: Econometric theory and an application to the Netherlands," Labour Economics, Elsevier, vol. 16(4), pages 383-396, August.
    55. David H. Autor & Lawrence F. Katz & Melissa S. Kearney, 2008. "Trends in U.S. Wage Inequality: Revising the Revisionists," The Review of Economics and Statistics, MIT Press, vol. 90(2), pages 300-323, May.
    56. Bhattacharya, Debopam, 2007. "Inference on inequality from household survey data," Journal of Econometrics, Elsevier, vol. 137(2), pages 674-707, April.
    57. Buchinsky, Moshe, 1994. "Changes in the U.S. Wage Structure 1963-1987: Application of Quantile Regression," Econometrica, Econometric Society, vol. 62(2), pages 405-458, March.
    58. Powell, James L., 1986. "Censored regression quantiles," Journal of Econometrics, Elsevier, vol. 32(1), pages 143-155, June.
    59. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, January.
    60. Barnett,William A. & Powell,James & Tauchen,George E. (ed.), 1991. "Nonparametric and Semiparametric Methods in Econometrics and Statistics," Cambridge Books, Cambridge University Press, number 9780521424318, December.
    61. Juhn, Chinhui & Murphy, Kevin M & Pierce, Brooks, 1993. "Wage Inequality and the Rise in Returns to Skill," Journal of Political Economy, University of Chicago Press, vol. 101(3), pages 410-442, June.
    62. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    63. Joshua Angrist & Victor Chernozhukov & Iván Fernández-Val, 2006. "Quantile Regression under Misspecification, with an Application to the U.S. Wage Structure," Econometrica, Econometric Society, vol. 74(2), pages 539-563, March.
    64. repec:hal:spmain:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    65. Hahn, Jinyong, 1995. "Bootstrapping Quantile Regression Estimators," Econometric Theory, Cambridge University Press, vol. 11(1), pages 105-121, February.
    66. Alberto Abadie, 1997. "Changes in Spanish labor income structure during the 1980's: a quantile regression aproach," Investigaciones Economicas, Fundación SEPI, vol. 21(2), pages 253-272, May.
    67. Roger Koenker & Zhijie Xiao, 2002. "Inference on the Quantile Regression Process," Econometrica, Econometric Society, vol. 70(4), pages 1583-1612, July.
    68. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    69. Rothe, Christoph, 2010. "Nonparametric estimation of distributional policy effects," Journal of Econometrics, Elsevier, vol. 155(1), pages 56-70, March.
    70. Andrews, Donald W K, 1988. "Chi-Square Diagnostic Tests for Econometric Models: Theory," Econometrica, Econometric Society, vol. 56(6), pages 1419-1453, November.
    71. Chernozhukov, Victor & Hansen, Christian, 2006. "Instrumental quantile regression inference for structural and treatment effect models," Journal of Econometrics, Elsevier, vol. 132(2), pages 491-525, June.
    72. Hong H. & Chernozhukov V., 2002. "Three-Step Censored Quantile Regression and Extramarital Affairs," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 872-882, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fortin, Nicole & Lemieux, Thomas & Firpo, Sergio, 2011. "Decomposition Methods in Economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 1, pages 1-102, Elsevier.
    2. Ghosh, Pallab Kumar, 2014. "The contribution of human capital variables to changes in the wage distribution function," Labour Economics, Elsevier, vol. 28(C), pages 58-69.
    3. Manuel Arellano & Stéphane Bonhomme, 2017. "Quantile Selection Models With an Application to Understanding Changes in Wage Inequality," Econometrica, Econometric Society, vol. 85, pages 1-28, January.
    4. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    5. Sergio P. Firpo & Nicole M. Fortin & Thomas Lemieux, 2018. "Decomposing Wage Distributions Using Recentered Influence Function Regressions," Econometrics, MDPI, vol. 6(2), pages 1-40, May.
    6. Christoph Rothe, 2012. "Partial Distributional Policy Effects," Econometrica, Econometric Society, vol. 80(5), pages 2269-2301, September.
    7. Chernozhukov, Victor & Fernández-Val, Iván & Kowalski, Amanda E., 2015. "Quantile regression with censoring and endogeneity," Journal of Econometrics, Elsevier, vol. 186(1), pages 201-221.
    8. Philippe Van Kerm & Seunghee Yu & Chung Choe, 2016. "Decomposing quantile wage gaps: a conditional likelihood approach," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 65(4), pages 507-527, August.
    9. Sergio Firpo & Cristine Pinto, 2016. "Identification and Estimation of Distributional Impacts of Interventions Using Changes in Inequality Measures," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 457-486, April.
    10. Sokbae Lee & Yoon-Jae Whang, 2009. "Nonparametric Tests of Conditional Treatment Effects," Cowles Foundation Discussion Papers 1740, Cowles Foundation for Research in Economics, Yale University.
    11. Martinez-Sanchis, Elena & Mora, Juan & Kandemir, Ilker, 2012. "Counterfactual distributions of wages via quantile regression with endogeneity," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3212-3229.
    12. Rothe, Christoph, 2010. "Nonparametric estimation of distributional policy effects," Journal of Econometrics, Elsevier, vol. 155(1), pages 56-70, March.
    13. Brantly Callaway & Weige Huang, 2020. "Distributional Effects of a Continuous Treatment with an Application on Intergenerational Mobility," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(4), pages 808-842, August.
    14. Halbert White & Karim Chalak, 2013. "Identification and Identification Failure for Treatment Effects Using Structural Systems," Econometric Reviews, Taylor & Francis Journals, vol. 32(3), pages 273-317, November.
    15. Sonja C. Kassenboehmer & Mathias G. Sinning, 2014. "Distributional Changes in the Gender Wage Gap," ILR Review, Cornell University, ILR School, vol. 67(2), pages 335-361, April.
    16. Pallab Ghosh & Jae Lee, 2016. "Decomposition of Changes in Korean Wage Inequality, 1998–2007," Journal of Labor Research, Springer, vol. 37(1), pages 1-28, March.
    17. Donald, Stephen G. & Hsu, Yu-Chin, 2014. "Estimation and inference for distribution functions and quantile functions in treatment effect models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 383-397.
    18. Richard Blundell & Amanda Gosling & Hidehiko Ichimura & Costas Meghir, 2007. "Changes in the Distribution of Male and Female Wages Accounting for Employment Composition Using Bounds," Econometrica, Econometric Society, vol. 75(2), pages 323-363, March.
    19. Victor Chernozhukov & Iv·n Fern·ndez-Val & Alfred Galichon, 2010. "Quantile and Probability Curves Without Crossing," Econometrica, Econometric Society, vol. 78(3), pages 1093-1125, May.
    20. Victor Chernozhukov & Iv·n Fern·ndez-Val & Alfred Galichon, 2010. "Quantile and Probability Curves Without Crossing," Econometrica, Econometric Society, vol. 78(3), pages 1093-1125, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:05/12. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.