IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1512.05635.html
   My bibliography  Save this paper

The Sorted Effects Method: Discovering Heterogeneous Effects Beyond Their Averages

Author

Listed:
  • Victor Chernozhukov
  • Ivan Fernandez-Val
  • Ye Luo

Abstract

The partial (ceteris paribus) effects of interest in nonlinear and interactive linear models are heterogeneous as they can vary dramatically with the underlying observed or unobserved covariates. Despite the apparent importance of heterogeneity, a common practice in modern empirical work is to largely ignore it by reporting average partial effects (or, at best, average effects for some groups). While average effects provide very convenient scalar summaries of typical effects, by definition they fail to reflect the entire variety of the heterogeneous effects. In order to discover these effects much more fully, we propose to estimate and report sorted effects -- a collection of estimated partial effects sorted in increasing order and indexed by percentiles. By construction the sorted effect curves completely represent and help visualize the range of the heterogeneous effects in one plot. They are as convenient and easy to report in practice as the conventional average partial effects. They also serve as a basis for classification analysis, where we divide the observational units into most or least affected groups and summarize their characteristics. We provide a quantification of uncertainty (standard errors and confidence bands) for the estimated sorted effects and related classification analysis, and provide confidence sets for the most and least affected groups. The derived statistical results rely on establishing key, new mathematical results on Hadamard differentiability of a multivariate sorting operator and a related classification operator, which are of independent interest. We apply the sorted effects method and classification analysis to demonstrate several striking patterns in the gender wage gap.

Suggested Citation

  • Victor Chernozhukov & Ivan Fernandez-Val & Ye Luo, 2015. "The Sorted Effects Method: Discovering Heterogeneous Effects Beyond Their Averages," Papers 1512.05635, arXiv.org, revised May 2018.
  • Handle: RePEc:arx:papers:1512.05635
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1512.05635
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. V. Chernozhukov & I. Fernández-Val & A. Galichon, 2009. "Improving point and interval estimators of monotone functions by rearrangement," Biometrika, Biometrika Trust, vol. 96(3), pages 559-575.
    2. Chernozhukov, Victor & Fernández-Val, Iván & Hoderlein, Stefan & Holzmann, Hajo & Newey, Whitney, 2015. "Nonparametric identification in panels using quantiles," Journal of Econometrics, Elsevier, vol. 188(2), pages 378-392.
    3. Francine D. Blau & Lawrence M. Kahn, 2017. "The Gender Wage Gap: Extent, Trends, and Explanations," Journal of Economic Literature, American Economic Association, vol. 55(3), pages 789-865, September.
    4. Oaxaca, Ronald, 1973. "Male-Female Wage Differentials in Urban Labor Markets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 14(3), pages 693-709, October.
    5. Victor Chernozhukov & Iv·n Fern·ndez-Val & Alfred Galichon, 2010. "Quantile and Probability Curves Without Crossing," Econometrica, Econometric Society, vol. 78(3), pages 1093-1125, May.
    6. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731.
    7. Munnell, Alicia H. & Geoffrey M. B. Tootell & Lynn E. Browne & James McEneaney, 1996. "Mortgage Lending in Boston: Interpreting HMDA Data," American Economic Review, American Economic Association, vol. 86(1), pages 25-53, March.
    8. Sasaki, Yuya, 2015. "What Do Quantile Regressions Identify For General Structural Functions?," Econometric Theory, Cambridge University Press, vol. 31(5), pages 1102-1116, October.
    9. Joseph P. Romano & Azeem M. Shaikh, 2010. "Inference for the Identified Set in Partially Identified Econometric Models," Econometrica, Econometric Society, vol. 78(1), pages 169-211, January.
    10. repec:hal:wpspec:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    11. James Albrecht & Anders Bjorklund & Susan Vroman, 2003. "Is There a Glass Ceiling in Sweden?," Journal of Labor Economics, University of Chicago Press, vol. 21(1), pages 145-177, January.
    12. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    13. repec:hal:spmain:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    14. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, April.
    15. Victor Chernozhukov & Iván Fernández‐Val & Ye Luo, 2018. "The Sorted Effects Method: Discovering Heterogeneous Effects Beyond Their Averages," Econometrica, Econometric Society, vol. 86(6), pages 1911-1938, November.
    16. Jerry A. Hausman & Whitney K. Newey, 2017. "Nonparametric Welfare Analysis," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 521-546, September.
    17. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, September.
    18. Bhattacharya, Debopam & Dupas, Pascaline, 2012. "Inferring welfare maximizing treatment assignment under budget constraints," Journal of Econometrics, Elsevier, vol. 167(1), pages 168-196.
    19. Romano, Joseph P. & Wolf, Michael, 2016. "Efficient computation of adjusted p-values for resampling-based stepdown multiple testing," Statistics & Probability Letters, Elsevier, vol. 113(C), pages 38-40.
    20. Casey B. Mulligan & Yona Rubinstein, 2008. "Selection, Investment, and Women's Relative Wages Over Time," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(3), pages 1061-1110.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabriel Montes-Rojas & Lucas Siga & Ram Mainali, 2017. "Mean and quantile regression Oaxaca-Blinder decompositions with an application to caste discrimination," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 15(3), pages 245-255, September.
    2. Victor Chernozhukov & Mert Demirer & Esther Duflo & Ivan Fernandez-Val, 2017. "Generic machine learning inference on heterogenous treatment effects in randomized experiments," CeMMAP working papers 61/17, Institute for Fiscal Studies.
    3. Maasoumi, Esfandiar & Wang, Le, 2017. "What can we learn about the racial gap in the presence of sample selection?," Journal of Econometrics, Elsevier, vol. 199(2), pages 117-130.
    4. Gail Pacheco & Bill Cochrane, 2015. "Decomposing the temporary-permanent wage gap in New Zealand," Working Papers 2015-07, Auckland University of Technology, Department of Economics.
    5. Victor Chernozhukov & Iván Fernández‐Val & Blaise Melly, 2013. "Inference on Counterfactual Distributions," Econometrica, Econometric Society, vol. 81(6), pages 2205-2268, November.
    6. Chernozhukov, Victor & Fernández-Val, Iván & Newey, Whitney K., 2019. "Nonseparable multinomial choice models in cross-section and panel data," Journal of Econometrics, Elsevier, vol. 211(1), pages 104-116.
    7. Sonja C. Kassenboehmer & Mathias G. Sinning, 2014. "Distributional Changes in the Gender Wage Gap," ILR Review, Cornell University, ILR School, vol. 67(2), pages 335-361, April.
    8. Kaya, Ezgi, 2019. "Gender wage gap across the quantiles:What is the role of firm segregation?," Cardiff Economics Working Papers E2019/7, Cardiff University, Cardiff Business School, Economics Section.
    9. Gevrek, Z. Eylem & Seiberlich, Ruben R., 2014. "Semiparametric decomposition of the gender achievement gap: An application for Turkey," Labour Economics, Elsevier, vol. 31(C), pages 27-44.
    10. Neugart, Michael & Zaharieva, Anna, 2018. "Social Networks, Promotions, and the Glass-Ceiling Effect," Center for Mathematical Economics Working Papers 601, Center for Mathematical Economics, Bielefeld University.
    11. Picchio, Matteo & Mussida, Chiara, 2011. "Gender wage gap: A semi-parametric approach with sample selection correction," Labour Economics, Elsevier, vol. 18(5), pages 564-578, October.
    12. Bedaso, Fenet Jima, 2024. "Occupational Segregation and the Gender Wage Gap: Evidence from Ethiopia," GLO Discussion Paper Series 1393, Global Labor Organization (GLO).
    13. Niels-Hugo Blunch, 2018. "Just like a woman? New comparative evidence on the gender income gap across Eastern Europe and Central Asia," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-41, December.
    14. Davide Viviano & Kaspar Wuthrich & Paul Niehaus, 2021. "A model of multiple hypothesis testing," Papers 2104.13367, arXiv.org, revised Apr 2024.
    15. Kaya Ezgi, 2021. "Gender wage gap across the distribution: What is the role of within- and between-firm effects?," IZA Journal of Development and Migration, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 12(1), pages 1-49, January.
    16. Hunt, Priscillia, 2008. "Are immigrants so stuck to the floor that the ceiling is irrelevant?," Economic Research Papers 269787, University of Warwick - Department of Economics.
    17. Matthias Westphal & Daniel A Kamhöfer & Hendrik Schmitz, 2022. "Marginal College Wage Premiums Under Selection Into Employment," The Economic Journal, Royal Economic Society, vol. 132(646), pages 2231-2272.
    18. Chernozhukov, Victor & Fernández-Val, Iván & Kowalski, Amanda E., 2015. "Quantile regression with censoring and endogeneity," Journal of Econometrics, Elsevier, vol. 186(1), pages 201-221.
    19. Jones, Melanie K. & Kaya, Ezgi, 2021. "The Gender Pay Gap in UK Medicine," IZA Discussion Papers 14177, Institute of Labor Economics (IZA).
    20. Manuel Arellano & Stéphane Bonhomme, 2016. "Nonlinear panel data estimation via quantile regressions," Econometrics Journal, Royal Economic Society, vol. 19(3), pages 61-94, October.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1512.05635. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.