IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/37-16.html
   My bibliography  Save this paper

hdm: High-Dimensional Metrics

Author

Listed:
  • Victor Chernozhukov

    (Institute for Fiscal Studies and MIT)

  • Christian Hansen

    (Institute for Fiscal Studies and Chicago GSB)

  • Martin Spindler

    (Institute for Fiscal Studies)

Abstract

In this article the package High-dimensional Metrics (hdm) is introduced. It is a collection of statistical methods for estimation and quantification of uncertainty in high-dimensional approximately sparse models. It focuses on providing confidence intervals and significance testing for (possibly many) low-dimensional subcomponents of the high-dimensional parameter vector. Efficient estimators and uniformly valid confidence intervals for regression coefficients on target variables (e.g., treatment or policy variable) in a high-dimensional approximately sparse regression model, for average treatment effect (ATE) and average treatment effect for the treated (ATET), as well for extensions of these parameters to the endogenous setting are provided. Theory grounded, data-driven methods for selecting the penalization parameter in Lasso regressions under heteroscedastic and non-Gaussian errors are implemented. Moreover, joint/ simultaneous confidence intervals for regression coefficients of a high-dimensional sparse regression are implemented. Data sets which have been used in the literature and might be useful for classroom demonstration and for testing new estimators are included.

Suggested Citation

  • Victor Chernozhukov & Christian Hansen & Martin Spindler, 2016. "hdm: High-Dimensional Metrics," CeMMAP working papers CWP37/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:37/16
    as

    Download full text from publisher

    File URL: https://www.ifs.org.uk/uploads/cemmap/wps/CWP371616.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2012. "Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors," Papers 1212.6906, arXiv.org, revised Jan 2018.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Edward I. Altman & Marco Balzano & Alessandro Giannozzi & Stjepan Srhoj, 2023. "Revisiting SME default predictors: The Omega Score," Journal of Small Business Management, Taylor & Francis Journals, vol. 61(6), pages 2383-2417, November.
    2. A. Belloni & V. Chernozhukov & I. Fernández‐Val & C. Hansen, 2017. "Program Evaluation and Causal Inference With High‐Dimensional Data," Econometrica, Econometric Society, vol. 85, pages 233-298, January.
    3. Elena Denisova-Schmidt & Martin Huber & Elvira Leontyeva & Anna Solovyeva, 2021. "Combining experimental evidence with machine learning to assess anti-corruption educational campaigns among Russian university students," Empirical Economics, Springer, vol. 60(4), pages 1661-1684, April.
    4. Pawel Dlotko & Simon Rudkin & Wanling Qiu, 2019. "Topologically Mapping the Macroeconomy," Papers 1911.10476, arXiv.org.
    5. Daniels, David P. & Zlatev, Julian J., 2019. "Choice architects reveal a bias toward positivity and certainty," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 132-149.
    6. Imhof, David & Wallimann, Hannes, 2021. "Detecting bid-rigging coalitions in different countries and auction formats," International Review of Law and Economics, Elsevier, vol. 68(C).
    7. Godzinski, Alexandre & Suarez Castillo, Milena, 2021. "Disentangling the effects of air pollutants with many instruments," Journal of Environmental Economics and Management, Elsevier, vol. 109(C).
    8. Marica Valente & Timm Gries & Lorenzo Trapani, 2023. "Informal employment from migration shocks," Working Papers 2023-09, Faculty of Economics and Statistics, Universität Innsbruck.
    9. Wallimann, Hannes & Imhof, David & Huber, Martin, 2020. "A Machine Learning Approach for Flagging Incomplete Bid-rigging Cartels," FSES Working Papers 513, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    10. Huber, Martin & Imhof, David, 2019. "Machine learning with screens for detecting bid-rigging cartels," International Journal of Industrial Organization, Elsevier, vol. 65(C), pages 277-301.
    11. Ismael Mourifié, 2019. "A marriage matching function with flexible spillover and substitution patterns," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 67(2), pages 421-461, March.
    12. Hannes Wallimann & David Imhof & Martin Huber, 2023. "A Machine Learning Approach for Flagging Incomplete Bid-Rigging Cartels," Computational Economics, Springer;Society for Computational Economics, vol. 62(4), pages 1669-1720, December.
    13. Philipp Bach & Victor Chernozhukov & Martin Spindler, 2018. "Valid Simultaneous Inference in High-Dimensional Settings (with the hdm package for R)," Papers 1809.04951, arXiv.org.
    14. Philipp Bach & Victor Chernozhukov & Malte S. Kurz & Martin Spindler & Sven Klaassen, 2021. "DoubleML -- An Object-Oriented Implementation of Double Machine Learning in R," Papers 2103.09603, arXiv.org, revised Feb 2024.
    15. Stefan Seifert & Marica Valente, 2018. "An Offer that you Can't Refuse? Agrimafias and Migrant Labor on Vineyards in Southern Italy," Discussion Papers of DIW Berlin 1735, DIW Berlin, German Institute for Economic Research.
    16. Harold D. Chiang, 2018. "Many Average Partial Effects: with An Application to Text Regression," Papers 1812.09397, arXiv.org, revised Jan 2022.
    17. Selina Gangl & Martin Huber, 2021. "From homemakers to breadwinners? How mandatory kindergarten affects maternal labour market outcomes," Papers 2111.14524, arXiv.org, revised Mar 2022.
    18. Gangl, Selina & Huber, Martin, 2021. "From homemakers to breadwinners? How mandatory kindergarten affects maternal labour market attachment," VfS Annual Conference 2019 (Leipzig): 30 Years after the Fall of the Berlin Wall - Democracy and Market Economy 203636, Verein für Socialpolitik / German Economic Association, revised 2021.
    19. Ruben Dezeure & Peter Bühlmann & Cun-Hui Zhang, 2017. "High-dimensional simultaneous inference with the bootstrap," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(4), pages 685-719, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2013. "Testing Many Moment Inequalities," CeMMAP working papers 65/13, Institute for Fiscal Studies.
    2. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Mayya Zhilova, 2015. "Simultaneous likelihood-based bootstrap confidence sets for a large number of models," SFB 649 Discussion Papers SFB649DP2015-031, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    4. Vladimir Spokoiny & Mayya Zhilova, 2014. "Bootstrap confidence sets under model misspecification," SFB 649 Discussion Papers SFB649DP2014-067, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    5. Shengchun Kong & Zhuqing Yu & Xianyang Zhang & Guang Cheng, 2021. "High‐dimensional robust inference for Cox regression models using desparsified Lasso," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(3), pages 1068-1095, September.
    6. Magne Mogstad & Joseph P. Romano & Azeem Shaikh & Daniel Wilhelm, 2020. "Inference for Ranks with Applications to Mobility across Neighborhoods and Academic Achievement across Countries," NBER Working Papers 26883, National Bureau of Economic Research, Inc.
    7. Brice Ozenne & Esben Budtz-Jørgensen & Sebastian Elgaard Ebert, 2023. "Controlling the familywise error rate when performing multiple comparisons in a linear latent variable model," Computational Statistics, Springer, vol. 38(1), pages 1-23, March.
    8. Hansen, Christian & Liao, Yuan, 2019. "The Factor-Lasso And K-Step Bootstrap Approach For Inference In High-Dimensional Economic Applications," Econometric Theory, Cambridge University Press, vol. 35(3), pages 465-509, June.
    9. Alexandre Belloni & Victor Chernozhukov & Kengo Kato, 2013. "Uniform post selection inference for LAD regression and other z-estimation problems," CeMMAP working papers CWP74/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Alexandre Belloni & Victor Chernozhukov & Abhishek Kaul, 2017. "Confidence bands for coefficients in high dimensional linear models with error-in-variables," CeMMAP working papers CWP22/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Yuta Koike, 2023. "High-Dimensional Central Limit Theorems for Homogeneous Sums," Journal of Theoretical Probability, Springer, vol. 36(1), pages 1-45, March.
    12. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney K. Newey, 2016. "Double machine learning for treatment and causal parameters," CeMMAP working papers 49/16, Institute for Fiscal Studies.
    13. Wu Wang & Xuming He & Zhongyi Zhu, 2020. "Statistical inference for multiple change‐point models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1149-1170, December.
    14. Philipp Bach & Victor Chernozhukov & Malte S. Kurz & Martin Spindler & Sven Klaassen, 2021. "DoubleML -- An Object-Oriented Implementation of Double Machine Learning in R," Papers 2103.09603, arXiv.org, revised Feb 2024.
    15. Demian Pouzo, 2014. "Bootstrap Consistency for Quadratic Forms of Sample Averages with Increasing Dimension," Papers 1411.2701, arXiv.org, revised Aug 2015.
    16. Sokbae Lee & Ryo Okui & Yoon†Jae Whang, 2017. "Doubly robust uniform confidence band for the conditional average treatment effect function," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(7), pages 1207-1225, November.
    17. Chetverikov, Denis & Wilhelm, Daniel & Kim, Dongwoo, 2021. "An Adaptive Test Of Stochastic Monotonicity," Econometric Theory, Cambridge University Press, vol. 37(3), pages 495-536, June.
    18. Dongwoo Kim & Daniel Wilhelm, 2017. "Powerful t-Tests in the presence of nonclassical measurement error," CeMMAP working papers CWP57/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Joel L. Horowitz, 2018. "Non-Asymptotic Inference in Instrumental Variables Estimation," Papers 1809.03600, arXiv.org.
    20. S Klaassen & J Kueck & M Spindler & V Chernozhukov, 2023. "Uniform inference in high-dimensional Gaussian graphical models," Biometrika, Biometrika Trust, vol. 110(1), pages 51-68.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:37/16. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.