IDEAS home Printed from https://ideas.repec.org/p/azt/cemmap/37-16.html
   My bibliography  Save this paper

hdm: High-Dimensional Metrics

Author

Listed:
  • Victor Chernozhukov
  • Christian Hansen
  • Martin Spindler

Abstract

In this article the package High-dimensional Metrics (hdm) is introduced. It is a collection of statistical methods for estimation and quantification of uncertainty in high-dimensional approximately sparse models. It focuses on providing confidence intervals and significance testing for (possibly many) low-dimensional subcomponents of the high-dimensional parameter vector. Efficient estimators and uniformly valid confidence intervals for regression coefficients on target variables (e.g., treatment or policy variable) in a high-dimensional approximately sparse regression model, for average treatment effect (ATE) and average treatment effect for the treated (ATET), as well for extensions of these parameters to the endogenous setting are provided. Theory grounded, data-driven methods for selecting the penalization parameter in Lasso regressions under heteroscedastic and non-Gaussian errors are implemented. Moreover, joint/ simultaneous confidence intervals for regression coefficients of a high-dimensional sparse regression are implemented. Data sets which have been used in the literature and might be useful for classroom demonstration and for testing new estimators are included.

Suggested Citation

  • Victor Chernozhukov & Christian Hansen & Martin Spindler, 2016. "hdm: High-Dimensional Metrics," CeMMAP working papers 37/16, Institute for Fiscal Studies.
  • Handle: RePEc:azt:cemmap:37/16
    DOI: 10.1920/wp.cem.2016.3716
    as

    Download full text from publisher

    File URL: https://www.cemmap.ac.uk/wp-content/uploads/2020/08/CWP3716.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.1920/wp.cem.2016.3716?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2012. "Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors," Papers 1212.6906, arXiv.org, revised Jan 2018.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Huber, Martin & Imhof, David, 2019. "Machine learning with screens for detecting bid-rigging cartels," International Journal of Industrial Organization, Elsevier, vol. 65(C), pages 277-301.
    2. Ismael Mourifié, 2019. "A marriage matching function with flexible spillover and substitution patterns," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 67(2), pages 421-461, March.
    3. Hannes Wallimann & David Imhof & Martin Huber, 2023. "A Machine Learning Approach for Flagging Incomplete Bid-Rigging Cartels," Computational Economics, Springer;Society for Computational Economics, vol. 62(4), pages 1669-1720, December.
    4. Edward I. Altman & Marco Balzano & Alessandro Giannozzi & Stjepan Srhoj, 2023. "Revisiting SME default predictors: The Omega Score," Journal of Small Business Management, Taylor & Francis Journals, vol. 61(6), pages 2383-2417, November.
    5. Selina Gangl & Martin Huber, 2021. "From homemakers to breadwinners? How mandatory kindergarten affects maternal labour market outcomes," Papers 2111.14524, arXiv.org, revised Mar 2022.
    6. Philipp Bach & Victor Chernozhukov & Martin Spindler, 2018. "Valid Simultaneous Inference in High-Dimensional Settings (with the hdm package for R)," Papers 1809.04951, arXiv.org.
    7. A. Belloni & V. Chernozhukov & I. Fernández‐Val & C. Hansen, 2017. "Program Evaluation and Causal Inference With High‐Dimensional Data," Econometrica, Econometric Society, vol. 85, pages 233-298, January.
    8. Elena Denisova-Schmidt & Martin Huber & Elvira Leontyeva & Anna Solovyeva, 2021. "Combining experimental evidence with machine learning to assess anti-corruption educational campaigns among Russian university students," Empirical Economics, Springer, vol. 60(4), pages 1661-1684, April.
    9. Harold D. Chiang, 2018. "Many Average Partial Effects: with An Application to Text Regression," Papers 1812.09397, arXiv.org, revised Jan 2022.
    10. Philipp Bach & Victor Chernozhukov & Malte S. Kurz & Martin Spindler & Sven Klaassen, 2021. "DoubleML -- An Object-Oriented Implementation of Double Machine Learning in R," Papers 2103.09603, arXiv.org, revised Feb 2024.
    11. Pawel Dlotko & Simon Rudkin & Wanling Qiu, 2019. "Topologically Mapping the Macroeconomy," Papers 1911.10476, arXiv.org.
    12. Ruben Dezeure & Peter Bühlmann & Cun-Hui Zhang, 2017. "High-dimensional simultaneous inference with the bootstrap," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(4), pages 685-719, December.
    13. Daniels, David P. & Zlatev, Julian J., 2019. "Choice architects reveal a bias toward positivity and certainty," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 132-149.
    14. Imhof, David & Wallimann, Hannes, 2021. "Detecting bid-rigging coalitions in different countries and auction formats," International Review of Law and Economics, Elsevier, vol. 68(C).
    15. Hannes Wallimann & David Imhof & Martin Huber, 2020. "A Machine Learning Approach for Flagging Incomplete Bid-rigging Cartels," Papers 2004.05629, arXiv.org.
    16. Godzinski, Alexandre & Suarez Castillo, Milena, 2021. "Disentangling the effects of air pollutants with many instruments," Journal of Environmental Economics and Management, Elsevier, vol. 109(C).
    17. Gangl, Selina & Huber, Martin, 2021. "From homemakers to breadwinners? How mandatory kindergarten affects maternal labour market attachment," VfS Annual Conference 2019 (Leipzig): 30 Years after the Fall of the Berlin Wall - Democracy and Market Economy 203636, Verein für Socialpolitik / German Economic Association, revised 2021.
    18. Stefan Seifert & Marica Valente, 2018. "An Offer that you Can't Refuse? Agrimafias and Migrant Labor on Vineyards in Southern Italy," Discussion Papers of DIW Berlin 1735, DIW Berlin, German Institute for Economic Research.
    19. Marica Valente & Timm Gries & Lorenzo Trapani, 2023. "Informal employment from migration shocks," Working Papers 2023-09, Faculty of Economics and Statistics, Universität Innsbruck.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2013. "Testing Many Moment Inequalities," CeMMAP working papers 65/13, Institute for Fiscal Studies.
    2. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2014. "Central limit theorems and bootstrap in high dimensions," CeMMAP working papers CWP49/14, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Hidalgo, Javier & Schafgans, Marcia, 2017. "Inference and testing breaks in large dynamic panels with strong cross sectional dependence," Journal of Econometrics, Elsevier, vol. 196(2), pages 259-274.
    5. Mayya Zhilova, 2015. "Simultaneous likelihood-based bootstrap confidence sets for a large number of models," SFB 649 Discussion Papers SFB649DP2015-031, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    6. Vladimir Spokoiny & Mayya Zhilova, 2014. "Bootstrap confidence sets under model misspecification," SFB 649 Discussion Papers SFB649DP2014-067, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    7. Hansen, Christian & Liao, Yuan, 2019. "The Factor-Lasso And K-Step Bootstrap Approach For Inference In High-Dimensional Economic Applications," Econometric Theory, Cambridge University Press, vol. 35(3), pages 465-509, June.
    8. Denis Kojevnikov, 2021. "The Bootstrap for Network Dependent Processes," Papers 2101.12312, arXiv.org.
    9. Yukun Ma, 2023. "Identification-robust inference for the LATE with high-dimensional covariates," Papers 2302.09756, arXiv.org, revised Nov 2023.
    10. Pasha Andreyanov & Grigory Franguridi, 2021. "Nonparametric inference on counterfactuals in first-price auctions," Papers 2106.13856, arXiv.org, revised Jun 2022.
    11. Victor Chernozhukov & Christian Hansen & Martin Spindler, 2015. "Valid Post-Selection and Post-Regularization Inference: An Elementary, General Approach," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 649-688, August.
    12. Jinyuan Chang & Wen Zhou & Wen-Xin Zhou & Lan Wang, 2017. "Comparing large covariance matrices under weak conditions on the dependence structure and its application to gene clustering," Biometrics, The International Biometric Society, vol. 73(1), pages 31-41, March.
    13. Shengchun Kong & Zhuqing Yu & Xianyang Zhang & Guang Cheng, 2021. "High‐dimensional robust inference for Cox regression models using desparsified Lasso," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(3), pages 1068-1095, September.
    14. Victor Chernozhukov & Christian Hansen & Martin Spindler, 2015. "Post-Selection and Post-Regularization Inference in Linear Models with Many Controls and Instruments," American Economic Review, American Economic Association, vol. 105(5), pages 486-490, May.
    15. Magne Mogstad & Joseph P. Romano & Azeem Shaikh & Daniel Wilhelm, 2020. "Inference for Ranks with Applications to Mobility across Neighborhoods and Academic Achievement across Countries," NBER Working Papers 26883, National Bureau of Economic Research, Inc.
    16. Alexandre Belloni & Victor Chernozhukov & Ying Wei, 2016. "Post-Selection Inference for Generalized Linear Models With Many Controls," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 606-619, October.
    17. Brice Ozenne & Esben Budtz-Jørgensen & Sebastian Elgaard Ebert, 2023. "Controlling the familywise error rate when performing multiple comparisons in a linear latent variable model," Computational Statistics, Springer, vol. 38(1), pages 1-23, March.
    18. Matias D. Cattaneo & Ricardo P. Masini & William G. Underwood, 2022. "Yurinskii's Coupling for Martingales," Papers 2210.00362, arXiv.org, revised Mar 2024.
    19. Timmermann, Allan & Qu, Ritong & Zhu, Yinchu, 2019. "Do Any Economists Have Superior Forecasting Skills?," CEPR Discussion Papers 14112, C.E.P.R. Discussion Papers.
    20. Alexandre Belloni & Victor Chernozhukov & Kengo Kato, 2013. "Uniform post selection inference for LAD regression and other z-estimation problems," CeMMAP working papers CWP74/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:azt:cemmap:37/16. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dermot Watson (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.