IDEAS home Printed from https://ideas.repec.org/a/wly/quante/v12y2021i2p405-442.html

Linear regression with many controls of limited explanatory power

Author

Listed:
  • Chenchuan (Mark) Li
  • Ulrich K. Müller

Abstract

We consider inference about a scalar coefficient in a linear regression model. One previously considered approach to dealing with many controls imposes sparsity, that is, it is assumed known that nearly all control coefficients are (very nearly) zero. We instead impose a bound on the quadratic mean of the controls' effect on the dependent variable, which also has an interpretation as an R2‐type bound on the explanatory power of the controls. We develop a simple inference procedure that exploits this additional information in general heteroskedastic models. We study its asymptotic efficiency properties and compare it to a sparsity‐based approach in a Monte Carlo study. The method is illustrated in three empirical applications.

Suggested Citation

  • Chenchuan (Mark) Li & Ulrich K. Müller, 2021. "Linear regression with many controls of limited explanatory power," Quantitative Economics, Econometric Society, vol. 12(2), pages 405-442, May.
  • Handle: RePEc:wly:quante:v:12:y:2021:i:2:p:405-442
    DOI: 10.3982/QE1577
    as

    Download full text from publisher

    File URL: https://doi.org/10.3982/QE1577
    Download Restriction: no

    File URL: https://libkey.io/10.3982/QE1577?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Graham Elliott & Ulrich K. Müller & Mark W. Watson, 2015. "Nearly Optimal Tests When a Nuisance Parameter Is Present Under the Null Hypothesis," Econometrica, Econometric Society, vol. 83, pages 771-811, March.
    2. Timothy B. Armstrong & Michal Kolesár, 2018. "Optimal Inference in a Class of Regression Models," Econometrica, Econometric Society, vol. 86(2), pages 655-683, March.
    3. Ulrich K. Müller & Andriy Norets, 2016. "Credibility of Confidence Sets in Nonstandard Econometric Problems," Econometrica, Econometric Society, vol. 84, pages 2183-2213, November.
    4. Ted Joyce, 2004. "Did Legalized Abortion Lower Crime?," Journal of Human Resources, University of Wisconsin Press, vol. 39(1).
    5. Rocco Macchiavello & Ameet Morjaria, 2015. "The Value of Relationships: Evidence from a Supply Shock to Kenyan Rose Exports," American Economic Review, American Economic Association, vol. 105(9), pages 2911-2945, September.
    6. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    7. Guido W. Imbens & Donald B. Rubin & Bruce I. Sacerdote, 2001. "Estimating the Effect of Unearned Income on Labor Earnings, Savings, and Consumption: Evidence from a Survey of Lottery Players," American Economic Review, American Economic Association, vol. 91(4), pages 778-794, September.
    8. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    9. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    10. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    11. Müller, Ulrich K. & Wang, Yulong, 2019. "Nearly weighted risk minimal unbiased estimation," Journal of Econometrics, Elsevier, vol. 209(1), pages 18-34.
    12. Christopher L. Foote & Christopher F. Goetz, 2008. "The Impact of Legalized Abortion on Crime: Comment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(1), pages 407-423.
    13. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    14. John J. Donohue III & Steven D. Levitt, 2001. "The Impact of Legalized Abortion on Crime," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 379-420.
    15. Ted Joyce, 2009. "A Simple Test of Abortion and Crime," The Review of Economics and Statistics, MIT Press, vol. 91(1), pages 112-123, February.
    16. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, Enero-Abr.
    17. Cun-Hui Zhang & Stephanie S. Zhang, 2014. "Confidence intervals for low dimensional parameters in high dimensional linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 217-242, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Giuseppe Cavaliere & Sílvia Gonçalves & Morten Ørregaard Nielsen & Edoardo Zanelli, 2024. "Bootstrap Inference in the Presence of Bias," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 119(548), pages 2908-2918, October.
    2. Jiang, Liang & Li, Liyao & Miao, Ke & Zhang, Yichong, 2025. "Adjustments with many regressors under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 249(PB).
    3. Philipp Ketz & Adam McCloskey, 2025. "Short and Simple Confidence Intervals When the Directions of Some Effects are Known," The Review of Economics and Statistics, MIT Press, vol. 107(3), pages 820-834, May.
    4. Soonwoo Kwon & Liyang Sun, 2025. "Estimating Treatment Effects Under Bounded Heterogeneity," Papers 2510.05454, arXiv.org, revised Apr 2026.
    5. Xiduo Chen & Xingdong Feng & Antonio F. Galvao & Yeheng Ge, 2025. "Treatment Effects Inference with High-Dimensional Instruments and Control Variables," Papers 2503.20149, arXiv.org, revised Oct 2025.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chenchuan (Mark) Li & Ulrich K. Müller, 2020. "Linear Regression with Many Controls of Limited Explanatory Power," Working Papers 2020-57, Princeton University. Economics Department..
    2. Chevalier, Arnaud & Marie, Olivier, 2024. "Risky moms, risky kids? fertility and crime after the fall of the wall," Journal of Public Economics, Elsevier, vol. 230(C).
    3. François, Abel & Magni-Berton, Raul & Weill, Laurent, 2014. "Abortion and crime: Cross-country evidence from Europe," International Review of Law and Economics, Elsevier, vol. 40(C), pages 24-35.
    4. Alexander Chudik & M. Hashem Pesaran & Jui‐Chung Yang, 2018. "Half‐panel jackknife fixed‐effects estimation of linear panels with weakly exogenous regressors," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(6), pages 816-836, September.
    5. Agboola, Oluwagbenga David & Yu, Han, 2023. "Neighborhood-based cross fitting approach to treatment effects with high-dimensional data," Computational Statistics & Data Analysis, Elsevier, vol. 186(C).
    6. Clarke, Damian, 2023. "The Economics of Abortion Policy," IZA Discussion Papers 16395, IZA Network @ LISER.
    7. Alexander Chudik & M. Hashem Pesaran & Jui-Chung Yang, 2016. "Half-panel jackknife fixed effects estimation of panels with weakly exogenous regressor," Globalization Institute Working Papers 281, Federal Reserve Bank of Dallas.
    8. Gebhard Kirchgässner, 2011. "Econometric Estimates of Deterrence of the Death Penalty: Facts or Ideology?," Kyklos, Wiley Blackwell, vol. 64(3), pages 448-478, August.
    9. Farrell, Max H., 2015. "Robust inference on average treatment effects with possibly more covariates than observations," Journal of Econometrics, Elsevier, vol. 189(1), pages 1-23.
    10. Theodore J. Joyce, 2009. "Abortion and Crime: A Review," NBER Working Papers 15098, National Bureau of Economic Research, Inc.
    11. Julio Cáceres-Delpiano & Eugenio Giolito, 2012. "The Impact of Unilateral Divorce on Crime," Journal of Labor Economics, University of Chicago Press, vol. 30(1), pages 215-248.
    12. Zhong, Wei & Gao, Yang & Zhou, Wei & Fan, Qingliang, 2021. "Endogenous treatment effect estimation using high-dimensional instruments and double selection," Statistics & Probability Letters, Elsevier, vol. 169(C).
    13. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    14. Anders Bredahl Kock & Haihan Tang, 2014. "Inference in High-dimensional Dynamic Panel Data Models," CREATES Research Papers 2014-58, Department of Economics and Business Economics, Aarhus University.
    15. Gregory Fletcher Cox, 2024. "A Simple and Adaptive Confidence Interval when Nuisance Parameters Satisfy an Inequality," Papers 2409.09962, arXiv.org.
    16. Gábor Hajdu & Tamás Hajdu, 2021. "The long-term impact of restricted access to abortion on children’s socioeconomic outcomes," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-14, March.
    17. Mueller-Langer, Frank & Fecher, Benedikt & Harhoff, Dietmar & Wagner, Gert G., 2019. "Replication studies in economics—How many and which papers are chosen for replication, and why?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 48(1), pages 62-83.
    18. Ted Joyce, 2010. "Abortion and Crime: A Review," Chapters, in: Bruce L. Benson & Paul R. Zimmerman (ed.), Handbook on the Economics of Crime, chapter 18, Edward Elgar Publishing.
    19. Hirano, Keisuke & Porter, Jack R., 2020. "Asymptotic analysis of statistical decision rules in econometrics," Handbook of Econometrics, in: Steven N. Durlauf & Lars Peter Hansen & James J. Heckman & Rosa L. Matzkin (ed.), Handbook of Econometrics, edition 1, volume 7, chapter 0, pages 283-354, Elsevier.
    20. Nunley, John M. & Seals, Richard Alan & Zietz, Joachim, 2011. "Demographic change, macroeconomic conditions, and the murder rate: The case of the United States, 1934–2006," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 40(6), pages 942-948.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:quante:v:12:y:2021:i:2:p:405-442. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.