IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1012.1297.html
   My bibliography  Save this paper

LASSO Methods for Gaussian Instrumental Variables Models

Author

Listed:
  • Alexandre Belloni
  • Victor Chernozhukov
  • Christian Hansen

Abstract

In this note, we propose to use sparse methods (e.g. LASSO, Post-LASSO, sqrt-LASSO, and Post-sqrt-LASSO) to form first-stage predictions and estimate optimal instruments in linear instrumental variables (IV) models with many instruments in the canonical Gaussian case. The methods apply even when the number of instruments is much larger than the sample size. We derive asymptotic distributions for the resulting IV estimators and provide conditions under which these sparsity-based IV estimators are asymptotically oracle-efficient. In simulation experiments, a sparsity-based IV estimator with a data-driven penalty performs well compared to recently advocated many-instrument-robust procedures. We illustrate the procedure in an empirical example using the Angrist and Krueger (1991) schooling data.

Suggested Citation

  • Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2010. "LASSO Methods for Gaussian Instrumental Variables Models," Papers 1012.1297, arXiv.org, revised Feb 2011.
  • Handle: RePEc:arx:papers:1012.1297
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1012.1297
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Alan B. Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," Working Papers 834, Princeton University, Department of Economics, Industrial Relations Section..
    2. Ng Serena & Bai Jushan, 2009. "Selecting Instrumental Variables in a Data Rich Environment," Journal of Time Series Econometrics, De Gruyter, vol. 1(1), pages 1-34, April.
    3. Newey, Whitney K, 1990. "Efficient Instrumental Variables Estimation of Nonlinear Models," Econometrica, Econometric Society, vol. 58(4), pages 809-837, July.
    4. Fuller, Wayne A, 1977. "Some Properties of a Modification of the Limited Information Estimator," Econometrica, Econometric Society, vol. 45(4), pages 939-953, May.
    5. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    6. Amemiya, Takeshi, 1974. "The nonlinear two-stage least-squares estimator," Journal of Econometrics, Elsevier, vol. 2(2), pages 105-110, July.
    7. Robert Shimer, 2001. "The Impact of Young Workers on the Aggregate Labor Market," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(3), pages 969-1007.
    8. Jinyong Hahn & Jerry Hausman & Guido Kuersteiner, 2004. "Estimation with weak instruments: Accuracy of higher-order bias and MSE approximations," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 272-306, June.
    9. Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
    10. Hansen, Christian & Hausman, Jerry & Newey, Whitney, 2008. "Estimation With Many Instrumental Variables," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 398-422.
    11. repec:fth:prinin:455 is not listed on IDEAS
    12. Joshua D. Angrist & Alan B. Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 69-85, Fall.
    13. Daron Acemoglu & Simon Johnson & James A. Robinson, 2001. "The Colonial Origins of Comparative Development: An Empirical Investigation," American Economic Review, American Economic Association, vol. 91(5), pages 1369-1401, December.
    14. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    15. Joshua Angrist & Alan Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," Working Papers 834, Princeton University, Department of Economics, Industrial Relations Section..
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Breunig, Christoph & Mammen, Enno & Simoni, Anna, 2020. "Ill-posed estimation in high-dimensional models with instrumental variables," Journal of Econometrics, Elsevier, vol. 219(1), pages 171-200.
    2. Andrii Babii, 2022. "High-Dimensional Mixed-Frequency IV Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1470-1483, October.
    3. Nepp, Alexander & Okhrin, Ostap & Egorova, Julia & Dzhuraeva, Zarnigor & Zykov, Alexander, 2022. "What threatens stock markets more - The coronavirus or the hype around it?," International Review of Economics & Finance, Elsevier, vol. 78(C), pages 519-539.
    4. Adel Javanmard & Jason D. Lee, 2020. "A flexible framework for hypothesis testing in high dimensions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(3), pages 685-718, July.
    5. Alena Skolkova, 2023. "Instrumental Variable Estimation with Many Instruments Using Elastic-Net IV," CERGE-EI Working Papers wp759, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    6. Belloni, Alexandre & Hansen, Christian & Newey, Whitney, 2022. "High-dimensional linear models with many endogenous variables," Journal of Econometrics, Elsevier, vol. 228(1), pages 4-26.
    7. Mehmet Caner & Esfandiar Maasoumi & Juan Andrés Riquelme, 2016. "Moment and IV Selection Approaches: A Comparative Simulation Study," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1562-1581, December.
    8. Felipe González & Magdalena Larreboure, 2021. "The Impact of the Women’s March on the U.S. House Election," Documentos de Trabajo 560, Instituto de Economia. Pontificia Universidad Católica de Chile..
    9. Ellora Derenoncourt, 2022. "Can You Move to Opportunity? Evidence from the Great Migration," American Economic Review, American Economic Association, vol. 112(2), pages 369-408, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hansen, Christian & Kozbur, Damian, 2014. "Instrumental variables estimation with many weak instruments using regularized JIVE," Journal of Econometrics, Elsevier, vol. 182(2), pages 290-308.
    2. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    3. Guilhem Bascle, 2008. "Controlling for endogeneity with instrumental variables in strategic management research," Post-Print hal-00576795, HAL.
    4. Michael P. Murray, 2006. "Avoiding Invalid Instruments and Coping with Weak Instruments," Journal of Economic Perspectives, American Economic Association, vol. 20(4), pages 111-132, Fall.
    5. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "High-Dimensional Methods and Inference on Structural and Treatment Effects," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
    6. Murray Michael P., 2017. "Linear Model IV Estimation When Instruments Are Many or Weak," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-22, January.
    7. Sølvsten, Mikkel, 2020. "Robust estimation with many instruments," Journal of Econometrics, Elsevier, vol. 214(2), pages 495-512.
    8. Alena Skolkova, 2023. "Instrumental Variable Estimation with Many Instruments Using Elastic-Net IV," CERGE-EI Working Papers wp759, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    9. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2011. "Inference for high-dimensional sparse econometric models," CeMMAP working papers CWP41/11, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Christopher D. Walker, 2024. "Semiparametric Bayesian Inference for a Conditional Moment Equality Model," Papers 2410.16017, arXiv.org.
    11. Brendan Kline, 2016. "Identification of the Direction of a Causal Effect by Instrumental Variables," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(2), pages 176-184, April.
    12. Markus Brückner & Antonio Ciccone, 2011. "Rain and the Democratic Window of Opportunity," Econometrica, Econometric Society, vol. 79(3), pages 923-947, May.
    13. Yiming He & Thomas M. Fullerton, 2020. "The economic analysis of instrument variables estimation in dynamic optimal models with an application to the water consumption," Agricultural Economics, Czech Academy of Agricultural Sciences, vol. 66(9), pages 413-423.
    14. Burke, Paul J. & Yang, Hewen, 2016. "The price and income elasticities of natural gas demand: International evidence," Energy Economics, Elsevier, vol. 59(C), pages 466-474.
    15. Sascha O. Becker, 2016. "Using instrumental variables to establish causality," IZA World of Labor, Institute of Labor Economics (IZA), pages 250-250, April.
    16. Roberto Ezcurra & Andrés Rodríguez-Pose, 2017. "Does ethnic segregation matter for spatial inequality?," Journal of Economic Geography, Oxford University Press, vol. 17(6), pages 1149-1178.
    17. Matsushita, Yukitoshi & Otsu, Taisuke, 2024. "A jackknife Lagrange multiplier test with many weak instruments," LSE Research Online Documents on Economics 116392, London School of Economics and Political Science, LSE Library.
    18. Yasser Razak Hussain & Pranab Mukhopadhyay, 2023. "How Much do Education, Experience, and Social Networks Impact Earnings in India? A Panel Data Analysis Disaggregated by Class, Gender, Caste and Religion," SAGE Open, , vol. 13(4), pages 21582440231, December.
    19. Maystadt, Jean-François & Trinh Tan, Jean-François & Breisinger, Clemens, 2014. "Does food security matter for transition in Arab countries?," Food Policy, Elsevier, vol. 46(C), pages 106-115.
    20. Rietveld, Cornelius A. & Webbink, Dinand, 2016. "On the genetic bias of the quarter of birth instrument," Economics & Human Biology, Elsevier, vol. 21(C), pages 137-146.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1012.1297. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.