IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v182y2014i2p290-308.html
   My bibliography  Save this article

Instrumental variables estimation with many weak instruments using regularized JIVE

Author

Listed:
  • Hansen, Christian
  • Kozbur, Damian

Abstract

We consider instrumental variables regression in models where the number of available instruments may be larger than the sample size and consistent model selection in the first stage may not be possible. Such a situation may arise when there are many weak instruments. With many weak instruments, existing approaches to first-stage regularization can lead to a large bias relative to standard errors. We propose a jackknife instrumental variables estimator (JIVE) with regularization at each jackknife iteration that helps alleviate this bias. We derive the limiting behavior for a ridge-regularized JIV estimator (RJIVE), verifying that the RJIVE is consistent and asymptotically normal under conditions which allow for more instruments than observations and do not require consistent model selection. We provide simulation results that demonstrate the proposed RJIVE performs favorably in terms of size of tests and risk properties relative to other many-weak instrument estimation strategies in high-dimensional settings. We also apply the RJIVE to the Angrist and Krueger (1991) example where it performs favorably relative to other many-instrument robust procedures.

Suggested Citation

  • Hansen, Christian & Kozbur, Damian, 2014. "Instrumental variables estimation with many weak instruments using regularized JIVE," Journal of Econometrics, Elsevier, vol. 182(2), pages 290-308.
    • Handle: RePEc:eee:econom:v:182:y:2014:i:2:p:290-308
    DOI: 10.1016/j.jeconom.2014.04.022
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407614000918
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jeconom.2014.04.022?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kapetanios, George & Marcellino, Massimiliano, 2010. "Factor-GMM estimation with large sets of possibly weak instruments," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2655-2675, November.
    2. Bai, Jushan & Ng, Serena, 2010. "Instrumental Variable Estimation In A Data Rich Environment," Econometric Theory, Cambridge University Press, vol. 26(6), pages 1577-1606, December.
    3. Eric Gautier & Alexandre Tsybakov, 2011. "High-Dimensional Instrumental Variables Regression and Confidence Sets," Working Papers 2011-13, Center for Research in Economics and Statistics.
    4. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    5. Donald, Stephen G & Newey, Whitney K, 2001. "Choosing the Number of Instruments," Econometrica, Econometric Society, vol. 69(5), pages 1161-1191, September.
    6. Carrasco, Marine, 2012. "A regularization approach to the many instruments problem," Journal of Econometrics, Elsevier, vol. 170(2), pages 383-398.
    7. Ng Serena & Bai Jushan, 2009. "Selecting Instrumental Variables in a Data Rich Environment," Journal of Time Series Econometrics, De Gruyter, vol. 1(1), pages 1-34, April.
    8. Gary Chamberlain & Guido Imbens, 2004. "Random Effects Estimators with many Instrumental Variables," Econometrica, Econometric Society, vol. 72(1), pages 295-306, January.
    9. Newey, Whitney K, 1990. "Efficient Instrumental Variables Estimation of Nonlinear Models," Econometrica, Econometric Society, vol. 58(4), pages 809-837, July.
    10. Fuller, Wayne A, 1977. "Some Properties of a Modification of the Limited Information Estimator," Econometrica, Econometric Society, vol. 45(4), pages 939-953, May.
    11. Bekker, Paul A, 1994. "Alternative Approximations to the Distributions of Instrumental Variable Estimators," Econometrica, Econometric Society, vol. 62(3), pages 657-681, May.
    12. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    13. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    14. Angrist, J D & Imbens, G W & Krueger, A B, 1999. "Jackknife Instrumental Variables Estimation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(1), pages 57-67, Jan.-Feb..
    15. Amemiya, Takeshi, 1974. "The nonlinear two-stage least-squares estimator," Journal of Econometrics, Elsevier, vol. 2(2), pages 105-110, July.
    16. Stock, James H & Wright, Jonathan H & Yogo, Motohiro, 2002. "A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 518-529, October.
    17. John C. Chao & Norman R. Swanson, 2005. "Consistent Estimation with a Large Number of Weak Instruments," Econometrica, Econometric Society, vol. 73(5), pages 1673-1692, September.
    18. Chao, John C. & Swanson, Norman R. & Hausman, Jerry A. & Newey, Whitney K. & Woutersen, Tiemen, 2012. "Asymptotic Distribution Of Jive In A Heteroskedastic Iv Regression With Many Instruments," Econometric Theory, Cambridge University Press, vol. 28(1), pages 42-86, February.
    19. Hansen, Christian & Hausman, Jerry & Newey, Whitney, 2008. "Estimation With Many Instrumental Variables," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 398-422.
    20. Chamberlain, Gary, 1987. "Asymptotic efficiency in estimation with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 34(3), pages 305-334, March.
    21. Okui, Ryo, 2011. "Instrumental variable estimation in the presence of many moment conditions," Journal of Econometrics, Elsevier, vol. 165(1), pages 70-86.
    22. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    23. Caner, Mehmet, 2009. "Lasso-Type Gmm Estimator," Econometric Theory, Cambridge University Press, vol. 25(1), pages 270-290, February.
    24. Phillips, Garry D A & Hale, C, 1977. "The Bias of Instrumental Variable Estimators of Simultaneous Equation Systems," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 18(1), pages 219-228, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    2. Carrasco, Marine & Tchuente, Guy, 2015. "Regularized LIML for many instruments," Journal of Econometrics, Elsevier, vol. 186(2), pages 427-442.
    3. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    4. Thomas Wiemann, 2023. "Optimal Categorical Instrumental Variables," Papers 2311.17021, arXiv.org.
    5. Dennis Lim & Wenjie Wang & Yichong Zhang, 2022. "A Conditional Linear Combination Test with Many Weak Instruments," Papers 2207.11137, arXiv.org, revised Apr 2023.
    6. Alena Skolkova, 2023. "Instrumental Variable Estimation with Many Instruments Using Elastic-Net IV," CERGE-EI Working Papers wp759, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    7. Michal Kolesár & Raj Chetty & John Friedman & Edward Glaeser & Guido W. Imbens, 2015. "Identification and Inference With Many Invalid Instruments," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(4), pages 474-484, October.
    8. Xu Cheng & Zhipeng Liao, 2012. "Select the Valid and Relevant Moments: A One-Step Procedure for GMM with Many Moments," PIER Working Paper Archive 12-045, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    9. Anna Mikusheva & Liyang Sun, 2023. "Weak Identification with Many Instruments," Papers 2308.09535, arXiv.org, revised Jan 2024.
    10. Guy Tchuente, 2019. "Weak Identification and Estimation of Social Interaction Models," Papers 1902.06143, arXiv.org.
    11. Wang, Wenjie & Doko Tchatoka, Firmin, 2018. "On Bootstrap inconsistency and Bonferroni-based size-correction for the subset Anderson–Rubin test under conditional homoskedasticity," Journal of Econometrics, Elsevier, vol. 207(1), pages 188-211.
    12. Wang, Wenjie & Kaffo, Maximilien, 2016. "Bootstrap inference for instrumental variable models with many weak instruments," Journal of Econometrics, Elsevier, vol. 192(1), pages 231-268.
    13. Sølvsten, Mikkel, 2020. "Robust estimation with many instruments," Journal of Econometrics, Elsevier, vol. 214(2), pages 495-512.
    14. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.
    15. Kolesár, Michal, 2018. "Minimum distance approach to inference with many instruments," Journal of Econometrics, Elsevier, vol. 204(1), pages 86-100.
    16. Daniel A. Ackerberg & Paul J. Devereux, 2009. "Improved JIVE Estimators for Overidentified Linear Models with and without Heteroskedasticity," The Review of Economics and Statistics, MIT Press, vol. 91(2), pages 351-362, May.
    17. Guy Tchuente, 2016. "Estimation of social interaction models using regularization," Studies in Economics 1607, School of Economics, University of Kent.
    18. Yoonseok Lee & Yu Zhou, 2015. "Averaged Instrumental Variables Estimators," Center for Policy Research Working Papers 180, Center for Policy Research, Maxwell School, Syracuse University.
    19. Eric Gautier & Christiern Rose, 2022. "Fast, Robust Inference for Linear Instrumental Variables Models using Self-Normalized Moments," Papers 2211.02249, arXiv.org, revised Nov 2022.
    20. Nam-Hyun Kim & Winfried Pohlmeier, 2015. "A Regularization Approach to Biased Two-Stage Least Squares Estimation," Working Paper series 15-22, Rimini Centre for Economic Analysis.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:182:y:2014:i:2:p:290-308. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.