IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/18-05.html
   My bibliography  Save this paper

GMM with many weak moment conditions

Author

Listed:
  • Whitney K. Newey

    (Institute for Fiscal Studies and MIT)

  • Frank Windmeijer

    (Institute for Fiscal Studies and University of Bristol)

Abstract

Using many moment conditions can improve efficiency but makes the usual GMM inferences inaccurate. Two step GMM is biased. Generalized empirical likelihood (GEL) has smaller bias but the usual standard errors are too small. In this paper we use alternative asymptotics, based on many weak moment conditions, that addresses this problem. This asymptotics leads to improved approximations in overidentified models where the variance of the derivative of the moment conditions is large relative to the squared expected value of the moment conditions and identification is not too weak. We obtain an asymptotic variance for GEL that is larger than the usual one and give a "sandwich" estimator of it. In Monte Carlo examples we find that this variance estimator leads to a better Gaussian approximation to t-ratios in a range of cases. We also show that Kleibergen (2005) K statistic is valid under these asymptotics. We also compare these results with a jackknife GMM estimator, finding that GEL is asymptotically more efficient under many weak moments.

Suggested Citation

  • Whitney K. Newey & Frank Windmeijer, 2005. "GMM with many weak moment conditions," CeMMAP working papers CWP18/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  • Handle: RePEc:ifs:cemmap:18/05
    as

    Download full text from publisher

    File URL: http://cemmap.ifs.org.uk/wps/cwp1805.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    3. Guggenberger, Patrik & Smith, Richard J., 2005. "Generalized Empirical Likelihood Estimators And Tests Under Partial, Weak, And Strong Identification," Econometric Theory, Cambridge University Press, vol. 21(4), pages 667-709, August.
    4. Chirok Han & Peter C. B. Phillips, 2006. "GMM with Many Moment Conditions," Econometrica, Econometric Society, vol. 74(1), pages 147-192, January.
    5. Newey, Whitney K, 1991. "Uniform Convergence in Probability and Stochastic Equicontinuity," Econometrica, Econometric Society, vol. 59(4), pages 1161-1167, July.
    6. Newey, Whitney K, 1990. "Efficient Instrumental Variables Estimation of Nonlinear Models," Econometrica, Econometric Society, vol. 58(4), pages 809-837, July.
    7. Smith, Richard J, 1997. "Alternative Semi-parametric Likelihood Approaches to Generalised Method of Moments Estimation," Economic Journal, Royal Economic Society, vol. 107(441), pages 503-519, March.
    8. Andrews,Donald W. K. & Stock,James H. (ed.), 2005. "Identification and Inference for Econometric Models," Cambridge Books, Cambridge University Press, number 9780521844413.
    9. John Chao & Norman Swanson, 2004. "Estimation and Testing Using Jackknife IV in Heteroskedastic Regressions With Many Weak Instruments," Departmental Working Papers 200420, Rutgers University, Department of Economics.
    10. Holtz-Eakin, Douglas & Newey, Whitney & Rosen, Harvey S, 1988. "Estimating Vector Autoregressions with Panel Data," Econometrica, Econometric Society, vol. 56(6), pages 1371-1395, November.
    11. Bryan W. Brown & Whitney K. Newey, 1998. "Efficient Semiparametric Estimation of Expectations," Econometrica, Econometric Society, vol. 66(2), pages 453-464, March.
    12. Bekker, Paul & Kleibergen, Frank, 2003. "Finite-Sample Instrumental Variables Inference Using An Asymptotically Pivotal Statistic," Econometric Theory, Cambridge University Press, vol. 19(5), pages 744-753, October.
    13. Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
    14. Bekker, Paul A, 1994. "Alternative Approximations to the Distributions of Instrumental Variable Estimators," Econometrica, Econometric Society, vol. 62(3), pages 657-681, May.
    15. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    16. John C. Chao & Norman R. Swanson, 2005. "Consistent Estimation with a Large Number of Weak Instruments," Econometrica, Econometric Society, vol. 73(5), pages 1673-1692, September.
    17. James H. Stock & Jonathan Wright, 2000. "GMM with Weak Identification," Econometrica, Econometric Society, vol. 68(5), pages 1055-1096, September.
    18. Guido W. Imbens, 1997. "One-Step Estimators for Over-Identified Generalized Method of Moments Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(3), pages 359-383.
    19. Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
    20. Hall, Peter, 1984. "Central limit theorem for integrated square error of multivariate nonparametric density estimators," Journal of Multivariate Analysis, Elsevier, vol. 14(1), pages 1-16, February.
    21. Donald, Stephen G. & Newey, Whitney K., 2000. "A jackknife interpretation of the continuous updating estimator," Economics Letters, Elsevier, vol. 67(3), pages 239-243, June.
    22. Donald, Stephen G. & Imbens, Guido W. & Newey, Whitney K., 2003. "Empirical likelihood estimation and consistent tests with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 117(1), pages 55-93, November.
    23. Chamberlain, Gary, 1987. "Asymptotic efficiency in estimation with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 34(3), pages 305-334, March.
    24. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    25. Phillips, Garry D A & Hale, C, 1977. "The Bias of Instrumental Variable Estimators of Simultaneous Equation Systems," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 18(1), pages 219-228, February.
    26. Hansen, Lars Peter & Heaton, John & Yaron, Amir, 1996. "Finite-Sample Properties of Some Alternative GMM Estimators," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 262-280, July.
    27. Frank Kleibergen, 2005. "Testing Parameters in GMM Without Assuming that They Are Identified," Econometrica, Econometric Society, vol. 73(4), pages 1103-1123, July.
    28. Frank Kleibergen, 2002. "Pivotal Statistics for Testing Structural Parameters in Instrumental Variables Regression," Econometrica, Econometric Society, vol. 70(5), pages 1781-1803, September.
    29. Manuel Arellano & Stephen Bond, 1991. "Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(2), pages 277-297.
    30. Windmeijer, Frank, 2005. "A finite sample correction for the variance of linear efficient two-step GMM estimators," Journal of Econometrics, Elsevier, vol. 126(1), pages 25-51, May.
    31. Hansen, Lars Peter & Singleton, Kenneth J, 1982. "Generalized Instrumental Variables Estimation of Nonlinear Rational Expectations Models," Econometrica, Econometric Society, vol. 50(5), pages 1269-1286, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maurice J. G. Bun & Frank Windmeijer, 2010. "The weak instrument problem of the system GMM estimator in dynamic panel data models," Econometrics Journal, Royal Economic Society, vol. 13(1), pages 95-126, February.
    2. Chao, John C. & Hausman, Jerry A. & Newey, Whitney K. & Swanson, Norman R. & Woutersen, Tiemen, 2014. "Testing overidentifying restrictions with many instruments and heteroskedasticity," Journal of Econometrics, Elsevier, vol. 178(P1), pages 15-21.
    3. Todd, Prono, 2010. "Simple GMM Estimation of the Semi-Strong GARCH(1,1) Model," MPRA Paper 20034, University Library of Munich, Germany.
    4. Mehmet Caner & Xu Han & Yoonseok Lee, 2018. "Adaptive Elastic Net GMM Estimation With Many Invalid Moment Conditions: Simultaneous Model and Moment Selection," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 24-46, January.
    5. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    6. Guo, Zijian & Kang, Hyunseung & Cai, T. Tony & Small, Dylan S., 2018. "Testing endogeneity with high dimensional covariates," Journal of Econometrics, Elsevier, vol. 207(1), pages 175-187.
    7. Patrizia Ordine & Giuseppe Rose, 2008. "Local Banks Efficiency and Employment," LABOUR, CEIS, vol. 22(3), pages 469-493, September.
    8. Chao, John C. & Swanson, Norman R. & Hausman, Jerry A. & Newey, Whitney K. & Woutersen, Tiemen, 2012. "Asymptotic Distribution Of Jive In A Heteroskedastic Iv Regression With Many Instruments," Econometric Theory, Cambridge University Press, vol. 28(1), pages 42-86, February.
    9. Yuichi Kitamura, 2006. "Empirical Likelihood Methods in Econometrics: Theory and Practice," CIRJE F-Series CIRJE-F-430, CIRJE, Faculty of Economics, University of Tokyo.
    10. Frank Windmeijer, 2006. "GMM for panel count data models," Bristol Economics Discussion Papers 06/591, School of Economics, University of Bristol, UK.
    11. Stanislav Anatolyev, 2007. "Inference about predictive ability when there are many predictors," Working Papers w0096, Center for Economic and Financial Research (CEFIR).
    12. Yoonseok Lee & Ryo Okui, 2009. "A Specification Test for Instrumental Variables Regression with Many Instruments," Cowles Foundation Discussion Papers 1741, Cowles Foundation for Research in Economics, Yale University.
    13. Travaglini, Guido, 2010. "Dynamic Econometric Testing of Climate Change and of its Causes," MPRA Paper 23600, University Library of Munich, Germany.
    14. Enrica Croda & Ekaterini Kyriazidou & Iannis Polycarpou, 2011. "Intertemporal Labor Force Participation of Married Women in Germany: A Panel Data Analysis," Working Papers 2011_17, Department of Economics, University of Venice "Ca' Foscari".
    15. Yaya Li & Yongli Li & Yulin Zhao & Fang Wang, 2014. "Which factor dominates the industry evolution? A synergy analysis based on China's ICT industry," Papers 1403.4305, arXiv.org.
    16. Travaglini, Guido, 2010. "Supervised Principal Components and Factor Instrumental Variables. An Application to Violent CrimeTrends in the US, 1982-2005," MPRA Paper 22077, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.
    2. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    3. Yuichi Kitamura, 2006. "Empirical Likelihood Methods in Econometrics: Theory and Practice," CIRJE F-Series CIRJE-F-430, CIRJE, Faculty of Economics, University of Tokyo.
    4. Guggenberger, Patrik & Ramalho, Joaquim J.S. & Smith, Richard J., 2012. "GEL statistics under weak identification," Journal of Econometrics, Elsevier, vol. 170(2), pages 331-349.
    5. Frank Kleibergen, 2004. "Expansions of GMM statistics that indicate their properties under weak and/or many instruments and the bootstrap," Econometric Society 2004 North American Summer Meetings 408, Econometric Society.
    6. Parente, Paulo M.D.C. & Smith, Richard J., 2017. "Tests of additional conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 200(1), pages 1-16.
    7. Guggenberger, Patrik & Smith, Richard J., 2008. "Generalized empirical likelihood tests in time series models with potential identification failure," Journal of Econometrics, Elsevier, vol. 142(1), pages 134-161, January.
    8. Donald, Stephen G. & Imbens, Guido W. & Newey, Whitney K., 2003. "Empirical likelihood estimation and consistent tests with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 117(1), pages 55-93, November.
    9. Hausman, Jerry & Lewis, Randall & Menzel, Konrad & Newey, Whitney, 2011. "Properties of the CUE estimator and a modification with moments," Journal of Econometrics, Elsevier, vol. 165(1), pages 45-57.
    10. Richard Smith, 2005. "Weak instruments and empirical likelihood: a discussion of the papers by DWK Andrews and JH Stock and Y Kitamura," CeMMAP working papers CWP13/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Fan, Yanqin & Gentry, Matthew & Li, Tong, 2011. "A new class of asymptotically efficient estimators for moment condition models," Journal of Econometrics, Elsevier, vol. 162(2), pages 268-277, June.
    12. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    13. Jeffrey M. Wooldridge, 2004. "Estimating average partial effects under conditional moment independence assumptions," CeMMAP working papers CWP03/04, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    14. Hahn, Jinyong & Newey, Whitney K. & Smith, Richard J., 2014. "Neglected heterogeneity in moment condition models," Journal of Econometrics, Elsevier, vol. 178(P1), pages 86-100.
    15. Richard Smith, 2005. "Local GEL methods for conditional moment restrictions," CeMMAP working papers CWP15/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    16. Giuseppe Ragusa, 2011. "Minimum Divergence, Generalized Empirical Likelihoods, and Higher Order Expansions," Econometric Reviews, Taylor & Francis Journals, vol. 30(4), pages 406-456, August.
    17. Alain Guay & Florian Pelgrin, 2007. "Using Implied Probabilities to Improve Estimation with Unconditional Moment Restrictions," Cahiers de recherche 0747, CIRPEE.
    18. Smith, Richard J., 2007. "Efficient information theoretic inference for conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 138(2), pages 430-460, June.
    19. Chao, John C. & Swanson, Norman R. & Hausman, Jerry A. & Newey, Whitney K. & Woutersen, Tiemen, 2012. "Asymptotic Distribution Of Jive In A Heteroskedastic Iv Regression With Many Instruments," Econometric Theory, Cambridge University Press, vol. 28(1), pages 42-86, February.
    20. Okui, Ryo, 2009. "The optimal choice of moments in dynamic panel data models," Journal of Econometrics, Elsevier, vol. 151(1), pages 1-16, July.

    More about this item

    Keywords

    GMM; Continuous Updating; Many Moments; Variance Adjustment;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:18/05. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.