IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/04-03.html
   My bibliography  Save this paper

Higher order properties of GMM and generalised empirical likelihood estimators

Author

Listed:
  • Whitney K. Newey

    (Institute for Fiscal Studies and MIT)

  • Richard Smith

    (Institute for Fiscal Studies and University of Cambridge)

Abstract

In an effort to improve the small sample properties of generalized method of moments (GMM) estimators, a number of alternative estimators have been suggested. These include empirical likelihood (EL), continuous updating, and exponential tilting estimators. We show that these estimators share a common structure, being members of a class of generalized empirical likelihood (GEL) estimators. We use this structure to compare their higher order asymptotic properties. We find that GEL has no asymptotic bias due to correlation of the moment functions with their Jacobian, eliminating an important source of bias for GMM in models with endogeneity. We also find that EL has no asymptotic bias from estimating the optimal weight matrix, eliminating a further important source of bias for GMM in panel data models. We give bias corrected GMM and GEL estimators. We also show that bias corrected EL inherits the higher order property of maximum likelihood, that it is higher order asymptotically effcient relative to the other bias corrected estimators.

Suggested Citation

  • Whitney K. Newey & Richard Smith, 2003. "Higher order properties of GMM and generalised empirical likelihood estimators," CeMMAP working papers CWP04/03, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    • Handle: RePEc:ifs:cemmap:04/03
    as

    Download full text from publisher

    File URL: http://cemmap.ifs.org.uk/wps/cwp0304.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Altonji, Joseph G & Segal, Lewis M, 1996. "Small-Sample Bias in GMM Estimation of Covariance Structures," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 353-366, July.
    3. Pfanzagl, J. & Wefelmeyer, W., 1978. "A third-order optimum property of the maximum likelihood estimator," Journal of Multivariate Analysis, Elsevier, vol. 8(1), pages 1-29, March.
    4. Smith, Richard J, 1997. "Alternative Semi-parametric Likelihood Approaches to Generalised Method of Moments Estimation," Economic Journal, Royal Economic Society, vol. 107(441), pages 503-519, March.
    5. Holtz-Eakin, Douglas & Newey, Whitney & Rosen, Harvey S, 1988. "Estimating Vector Autoregressions with Panel Data," Econometrica, Econometric Society, vol. 56(6), pages 1371-1395, November.
    6. Koenker, Roger & Machado, José A.F. & Skeels, Christopher L. & Welsh, Alan H., 1994. "Momentary Lapses: Moment Expansions and the Robustness of Minimum Distance Estimation," Econometric Theory, Cambridge University Press, vol. 10(1), pages 172-197, March.
    7. Bryan W. Brown & Whitney K. Newey, 1998. "Efficient Semiparametric Estimation of Expectations," Econometrica, Econometric Society, vol. 66(2), pages 453-464, March.
    8. Newey, Whitney K. & McFadden, Daniel, 1986. "Large sample estimation and hypothesis testing," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 36, pages 2111-2245, Elsevier.
    9. Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
    10. Robinson, Peter M, 1988. "The Stochastic Difference between Econometric Statistics," Econometrica, Econometric Society, vol. 56(3), pages 531-548, May.
    11. Amemiya, Takeshi, 1983. "Partially generalized least squares and two-stage least squares estimators," Journal of Econometrics, Elsevier, vol. 23(2), pages 275-283, October.
    12. Chamberlain, Gary, 1982. "Multivariate regression models for panel data," Journal of Econometrics, Elsevier, vol. 18(1), pages 5-46, January.
    13. Guido W. Imbens, 1997. "One-Step Estimators for Over-Identified Generalized Method of Moments Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(3), pages 359-383.
    14. Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
    15. Cragg, John G, 1983. "More Efficient Estimation in the Presence of Heteroscedasticity of Unknown Form," Econometrica, Econometric Society, vol. 51(3), pages 751-763, May.
    16. Joel L. Horowitz, 1998. "Bootstrap Methods for Covariance Structures," Journal of Human Resources, University of Wisconsin Press, vol. 33(1), pages 39-61.
    17. Whitney K. Newey & Joaquim J. S. Ramalho Ramalho & Richard Smith, 2003. "Asymptotic bias for GMM and GEL estimators with estimated nuisance parameters," CeMMAP working papers CWP05/03, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    18. Rilstone, Paul & Srivastava, V. K. & Ullah, Aman, 1996. "The second-order bias and mean squared error of nonlinear estimators," Journal of Econometrics, Elsevier, vol. 75(2), pages 369-395, December.
    19. Joel L. Horowitz, 1996. "Bootstrap Methods For Covariance Structures," Econometrics 9610003, University Library of Munich, Germany.
    20. Chamberlain, Gary, 1987. "Asymptotic efficiency in estimation with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 34(3), pages 305-334, March.
    21. Kezdi, Gabor & Hahn, Jinyong & Solon, Gary, 2002. "Jackknife minimum distance estimation," Economics Letters, Elsevier, vol. 76(1), pages 35-45, June.
    22. Hansen, Lars Peter & Heaton, John & Yaron, Amir, 1996. "Finite-Sample Properties of Some Alternative GMM Estimators," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 262-280, July.
    23. Back, Kerry & Brown, David P, 1993. "Implied Probabilities in GMM Estimators," Econometrica, Econometric Society, vol. 61(4), pages 971-975, July.
    24. Abowd, John M & Card, David, 1989. "On the Covariance Structure of Earnings and Hours Changes," Econometrica, Econometric Society, vol. 57(2), pages 411-445, March.
    25. Hansen, Lars Peter & Singleton, Kenneth J, 1982. "Generalized Instrumental Variables Estimation of Nonlinear Rational Expectations Models," Econometrica, Econometric Society, vol. 50(5), pages 1269-1286, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jeffrey M. Wooldridge, 2004. "Estimating average partial effects under conditional moment independence assumptions," CeMMAP working papers CWP03/04, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Joachim Inkmann, 2000. "Finite Sample Properties of One-Step, Two-Step and Bootstrap Empirical Likelihood Approaches to Efficient GMM Estimation," Econometric Society World Congress 2000 Contributed Papers 0332, Econometric Society.
    3. Smith, Richard J., 2007. "Efficient information theoretic inference for conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 138(2), pages 430-460, June.
    4. Whitney K. Newey & Frank Windmeijer, 2005. "GMM with many weak moment conditions," CeMMAP working papers CWP18/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    5. Whitney K. Newey & Richard Smith, 2003. "Higher order properties of GMM and generalised empirical likelihood estimators," CeMMAP working papers 04/03, Institute for Fiscal Studies.
    6. Parente, Paulo M.D.C. & Smith, Richard J., 2017. "Tests of additional conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 200(1), pages 1-16.
    7. Hahn, Jinyong & Newey, Whitney K. & Smith, Richard J., 2014. "Neglected heterogeneity in moment condition models," Journal of Econometrics, Elsevier, vol. 178(P1), pages 86-100.
    8. Yuichi Kitamura, 2006. "Empirical Likelihood Methods in Econometrics: Theory and Practice," CIRJE F-Series CIRJE-F-430, CIRJE, Faculty of Economics, University of Tokyo.
    9. Richard Smith, 2005. "Local GEL methods for conditional moment restrictions," CeMMAP working papers CWP15/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    10. Shane M. Sherlund, 2004. "Quasi Empirical Likelihood Estimation of Moment Condition Models," Econometric Society 2004 North American Summer Meetings 507, Econometric Society.
    11. Antoine, Bertille & Bonnal, Helene & Renault, Eric, 2007. "On the efficient use of the informational content of estimating equations: Implied probabilities and Euclidean empirical likelihood," Journal of Econometrics, Elsevier, vol. 138(2), pages 461-487, June.
    12. Fan, Yanqin & Gentry, Matthew & Li, Tong, 2011. "A new class of asymptotically efficient estimators for moment condition models," Journal of Econometrics, Elsevier, vol. 162(2), pages 268-277, June.
    13. Prosper Dovonon, 2016. "Large Sample Properties of the Three-Step Euclidean Likelihood Estimators under Model Misspecification," Econometric Reviews, Taylor & Francis Journals, vol. 35(4), pages 465-514, April.
    14. Joaquim Ramalho, 2003. "Small Sample Bias of Alternative Estimation Methods for Moment Condition Models: Monte Carlo Evidence for Covariance Structures and Instrumental Variables," Economics Working Papers 9_2003, University of Évora, Department of Economics (Portugal).
    15. Ramalho Joaquim J.S., 2005. "Small Sample Bias of Alternative Estimation Methods for Moment Condition Models: Monte Carlo Evidence for Covariance Structures," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 9(1), pages 1-20, March.
    16. Whitney K. Newey & Joaquim J.S. Ramalho & Richard J. Smith, 2003. "A symptotic Bias for GMM and GEL Estimators with Estimated Nuisance Parameter," Economics Working Papers 5_2003, University of Évora, Department of Economics (Portugal).
    17. Giuseppe Ragusa, 2011. "Minimum Divergence, Generalized Empirical Likelihoods, and Higher Order Expansions," Econometric Reviews, Taylor & Francis Journals, vol. 30(4), pages 406-456, August.
    18. Mikio Ito & Akihiko Noda, 2012. "The GEL estimates resolve the risk-free rate puzzle in Japan," Applied Financial Economics, Taylor & Francis Journals, vol. 22(5), pages 365-374, March.
    19. Donald, Stephen G. & Imbens, Guido W. & Newey, Whitney K., 2003. "Empirical likelihood estimation and consistent tests with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 117(1), pages 55-93, November.
    20. Hill, Jonathan B. & Prokhorov, Artem, 2016. "GEL estimation for heavy-tailed GARCH models with robust empirical likelihood inference," Journal of Econometrics, Elsevier, vol. 190(1), pages 18-45.

    More about this item

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C30 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:04/03. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.