IDEAS home Printed from https://ideas.repec.org/p/tky/fseres/2006cf430.html
   My bibliography  Save this paper

Empirical Likelihood Methods in Econometrics: Theory and Practice

Author

Listed:
  • Yuichi Kitamura

    (Department of Economics, Yale University)

Abstract

Recent developments in empirical likelihood (EL) methods are reviewed. First, to put the method inperspective, two interpretations of empirical likelihood are presented, one as a nonparametric maximum likelihood estimation method (NPMLE) and the other as a generalized minimum contrast estimator(GMC). The latter interpretation provides a clear connection between EL, GMM, GEL and other related estimators. Second, EL is shown to have various advantages over other methods. The theory of large deviations demonstrates that EL emerges naturally in achieving asymptotic optimality both for estimation and testing. Interestingly, higher order asymptotic analysis also suggests that EL is generally a preferred method. Third, extensions of EL are discussed in various settings, including estimation of conditional moment restriction models, nonparametric specification testing and time series models. Finally, practical issues in applying EL to real data, such as computational algorithms for EL, are discussed. Numerical examples to illustrate the efficacy of the method are presented.

Suggested Citation

  • Yuichi Kitamura, 2006. "Empirical Likelihood Methods in Econometrics: Theory and Practice," CIRJE F-Series CIRJE-F-430, CIRJE, Faculty of Economics, University of Tokyo.
  • Handle: RePEc:tky:fseres:2006cf430
    as

    Download full text from publisher

    File URL: http://www.cirje.e.u-tokyo.ac.jp/research/dp/2006/2006cf430.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. P. Gagliardini & C. Gourieroux & E. Renault, 2011. "Efficient Derivative Pricing by the Extended Method of Moments," Econometrica, Econometric Society, vol. 79(4), pages 1181-1232, July.
    2. Zhang, Junjian, 2006. "Empirical likelihood for NA series," Statistics & Probability Letters, Elsevier, vol. 76(2), pages 153-160, January.
    3. Heckman, James & Singer, Burton, 1984. "A Method for Minimizing the Impact of Distributional Assumptions in Econometric Models for Duration Data," Econometrica, Econometric Society, vol. 52(2), pages 271-320, March.
    4. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    5. Manuel A. Domínguez & Ignacio N. Lobato, 2004. "Consistent Estimation of Models Defined by Conditional Moment Restrictions," Econometrica, Econometric Society, vol. 72(5), pages 1601-1615, September.
    6. Otsu, Taisuke & Whang, Yoon-Jae, 2011. "Testing For Nonnested Conditional Moment Restrictions Via Conditional Empirical Likelihood," Econometric Theory, Cambridge University Press, vol. 27(1), pages 114-153, February.
    7. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    8. Donald J. Brown & Marten H. Wegkamp, 2002. "Weighted Minimum Mean-Square Distance from Independence Estimation," Econometrica, Econometric Society, vol. 70(5), pages 2035-2051, September.
    9. Guggenberger, Patrik & Smith, Richard J., 2005. "Generalized Empirical Likelihood Estimators And Tests Under Partial, Weak, And Strong Identification," Econometric Theory, Cambridge University Press, vol. 21(4), pages 667-709, August.
    10. Altonji, Joseph G & Segal, Lewis M, 1996. "Small-Sample Bias in GMM Estimation of Covariance Structures," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 353-366, July.
    11. Tripathi, Gautam, 2011. "Moment-Based Inference With Stratified Data," Econometric Theory, Cambridge University Press, vol. 27(1), pages 47-73, February.
    12. Judith K. Hellerstein & Guido W. Imbens, 1999. "Imposing Moment Restrictions From Auxiliary Data By Weighting," The Review of Economics and Statistics, MIT Press, vol. 81(1), pages 1-14, February.
    13. Manski, Charles F, 1983. "Closest Empirical Distribution Estimation," Econometrica, Econometric Society, vol. 51(2), pages 305-319, March.
    14. Robinson, P M, 1987. "Asymptotically Efficient Estimation in the Presence of Heteroskedasticity of Unknown Form," Econometrica, Econometric Society, vol. 55(4), pages 875-891, July.
    15. Antoine, Bertille & Bonnal, Helene & Renault, Eric, 2007. "On the efficient use of the informational content of estimating equations: Implied probabilities and Euclidean empirical likelihood," Journal of Econometrics, Elsevier, vol. 138(2), pages 461-487, June.
    16. Song Xi Chen & Wolfgang Härdle & Ming Li, 2003. "An empirical likelihood goodness‐of‐fit test for time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(3), pages 663-678, August.
    17. Newey, Whitney K, 1990. "Efficient Instrumental Variables Estimation of Nonlinear Models," Econometrica, Econometric Society, vol. 58(4), pages 809-837, July.
    18. Smith, Richard J, 1997. "Alternative Semi-parametric Likelihood Approaches to Generalised Method of Moments Estimation," Economic Journal, Royal Economic Society, vol. 107(441), pages 503-519, March.
    19. Whang, Yoon-Jae, 2006. "Smoothed Empirical Likelihood Methods For Quantile Regression Models," Econometric Theory, Cambridge University Press, vol. 22(2), pages 173-205, April.
    20. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    21. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    22. Bryan W. Brown & Whitney K. Newey, 1998. "Efficient Semiparametric Estimation of Expectations," Econometrica, Econometric Society, vol. 66(2), pages 453-464, March.
    23. Tae-Hwan Kim & Halbert White, 2003. "Estimation, Inference, And Specification Testing For Possibly Misspecified Quantile Regression," Advances in Econometrics, in: Maximum Likelihood Estimation of Misspecified Models: Twenty Years Later, pages 107-132, Emerald Group Publishing Limited.
    24. Ramalho, Joaquim J. S. & Smith, Richard J., 2002. "Generalized empirical likelihood non-nested tests," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 99-125, March.
    25. Blundell, Richard & Bond, Stephen, 1998. "Initial conditions and moment restrictions in dynamic panel data models," Journal of Econometrics, Elsevier, vol. 87(1), pages 115-143, August.
    26. Keisuke Hirano, 2002. "Semiparametric Bayesian Inference in Autoregressive Panel Data Models," Econometrica, Econometric Society, vol. 70(2), pages 781-799, March.
    27. Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
    28. Bond, Stephen & Bowsher, Clive & Windmeijer, Frank, 2001. "Criterion-based inference for GMM in autoregressive panel data models," Economics Letters, Elsevier, vol. 73(3), pages 379-388, December.
    29. Chen S.X. & Leung D.H.Y. & Qin J., 2003. "Information Recovery in a Study With Surrogate Endpoints," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 1052-1062, January.
    30. Marriott,Paul & Salmon,Mark (ed.), 2000. "Applications of Differential Geometry to Econometrics," Cambridge Books, Cambridge University Press, number 9780521651165.
    31. Guido W. Imbens & Richard H. Spady & Phillip Johnson, 1998. "Information Theoretic Approaches to Inference in Moment Condition Models," Econometrica, Econometric Society, vol. 66(2), pages 333-358, March.
    32. Geweke, John & Keane, Michael, 2000. "An empirical analysis of earnings dynamics among men in the PSID: 1968-1989," Journal of Econometrics, Elsevier, vol. 96(2), pages 293-356, June.
    33. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    34. Whitney K. Newey & Frank Windmeijer, 2005. "GMM with many weak moment conditions," CeMMAP working papers CWP18/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    35. Guido W. Imbens, 1997. "One-Step Estimators for Over-Identified Generalized Method of Moments Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(3), pages 359-383.
    36. Andrew Chesher & Richard J. Smith, 1997. "Likelihood Ratio Specification Tests," Econometrica, Econometric Society, vol. 65(3), pages 627-646, May.
    37. Bravo, Francesco, 2002. "Blockwise empirical Cressie-Read test statistics for [alpha]-mixing processes," Statistics & Probability Letters, Elsevier, vol. 58(3), pages 319-325, July.
    38. Christoffersen, Peter & Hahn, Jinyong & Inoue, Atsushi, 2001. "Testing and comparing Value-at-Risk measures," Journal of Empirical Finance, Elsevier, vol. 8(3), pages 325-342, July.
    39. Yuichi Kitamura & Gautam Tripathi & Hyungtaik Ahn, 2004. "Empirical Likelihood-Based Inference in Conditional Moment Restriction Models," Econometrica, Econometric Society, vol. 72(6), pages 1667-1714, November.
    40. Donald, Stephen G. & Newey, Whitney K., 2000. "A jackknife interpretation of the continuous updating estimator," Economics Letters, Elsevier, vol. 67(3), pages 239-243, June.
    41. Donald, Stephen G. & Imbens, Guido W. & Newey, Whitney K., 2003. "Empirical likelihood estimation and consistent tests with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 117(1), pages 55-93, November.
    42. Stanislav Anatolyev, 2005. "GMM, GEL, Serial Correlation, and Asymptotic Bias," Econometrica, Econometric Society, vol. 73(3), pages 983-1002, May.
    43. Jian Zhang & Irène Gijbels, 2003. "Sieve Empirical Likelihood and Extensions of the Generalized Least Squares," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 30(1), pages 1-24, March.
    44. Gali, Jordi & Gertler, Mark, 1999. "Inflation dynamics: A structural econometric analysis," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 195-222, October.
    45. Lin, Lu & Zhang, Runchu, 2001. "Blockwise empirical Euclidean likelihood for weakly dependent processes," Statistics & Probability Letters, Elsevier, vol. 53(2), pages 143-152, June.
    46. Chamberlain, Gary, 1987. "Asymptotic efficiency in estimation with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 34(3), pages 305-334, March.
    47. Hall, Peter & Horowitz, Joel L, 1996. "Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators," Econometrica, Econometric Society, vol. 64(4), pages 891-916, July.
    48. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    49. Naoto Kunitomo & Yukitoshi Matsushita, 2003. "On Finite Sample Distributions of the Empirical Likelihood Estimator and the GMM Estimator," CIRJE F-Series CIRJE-F-200, CIRJE, Faculty of Economics, University of Tokyo.
    50. Hansen, Lars Peter & Heaton, John & Yaron, Amir, 1996. "Finite-Sample Properties of Some Alternative GMM Estimators," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 262-280, July.
    51. Frank Kleibergen, 2002. "Pivotal Statistics for Testing Structural Parameters in Instrumental Variables Regression," Econometrica, Econometric Society, vol. 70(5), pages 1781-1803, September.
    52. Ait-Sahalia, Yacine & Bickel, Peter J. & Stoker, Thomas M., 2001. "Goodness-of-fit tests for kernel regression with an application to option implied volatilities," Journal of Econometrics, Elsevier, vol. 105(2), pages 363-412, December.
    53. Hansen, Lars Peter & Singleton, Kenneth J, 1982. "Generalized Instrumental Variables Estimation of Nonlinear Rational Expectations Models," Econometrica, Econometric Society, vol. 50(5), pages 1269-1286, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. J. Arismendi-Zambrano & R. Azevedo, 2020. "Implicit Entropic Market Risk-Premium from Interest Rate Derivatives," Economics Department Working Paper Series n303-20.pdf, Department of Economics, National University of Ireland - Maynooth.
    2. Anisha Ghosh & Christian Julliard & Alex P. Taylor, 2017. "What Is the Consumption-CAPM Missing? An Information-Theoretic Framework for the Analysis of Asset Pricing Models," The Review of Financial Studies, Society for Financial Studies, vol. 30(2), pages 442-504.
    3. Xu, Ke-Li, 2009. "Empirical likelihood-based inference for nonparametric recurrent diffusions," Journal of Econometrics, Elsevier, vol. 153(1), pages 65-82, November.
    4. Canay, Ivan A., 2010. "EL inference for partially identified models: Large deviations optimality and bootstrap validity," Journal of Econometrics, Elsevier, vol. 156(2), pages 408-425, June.
    5. Thanasis Stengos & Ximing Wu, 2010. "Information-Theoretic Distribution Test with Application to Normality," Econometric Reviews, Taylor & Francis Journals, vol. 29(3), pages 307-329.
    6. Prosper Dovonon, 2016. "Large Sample Properties of the Three-Step Euclidean Likelihood Estimators under Model Misspecification," Econometric Reviews, Taylor & Francis Journals, vol. 35(4), pages 465-514, April.
    7. Almeida, Caio & Freire, Gustavo, 2022. "Pricing of index options in incomplete markets," Journal of Financial Economics, Elsevier, vol. 144(1), pages 174-205.
    8. Devereux, Paul J. & Tripathi, Gautam, 2009. "Optimally combining censored and uncensored datasets," Journal of Econometrics, Elsevier, vol. 151(1), pages 17-32, July.
    9. Stefan Boes, 2007. "Count Data Models with Unobserved Heterogeneity: An Empirical Likelihood Approach," SOI - Working Papers 0704, Socioeconomic Institute - University of Zurich.
    10. Alain Guay & Florian Pelgrin, 2016. "Using Implied Probabilities to Improve the Estimation of Unconditional Moment Restrictions for Weakly Dependent Data," Econometric Reviews, Taylor & Francis Journals, vol. 35(3), pages 344-372, March.
    11. Gishan Dissanaike & Amir Amel-Zadeh, 2007. ""Discussion of" Venture Capitalists, Business Angels, and Performance of Entrepreneurial IPOs in the UK and France," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 34(3-4), pages 529-540.
    12. Xiao, Zhiguo, 2010. "The weighted method of moments approach for moment condition models," Economics Letters, Elsevier, vol. 107(2), pages 183-186, May.
    13. Caio Almeida & René Garcia, 2017. "Economic Implications of Nonlinear Pricing Kernels," Management Science, INFORMS, vol. 63(10), pages 3361-3380, October.
    14. Xu, Ke-Li, 2020. "Inference of local regression in the presence of nuisance parameters," Journal of Econometrics, Elsevier, vol. 218(2), pages 532-560.
    15. Jun Ma & Zhengfei Yu, 2020. "Empirical Likelihood Covariate Adjustment for Regression Discontinuity Designs," Papers 2008.09263, arXiv.org, revised May 2024.
    16. Liao, Yuan & Jiang, Wenxin, 2011. "Posterior consistency of nonparametric conditional moment restricted models," MPRA Paper 38700, University Library of Munich, Germany.
    17. George A Vamvoukas, 2012. "Panel data modelling and the tax-spend controversy in the euro zone," Applied Economics, Taylor & Francis Journals, vol. 44(31), pages 4073-4085, November.
    18. Lehmann, Bruce N., 2009. "The role of beliefs in inference for rational expectations models," Journal of Econometrics, Elsevier, vol. 150(2), pages 322-331, June.
    19. Yuan, Ao & He, Wenqing & Wang, Binhuan & Qin, Gengsheng, 2012. "U-statistic with side information," Journal of Multivariate Analysis, Elsevier, vol. 111(C), pages 20-38.
    20. Zhiguo Xiao, 2011. "Efficient Estimation of Moment Condition Models with Heterogenous Populations," Annals of Economics and Finance, Society for AEF, vol. 12(1), pages 89-107, May.
    21. Xianyang Zhang & Xiaofeng Shao, 2016. "On the coverage bound problem of empirical likelihood methods for time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(2), pages 395-421, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guggenberger, Patrik & Ramalho, Joaquim J.S. & Smith, Richard J., 2012. "GEL statistics under weak identification," Journal of Econometrics, Elsevier, vol. 170(2), pages 331-349.
    2. Whitney K. Newey & Frank Windmeijer, 2005. "GMM with many weak moment conditions," CeMMAP working papers CWP18/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. repec:bla:ecorec:v:91:y:2015:i::p:1-24 is not listed on IDEAS
    4. Fan, Yanqin & Gentry, Matthew & Li, Tong, 2011. "A new class of asymptotically efficient estimators for moment condition models," Journal of Econometrics, Elsevier, vol. 162(2), pages 268-277, June.
    5. Prosper Dovonon, 2016. "Large Sample Properties of the Three-Step Euclidean Likelihood Estimators under Model Misspecification," Econometric Reviews, Taylor & Francis Journals, vol. 35(4), pages 465-514, April.
    6. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    7. Smith, Richard J., 2007. "Efficient information theoretic inference for conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 138(2), pages 430-460, June.
    8. Richard Smith, 2005. "Local GEL methods for conditional moment restrictions," CeMMAP working papers CWP15/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Giuseppe Ragusa, 2011. "Minimum Divergence, Generalized Empirical Likelihoods, and Higher Order Expansions," Econometric Reviews, Taylor & Francis Journals, vol. 30(4), pages 406-456, August.
    10. Alain Guay & Florian Pelgrin, 2007. "Using Implied Probabilities to Improve Estimation with Unconditional Moment Restrictions," Cahiers de recherche 0747, CIRPEE.
    11. Parente, Paulo M.D.C. & Smith, Richard J., 2017. "Tests of additional conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 200(1), pages 1-16.
    12. Seojeong Lee, 2018. "Asymptotic Refinements of a Misspecification-Robust Bootstrap for Generalized Empirical Likelihood Estimators," Papers 1806.00953, arXiv.org, revised Jun 2018.
    13. Lee, Seojeong, 2016. "Asymptotic refinements of a misspecification-robust bootstrap for GEL estimators," Journal of Econometrics, Elsevier, vol. 192(1), pages 86-104.
    14. Alain Guay & Jean-Francois Lamarche, 2005. "The Information Content of Implied Probabilities to Detect Structural Change," Working Papers 0804, Brock University, Department of Economics, revised Oct 2008.
    15. Stefan Boes, 2010. "Count Data Models with Correlated Unobserved Heterogeneity," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 37(3), pages 382-402, September.
    16. Gospodinov, Nikolay & Otsu, Taisuke, 2012. "Local GMM estimation of time series models with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 170(2), pages 476-490.
    17. Mikio Ito & Akihiko Noda, 2012. "The GEL estimates resolve the risk-free rate puzzle in Japan," Applied Financial Economics, Taylor & Francis Journals, vol. 22(5), pages 365-374, March.
    18. La Vecchia, Davide & Moor, Alban & Scaillet, Olivier, 2023. "A higher-order correct fast moving-average bootstrap for dependent data," Journal of Econometrics, Elsevier, vol. 235(1), pages 65-81.
    19. Antoine, Bertille & Bonnal, Helene & Renault, Eric, 2007. "On the efficient use of the informational content of estimating equations: Implied probabilities and Euclidean empirical likelihood," Journal of Econometrics, Elsevier, vol. 138(2), pages 461-487, June.
    20. Stefan Boes, 2007. "Count Data Models with Unobserved Heterogeneity: An Empirical Likelihood Approach," SOI - Working Papers 0704, Socioeconomic Institute - University of Zurich.
    21. Hill, Jonathan B. & Prokhorov, Artem, 2016. "GEL estimation for heavy-tailed GARCH models with robust empirical likelihood inference," Journal of Econometrics, Elsevier, vol. 190(1), pages 18-45.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tky:fseres:2006cf430. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CIRJE administrative office (email available below). General contact details of provider: https://edirc.repec.org/data/ritokjp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.