IDEAS home Printed from https://ideas.repec.org/p/cdl/agrebk/qt20n3j23r.html

Large Deviations Theory and Empirical Estimator Choice

Author

Listed:
  • Grendar, Marian
  • Judge, George G.

Abstract

Criterion choice is such a hard problem in information recovery and in estimation and inference. In the case of inverse problems with noise, can probabilistic laws provide a basis for empirical estimator choice? That is the problem we investigate in this paper. Large Deviations Theory is used to evaluate the choice of estimator in the case of two fundamental situations-problems in modelling data. The probabilistic laws developed demonstrate that each problem has a unique solution-empirical estimator. Whether other members of the empirical estimator family can be associated a particular problem and conditional limit theorem, is an open question.

Suggested Citation

  • Grendar, Marian & Judge, George G., 2006. "Large Deviations Theory and Empirical Estimator Choice," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt20n3j23r, Department of Agricultural & Resource Economics, UC Berkeley.
    • Handle: RePEc:cdl:agrebk:qt20n3j23r
    as

    Download full text from publisher

    File URL: https://www.escholarship.org/uc/item/20n3j23r.pdf;origin=repeccitec
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Imbens, G., 1993. "A New Approach to Generalized Method on Moments Estimation," Harvard Institute of Economic Research Working Papers 1633, Harvard - Institute of Economic Research.
    2. Susanne M. Schennach, 2007. "Point estimation with exponentially tilted empirical likelihood," Papers 0708.1874, arXiv.org.
    3. Kitamura, Yuichi & Stutzer, Michael, 2002. "Connections between entropic and linear projections in asset pricing estimation," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 159-174, March.
    4. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    5. Guido W. Imbens & Richard H. Spady & Phillip Johnson, 1998. "Information Theoretic Approaches to Inference in Moment Condition Models," Econometrica, Econometric Society, vol. 66(2), pages 333-358, March.
    6. Judge G.G. & Mittelhammer R.C., 2004. "A Semiparametric Basis for Combining Estimation Problems Under Quadratic Loss," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 479-487, January.
    7. Marian Grendar Jr & Marian Grendar, 2003. "Maximum Probability/Entropy translating of contiguous categorical observations into frequencies," Econometrics 0309003, University Library of Munich, Germany.
    8. Yuichi Kitamura, 2001. "Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions," Econometrica, Econometric Society, vol. 69(6), pages 1661-1672, November.
    9. Francesco Bravo, "undated". "Bartlett-type Adjustments for Empirical Discrepancy Test Statistics," Discussion Papers 04/14, Department of Economics, University of York.
    10. Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giuseppe Ragusa, 2011. "Minimum Divergence, Generalized Empirical Likelihoods, and Higher Order Expansions," Econometric Reviews, Taylor & Francis Journals, vol. 30(4), pages 406-456, August.
    2. Otsu, Taisuke, 2010. "On Bahadur efficiency of empirical likelihood," Journal of Econometrics, Elsevier, vol. 157(2), pages 248-256, August.
    3. Yuichi Kitamura & Taisuke Otsu & Kirill Evdokimov, 2013. "Robustness, Infinitesimal Neighborhoods, and Moment Restrictions," Econometrica, Econometric Society, vol. 81(3), pages 1185-1201, May.
    4. Prosper Dovonon, 2016. "Large Sample Properties of the Three-Step Euclidean Likelihood Estimators under Model Misspecification," Econometric Reviews, Taylor & Francis Journals, vol. 35(4), pages 465-514, April.
    5. Alain Guay & Jean-Francois Lamarche, 2005. "The Information Content of Implied Probabilities to Detect Structural Change," Working Papers 0804, Brock University, Department of Economics, revised Oct 2008.
    6. Susanne M. Schennach, 2014. "Entropic Latent Variable Integration via Simulation," Econometrica, Econometric Society, vol. 82(1), pages 345-385, January.
    7. Susanne M. Schennach, 2007. "Point estimation with exponentially tilted empirical likelihood," Papers 0708.1874, arXiv.org.
    8. Lavergne, Pascal, 2015. "Assessing the Approximate Validity of Moment Restrictions," TSE Working Papers 15-562, Toulouse School of Economics (TSE), revised May 2020.
    9. Shane M. Sherlund, 2004. "Quasi Empirical Likelihood Estimation of Moment Condition Models," Econometric Society 2004 North American Summer Meetings 507, Econometric Society.
    10. Lô, Serigne N. & Ronchetti, Elvezio, 2012. "Robust small sample accurate inference in moment condition models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3182-3197.
    11. Israelov, Roni & Lugauer, Steven, 2011. "Combining empirical likelihood and generalized method of moments estimators: Asymptotics and higher order bias," Statistics & Probability Letters, Elsevier, vol. 81(9), pages 1339-1347, September.
    12. Caner, Mehmet, 2008. "Nearly-singular design in GMM and generalized empirical likelihood estimators," Journal of Econometrics, Elsevier, vol. 144(2), pages 511-523, June.
    13. Zhang, Xianyang, 2016. "Fixed-smoothing asymptotics in the generalized empirical likelihood estimation framework," Journal of Econometrics, Elsevier, vol. 193(1), pages 123-146.
    14. Chen, Xiaohong & Hansen, Lars Peter & Hansen, Peter G., 2024. "Robust inference for moment condition models without rational expectations," Journal of Econometrics, Elsevier, vol. 243(1).
    15. Jin, Fei & Lee, Lung-fei, 2019. "GEL estimation and tests of spatial autoregressive models," Journal of Econometrics, Elsevier, vol. 208(2), pages 585-612.
    16. Jieun Lee & Anil Bera, 2026. "Risk-Optimal Curvature Selection for Finite-Sample Cressie-Read Moment Estimation," Papers 2603.22599, arXiv.org, revised Jun 2026.
    17. Canay, Ivan A. & Otsu, Taisuke, 2012. "Hodges–Lehmann optimality for testing moment conditions," Journal of Econometrics, Elsevier, vol. 171(1), pages 45-53.
    18. Chaudhuri, Saraswata & Renault, Eric, 2020. "Score tests in GMM: Why use implied probabilities?," Journal of Econometrics, Elsevier, vol. 219(2), pages 260-280.
    19. Lee, Seojeong, 2016. "Asymptotic refinements of a misspecification-robust bootstrap for GEL estimators," Journal of Econometrics, Elsevier, vol. 192(1), pages 86-104.
    20. Xiaohong Chen & Lars Peter Hansen & Peter G. Hansen, 2020. "Robust identification of investor beliefs," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(52), pages 33130-33140, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cdl:agrebk:qt20n3j23r. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lisa Schiff (email available below). General contact details of provider: https://edirc.repec.org/data/dabrkus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.