IDEAS home Printed from https://ideas.repec.org/p/crs/wpaper/2016-21.html
   My bibliography  Save this paper

Bayesian Empirical Likelihood Estimation and Comparison of Moment Condition Models

Author

Listed:
  • Siddharta Chib

    (Olin Business School, Washington University in St. Louis)

  • Minchul Shin

    (University of Illinois)

  • Anna Simoni

    (CREST)

Abstract

In this paper we consider the problem of inference in statistical models characterized by moment restrictions by casting the problem within the Exponentially Tilted Empirical Likelihood (ETEL) framework. Because the ETEL function has a well de ned probabilistic interpretation and plays the role of a likelihood, a fully Bayesian framework can be developed. We establish a number of powerful results surrounding the Bayesian ETEL framework in such models. One ma jor concern driving our work is the possibility of misspeci cation. To accommodate this possibility, we show how the moment conditions can be reexpressed in terms of additional nuisance parameters and that, even under misspeci cation, the Bayesian ETEL posterior distribution satis es a Bernstein-von Mises result. A second key contribution of the paper is the development of a framework based on marginal likelihoods (MLs) and Bayes factors to compare models de ned by di erent moment conditions. Computation of the MLs is by Chib (1995)'s method. We establish the consistency of the Bayes factors and show that the ML favors the model with the minimum number of parameters and the maximum number of valid moment restrictions. When the models are misspeci ed, the ML model selection procedure selects the model that is closer to the (unknown) true data generating process in terms of the Kullback-Leibler divergence. The ideas and results in this paper provide a further broadening of the theoretical underpinning and value of the Bayesian ETEL framework with likely far-reaching practical consequences. The discussion is illuminated through several examples.

Suggested Citation

  • Siddharta Chib & Minchul Shin & Anna Simoni, 2016. "Bayesian Empirical Likelihood Estimation and Comparison of Moment Condition Models," Working Papers 2016-21, Center for Research in Economics and Statistics.
  • Handle: RePEc:crs:wpaper:2016-21
    as

    Download full text from publisher

    File URL: http://crest.science/RePEc/wpstorage/2016-21.pdf
    File Function: Crest working paper version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    3. Sanjay Chaudhuri & Malay Ghosh, 2011. "Empirical likelihood for small area estimation," Biometrika, Biometrika Trust, vol. 98(2), pages 473-480.
    4. Kai-Tai Fang & Rahul Mukerjee, 2006. "Empirical-type likelihoods allowing posterior credible sets with frequentist validity: Higher-order asymptotics," Biometrika, Biometrika Trust, vol. 93(3), pages 723-733, September.
    5. Song Chen & Ingrid Van Keilegom, 2009. "A review on empirical likelihood methods for regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 18(3), pages 415-447, November.
    6. Sanjay Chaudhuri & Debashis Mondal & Teng Yin, 2017. "Hamiltonian Monte Carlo sampling in Bayesian empirical likelihood computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 293-320, January.
    7. Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
    8. J. N. K. Rao & Changbao Wu, 2010. "Bayesian pseudo‐empirical‐likelihood intervals for complex surveys," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(4), pages 533-544, September.
    9. Nicole A. Lazar, 2003. "Bayesian empirical likelihood," Biometrika, Biometrika Trust, vol. 90(2), pages 319-326, June.
    10. Chib, Siddhartha & Ramamurthy, Srikanth, 2010. "Tailored randomized block MCMC methods with application to DSGE models," Journal of Econometrics, Elsevier, vol. 155(1), pages 19-38, March.
    11. Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
    12. Hong, Han & Preston, Bruce, 2012. "Bayesian averaging, prediction and nonnested model selection," Journal of Econometrics, Elsevier, vol. 167(2), pages 358-369.
    13. Susanne M. Schennach, 2005. "Bayesian exponentially tilted empirical likelihood," Biometrika, Biometrika Trust, vol. 92(1), pages 31-46, March.
    14. Tony Lancaster & Sung Jae Jun, 2010. "Bayesian quantile regression methods," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(2), pages 287-307.
    15. Sueishi, Naoya, 2013. "Identification problem of the exponential tilting estimator under misspecification," Economics Letters, Elsevier, vol. 118(3), pages 509-511.
    16. Susanne M. Schennach, 2007. "Point estimation with exponentially tilted empirical likelihood," Papers 0708.1874, arXiv.org.
    17. Song Chen & Ingrid Van Keilegom, 2009. "Rejoinder on: A review on empirical likelihood methods for regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 18(3), pages 468-474, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhichao Liu & Catherine Forbes & Heather Anderson, 2017. "Robust Bayesian exponentially tilted empirical likelihood method," Monash Econometrics and Business Statistics Working Papers 21/17, Monash University, Department of Econometrics and Business Statistics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Cheng & Jiang, Wenxin, 2016. "On oracle property and asymptotic validity of Bayesian generalized method of moments," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 132-147.
    2. Chang, Jinyuan & Chen, Song Xi & Chen, Xiaohong, 2015. "High dimensional generalized empirical likelihood for moment restrictions with dependent data," Journal of Econometrics, Elsevier, vol. 185(1), pages 283-304.
    3. Sanjay Chaudhuri & Debashis Mondal & Teng Yin, 2017. "Hamiltonian Monte Carlo sampling in Bayesian empirical likelihood computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 293-320, January.
    4. Jean-Pierre Florens & Anna Simoni, 2021. "Gaussian Processes and Bayesian Moment Estimation," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 482-492, March.
    5. Zhichao Liu & Catherine Forbes & Heather Anderson, 2017. "Robust Bayesian exponentially tilted empirical likelihood method," Monash Econometrics and Business Statistics Working Papers 21/17, Monash University, Department of Econometrics and Business Statistics.
    6. Siddhartha Chib & Minchul Shin & Anna Simoni, 2022. "Bayesian estimation and comparison of conditional moment models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(3), pages 740-764, July.
    7. Philip Kostov, 2013. "Empirical likelihood estimation of the spatial quantile regression," Journal of Geographical Systems, Springer, vol. 15(1), pages 51-69, January.
    8. Lavergne, Pascal, 2015. "Assessing the Approximate Validity of Moment Restrictions," TSE Working Papers 15-562, Toulouse School of Economics (TSE), revised May 2020.
    9. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    10. Otsu, Taisuke, 2010. "On Bahadur efficiency of empirical likelihood," Journal of Econometrics, Elsevier, vol. 157(2), pages 248-256, August.
    11. Zhang, Jia & Shi, Haoming & Tian, Lemeng & Xiao, Fengjun, 2019. "Penalized generalized empirical likelihood in high-dimensional weakly dependent data," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 270-283.
    12. Giuseppe Ragusa, 2011. "Minimum Divergence, Generalized Empirical Likelihoods, and Higher Order Expansions," Econometric Reviews, Taylor & Francis Journals, vol. 30(4), pages 406-456, August.
    13. Luo, Yu & Graham, Daniel J. & McCoy, Emma J., 2023. "Semiparametric Bayesian doubly robust causal estimation," LSE Research Online Documents on Economics 117944, London School of Economics and Political Science, LSE Library.
    14. Kai Yang & Xue Ding & Xiaohui Yuan, 2022. "Bayesian empirical likelihood inference and order shrinkage for autoregressive models," Statistical Papers, Springer, vol. 63(1), pages 97-121, February.
    15. Yuichi Kitamura & Taisuke Otsu & Kirill Evdokimov, 2013. "Robustness, Infinitesimal Neighborhoods, and Moment Restrictions," Econometrica, Econometric Society, vol. 81(3), pages 1185-1201, May.
    16. Lô, Serigne N. & Ronchetti, Elvezio, 2012. "Robust small sample accurate inference in moment condition models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3182-3197.
    17. Amor Keziou & Aida Toma, 2021. "A Robust Version of the Empirical Likelihood Estimator," Mathematics, MDPI, vol. 9(8), pages 1-19, April.
    18. Christian Julliard & Anisha Ghosh, 2012. "Can Rare Events Explain the Equity Premium Puzzle?," The Review of Financial Studies, Society for Financial Studies, vol. 25(10), pages 3037-3076.
    19. Jin, Fei & Lee, Lung-fei, 2019. "GEL estimation and tests of spatial autoregressive models," Journal of Econometrics, Elsevier, vol. 208(2), pages 585-612.
    20. de Castro, Luciano & Galvao, Antonio F. & Kaplan, David M. & Liu, Xin, 2019. "Smoothed GMM for quantile models," Journal of Econometrics, Elsevier, vol. 213(1), pages 121-144.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crs:wpaper:2016-21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General (email available below). General contact details of provider: https://edirc.repec.org/data/crestfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.