IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v145y2016icp132-147.html
   My bibliography  Save this article

On oracle property and asymptotic validity of Bayesian generalized method of moments

Author

Listed:
  • Li, Cheng
  • Jiang, Wenxin

Abstract

Statistical inference based on moment conditions and estimating equations is of substantial interest when it is difficult to specify a full probabilistic model. We propose a Bayesian flavored model selection framework based on (quasi-)posterior probabilities from the Bayesian Generalized Method of Moments (BGMM), which allows us to incorporate two important advantages of a Bayesian approach: the expressiveness of posterior distributions and the convenient computational method of Markov Chain Monte Carlo (MCMC). Theoretically we show that BGMM can achieve the posterior consistency for selecting the unknown true model, and that it possesses a Bayesian version of the oracle property, i.e. the posterior distribution for the parameter of interest is asymptotically normal and is as informative as if the true model were known. In addition, we show that the proposed quasi-posterior is valid to be interpreted as an approximate posterior distribution given a data summary. Our applications include modeling of correlated data, quantile regression, and graphical models based on partial correlations. We demonstrate the implementation of the BGMM model selection through numerical examples.

Suggested Citation

  • Li, Cheng & Jiang, Wenxin, 2016. "On oracle property and asymptotic validity of Bayesian generalized method of moments," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 132-147.
  • Handle: RePEc:eee:jmvana:v:145:y:2016:i:c:p:132-147
    DOI: 10.1016/j.jmva.2015.12.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X15003358
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmva.2015.12.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Suojin Wang & Lianfen Qian & Raymond J. Carroll, 2010. "Generalized empirical likelihood methods for analyzing longitudinal data," Biometrika, Biometrika Trust, vol. 97(1), pages 79-93.
    3. Chenlei Leng & Cheng Yong Tang, 2012. "Penalized empirical likelihood and growing dimensional general estimating equations," Biometrika, Biometrika Trust, vol. 99(3), pages 703-716.
    4. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    5. repec:dau:papers:123456789/7848 is not listed on IDEAS
    6. Valen E. Johnson & David Rossell, 2012. "Bayesian Model Selection in High-Dimensional Settings," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 649-660, June.
    7. Kai-Tai Fang & Rahul Mukerjee, 2006. "Empirical-type likelihoods allowing posterior credible sets with frequentist validity: Higher-order asymptotics," Biometrika, Biometrika Trust, vol. 93(3), pages 723-733, September.
    8. Faming Liang & Qifan Song & Kai Yu, 2013. "Bayesian Subset Modeling for High-Dimensional Generalized Linear Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(502), pages 589-606, June.
    9. Chernozhukov, Victor & Hong, Han, 2003. "An MCMC approach to classical estimation," Journal of Econometrics, Elsevier, vol. 115(2), pages 293-346, August.
    10. Jean-Pierre Florens & Anna Simoni, 2021. "Gaussian Processes and Bayesian Moment Estimation," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 482-492, March.
    11. Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
    12. Kundhi, Gubhinder & Rilstone, Paul, 2013. "Edgeworth And Saddlepoint Expansions For Nonlinear Estimators," Econometric Theory, Cambridge University Press, vol. 29(5), pages 1057-1078, October.
    13. Lan Wang & Jianhui Zhou & Annie Qu, 2012. "Penalized Generalized Estimating Equations for High-Dimensional Longitudinal Data Analysis," Biometrics, The International Biometric Society, vol. 68(2), pages 353-360, June.
    14. Nicole A. Lazar, 2003. "Bayesian empirical likelihood," Biometrika, Biometrika Trust, vol. 90(2), pages 319-326, June.
    15. Smith, Michael & Kohn, Robert, 1996. "Nonparametric regression using Bayesian variable selection," Journal of Econometrics, Elsevier, vol. 75(2), pages 317-343, December.
    16. Liao, Yuan & Jiang, Wenxin, 2011. "Posterior consistency of nonparametric conditional moment restricted models," MPRA Paper 38700, University Library of Munich, Germany.
    17. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    18. Hong, Han & Preston, Bruce, 2012. "Bayesian averaging, prediction and nonnested model selection," Journal of Econometrics, Elsevier, vol. 167(2), pages 358-369.
    19. Jean-Michel Marin & Natesh S. Pillai & Christian P. Robert & Judith Rousseau, 2014. "Relevant statistics for Bayesian model choice," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(5), pages 833-859, November.
    20. Kim, Jae-Young, 2002. "Limited information likelihood and Bayesian analysis," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 175-193, March.
    21. Whitney K. Newey, 2004. "Efficient Semiparametric Estimation via Moment Restrictions," Econometrica, Econometric Society, vol. 72(6), pages 1877-1897, November.
    22. Kim, Jae-Young, 2014. "An alternative quasi likelihood approach, Bayesian analysis and data-based inference for model specification," Journal of Econometrics, Elsevier, vol. 178(P1), pages 132-145.
    23. Susanne M. Schennach, 2005. "Bayesian exponentially tilted empirical likelihood," Biometrika, Biometrika Trust, vol. 92(1), pages 31-46, March.
    24. Hansen, Lars Peter & Heaton, John & Yaron, Amir, 1996. "Finite-Sample Properties of Some Alternative GMM Estimators," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(3), pages 262-280, July.
    25. Liang, Feng & Paulo, Rui & Molina, German & Clyde, Merlise A. & Berger, Jim O., 2008. "Mixtures of g Priors for Bayesian Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 410-423, March.
    26. Susanne M. Schennach, 2007. "Point estimation with exponentially tilted empirical likelihood," Papers 0708.1874, arXiv.org.
    27. Chen, Kun & Jiang, Wenxin & Tanner, Martin A., 2010. "A note on some algorithms for the Gibbs posterior," Statistics & Probability Letters, Elsevier, vol. 80(15-16), pages 1234-1241, August.
    28. Mathias Drton, 2004. "Model selection for Gaussian concentration graphs," Biometrika, Biometrika Trust, vol. 91(3), pages 591-602, September.
    29. Ishwaran, Hemant & Sunil Rao, J., 2011. "Consistency of spike and slab regression," Statistics & Probability Letters, Elsevier, vol. 81(12), pages 1920-1928.
    30. Kundhi, Gubhinder & Rilstone, Paul, 2012. "Edgeworth expansions for GEL estimators," Journal of Multivariate Analysis, Elsevier, vol. 106(C), pages 118-146.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Igari, Ryosuke & Hoshino, Takahiro, 2018. "A Bayesian data combination approach for repeated durations under unobserved missing indicators: Application to interpurchase-timing in marketing," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 150-166.
    2. Sikora, Grzegorz & Michalak, Anna & Bielak, Łukasz & Miśta, Paweł & Wyłomańska, Agnieszka, 2019. "Stochastic modeling of currency exchange rates with novel validation techniques," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 523(C), pages 1202-1215.
    3. Gyuhyeong Goh & Jisang Yu, 2022. "Causal inference with some invalid instrumental variables: A quasi‐Bayesian approach," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1432-1451, December.
    4. Takahiro Hoshino & Ryosuke Igari, 2017. "Quasi-Bayesian Inference for Latent Variable Models with External Information: Application to generalized linear mixed models for biased data," Keio-IES Discussion Paper Series 2017-014, Institute for Economics Studies, Keio University.
    5. Ryosuke Igari & Takahiro Hoshino, 2018. "A Bayesian Gamma Frailty Model Using the Sum of Independent Random Variables: Application of the Estimation of an Interpurchase Timing Model," Keio-IES Discussion Paper Series 2018-021, Institute for Economics Studies, Keio University.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jean-Pierre Florens & Anna Simoni, 2021. "Gaussian Processes and Bayesian Moment Estimation," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 482-492, March.
    2. Siddharta Chib & Minchul Shin & Anna Simoni, 2016. "Bayesian Empirical Likelihood Estimation and Comparison of Moment Condition Models," Working Papers 2016-21, Center for Research in Economics and Statistics.
    3. Chang, Jinyuan & Chen, Song Xi & Chen, Xiaohong, 2015. "High dimensional generalized empirical likelihood for moment restrictions with dependent data," Journal of Econometrics, Elsevier, vol. 185(1), pages 283-304.
    4. Zhichao Liu & Catherine Forbes & Heather Anderson, 2017. "Robust Bayesian exponentially tilted empirical likelihood method," Monash Econometrics and Business Statistics Working Papers 21/17, Monash University, Department of Econometrics and Business Statistics.
    5. Philip Kostov, 2013. "Empirical likelihood estimation of the spatial quantile regression," Journal of Geographical Systems, Springer, vol. 15(1), pages 51-69, January.
    6. Seojeong Lee, 2018. "Asymptotic Refinements of a Misspecification-Robust Bootstrap for Generalized Empirical Likelihood Estimators," Papers 1806.00953, arXiv.org, revised Jun 2018.
    7. Lee, Seojeong, 2016. "Asymptotic refinements of a misspecification-robust bootstrap for GEL estimators," Journal of Econometrics, Elsevier, vol. 192(1), pages 86-104.
    8. Giuseppe Ragusa, 2007. "Bayesian Likelihoods for Moment Condition Models," Working Papers 060714, University of California-Irvine, Department of Economics.
    9. Otsu, Taisuke, 2010. "On Bahadur efficiency of empirical likelihood," Journal of Econometrics, Elsevier, vol. 157(2), pages 248-256, August.
    10. Parente, Paulo M.D.C. & Smith, Richard J., 2011. "Gel Methods For Nonsmooth Moment Indicators," Econometric Theory, Cambridge University Press, vol. 27(1), pages 74-113, February.
    11. Giuseppe Ragusa, 2011. "Minimum Divergence, Generalized Empirical Likelihoods, and Higher Order Expansions," Econometric Reviews, Taylor & Francis Journals, vol. 30(4), pages 406-456, August.
    12. Lô, Serigne N. & Ronchetti, Elvezio, 2012. "Robust small sample accurate inference in moment condition models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3182-3197.
    13. La Vecchia, Davide & Moor, Alban & Scaillet, Olivier, 2023. "A higher-order correct fast moving-average bootstrap for dependent data," Journal of Econometrics, Elsevier, vol. 235(1), pages 65-81.
    14. Amor Keziou & Aida Toma, 2021. "A Robust Version of the Empirical Likelihood Estimator," Mathematics, MDPI, vol. 9(8), pages 1-19, April.
    15. de Castro, Luciano & Galvao, Antonio F. & Kaplan, David M. & Liu, Xin, 2019. "Smoothed GMM for quantile models," Journal of Econometrics, Elsevier, vol. 213(1), pages 121-144.
    16. Hwang, Jungbin & Kang, Byunghoon & Lee, Seojeong, 2022. "A doubly corrected robust variance estimator for linear GMM," Journal of Econometrics, Elsevier, vol. 229(2), pages 276-298.
    17. Andreas Tryphonides, 2017. "Conditional moment restrictions and the role of density information in estimated structural models," SFB 649 Discussion Papers SFB649DP2017-016, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    18. A. Felipe & N. Martín & P. Miranda & L. Pardo, 2018. "Testing with Exponentially Tilted Empirical Likelihood," Methodology and Computing in Applied Probability, Springer, vol. 20(4), pages 1319-1358, December.
    19. Alain Guay & Florian Pelgrin, 2007. "Using Implied Probabilities to Improve Estimation with Unconditional Moment Restrictions," Cahiers de recherche 0747, CIRPEE.
    20. Isaiah Andrews & Anna Mikusheva, 2022. "Optimal Decision Rules for Weak GMM," Econometrica, Econometric Society, vol. 90(2), pages 715-748, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:145:y:2016:i:c:p:132-147. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.