IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v138y2019icp96-106.html
   My bibliography  Save this article

The empirical likelihood prior applied to bias reduction of general estimating equations

Author

Listed:
  • Vexler, Albert
  • Zou, Li
  • Hutson, Alan D.

Abstract

The practice of employing empirical likelihood (EL) components in place of parametric likelihood functions in the construction of Bayesian-type procedures has been well-addressed in the modern statistical literature. The EL prior, a Jeffreys-type prior, which asymptotically maximizes the Shannon mutual information between data and the parameters of interest, is rigorously derived. The focus of the proposed approach is on an integrated Kullback–Leibler distance between the EL-based posterior and prior density functions. The EL prior density is the density function for which the corresponding posterior form is asymptotically negligibly different from the EL. The proposed result can be used to develop a methodology for reducing the asymptotic bias of solutions of general estimating equations and M-estimation schemes by removing the first-order term. This technique is developed in a similar manner to methods employed to reduce the asymptotic bias of maximum likelihood estimates via penalizing the underlying parametric likelihoods by their Jeffreys invariant priors. A real data example related to a study of myocardial infarction illustrates the attractiveness of the proposed technique in practical aspects.

Suggested Citation

  • Vexler, Albert & Zou, Li & Hutson, Alan D., 2019. "The empirical likelihood prior applied to bias reduction of general estimating equations," Computational Statistics & Data Analysis, Elsevier, vol. 138(C), pages 96-106.
  • Handle: RePEc:eee:csdana:v:138:y:2019:i:c:p:96-106
    DOI: 10.1016/j.csda.2019.04.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947319300854
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2019.04.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    3. Sanjay Chaudhuri & Malay Ghosh, 2011. "Empirical likelihood for small area estimation," Biometrika, Biometrika Trust, vol. 98(2), pages 473-480.
    4. Nicole A. Lazar, 2003. "Bayesian empirical likelihood," Biometrika, Biometrika Trust, vol. 90(2), pages 319-326, June.
    5. A. Vexler & G. Tao & A. D. Hutson, 2014. "Posterior expectation based on empirical likelihoods," Biometrika, Biometrika Trust, vol. 101(3), pages 711-718.
    6. Zheng, Ming & Yu, Wen, 2011. "An empirical likelihood approach to data analysis under two-stage sampling designs," Statistics & Probability Letters, Elsevier, vol. 81(8), pages 947-956, August.
    7. Zhou, Xiang & Reiter, Jerome P., 2010. "A Note on Bayesian Inference After Multiple Imputation," The American Statistician, American Statistical Association, vol. 64(2), pages 159-163.
    8. Jihnhee Yu & Albert Vexler & Lili Tian, 2010. "Analyzing Incomplete Data Subject to a Threshold using Empirical Likelihood Methods: An Application to a Pneumonia Risk Study in an ICU Setting," Biometrics, The International Biometric Society, vol. 66(1), pages 123-130, March.
    9. Albert Vexler & Li Zou & Alan D. Hutson, 2016. "Data-Driven Confidence Interval Estimation Incorporating Prior Information with an Adjustment for Skewed Data," The American Statistician, Taylor & Francis Journals, vol. 70(3), pages 243-249, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chang-Sheng Liu & Han-Ying Liang, 2023. "Bayesian empirical likelihood of quantile regression with missing observations," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 86(3), pages 285-313, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Siddharta Chib & Minchul Shin & Anna Simoni, 2016. "Bayesian Empirical Likelihood Estimation and Comparison of Moment Condition Models," Working Papers 2016-21, Center for Research in Economics and Statistics.
    2. Zhichao Liu & Catherine Forbes & Heather Anderson, 2017. "Robust Bayesian exponentially tilted empirical likelihood method," Monash Econometrics and Business Statistics Working Papers 21/17, Monash University, Department of Econometrics and Business Statistics.
    3. Li, Cheng & Jiang, Wenxin, 2016. "On oracle property and asymptotic validity of Bayesian generalized method of moments," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 132-147.
    4. Albert Vexler & Li Zou & Alan D. Hutson, 2016. "Data-Driven Confidence Interval Estimation Incorporating Prior Information with an Adjustment for Skewed Data," The American Statistician, Taylor & Francis Journals, vol. 70(3), pages 243-249, July.
    5. Chang, Jinyuan & Chen, Song Xi & Chen, Xiaohong, 2015. "High dimensional generalized empirical likelihood for moment restrictions with dependent data," Journal of Econometrics, Elsevier, vol. 185(1), pages 283-304.
    6. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    7. Whitney K. Newey & Frank Windmeijer, 2005. "GMM with many weak moment conditions," CeMMAP working papers CWP18/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    8. Otsu, Taisuke, 2010. "On Bahadur efficiency of empirical likelihood," Journal of Econometrics, Elsevier, vol. 157(2), pages 248-256, August.
    9. Frank Kleibergen, 2004. "Expansions of GMM statistics that indicate their properties under weak and/or many instruments and the bootstrap," Econometric Society 2004 North American Summer Meetings 408, Econometric Society.
    10. Masakatsu Okubo, 2011. "The Intertemporal Elasticity of Substitution: An Analysis Based on Japanese Data," Economica, London School of Economics and Political Science, vol. 78(310), pages 367-390, April.
    11. Xu Cheng & Winston Wei Dou & Zhipeng Liao, 2022. "Macro‐Finance Decoupling: Robust Evaluations of Macro Asset Pricing Models," Econometrica, Econometric Society, vol. 90(2), pages 685-713, March.
    12. Parente, Paulo M.D.C. & Smith, Richard J., 2011. "Gel Methods For Nonsmooth Moment Indicators," Econometric Theory, Cambridge University Press, vol. 27(1), pages 74-113, February.
    13. Shane M. Sherlund, 2004. "Quasi Empirical Likelihood Estimation of Moment Condition Models," Econometric Society 2004 North American Summer Meetings 507, Econometric Society.
    14. Giuseppe Ragusa, 2011. "Minimum Divergence, Generalized Empirical Likelihoods, and Higher Order Expansions," Econometric Reviews, Taylor & Francis Journals, vol. 30(4), pages 406-456, August.
    15. Kai Yang & Xue Ding & Xiaohui Yuan, 2022. "Bayesian empirical likelihood inference and order shrinkage for autoregressive models," Statistical Papers, Springer, vol. 63(1), pages 97-121, February.
    16. Kundhi, Gubhinder & Rilstone, Paul, 2012. "Edgeworth expansions for GEL estimators," Journal of Multivariate Analysis, Elsevier, vol. 106(C), pages 118-146.
    17. Otsu, Taisuke & Whang, Yoon-Jae, 2011. "Testing For Nonnested Conditional Moment Restrictions Via Conditional Empirical Likelihood," Econometric Theory, Cambridge University Press, vol. 27(1), pages 114-153, February.
    18. Peñaranda, Francisco & Sentana, Enrique, 2012. "Spanning tests in return and stochastic discount factor mean–variance frontiers: A unifying approach," Journal of Econometrics, Elsevier, vol. 170(2), pages 303-324.
    19. James M. Malcomson & Sophocles Mavroeidis, 2007. "Matching Frictions, Efficiency Wages, and Unemployment in the USA and the UK," Working Papers 2007-02, Brown University, Department of Economics.
    20. Sanjay Chaudhuri & Debashis Mondal & Teng Yin, 2017. "Hamiltonian Monte Carlo sampling in Bayesian empirical likelihood computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 293-320, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:138:y:2019:i:c:p:96-106. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.