IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v55y2011i12p3148-3164.html
   My bibliography  Save this article

One-step minimum Hellinger distance estimation

Author

Listed:
  • Karunamuni, Rohana J.
  • Wu, Jingjing

Abstract

It is well known now that the minimum Hellinger distance estimation approach introduced by Beran (Beran, R., 1977. Minimum Hellinger distance estimators for parametric models. Ann. Statist. 5, 445-463) produces estimators that achieve efficiency at the model density and simultaneously have excellent robustness properties. However, computational difficulties and algorithmic convergence problems associated with this method have hampered its application in practice, particularly when the method is applied to models with high-dimensional parameter spaces. A one-step minimum Hellinger distance (MHD) procedure is investigated in this paper to overcome computational drawbacks of the fully iterative MHD method. The idea is to start with an initial estimator, and then iterate the Newton-Raphson equation once related to the Hellinger distance. The resulting estimator can be considered a one-step MHD estimator. We show that the proposed one-step MHD estimator has the same asymptotic behavior as the MHD estimator, as long as the initial estimators are reasonably good. Furthermore, our theoretical and numerical studies also demonstrate that the proposed one-step MHD estimator also retains excellent robustness properties of the MHD estimators. A real data example is analyzed as well.

Suggested Citation

  • Karunamuni, Rohana J. & Wu, Jingjing, 2011. "One-step minimum Hellinger distance estimation," Computational Statistics & Data Analysis, Elsevier, vol. 55(12), pages 3148-3164, December.
    • Handle: RePEc:eee:csdana:v:55:y:2011:i:12:p:3148-3164
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947311002465
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Karunamuni, R.J. & Sriram, T.N. & Wu, J., 2006. "Rates of convergence of an adaptive kernel density estimator for finite mixture models," Statistics & Probability Letters, Elsevier, vol. 76(3), pages 221-230, February.
    2. Woo, Mi-Ja & Sriram, T.N., 2007. "Robust estimation of mixture complexity for count data," Computational Statistics & Data Analysis, Elsevier, vol. 51(9), pages 4379-4392, May.
    3. Takada, Teruko, 2009. "Simulated minimum Hellinger distance estimation of stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 2390-2403, April.
    4. Woo, Mi-Ja & Sriram, T.N., 2006. "Robust Estimation of Mixture Complexity," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1475-1486, December.
    5. Karunamuni, R.J. & Sriram, T.N. & Wu, J., 2006. "Asymptotic normality of an adaptive kernel density estimator for finite mixture models," Statistics & Probability Letters, Elsevier, vol. 76(2), pages 211-220, January.
    6. Ayanendranath Basu & Bruce Lindsay, 1994. "Minimum disparity estimation for continuous models: Efficiency, distributions and robustness," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 46(4), pages 683-705, December.
    7. J. Fan & J. Chen, 1999. "One‐step local quasi‐likelihood estimation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(4), pages 927-943.
    8. Sriram, T. N. & Vidyashankar, A. N., 2000. "Minimum Hellinger distance estimation for supercritical Galton-Watson processes," Statistics & Probability Letters, Elsevier, vol. 50(4), pages 331-342, December.
    9. Wu, Jingjing & Karunamuni, Rohana & Zhang, Biao, 2010. "Minimum Hellinger distance estimation in a two-sample semiparametric model," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1102-1122, May.
    10. Karlis, Dimitris & Xekalaki, Evdokia, 1998. "Minimum Hellinger distance estimation for Poisson mixtures," Computational Statistics & Data Analysis, Elsevier, vol. 29(1), pages 81-103, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Karunamuni, Rohana J. & Tang, Qingguo & Zhao, Bangxin, 2015. "Robust and efficient estimation of effective dose," Computational Statistics & Data Analysis, Elsevier, vol. 90(C), pages 47-60.
    2. Jingjing Wu & Rohana J. Karunamuni, 2018. "Efficient and robust tests for semiparametric models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(4), pages 761-788, August.
    3. Qingguo Tang & R. J. Karunamuni, 2018. "Robust variable selection for finite mixture regression models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(3), pages 489-521, June.
    4. Jingjing Wu & Tasnima Abedin & Qiang Zhao, 2023. "Semiparametric modelling of two-component mixtures with stochastic dominance," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(1), pages 39-70, February.
    5. Jingjing Wu & Guoqiang Chen & Zeny Feng, 2017. "An Efficient Semiparametric Approach for Marker Gene Selection and Patient Classification," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 1(2), pages 40-49, April.
    6. Tang, Qingguo & Karunamuni, Rohana J., 2013. "Minimum distance estimation in a finite mixture regression model," Journal of Multivariate Analysis, Elsevier, vol. 120(C), pages 185-204.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tang, Qingguo & Karunamuni, Rohana J., 2013. "Minimum distance estimation in a finite mixture regression model," Journal of Multivariate Analysis, Elsevier, vol. 120(C), pages 185-204.
    2. Wu, Jingjing & Karunamuni, Rohana J., 2012. "Efficient Hellinger distance estimates for semiparametric models," Journal of Multivariate Analysis, Elsevier, vol. 107(C), pages 1-23.
    3. Jingjing Wu & Tasnima Abedin & Qiang Zhao, 2023. "Semiparametric modelling of two-component mixtures with stochastic dominance," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(1), pages 39-70, February.
    4. Jingjing Wu & Rohana J. Karunamuni, 2018. "Efficient and robust tests for semiparametric models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(4), pages 761-788, August.
    5. Wu, Jingjing & Karunamuni, Rohana & Zhang, Biao, 2010. "Minimum Hellinger distance estimation in a two-sample semiparametric model," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1102-1122, May.
    6. Takada, Teruko, 2009. "Simulated minimum Hellinger distance estimation of stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 2390-2403, April.
    7. Umashanger, T. & Sriram, T.N., 2009. "L2E estimation of mixture complexity for count data," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4243-4254, October.
    8. Chee, Chew-Seng, 2017. "A mixture model-based nonparametric approach to estimating a count distribution," Computational Statistics & Data Analysis, Elsevier, vol. 109(C), pages 34-44.
    9. Wang, Yong, 2007. "Minimum disparity computation via the iteratively reweighted least integrated squares algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 5662-5672, August.
    10. Woo, Mi-Ja & Sriram, T.N., 2007. "Robust estimation of mixture complexity for count data," Computational Statistics & Data Analysis, Elsevier, vol. 51(9), pages 4379-4392, May.
    11. Yayuan Zhu & Jingjing Wu & Xuewen Lu, 2013. "Minimum Hellinger distance estimation for a two-sample semiparametric cure rate model with censored survival data," Computational Statistics, Springer, vol. 28(6), pages 2495-2518, December.
    12. Arun Kumar Kuchibhotla & Somabha Mukherjee & Ayanendranath Basu, 2019. "Statistical inference based on bridge divergences," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(3), pages 627-656, June.
    13. Ye, Mao & Lu, Zhao-Hua & Li, Yimei & Song, Xinyuan, 2019. "Finite mixture of varying coefficient model: Estimation and component selection," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 452-474.
    14. Lô, Serigne N. & Ronchetti, Elvezio, 2012. "Robust small sample accurate inference in moment condition models," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3182-3197.
    15. Stéphane Bonhomme & Koen Jochmans & Jean-Marc Robin, 2016. "Non-parametric estimation of finite mixtures from repeated measurements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(1), pages 211-229, January.
    16. Sangyeol Lee & Junmo Song, 2013. "Minimum density power divergence estimator for diffusion processes," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(2), pages 213-236, April.
    17. Kasahara, Hiroyuki & 笠原, 博幸 & Shimotsu, Katsumi & 下津, 克己, 2010. "Nonparametric Identification of Multivariate Mixtures," Discussion Papers 2010-09, Graduate School of Economics, Hitotsubashi University.
    18. Luca Greco & Giovanni Saraceno & Claudio Agostinelli, 2021. "Robust Fitting of a Wrapped Normal Model to Multivariate Circular Data and Outlier Detection," Stats, MDPI, vol. 4(2), pages 1-18, June.
    19. Derek S. Young & Xi Chen & Dilrukshi C. Hewage & Ricardo Nilo-Poyanco, 2019. "Finite mixture-of-gamma distributions: estimation, inference, and model-based clustering," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(4), pages 1053-1082, December.
    20. Chunming Zhang, 2008. "Prediction Error Estimation Under Bregman Divergence for Non‐Parametric Regression and Classification," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 35(3), pages 496-523, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:55:y:2011:i:12:p:3148-3164. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.