IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v99y2008i9p2053-2081.html

Robust parameter estimation with a small bias against heavy contamination

Author

Listed:
  • Fujisawa, Hironori
  • Eguchi, Shinto

Abstract

In this paper we consider robust parameter estimation based on a certain cross entropy and divergence. The robust estimate is defined as the minimizer of the empirically estimated cross entropy. It is shown that the robust estimate can be regarded as a kind of projection from the viewpoint of a Pythagorean relation based on the divergence. This property implies that the bias caused by outliers can become sufficiently small even in the case of heavy contamination. It is seen that the asymptotic variance of the robust estimator is naturally overweighted in proportion to the ratio of contamination. One may surmise that another form of cross entropy can present the same behavior as that discussed above. It can be proved under some conditions that no cross entropy can present the same behavior except for the cross entropy considered here and its monotone transformation.

Suggested Citation

  • Fujisawa, Hironori & Eguchi, Shinto, 2008. "Robust parameter estimation with a small bias against heavy contamination," Journal of Multivariate Analysis, Elsevier, vol. 99(9), pages 2053-2081, October.
    • Handle: RePEc:eee:jmvana:v:99:y:2008:i:9:p:2053-2081
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(08)00045-6
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Miyamura, Masashi & Kano, Yutaka, 2006. "Robust Gaussian graphical modeling," Journal of Multivariate Analysis, Elsevier, vol. 97(7), pages 1525-1550, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hirose, Kei & Fujisawa, Hironori & Sese, Jun, 2017. "Robust sparse Gaussian graphical modeling," Journal of Multivariate Analysis, Elsevier, vol. 161(C), pages 172-190.
    2. Daniel Felix Ahelegbey, . "The econometrics of Bayesian graphical models: a review with financial application," Journal of Network Theory in Finance, Journal of Network Theory in Finance.
    3. Vinciotti, Veronica & Hashem, Hussein, 2013. "Robust methods for inferring sparse network structures," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 84-94.
    4. Hokeun Sun & Hongzhe Li, 2012. "Robust Gaussian Graphical Modeling Via l 1 Penalization," Biometrics, The International Biometric Society, vol. 68(4), pages 1197-1206, December.
    5. Stead, Alexander D. & Wheat, Phill & Greene, William H., 2023. "Robust maximum likelihood estimation of stochastic frontier models," European Journal of Operational Research, Elsevier, vol. 309(1), pages 188-201.
    6. Daniel Felix Ahelegbey, 2015. "The Econometrics of Networks: A Review," Working Papers 2015:13, Department of Economics, University of Venice "Ca' Foscari".

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:99:y:2008:i:9:p:2053-2081. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.