IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v82y2014i3p422-439.html
   My bibliography  Save this article

Akaike's Information Criterion, C p and Estimators of Loss for Elliptically Symmetric Distributions

Author

Listed:
  • Aurélie Boisbunon
  • Stéphane Canu
  • Dominique Fourdrinier
  • William Strawderman
  • Martin T. Wells

Abstract

type="main" xml:id="insr12052-abs-0001"> In this article, we develop a modern perspective on Akaike's information criterion and Mallows's C p for model selection, and propose generalisations to spherically and elliptically symmetric distributions. Despite the differences in their respective motivation, C p and Akaike's information criterion are equivalent in the special case of Gaussian linear regression. In this case, they are also equivalent to a third criterion, an unbiased estimator of the quadratic prediction loss, derived from loss estimation theory. We then show that the form of the unbiased estimator of the quadratic prediction loss under a Gaussian assumption still holds under a more general distributional assumption, the family of spherically symmetric distributions. One of the features of our results is that our criterion does not rely on the specificity of the distribution, but only on its spherical symmetry. The same kind of criterion can be derived for a family of elliptically contoured distribution, which allows correlations, when considering the invariant loss. More specifically, the unbiasedness property is relative to a distribution associated to the original density.

Suggested Citation

  • Aurélie Boisbunon & Stéphane Canu & Dominique Fourdrinier & William Strawderman & Martin T. Wells, 2014. "Akaike's Information Criterion, C p and Estimators of Loss for Elliptically Symmetric Distributions," International Statistical Review, International Statistical Institute, vol. 82(3), pages 422-439, December.
  • Handle: RePEc:bla:istatr:v:82:y:2014:i:3:p:422-439
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/insr.12052
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Maruyama, Yuzo & Strawderman, William E., 2009. "An extended class of minimax generalized Bayes estimators of regression coefficients," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2155-2166, November.
    2. Dominique Fourdrinier & William Strawderman, 2003. "On Bayes and unbiased estimators of loss," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 55(4), pages 803-816, December.
    3. Cellier, D. & Fourdrinier, D., 1995. "Shrinkage Estimators under Spherical Symmetry for the General Linear Model," Journal of Multivariate Analysis, Elsevier, vol. 52(2), pages 338-351, February.
    4. Cellier, Dominique & Fourdrinier, Dominique & Robert, Christian, 1989. "Robust shrinkage estimators of the location parameter for elliptically symmetric distributions," Journal of Multivariate Analysis, Elsevier, vol. 29(1), pages 39-52, April.
    5. Kubokawa, T. & Srivastava, M. S., 2001. "Robust Improvement in Estimation of a Mean Matrix in an Elliptically Contoured Distribution," Journal of Multivariate Analysis, Elsevier, vol. 76(1), pages 138-152, January.
    6. Fourdrinier, Dominique & Strawderman, William E. & Wells, Martin T., 2003. "Robust shrinkage estimation for elliptically symmetric distributions with unknown covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 85(1), pages 24-39, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Canu, Stéphane & Fourdrinier, Dominique, 2017. "Unbiased risk estimates for matrix estimation in the elliptical case," Journal of Multivariate Analysis, Elsevier, vol. 158(C), pages 60-72.
    2. Matsuda, Takeru & Strawderman, William E., 2019. "Improved loss estimation for a normal mean matrix," Journal of Multivariate Analysis, Elsevier, vol. 169(C), pages 300-311.
    3. Stéphane Canu & Dominique Fourdrinier, 2023. "Data based loss estimation of the mean of a spherical distribution with a residual vector," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 86(8), pages 851-878, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fourdrinier Dominique & Strawderman William E. & Wells Martin T., 2009. "Improved estimation for elliptically symmetric distributions with unknown block diagonal covariance matrix," Statistics & Risk Modeling, De Gruyter, vol. 26(3), pages 203-217, April.
    2. Dominique Fourdrinier & William Strawderman, 2015. "Robust minimax Stein estimation under invariant data-based loss for spherically and elliptically symmetric distributions," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 78(4), pages 461-484, May.
    3. Fourdrinier, Dominique & Strawderman, William, 2014. "On the non existence of unbiased estimators of risk for spherically symmetric distributions," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 6-13.
    4. Fourdrinier, Dominique & Strawderman, William E., 2016. "Stokes’ theorem, Stein’s identity and completeness," Statistics & Probability Letters, Elsevier, vol. 109(C), pages 224-231.
    5. Maruyama Yuzo, 2003. "A robust generalized Bayes estimator improving on the James-Stein estimator for spherically symmetric distributions," Statistics & Risk Modeling, De Gruyter, vol. 21(1/2003), pages 69-78, January.
    6. Kubokawa, T. & Srivastava, M. S., 2001. "Robust Improvement in Estimation of a Mean Matrix in an Elliptically Contoured Distribution," Journal of Multivariate Analysis, Elsevier, vol. 76(1), pages 138-152, January.
    7. Canu, Stéphane & Fourdrinier, Dominique, 2017. "Unbiased risk estimates for matrix estimation in the elliptical case," Journal of Multivariate Analysis, Elsevier, vol. 158(C), pages 60-72.
    8. Marchand, Éric & Perron, François, 2005. "Improving on the mle of a bounded location parameter for spherical distributions," Journal of Multivariate Analysis, Elsevier, vol. 92(2), pages 227-238, February.
    9. Dominique Fourdrinier & Othmane Kortbi & William Strawderman, 2014. "Generalized Bayes minimax estimators of location vectors for spherically symmetric distributions with residual vector," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 77(2), pages 285-296, February.
    10. Srivastava, M. S. & Kubokawa, T., 2005. "Minimax multivariate empirical Bayes estimators under multicollinearity," Journal of Multivariate Analysis, Elsevier, vol. 93(2), pages 394-416, April.
    11. Evgeny Pchelintsev, 2013. "Improved estimation in a non-Gaussian parametric regression," Statistical Inference for Stochastic Processes, Springer, vol. 16(1), pages 15-28, April.
    12. Karamikabir, Hamid & Afshari, Mahmoud, 2020. "Generalized Bayesian shrinkage and wavelet estimation of location parameter for spherical distribution under balance-type loss: Minimaxity and admissibility," Journal of Multivariate Analysis, Elsevier, vol. 177(C).
    13. Tatsuya Kubokawa & M. S. Srivastava, 2002. "Minimax Multivariate Empirical Bayes Estimators under Multicollinearity," CIRJE F-Series CIRJE-F-187, CIRJE, Faculty of Economics, University of Tokyo.
    14. He Kun & Strawderman William E., 2001. "Estimation In Spherically Symmetric Regression With Random Design," Statistics & Risk Modeling, De Gruyter, vol. 19(1), pages 41-50, January.
    15. Mori, Yuichi & Suzuki, Taiji, 2018. "Generalized ridge estimator and model selection criteria in multivariate linear regression," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 243-261.
    16. Tsukuma, Hisayuki & Kubokawa, Tatsuya, 2015. "A unified approach to estimating a normal mean matrix in high and low dimensions," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 312-328.
    17. Kazuhiro Ohtani, 1998. "An MSE comparison of the restricted Stein-rule and minimum mean squared error estimators in regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 7(2), pages 361-376, December.
    18. Matsuda, Takeru & Strawderman, William E., 2019. "Improved loss estimation for a normal mean matrix," Journal of Multivariate Analysis, Elsevier, vol. 169(C), pages 300-311.
    19. Ouassou, Idir & Strawderman, William E., 2002. "Estimation of a parameter vector restricted to a cone," Statistics & Probability Letters, Elsevier, vol. 56(2), pages 121-129, January.
    20. M. Tan & L. Gleser, 1992. "Minimax estimators for location vectors in elliptical distributions with unknown scale parameter and its application to variance reduction in simulation," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 44(3), pages 537-550, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:82:y:2014:i:3:p:422-439. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.