IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v93y2005i2p394-416.html
   My bibliography  Save this article

Minimax multivariate empirical Bayes estimators under multicollinearity

Author

Listed:
  • Srivastava, M. S.
  • Kubokawa, T.

Abstract

In this paper we consider the problem of estimating the matrix of regression coefficients in a multivariate linear regression model in which the design matrix is near singular. Under the assumption of normality, we propose empirical Bayes ridge regression estimators with three types of shrinkage functions, that is, scalar, componentwise and matricial shrinkage. These proposed estimators are proved to be uniformly better than the least squares estimator, that is, minimax in terms of risk under the Strawderman's loss function. Through simulation and empirical studies, they are also shown to be useful in the multicollinearity cases.

Suggested Citation

  • Srivastava, M. S. & Kubokawa, T., 2005. "Minimax multivariate empirical Bayes estimators under multicollinearity," Journal of Multivariate Analysis, Elsevier, vol. 93(2), pages 394-416, April.
  • Handle: RePEc:eee:jmvana:v:93:y:2005:i:2:p:394-416
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(04)00036-3
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Haff, L. R., 1979. "An identity for the Wishart distribution with applications," Journal of Multivariate Analysis, Elsevier, vol. 9(4), pages 531-544, December.
    2. Bilodeau, Martin & Kariya, Takeaki, 1989. "Minimax estimators in the normal MANOVA model," Journal of Multivariate Analysis, Elsevier, vol. 28(2), pages 260-270, February.
    3. Kubokawa, T. & Srivastava, M. S., 2001. "Robust Improvement in Estimation of a Mean Matrix in an Elliptically Contoured Distribution," Journal of Multivariate Analysis, Elsevier, vol. 76(1), pages 138-152, January.
    4. Leo Breiman & Jerome H. Friedman, 1997. "Predicting Multivariate Responses in Multiple Linear Regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 59(1), pages 3-54.
    5. Konno, Yoshihiko, 1991. "On estimation of a matrix of normal means with unknown covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 36(1), pages 44-55, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tatsuya Kubokawa & M. S. Srivastava, 2002. "Minimax Multivariate Empirical Bayes Estimators under Multicollinearity," CIRJE F-Series CIRJE-F-187, CIRJE, Faculty of Economics, University of Tokyo.
    2. Oman, Samuel D., 2002. "Minimax Hierarchical Empirical Bayes Estimation in Multivariate Regression," Journal of Multivariate Analysis, Elsevier, vol. 80(2), pages 285-301, February.
    3. Tsukuma, Hisayuki, 2010. "Shrinkage priors for Bayesian estimation of the mean matrix in an elliptically contoured distribution," Journal of Multivariate Analysis, Elsevier, vol. 101(6), pages 1483-1492, July.
    4. Xu, Kai & He, Daojiang, 2015. "Further results on estimation of covariance matrix," Statistics & Probability Letters, Elsevier, vol. 101(C), pages 11-20.
    5. Kubokawa, T. & Srivastava, M. S., 2001. "Robust Improvement in Estimation of a Mean Matrix in an Elliptically Contoured Distribution," Journal of Multivariate Analysis, Elsevier, vol. 76(1), pages 138-152, January.
    6. Kubokawa, T. & Srivastava, M. S., 2002. "Estimating Risk and the Mean Squared Error Matrix in Stein Estimation," Journal of Multivariate Analysis, Elsevier, vol. 82(1), pages 39-64, July.
    7. Tsukuma, Hisayuki & Kubokawa, Tatsuya, 2007. "Methods for improvement in estimation of a normal mean matrix," Journal of Multivariate Analysis, Elsevier, vol. 98(8), pages 1592-1610, September.
    8. Hisayuki Tsukuma & Tatsuya Kubokawa, 2005. "Methods for Improvement in Estimation of a Normal Mean Matrix," CIRJE F-Series CIRJE-F-378, CIRJE, Faculty of Economics, University of Tokyo.
    9. Fourdrinier Dominique & Strawderman William E. & Wells Martin T., 2009. "Improved estimation for elliptically symmetric distributions with unknown block diagonal covariance matrix," Statistics & Risk Modeling, De Gruyter, vol. 26(3), pages 203-217, April.
    10. Mori, Yuichi & Suzuki, Taiji, 2018. "Generalized ridge estimator and model selection criteria in multivariate linear regression," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 243-261.
    11. Tsukuma, Hisayuki & Kubokawa, Tatsuya, 2015. "A unified approach to estimating a normal mean matrix in high and low dimensions," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 312-328.
    12. Hisayuki Tsukuma & Tatsuya Kubokawa, 2014. "A Unified Approach to Estimating a Normal Mean Matrix in High and Low Dimensions," CIRJE F-Series CIRJE-F-926, CIRJE, Faculty of Economics, University of Tokyo.
    13. Tatsuka Kubokawa & M. S. Srivastava, 2002. "Prediction in Multivariate Mixed Linear Models," CIRJE F-Series CIRJE-F-180, CIRJE, Faculty of Economics, University of Tokyo.
    14. Tsukuma, Hisayuki, 2010. "Shrinkage minimax estimation and positive-part rule for a mean matrix in an elliptically contoured distribution," Statistics & Probability Letters, Elsevier, vol. 80(3-4), pages 215-220, February.
    15. Tsukuma, Hisayuki, 2009. "Generalized Bayes minimax estimation of the normal mean matrix with unknown covariance matrix," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2296-2304, November.
    16. Paul Hewson & Keming Yu, 2008. "Quantile regression for binary performance indicators," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(5), pages 401-418, September.
    17. Andrew F. Siegel & Artemiza Woodgate, 2007. "Performance of Portfolios Optimized with Estimation Error," Management Science, INFORMS, vol. 53(6), pages 1005-1015, June.
    18. Kubokawa, Tatsuya & Srivastava, Muni S., 2008. "Estimation of the precision matrix of a singular Wishart distribution and its application in high-dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 99(9), pages 1906-1928, October.
    19. Jewson Stephen & Penzer Jeremy, 2006. "Estimating Trends in Weather Series: Consequences for Pricing Derivatives," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 10(3), pages 1-17, September.
    20. Luebke, Karsten & Czogiel, Irina & Weihs, Claus, 2004. "Latent Factor Prediction Pursuit for Rank Deficient Regressors," Technical Reports 2004,75, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:93:y:2005:i:2:p:394-416. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.