IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v100y2009i10p2376-2388.html
   My bibliography  Save this article

Robustness of Stein-type estimators under a non-scalar error covariance structure

Author

Listed:
  • Zhang, Xinyu
  • Chen, Ti
  • Wan, Alan T.K.
  • Zou, Guohua

Abstract

The Stein-rule (SR) and positive-part Stein-rule (PSR) estimators are two popular shrinkage techniques used in linear regression, yet very little is known about the robustness of these estimators to the disturbances' deviation from the white noise assumption. Recent studies have shown that the OLS estimator is quite robust, but whether this is so for the SR and PSR estimators is less clear as these estimators also depend on the F statistic which is highly susceptible to covariance misspecification. This study attempts to evaluate the effects of misspecifying the disturbances as white noise on the SR and PSR estimators by a sensitivity analysis. Sensitivity statistics of the SR and PSR estimators are derived and their properties are analyzed. We find that the sensitivity statistics of these estimators exhibit very similar properties and both estimators are extremely robust to MA(1) disturbances and reasonably robust to AR(1) disturbances except for the cases of severe autocorrelation. The results are useful in light of the rising interest of the SR and PSR techniques in the applied literature.

Suggested Citation

  • Zhang, Xinyu & Chen, Ti & Wan, Alan T.K. & Zou, Guohua, 2009. "Robustness of Stein-type estimators under a non-scalar error covariance structure," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2376-2388, November.
    • Handle: RePEc:eee:jmvana:v:100:y:2009:i:10:p:2376-2388
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(09)00067-0
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Simon Stevenson, 2001. "Bayes-Stein Estimators and International Real Estate Asset Allocation," Journal of Real Estate Research, American Real Estate Society, vol. 21(1/2), pages 89-104.
    2. Namba, Akio, 2002. "Pmse Performance Of The Biased Estimators In A Linear Regression Model When Relevant Regressors Are Omitted," Econometric Theory, Cambridge University Press, vol. 18(5), pages 1086-1098, October.
    3. Banerjee, Anurag N. & Magnus, Jan R., 1999. "The sensitivity of OLS when the variance matrix is (partially) unknown," Journal of Econometrics, Elsevier, vol. 92(2), pages 295-323, October.
    4. Alan T.K. Wan & Guohua Zou & Huaizhen Qin, 2007. "On the sensitivity of the restricted least squares estimators to covariance misspecification," Econometrics Journal, Royal Economic Society, vol. 10(3), pages 471-487, November.
    5. Ohtani, Kazuhiro, 1998. "Inadmissibility of the Stein-rule estimator under the balanced loss function," Journal of Econometrics, Elsevier, vol. 88(1), pages 193-201, November.
    6. Wan, Alan T. K. & Chaturvedi, Anoop, 2001. "Double k-Class Estimators in Regression Models with Non-spherical Disturbances," Journal of Multivariate Analysis, Elsevier, vol. 79(2), pages 226-250, November.
    7. Adkins, Lee C. & Eells, James B., 1995. "Improved estimators of energy models," Energy Economics, Elsevier, vol. 17(1), pages 15-25, January.
    8. Knight J. R. & Hill R. Carter & Sirmans C. F., 1993. "Estimation of Hedonic Housing Price Models Using Nonsample Information: A Monte Carlo Study," Journal of Urban Economics, Elsevier, vol. 34(3), pages 319-346, November.
    9. Grauer, Robert R & Hakansson, Nils H, 2001. "Applying Portfolio Change and Conditional Performance Measures: The Case of Industry Rotation via the Dynamic Investment Model," Review of Quantitative Finance and Accounting, Springer, vol. 17(3), pages 237-265, November.
    10. Jan R. Magnus & Andrey L. Vasnev, 2007. "Local sensitivity and diagnostic tests," Econometrics Journal, Royal Economic Society, vol. 10(1), pages 166-192, March.
    11. Alan Wan & Anoop Chaturvedi & Guohuazou Zou, 2003. "Unbiased estimation of the MSE matrices of improved estimators in linear regression," Journal of Applied Statistics, Taylor & Francis Journals, vol. 30(2), pages 173-189.
    12. Helen X. H. Bao & Alan T. K. Wan, 2007. "Improved Estimators of Hedonic Housing Price Models," Journal of Real Estate Research, American Real Estate Society, vol. 29(3), pages 267-302.
    13. Phillips, P.C.B., 1984. "The exact distribution of the Stein-rule estimator," Journal of Econometrics, Elsevier, vol. 25(1-2), pages 123-131.
    14. Namba, Akio & Ohtani, Kazuhiro, 2006. "PMSE performance of the Stein-rule and positive-part Stein-rule estimators in a regression model with or without proxy variables," Statistics & Probability Letters, Elsevier, vol. 76(9), pages 898-906, May.
    15. Opgen-Rhein Rainer & Strimmer Korbinian, 2007. "Accurate Ranking of Differentially Expressed Genes by a Distribution-Free Shrinkage Approach," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 6(1), pages 1-20, February.
    16. J. R. Knight & R. Carter Hill & C. F. Sirmans, 1992. "Biased Prediction of Housing Values," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 20(3), pages 427-456, September.
    17. Banerjee, Anurag N. & Magnus, Jan R., 2000. "On the sensitivity of the usual t- and F-tests to covariance misspecification," Journal of Econometrics, Elsevier, vol. 95(1), pages 157-176, March.
    18. Ohtani, Kazuhiro, 1993. "A Comparison of the Stein-Rule and Positive-Part Stein-Rule Estimators in a Misspecified Linear Regression Model," Econometric Theory, Cambridge University Press, vol. 9(4), pages 668-679, August.
    19. Chaturvedi, Anoop & Wan, Alan T. K. & Singh, Shri P., 2002. "Improved Multivariate Prediction in a General Linear Model with an Unknown Error Covariance Matrix," Journal of Multivariate Analysis, Elsevier, vol. 83(1), pages 166-182, October.
    20. Carter Hill, R. & Judge, George, 1987. "Improved prediction in the presence of multicollinearity," Journal of Econometrics, Elsevier, vol. 35(1), pages 83-100, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ahmed, S. Ejaz & Nicol, Christopher J., 2012. "An application of shrinkage estimation to the nonlinear regression model," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3309-3321.
    2. Qin, Huaizhen & Wan, Alan T.K. & Zou, Guohua, 2009. "On the sensitivity of the one-sided t test to covariance misspecification," Journal of Multivariate Analysis, Elsevier, vol. 100(8), pages 1593-1609, September.
    3. Magnus, Jan R. & Vasnev, Andrey L., 2015. "Interpretation and use of sensitivity in econometrics, illustrated with forecast combinations," International Journal of Forecasting, Elsevier, vol. 31(3), pages 769-781.
    4. Vasnev, Andrey L., 2010. "Sensitivity of GLS estimators in random effects models," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1252-1262, May.
    5. Jan R. Magnus & Andrey L. Vasnev, 2007. "Local sensitivity and diagnostic tests," Econometrics Journal, Royal Economic Society, vol. 10(1), pages 166-192, March.
    6. Namba, Akio, 2003. "PMSE dominance of the positive-part shrinkage estimator in a regression model when relevant regressors are omitted," Statistics & Probability Letters, Elsevier, vol. 63(4), pages 375-385, July.
    7. Chaturvedi, Anoop & Shalabh, 2004. "Risk and Pitman closeness properties of feasible generalized double k-class estimators in linear regression models with non-spherical disturbances under balanced loss function," Journal of Multivariate Analysis, Elsevier, vol. 90(2), pages 229-256, August.
    8. Omtzigt, Pieter & Paruolo, Paolo, 2005. "Impact factors," Journal of Econometrics, Elsevier, vol. 128(1), pages 31-68, September.
    9. Namba, Akio & Ohtani, Kazuhiro, 2006. "PMSE performance of the Stein-rule and positive-part Stein-rule estimators in a regression model with or without proxy variables," Statistics & Probability Letters, Elsevier, vol. 76(9), pages 898-906, May.
    10. Cao, Ming-Xiang & He, Dao-Jiang, 2017. "Admissibility of linear estimators of the common mean parameter in general linear models under a balanced loss function," Journal of Multivariate Analysis, Elsevier, vol. 153(C), pages 246-254.
    11. Magnus, Jan R. & Wan, Alan T.K. & Zhang, Xinyu, 2011. "Weighted average least squares estimation with nonspherical disturbances and an application to the Hong Kong housing market," Computational Statistics & Data Analysis, Elsevier, vol. 55(3), pages 1331-1341, March.
    12. Helen X. H. Bao & Alan T. K. Wan, 2007. "Improved Estimators of Hedonic Housing Price Models," Journal of Real Estate Research, American Real Estate Society, vol. 29(3), pages 267-302.
    13. Akio Namba, 2021. "Bootstrapping the Stein-Rule Estimators," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(1), pages 219-237, December.
    14. O'Hara Hines, R.J. & Hines, W.G.S., 2007. "Covariance miss-specification and the local influence approach in sensitivity analyses of longitudinal data with drop-outs," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 5537-5546, August.
    15. Ohtani, Kazuhiro & Kozumi, Hideo, 1996. "The exact general formulae for the moments and the MSE dominance of the Stein-rule and positive-part Stein-rule estimators," Journal of Econometrics, Elsevier, vol. 74(2), pages 273-287, October.
    16. Akio Namba & Kazuhiro Ohtani, 2007. "Risk comparison of the Stein-rule estimator in a linear regression model with omitted relevant regressors and multivariatet errors under the Pitman nearness criterion," Statistical Papers, Springer, vol. 48(1), pages 151-162, January.
    17. Phillips, P C B, 1986. "The Exact Distribution of the Wald Statistic," Econometrica, Econometric Society, vol. 54(4), pages 881-895, July.
    18. Liang Peng, 2012. "Repeat Sales Regression on Heterogeneous Properties," The Journal of Real Estate Finance and Economics, Springer, vol. 45(3), pages 804-827, October.
    19. Peng Yue & Qing Cai & Wanfeng Yan & Wei-Xing Zhou, 2020. "Information flow networks of Chinese stock market sectors," Papers 2004.08759, arXiv.org.
    20. Mayston, David, 2009. "The determinants of cumulative endogeneity bias in multivariate analysis," Journal of Multivariate Analysis, Elsevier, vol. 100(6), pages 1120-1136, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:100:y:2009:i:10:p:2376-2388. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.