IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1109.3069.html
   My bibliography  Save this paper

Directional Variance Adjustment: improving covariance estimates for high-dimensional portfolio optimization

Author

Listed:
  • Daniel Bartz
  • Kerr Hatrick
  • Christian W. Hesse
  • Klaus-Robert Muller
  • Steven Lemm

Abstract

Robust and reliable covariance estimates play a decisive role in financial and many other applications. An important class of estimators is based on Factor models. Here, we show by extensive Monte Carlo simulations that covariance matrices derived from the statistical Factor Analysis model exhibit a systematic error, which is similar to the well-known systematic error of the spectrum of the sample covariance matrix. Moreover, we introduce the Directional Variance Adjustment (DVA) algorithm, which diminishes the systematic error. In a thorough empirical study for the US, European, and Hong Kong market we show that our proposed method leads to improved portfolio allocation.

Suggested Citation

  • Daniel Bartz & Kerr Hatrick & Christian W. Hesse & Klaus-Robert Muller & Steven Lemm, 2011. "Directional Variance Adjustment: improving covariance estimates for high-dimensional portfolio optimization," Papers 1109.3069, arXiv.org, revised Mar 2012.
    • Handle: RePEc:arx:papers:1109.3069
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1109.3069
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    2. Campbell, Rachel A.J. & Forbes, Catherine S. & Koedijk, Kees G. & Kofman, Paul, 2008. "Increasing correlations or just fat tails?," Journal of Empirical Finance, Elsevier, vol. 15(2), pages 287-309, March.
    3. Loretan, Mico & Phillips, Peter C. B., 1994. "Testing the covariance stationarity of heavy-tailed time series: An overview of the theory with applications to several financial datasets," Journal of Empirical Finance, Elsevier, vol. 1(2), pages 211-248, January.
    4. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    5. Longin, Francois, 2005. "The choice of the distribution of asset returns: How extreme value theory can help?," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 1017-1035, April.
    6. Donald Rubin & Dorothy Thayer, 1982. "EM algorithms for ML factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 47(1), pages 69-76, March.
    7. Schäfer Juliane & Strimmer Korbinian, 2005. "A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 4(1), pages 1-32, November.
    8. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    9. Gregory Connor & Lisa R. Goldberg & Robert A. Korajczyk, 2010. "Portfolio Risk Analysis," Economics Books, Princeton University Press, edition 1, number 9224.
    10. Michael E. Tipping & Christopher M. Bishop, 1999. "Probabilistic Principal Component Analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(3), pages 611-622.
    11. Roll, Richard & Ross, Stephen A, 1980. "An Empirical Investigation of the Arbitrage Pricing Theory," Journal of Finance, American Finance Association, vol. 35(5), pages 1073-1103, December.
    12. Shanken, Jay, 1992. "On the Estimation of Beta-Pricing Models," The Review of Financial Studies, Society for Financial Studies, vol. 5(1), pages 1-33.
    13. repec:bla:jfinan:v:58:y:2003:i:4:p:1651-1684 is not listed on IDEAS
    14. Pagan, Adrian R. & Schwert, G. William, 1990. "Testing for covariance stationarity in stock market data," Economics Letters, Elsevier, vol. 33(2), pages 165-170, June.
    15. D. Goldfarb & G. Iyengar, 2003. "Robust Portfolio Selection Problems," Mathematics of Operations Research, INFORMS, vol. 28(1), pages 1-38, February.
    16. Fan, Jianqing & Fan, Yingying & Lv, Jinchi, 2008. "High dimensional covariance matrix estimation using a factor model," Journal of Econometrics, Elsevier, vol. 147(1), pages 186-197, November.
    17. K. Jöreskog, 1967. "Some contributions to maximum likelihood factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 32(4), pages 443-482, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel Bartz & Kerr Hatrick & Christian W Hesse & Klaus-Robert Müller & Steven Lemm, 2013. "Directional Variance Adjustment: Bias Reduction in Covariance Matrices Based on Factor Analysis with an Application to Portfolio Optimization," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-14, July.
    2. Bodnar, Taras & Reiß, Markus, 2016. "Exact and asymptotic tests on a factor model in low and large dimensions with applications," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 125-151.
    3. Zhu, Bo & Zhang, Tianlun, 2021. "Long-term wealth growth portfolio allocation under parameter uncertainty: A non-conservative robust approach," The North American Journal of Economics and Finance, Elsevier, vol. 57(C).
    4. Fan, Jianqing & Liao, Yuan & Shi, Xiaofeng, 2015. "Risks of large portfolios," Journal of Econometrics, Elsevier, vol. 186(2), pages 367-387.
    5. Viet Anh Nguyen & Daniel Kuhn & Peyman Mohajerin Esfahani, 2018. "Distributionally Robust Inverse Covariance Estimation: The Wasserstein Shrinkage Estimator," Papers 1805.07194, arXiv.org.
    6. Jianqing Fan & Jingjin Zhang & Ke Yu, 2008. "Asset Allocation and Risk Assessment with Gross Exposure Constraints for Vast Portfolios," Papers 0812.2604, arXiv.org.
    7. De Nard, Gianluca & Zhao, Zhao, 2023. "Using, taming or avoiding the factor zoo? A double-shrinkage estimator for covariance matrices," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 23-35.
    8. Wolfgang Karl Hardle & Yegor Klochkov & Alla Petukhina & Nikita Zhivotovskiy, 2022. "Robustifying Markowitz," Papers 2212.13996, arXiv.org.
    9. Gregory Connor & Lisa R. Goldberg & Robert A. Korajczyk, 2010. "Portfolio Risk Analysis," Economics Books, Princeton University Press, edition 1, number 9224.
    10. Petukhina, Alla & Klochkov, Yegor & Härdle, Wolfgang Karl & Zhivotovskiy, Nikita, 2024. "Robustifying Markowitz," Journal of Econometrics, Elsevier, vol. 239(2).
    11. Gillen, Benjamin J., 2014. "An empirical Bayesian approach to stein-optimal covariance matrix estimation," Journal of Empirical Finance, Elsevier, vol. 29(C), pages 402-420.
    12. Gilles Boevi Koumou, 2020. "Diversification and portfolio theory: a review," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 34(3), pages 267-312, September.
    13. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    14. Liusha Yang & Romain Couillet & Matthew R. McKay, 2015. "A Robust Statistics Approach to Minimum Variance Portfolio Optimization," Papers 1503.08013, arXiv.org.
    15. Seyoung Park & Eun Ryung Lee & Sungchul Lee & Geonwoo Kim, 2019. "Dantzig Type Optimization Method with Applications to Portfolio Selection," Sustainability, MDPI, vol. 11(11), pages 1-32, June.
    16. Nikolaus Hautsch & Lada M. Kyj & Peter Malec, 2015. "Do High‐Frequency Data Improve High‐Dimensional Portfolio Allocations?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(2), pages 263-290, March.
    17. Maillet, Bertrand & Tokpavi, Sessi & Vaucher, Benoit, 2015. "Global minimum variance portfolio optimisation under some model risk: A robust regression-based approach," European Journal of Operational Research, Elsevier, vol. 244(1), pages 289-299.
    18. Wang, Christina Dan & Chen, Zhao & Lian, Yimin & Chen, Min, 2022. "Asset selection based on high frequency Sharpe ratio," Journal of Econometrics, Elsevier, vol. 227(1), pages 168-188.
    19. Francisco Peñaranda & Enrique Sentana, 2024. "Portfolio management with big data," Working Papers wp2024_2411, CEMFI.
    20. Hautsch, Nikolaus & Voigt, Stefan, 2019. "Large-scale portfolio allocation under transaction costs and model uncertainty," Journal of Econometrics, Elsevier, vol. 212(1), pages 221-240.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1109.3069. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.