IDEAS home Printed from https://ideas.repec.org/p/cdl/econwp/qt4kt5g2x3.html
   My bibliography  Save this paper

The Dispersion Bias

Author

Listed:
  • Goldberg, Lisa R
  • Papanicolaou, Alex
  • Shkolnik, Alex

Abstract

We identify and correct excess dispersion in the leading eigenvector of a sample covariance matrix when the number of variables vastly exceeds the number of observations. Our correction is datadriven, and it materially diminishes the substantial impact of estimation error on weights and risk forecasts of minimum variance portfolios. We quantify that impact with a novel metric, the optimization bias, which has a positive lower bound prior to correction and tends to zero almost surely after correction. Our analysis sheds light on aspects of how estimation error corrupts an estimated covariance matrix and is transmitted to portfolios via quadratic optimization.

Suggested Citation

  • Goldberg, Lisa R & Papanicolaou, Alex & Shkolnik, Alex, 2022. "The Dispersion Bias," Department of Economics, Working Paper Series qt4kt5g2x3, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
  • Handle: RePEc:cdl:econwp:qt4kt5g2x3
    as

    Download full text from publisher

    File URL: https://www.escholarship.org/uc/item/4kt5g2x3.pdf;origin=repeccitec
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Victor DeMiguel & Lorenzo Garlappi & Francisco J. Nogales & Raman Uppal, 2009. "A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms," Management Science, INFORMS, vol. 55(5), pages 798-812, May.
    2. Joel Bun & Jean-Philippe Bouchaud & Marc Potters, 2016. "Cleaning large correlation matrices: tools from random matrix theory," Papers 1610.08104, arXiv.org.
    3. Connor, Gregory & Korajczyk, Robert A., 1986. "Performance measurement with the arbitrage pricing theory : A new framework for analysis," Journal of Financial Economics, Elsevier, vol. 15(3), pages 373-394, March.
    4. Chamberlain, Gary & Rothschild, Michael, 1983. "Arbitrage, Factor Structure, and Mean-Variance Analysis on Large Asset Markets," Econometrica, Econometric Society, vol. 51(5), pages 1281-1304, September.
    5. Mark Britten‐Jones, 1999. "The Sampling Error in Estimates of Mean‐Variance Efficient Portfolio Weights," Journal of Finance, American Finance Association, vol. 54(2), pages 655-671, April.
    6. Connor, Gregory & Korajczyk, Robert A., 1988. "Risk and return in an equilibrium APT : Application of a new test methodology," Journal of Financial Economics, Elsevier, vol. 21(2), pages 255-289, September.
    7. Blume, Marshall E, 1975. "Betas and Their Regression Tendencies," Journal of Finance, American Finance Association, vol. 30(3), pages 785-795, June.
    8. Anderson, Robert M. & Bianchi, Stephen W. & Goldberg, Lisa R., 2012. "Will My Risk Parity Strategy Outperform?," Department of Economics, Working Paper Series qt23t2s950, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    9. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    10. Bai, Jushan & Ng, Serena, 2008. "Large Dimensional Factor Analysis," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(2), pages 89-163, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.
    2. Gregory Connor & Robert A. Korajczyk, 2019. "Semi-strong factors in asset returns," Economics Department Working Paper Series n294-19.pdf, Department of Economics, National University of Ireland - Maynooth.
    3. Zhuo Chen & Gregory Connor & Robert A Korajczyk, 2018. "A Performance Comparison of Large-n Factor Estimators," The Review of Asset Pricing Studies, Society for Financial Studies, vol. 8(1), pages 153-182.
    4. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    5. Konomi Tonogi & Jun-ichi Nakamura & Kazumi Asako, 2014. "Heterogeneity of Capital Stocks in Japan: Classification by Factor Analysis," Journal of Knowledge Management, Economics and Information Technology, ScientificPapers.org, vol. 4(2), pages 1-10, April.
    6. Tomohiro Ando & Ruey S. Tsay, 2009. "Model selection for generalized linear models with factor‐augmented predictors," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 25(3), pages 207-235, May.
    7. Giovanni Bonaccolto & Massimiliano Caporin & Sandra Paterlini, 2018. "Asset allocation strategies based on penalized quantile regression," Computational Management Science, Springer, vol. 15(1), pages 1-32, January.
    8. Massacci, Daniele, 2017. "Least squares estimation of large dimensional threshold factor models," Journal of Econometrics, Elsevier, vol. 197(1), pages 101-129.
    9. Martin Lettau & Markus Pelger & Stijn Van Nieuwerburgh, 2020. "Factors That Fit the Time Series and Cross-Section of Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2274-2325.
    10. Goyal, Amit & Pérignon, Christophe & Villa, Christophe, 2008. "How common are common return factors across the NYSE and Nasdaq?," Journal of Financial Economics, Elsevier, vol. 90(3), pages 252-271, December.
    11. Kapetanios, G. & Pesaran, M. Hashem & Yamagata, T., 2011. "Panels with non-stationary multifactor error structures," Journal of Econometrics, Elsevier, vol. 160(2), pages 326-348, February.
    12. Li, Kunpeng & Li, Qi & Lu, Lina, 2018. "Quasi maximum likelihood analysis of high dimensional constrained factor models," Journal of Econometrics, Elsevier, vol. 206(2), pages 574-612.
    13. Mao Takongmo, Charles Olivier & Stevanovic, Dalibor, 2015. "Selection Of The Number Of Factors In Presence Of Structural Instability: A Monte Carlo Study," L'Actualité Economique, Société Canadienne de Science Economique, vol. 91(1-2), pages 177-233, Mars-Juin.
    14. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    15. Geweke, John & Zhou, Guofu, 1996. "Measuring the Pricing Error of the Arbitrage Pricing Theory," The Review of Financial Studies, Society for Financial Studies, vol. 9(2), pages 557-587.
    16. Tsionas, Mike G., 2016. "Parameters measuring bank risk and their estimation," European Journal of Operational Research, Elsevier, vol. 250(1), pages 291-304.
    17. Kar, Sabyasachi & Roy, Amrita & Sen, Kunal, 2019. "The double trap: Institutions and economic development," Economic Modelling, Elsevier, vol. 76(C), pages 243-259.
    18. António Rua & Francisco Craveiro Dias, 2008. "Determining the number of factors in approximate factor models with global and group-specific factors," Working Papers w200809, Banco de Portugal, Economics and Research Department.
    19. Bruce N. Lehmann & David M. Modest, 2005. "Diversification and the Optimal Construction of Basis Portfolios," Management Science, INFORMS, vol. 51(4), pages 581-598, April.
    20. Borus Jungbacker & Siem Jan Koopman, 2008. "Likelihood-based Analysis for Dynamic Factor Models," Tinbergen Institute Discussion Papers 08-007/4, Tinbergen Institute, revised 20 Mar 2014.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cdl:econwp:qt4kt5g2x3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lisa Schiff (email available below). General contact details of provider: https://edirc.repec.org/data/ibbrkus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.