IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-04514343.html
   My bibliography  Save this paper

Mean-Variance Efficient Large Portfolios : A Simple Machine Learning Heuristic Technique based on the Two-Fund Separation Theorem

Author

Listed:
  • Michele Costola
  • Bertrand Maillet

    (EM - EMLyon Business School)

  • Zhining Yuan
  • Xiang Zhang

Abstract

We revisit in this article the Two-Fund Separation Theorem as a simple technique for the Mean-Variance optimization of large portfolios. The proposed approach is fast and scalable and provides equivalent results of commonly used ML techniques but, with computing time differences counted in hours (1 minute versus several hours). In the empirical application, we consider three geographic areas (China, US, and French stock markets) and show that the Two-Fund Separation Theorem holds exactly when no constraints are imposed and is approximately true with (realistic) positive constraints on weights. This technique is shown to be of interest to both scholars and practitioners involved in portfolio optimization tasks.

Suggested Citation

  • Michele Costola & Bertrand Maillet & Zhining Yuan & Xiang Zhang, 2024. "Mean-Variance Efficient Large Portfolios : A Simple Machine Learning Heuristic Technique based on the Two-Fund Separation Theorem," Post-Print hal-04514343, HAL.
  • Handle: RePEc:hal:journl:hal-04514343
    Note: View the original document on HAL open archive server: https://hal.science/hal-04514343
    as

    Download full text from publisher

    File URL: https://hal.science/hal-04514343/document
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. DeMiguel, Victor & Martin-Utrera, Alberto & Nogales, Francisco J., 2013. "Size matters: Optimal calibration of shrinkage estimators for portfolio selection," Journal of Banking & Finance, Elsevier, vol. 37(8), pages 3018-3034.
    2. Zhao Zhao & Olivier Ledoit & Hui Jiang, 2019. "Risk reduction and efficiency increase in large portfolios: leverage and shrinkage," ECON - Working Papers 328, Department of Economics - University of Zurich, revised Jan 2020.
    3. Tu, Jun & Zhou, Guofu, 2011. "Markowitz meets Talmud: A combination of sophisticated and naive diversification strategies," Journal of Financial Economics, Elsevier, vol. 99(1), pages 204-215, January.
    4. Victor DeMiguel & Francisco J. Nogales & Raman Uppal, 2014. "Stock Return Serial Dependence and Out-of-Sample Portfolio Performance," The Review of Financial Studies, Society for Financial Studies, vol. 27(4), pages 1031-1073.
    5. Ledoit, Oliver & Wolf, Michael, 2008. "Robust performance hypothesis testing with the Sharpe ratio," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 850-859, December.
    6. Klein, Roger W. & Bawa, Vijay S., 1976. "The effect of estimation risk on optimal portfolio choice," Journal of Financial Economics, Elsevier, vol. 3(3), pages 215-231, June.
    7. Giovanni Bonaccolto & Massimiliano Caporin & Sandra Paterlini, 2018. "Asset allocation strategies based on penalized quantile regression," Computational Management Science, Springer, vol. 15(1), pages 1-32, January.
    8. Cairns, Andrew J.G. & Blake, David & Dowd, Kevin, 2006. "Stochastic lifestyling: Optimal dynamic asset allocation for defined contribution pension plans," Journal of Economic Dynamics and Control, Elsevier, vol. 30(5), pages 843-877, May.
    9. Breuer, Thomas & Csiszár, Imre, 2013. "Systematic stress tests with entropic plausibility constraints," Journal of Banking & Finance, Elsevier, vol. 37(5), pages 1552-1559.
    10. MacKinlay, A Craig & Pastor, Lubos, 2000. "Asset Pricing Models: Implications for Expected Returns and Portfolio Selection," The Review of Financial Studies, Society for Financial Studies, vol. 13(4), pages 883-916.
    11. Stephen A. Ross, 2005. "Mutual Fund Separation in Financial Theory—The Separating Distributions," World Scientific Book Chapters, in: Sudipto Bhattacharya & George M Constantinides (ed.), Theory Of Valuation, chapter 10, pages 309-356, World Scientific Publishing Co. Pte. Ltd..
    12. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    13. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    14. Yang, Yuhong, 2000. "Combining Different Procedures for Adaptive Regression," Journal of Multivariate Analysis, Elsevier, vol. 74(1), pages 135-161, July.
    15. J. Tobin, 1958. "Liquidity Preference as Behavior Towards Risk," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 25(2), pages 65-86.
    16. Kan, Raymond & Zhou, Guofu, 2007. "Optimal Portfolio Choice with Parameter Uncertainty," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 42(3), pages 621-656, September.
    17. Victor DeMiguel & Lorenzo Garlappi & Francisco J. Nogales & Raman Uppal, 2009. "A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms," Management Science, INFORMS, vol. 55(5), pages 798-812, May.
    18. Joo, Young C. & Park, Sung Y., 2021. "Optimal portfolio selection using a simple double-shrinkage selection rule," Finance Research Letters, Elsevier, vol. 43(C).
    19. Romain Deguest & Lionel Martellini & Vincent Milhau, 2018. "A Reinterpretation of the Optimal Demand for Risky Assets in Fund Separation Theorems," Management Science, INFORMS, vol. 64(9), pages 4333-4347, September.
    20. Yen, Yu-Min & Yen, Tso-Jung, 2014. "Solving norm constrained portfolio optimization via coordinate-wise descent algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 737-759.
    21. B. Fastrich & S. Paterlini & P. Winker, 2015. "Constructing optimal sparse portfolios using regularization methods," Computational Management Science, Springer, vol. 12(3), pages 417-434, July.
    22. Mark D. Flood & George G. Korenko, 2015. "Systematic scenario selection: stress testing and the nature of uncertainty," Quantitative Finance, Taylor & Francis Journals, vol. 15(1), pages 43-59, January.
    23. Craig Israelsen, 2005. "A refinement to the Sharpe ratio and information ratio," Journal of Asset Management, Palgrave Macmillan, vol. 5(6), pages 423-427, April.
    24. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    25. Jianqing Fan & Jingjin Zhang & Ke Yu, 2012. "Vast Portfolio Selection With Gross-Exposure Constraints," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 592-606, June.
    26. Thomas Breuer & Martin Jandacka & Klaus Rheinberger & Martin Summer, 2009. "How to Find Plausible, Severe and Useful Stress Scenarios," International Journal of Central Banking, International Journal of Central Banking, vol. 5(3), pages 205-224, September.
    27. Merton, Robert C, 1973. "An Intertemporal Capital Asset Pricing Model," Econometrica, Econometric Society, vol. 41(5), pages 867-887, September.
    28. Giovanni Bonaccolto & Sandra Paterlini, 2020. "Developing new portfolio strategies by aggregation," Annals of Operations Research, Springer, vol. 292(2), pages 933-971, September.
    29. Gourieroux, C. & Jouneau, F., 1999. "Econometrics of efficient fitted portfolios," Journal of Empirical Finance, Elsevier, vol. 6(1), pages 87-118, January.
    30. John Lintner, 1965. "Security Prices, Risk, And Maximal Gains From Diversification," Journal of Finance, American Finance Association, vol. 20(4), pages 587-615, December.
    31. Miguel Lobo & Maryam Fazel & Stephen Boyd, 2007. "Portfolio optimization with linear and fixed transaction costs," Annals of Operations Research, Springer, vol. 152(1), pages 341-365, July.
    32. Schanbacher Peter, 2015. "Averaging Across Asset Allocation Models," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 235(1), pages 61-81, February.
    33. Alexander J. McNeil & Rüdiger Frey & Paul Embrechts, 2015. "Quantitative Risk Management: Concepts, Techniques and Tools Revised edition," Economics Books, Princeton University Press, edition 2, number 10496.
    34. Yang Y., 2001. "Adaptive Regression by Mixing," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 574-588, June.
    35. Kolm, Petter N. & Tütüncü, Reha & Fabozzi, Frank J., 2014. "60 Years of portfolio optimization: Practical challenges and current trends," European Journal of Operational Research, Elsevier, vol. 234(2), pages 356-371.
    36. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    37. Yongjae Lee & Min Jeong Kim & Jang Ho Kim & Ju Ri Jang & Woo Chang Kim, 2020. "Sparse and robust portfolio selection via semi-definite relaxation," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 71(5), pages 687-699, May.
    38. Geyer, Alois & Hanke, Michael & Weissensteiner, Alex, 2014. "No-arbitrage bounds for financial scenarios," European Journal of Operational Research, Elsevier, vol. 236(2), pages 657-663.
    39. Hakansson, Nils H., 1969. "Risk Disposition and the Separation Property in Portfolio Selection†," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 4(4), pages 401-416, December.
    40. Alexander Kempf & Christoph Memmel, 2006. "Estimating the global Minimum Variance Portfolio," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 58(4), pages 332-348, October.
    41. Dybvig, Philip & Liu, Fang, 2018. "On investor preferences and mutual fund separation," Journal of Economic Theory, Elsevier, vol. 174(C), pages 224-260.
    42. Markowitz, Harry, 2014. "Mean–variance approximations to expected utility," European Journal of Operational Research, Elsevier, vol. 234(2), pages 346-355.
    43. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    44. Eduardo Bered Fernandes Vieira & Tiago Pascoal Filomena, 2020. "Liquidity Constraints for Portfolio Selection Based on Financial Volume," Computational Economics, Springer;Society for Computational Economics, vol. 56(4), pages 1055-1077, December.
    45. Samuelson, Paul A., 1967. "General Proof that Diversification Pays*," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 2(1), pages 1-13, March.
    46. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    47. Woodside-Oriakhi, M. & Lucas, C. & Beasley, J.E., 2011. "Heuristic algorithms for the cardinality constrained efficient frontier," European Journal of Operational Research, Elsevier, vol. 213(3), pages 538-550, September.
    48. repec:bla:jfinan:v:58:y:2003:i:4:p:1651-1684 is not listed on IDEAS
    49. Merton, Robert C., 1980. "On estimating the expected return on the market : An exploratory investigation," Journal of Financial Economics, Elsevier, vol. 8(4), pages 323-361, December.
    50. Jobson, J D & Korkie, Bob M, 1981. "Performance Hypothesis Testing with the Sharpe and Treynor Measures," Journal of Finance, American Finance Association, vol. 36(4), pages 889-908, September.
    51. Cass, David & Stiglitz, Joseph E., 1970. "The structure of investor preferences and asset returns, and separability in portfolio allocation: A contribution to the pure theory of mutual funds," Journal of Economic Theory, Elsevier, vol. 2(2), pages 122-160, June.
    52. John Douglas (J.D.) Opdyke, 2007. "Comparing Sharpe ratios: So where are the p-values?," Journal of Asset Management, Palgrave Macmillan, vol. 8(5), pages 308-336, December.
    53. Campbell R. Harvey & Akhtar Siddique, 2000. "Conditional Skewness in Asset Pricing Tests," Journal of Finance, American Finance Association, vol. 55(3), pages 1263-1295, June.
    54. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    55. Black, Fischer, 1972. "Capital Market Equilibrium with Restricted Borrowing," The Journal of Business, University of Chicago Press, vol. 45(3), pages 444-455, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas Conlon & John Cotter & Iason Kynigakis, 2021. "Machine Learning and Factor-Based Portfolio Optimization," Papers 2107.13866, arXiv.org.
    2. Giovanni Bonaccolto & Sandra Paterlini, 2020. "Developing new portfolio strategies by aggregation," Annals of Operations Research, Springer, vol. 292(2), pages 933-971, September.
    3. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    4. Gabriel Frahm & Tobias Wickern & Christof Wiechers, 2012. "Multiple tests for the performance of different investment strategies," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 96(3), pages 343-383, July.
    5. Kremer, Philipp J. & Lee, Sangkyun & Bogdan, Małgorzata & Paterlini, Sandra, 2020. "Sparse portfolio selection via the sorted ℓ1-Norm," Journal of Banking & Finance, Elsevier, vol. 110(C).
    6. Giovanni Bonaccolto & Massimiliano Caporin & Sandra Paterlini, 2018. "Asset allocation strategies based on penalized quantile regression," Computational Management Science, Springer, vol. 15(1), pages 1-32, January.
    7. Wang, Christina Dan & Chen, Zhao & Lian, Yimin & Chen, Min, 2022. "Asset selection based on high frequency Sharpe ratio," Journal of Econometrics, Elsevier, vol. 227(1), pages 168-188.
    8. Maillet, Bertrand & Tokpavi, Sessi & Vaucher, Benoit, 2015. "Global minimum variance portfolio optimisation under some model risk: A robust regression-based approach," European Journal of Operational Research, Elsevier, vol. 244(1), pages 289-299.
    9. Yen, Yu-Min & Yen, Tso-Jung, 2014. "Solving norm constrained portfolio optimization via coordinate-wise descent algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 737-759.
    10. Giovanni Bonaccolto, 2021. "Quantile– based portfolios: post– model– selection estimation with alternative specifications," Computational Management Science, Springer, vol. 18(3), pages 355-383, July.
    11. Jiahan Li, 2015. "Sparse and Stable Portfolio Selection With Parameter Uncertainty," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 381-392, July.
    12. Massimo Guidolin & Erwin Hansen & Martín Lozano-Banda, 2018. "Portfolio performance of linear SDF models: an out-of-sample assessment," Quantitative Finance, Taylor & Francis Journals, vol. 18(8), pages 1425-1436, August.
    13. Miguel, Victor de & Nogales, Francisco J., 2013. "Parameter uncertainty in multiperiod portfolio optimization with transaction costs," DES - Working Papers. Statistics and Econometrics. WS ws132119, Universidad Carlos III de Madrid. Departamento de Estadística.
    14. Erindi Allaj, 2020. "The Black–Litterman model and views from a reverse optimization procedure: an out-of-sample performance evaluation," Computational Management Science, Springer, vol. 17(3), pages 465-492, October.
    15. Hongxin Zhao & Lingchen Kong & Hou-Duo Qi, 2021. "Optimal portfolio selections via $$\ell _{1, 2}$$ ℓ 1 , 2 -norm regularization," Computational Optimization and Applications, Springer, vol. 80(3), pages 853-881, December.
    16. Olivier Ledoit & Michael Wolf, 2018. "Robust performance hypothesis testing with smooth functions of population moments," ECON - Working Papers 305, Department of Economics - University of Zurich.
    17. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2019. "Sparsity and Stability for Minimum-Variance Portfolios," Papers 1910.11840, arXiv.org.
    18. Chakrabarti, Deepayan, 2021. "Parameter-free robust optimization for the maximum-Sharpe portfolio problem," European Journal of Operational Research, Elsevier, vol. 293(1), pages 388-399.
    19. Gourieroux, C. & Monfort, A., 2005. "The econometrics of efficient portfolios," Journal of Empirical Finance, Elsevier, vol. 12(1), pages 1-41, January.
    20. Penaranda, Francisco, 2007. "Portfolio choice beyond the traditional approach," LSE Research Online Documents on Economics 24481, London School of Economics and Political Science, LSE Library.

    More about this item

    Keywords

    Two-Fund Separation Theorem; Machine learning; Robust portfolio; High-dimensional Portfolios; mean-variance efficient portfolios;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-04514343. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.