Sparse and Stable Markowitz Portfolios
AbstractThe Markowitz mean-variance optimizing framework has served as the basis for modern portfolio theory for more than 50 years. However, efforts to translate this theoretical foundation into a viable portfolio construction algorithm have been plagued by technical difficulties stemming from the instability of the original optimization problem with respect to the available data. In this paper we address these issues of estimation error by regularizing the Markowitz objective function through the addition of a penalty proportional to the sum of the absolute values of the portfolio weights (l1 penalty). This penalty stabilizes the optimization problem, encourages sparse portfolios, and facilitates treatment of transaction costs in a transparent way. We implement this methodology using the Fama and French 48 industry portfolios as our securities. Using only a modest amount of training data, we construct portfolios whose out-of-sample performance, as measured by Sharpe ratio, is consistently and significantly better than that of the naïve portfolio comprising equal investments in each available asset. In addition to their excellent performance, these portfolios have only a small number of active positions, a highly desirable attribute for real life applications. We conclude by discussing a collection of portfolio construction problems which can be naturally translated into optimizations involving l1 penalties and which can thus be tackled by algorithms similar to those discussed here.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by C.E.P.R. Discussion Papers in its series CEPR Discussion Papers with number 6474.
Date of creation: Sep 2007
Date of revision:
Contact details of provider:
Postal: Centre for Economic Policy Research, 77 Bastwick Street, London EC1V 3PZ.
Phone: 44 - 20 - 7183 8801
Fax: 44 - 20 - 7183 8820
Other versions of this item:
- Joshua Brodie & Ingrid Daubechies & Christine De Mol & Domenico Giannone & Ignace Loris, 2007. "Sparse and stable Markowitz portfolios," Papers 0708.0046, arXiv.org, revised May 2008.
- Brodie, Joshua & Daubechies, Ingrid & De Mol, Christine & Giannone, Domenico & Loris, Ignace, 2008. "Sparse and stable Markowitz portfolios," Working Paper Series 0936, European Central Bank.
- C00 - Mathematical and Quantitative Methods - - General - - - General
- G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
This paper has been announced in the following NEP Reports:
- NEP-ALL-2007-09-24 (All new papers)
- NEP-CMP-2007-09-24 (Computational Economics)
- NEP-FMK-2007-09-24 (Financial Markets)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2006.
"Forecasting using a large number of predictors: is Bayesian regression a valid alternative to principal components?,"
Discussion Paper Series 1: Economic Studies
2006,32, Deutsche Bundesbank, Research Centre.
- De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
- De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2006. "Forecasting Using a Large Number of Predictors: Is Bayesian Regression a Valid Alternative to Principal Components?," CEPR Discussion Papers 5829, C.E.P.R. Discussion Papers.
- De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2006. "Forecasting using a large number of predictors: Is Bayesian regression a valid alternative to principal components?," Working Paper Series 0700, European Central Bank.
- Christine De Mol & Domenico Giannone & Lucrezia Reichlin, 2008. "Forecasting using a large number of predictors: is Bayesian shrinkage a valid alternative to principal components?," ULB Institutional Repository 2013/6411, ULB -- Universite Libre de Bruxelles.
- Ravi Jagannathan & Tongshu Ma, 2002.
"Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps,"
NBER Working Papers
8922, National Bureau of Economic Research, Inc.
- Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1684, 08.
- Carlos Castro, 2010. "Portfolio choice under local industry and country factors," Financial Markets and Portfolio Management, Springer, vol. 24(4), pages 353-393, December.
- Jianqing Fan & Yuan Liao & Xiaofeng Shi, 2013.
"Risks of Large Portfolios,"
- Caihua Chen & Xindan Li & Caleb Tolman & Suyang Wang & Yinyu Ye, 2013. "Sparse Portfolio Selection via Quasi-Norm Regularization," Papers 1312.6350, arXiv.org.
- Ignace Loris & Caroline Verhoeven, 2013. "An iterative algorithm for sparse and constrained recovery with applications to divergence-free current reconstructions in magneto-encephalography," Computational Optimization and Applications, Springer, vol. 54(2), pages 399-416, March.
- Imre Kondor, 2014. "Estimation Error of Expected Shortfall," Papers 1402.5534, arXiv.org.
- Jun-ya Gotoh & Akiko Takeda, 2011. "On the role of norm constraints in portfolio selection," Computational Management Science, Springer, vol. 8(4), pages 323-353, November.
- Oliver Hülsewig & Johannes Mayr & Timo Wollmershäuser, 2008. "Forecasting Euro Area Real GDP: Optimal Pooling of Information," CESifo Working Paper Series 2371, CESifo Group Munich.
- Bjöern Fastrich & Sandra Paterlini & Peter Winker, 2011.
"Cardinality versus q-Norm Constraints for Index Tracking,"
Department of Economics
0642, University of Modena and Reggio E., Faculty of Economics "Marco Biagi".
- Bjoern Fastrich & Sandra Paterlini & Peter Winker, 2011. "Cardinality versus q-Norm Constraints for Index Tracking," Center for Economic Research (RECent) 056, University of Modena and Reggio E., Dept. of Economics.
- Akiko Takeda & Mahesan Niranjan & Jun-ya Gotoh & Yoshinobu Kawahara, 2013. "Simultaneous pursuit of out-of-sample performance and sparsity in index tracking portfolios," Computational Management Science, Springer, vol. 10(1), pages 21-49, February.
- Enzo Busseti & Fabrizio Lillo, 2012. "Calibration of optimal execution of financial transactions in the presence of transient market impact," Papers 1206.0682, arXiv.org.
- Yu-Min Yen, 2010. "A Note on Sparse Minimum Variance Portfolios and Coordinate-Wise Descent Algorithms," Papers 1005.5082, arXiv.org, revised Sep 2013.
- Fabio Caccioli & Imre Kondor & Matteo Marsili & Susanne Still, 2014. "$L_p$ regularized portfolio optimization," Papers 1404.4040, arXiv.org.
- Mayr, Johannes, 2010. "Forecasting Macroeconomic Aggregates," Munich Dissertations in Economics 11140, University of Munich, Department of Economics.
- Serge Darolles & Christian Gouriéroux & Emmanuelle Jay, 2012. "Robust Portfolio Allocation with Systematic Risk Contribution Restrictions," Working Papers 2012-35, Centre de Recherche en Economie et Statistique.
- Briec, Walter & Kerstens, Kristiaan & Van de Woestyne, Ignace, 2011. "Portfolio Selection with Skewness: A Comparison and a Generalized Two Fund Separation Result," Working Papers 2011/09, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
- Mohammed Bouaddi & Abderrahim Taamouti, 2012. "Portfolio risk management in a data-rich environment," Financial Markets and Portfolio Management, Springer, vol. 26(4), pages 469-494, December.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.