IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1612.07067.html
   My bibliography  Save this paper

Analytic solution to variance optimization with no short-selling

Author

Listed:
  • Imre Kondor
  • G'abor Papp
  • Fabio Caccioli

Abstract

A large portfolio of independent returns is optimized under the variance risk measure with a ban on short positions. The no-short selling constraint acts as an asymmetric $\ell_1$ regularizer, setting some of the portfolio weights to zero and keeping the out of sample estimator for the variance bounded, avoiding the divergence present in the non-regularized case. However, the susceptibility, i.e. the sensitivity of the optimal portfolio weights to changes in the returns, diverges at a critical value $r=2$. This means that a ban on short positions does not prevent the phase transition in the optimization problem, it merely shifts the critical point from its non-regularized value of $r=1$ to $2$. At $r=2$ the out of sample estimator for the portfolio variance stays finite and the estimated in-sample variance vanishes. We have performed numerical simulations to support the analytic results and found perfect agreement for $N/T

Suggested Citation

  • Imre Kondor & G'abor Papp & Fabio Caccioli, 2016. "Analytic solution to variance optimization with no short-selling," Papers 1612.07067, arXiv.org, revised Jan 2017.
  • Handle: RePEc:arx:papers:1612.07067
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1612.07067
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Fabio Caccioli & Susanne Still & Matteo Marsili & Imre Kondor, 2013. "Optimal liquidation strategies regularize portfolio selection," The European Journal of Finance, Taylor & Francis Journals, vol. 19(6), pages 554-571, July.
    3. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," The Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    4. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    5. Takashi Shinzato, 2016. "Replica Analysis for the Duality of the Portfolio Optimization Problem," Papers 1609.05475, arXiv.org.
    6. Fabio Caccioli & Imre Kondor & G'abor Papp, 2015. "Portfolio Optimization under Expected Shortfall: Contour Maps of Estimation Error," Papers 1510.04943, arXiv.org.
    7. Victor DeMiguel & Lorenzo Garlappi & Francisco J. Nogales & Raman Uppal, 2009. "A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms," Management Science, INFORMS, vol. 55(5), pages 798-812, May.
    8. Stefano Ciliberti & Imre Kondor & Marc Mezard, 2007. "On the feasibility of portfolio optimization under expected shortfall," Quantitative Finance, Taylor & Francis Journals, vol. 7(4), pages 389-396.
    9. Frahm, Gabriel & Memmel, Christoph, 2010. "Dominating estimators for minimum-variance portfolios," Journal of Econometrics, Elsevier, vol. 159(2), pages 289-302, December.
    10. Imre Kondor & Fabio Caccioli & G'abor Papp & Matteo Marsili, 2015. "Contour map of estimation error for Expected Shortfall," Papers 1502.06217, arXiv.org.
    11. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    12. Alexander Kempf & Christoph Memmel, 2006. "Estimating the global Minimum Variance Portfolio," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 58(4), pages 332-348, October.
    13. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    14. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1684, August.
    15. Fabio Caccioli & Imre Kondor & G'abor Papp, 2015. "Portfolio Optimization under Expected Shortfall: Contour Maps of Estimation Error," Papers 1510.04943, arXiv.org.
    16. repec:hal:journl:peer-00741629 is not listed on IDEAS
    17. Varga-Haszonits, Istvan & Caccioli, Fabio & Kondor, Imre, 2016. "Replica approach to mean-variance portfolio optimization," LSE Research Online Documents on Economics 68955, London School of Economics and Political Science, LSE Library.
    18. Varga-Haszonits, I. & Kondor, I., 2007. "Noise sensitivity of portfolio selection in constant conditional correlation GARCH models," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 385(1), pages 307-318.
    19. Gopal K. Basak & Ravi Jagannathan & Tongshu Ma, 2009. "Jackknife Estimator for Tracking Error Variance of Optimal Portfolios," Management Science, INFORMS, vol. 55(6), pages 990-1002, June.
    20. S. Ciliberti & M. Mézard, 2007. "Risk minimization through portfolio replication," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 57(2), pages 175-180, May.
    21. Jorion, Philippe, 1986. "Bayes-Stein Estimation for Portfolio Analysis," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 21(3), pages 279-292, September.
    22. Gábor, Adrienn & Kondor, I, 1999. "Portfolios with nonlinear constraints and spin glasses," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 274(1), pages 222-228.
    23. Istvan Varga-Haszonits & Fabio Caccioli & Imre Kondor, 2016. "Replica approach to mean-variance portfolio optimization," Papers 1606.08679, arXiv.org.
    24. Okhrin, Yarema & Schmid, Wolfgang, 2006. "Distributional properties of portfolio weights," Journal of Econometrics, Elsevier, vol. 134(1), pages 235-256, September.
    25. Vasyl Golosnoy & Yarema Okhrin, 2007. "Multivariate Shrinkage for Optimal Portfolio Weights," The European Journal of Finance, Taylor & Francis Journals, vol. 13(5), pages 441-458.
    26. Bouchaud,Jean-Philippe & Potters,Marc, 2003. "Theory of Financial Risk and Derivative Pricing," Cambridge Books, Cambridge University Press, number 9780521819169.
    27. Olivier Ledoit & Michael Wolf, 2011. "Nonlinear shrinkage estimation of large-dimensional covariance matrices," IEW - Working Papers 515, Institute for Empirical Research in Economics - University of Zurich.
    28. Kondor, Imre & Pafka, Szilard & Nagy, Gabor, 2007. "Noise sensitivity of portfolio selection under various risk measures," Journal of Banking & Finance, Elsevier, vol. 31(5), pages 1545-1573, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Landmann, Stefan & Engel, Andreas, 2020. "On non-negative solutions to large systems of random linear equations," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 552(C).
    2. Imre Kondor & G'abor Papp & Fabio Caccioli, 2017. "Analytic approach to variance optimization under an $\ell_1$ constraint," Papers 1709.08755, arXiv.org, revised Jul 2018.
    3. Papp, Gábor & Kondor, Imre & Caccioli, Fabio, 2021. "Optimizing expected shortfall under an ℓ1 constraint—an analytic approach," LSE Research Online Documents on Economics 111051, London School of Economics and Political Science, LSE Library.
    4. Li, Yan & Jiang, Xiong-Fei & Tian, Yue & Li, Sai-Ping & Zheng, Bo, 2019. "Portfolio optimization based on network topology," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 515(C), pages 671-681.
    5. Jerome Garnier-Brun & Michael Benzaquen & Stefano Ciliberti & Jean-Philippe Bouchaud, 2021. "A new spin on optimal portfolios and ecological equilibria," Post-Print hal-03378915, HAL.
    6. Jerome Garnier-Brun & Michael Benzaquen & Stefano Ciliberti & Jean-Philippe Bouchaud, 2021. "A new spin on optimal portfolios and ecological equilibria," Papers 2104.00668, arXiv.org, revised Oct 2021.
    7. Aditya Maheshwari & Traian A. Pirvu, 2020. "Portfolio Optimization under Correlation Constraint," Risks, MDPI, vol. 8(1), pages 1-18, February.
    8. Axel Pruser & Imre Kondor & Andreas Engel, 2021. "Aspects of a phase transition in high-dimensional random geometry," Papers 2105.04395, arXiv.org, revised Jun 2021.
    9. G'abor Papp & Imre Kondor & Fabio Caccioli, 2021. "Optimizing Expected Shortfall under an $\ell_1$ constraint -- an analytic approach," Papers 2103.04375, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Istvan Varga-Haszonits & Fabio Caccioli & Imre Kondor, 2016. "Replica approach to mean-variance portfolio optimization," Papers 1606.08679, arXiv.org.
    2. Varga-Haszonits, Istvan & Caccioli, Fabio & Kondor, Imre, 2016. "Replica approach to mean-variance portfolio optimization," LSE Research Online Documents on Economics 68955, London School of Economics and Political Science, LSE Library.
    3. Fabio Caccioli & Imre Kondor & G'abor Papp, 2015. "Portfolio Optimization under Expected Shortfall: Contour Maps of Estimation Error," Papers 1510.04943, arXiv.org.
    4. Fabio Caccioli & Imre Kondor & G'abor Papp, 2015. "Portfolio Optimization under Expected Shortfall: Contour Maps of Estimation Error," Papers 1510.04943, arXiv.org.
    5. Fabio Caccioli & Imre Kondor & Matteo Marsili & Susanne Still, 2014. "$L_p$ regularized portfolio optimization," Papers 1404.4040, arXiv.org.
    6. G'abor Papp & Fabio Caccioli & Imre Kondor, 2016. "Bias-variance trade-off in portfolio optimization under Expected Shortfall with $\ell_2$ regularization," Papers 1602.08297, arXiv.org, revised Jul 2018.
    7. Kourtis, Apostolos & Dotsis, George & Markellos, Raphael N., 2012. "Parameter uncertainty in portfolio selection: Shrinking the inverse covariance matrix," Journal of Banking & Finance, Elsevier, vol. 36(9), pages 2522-2531.
    8. Papp, Gábor & Caccioli, Fabio & Kondor, Imre, 2019. "Bias-variance trade-off in portfolio optimization under expected shortfall with ℓ 2 regularization," LSE Research Online Documents on Economics 100294, London School of Economics and Political Science, LSE Library.
    9. Papp, Gábor & Kondor, Imre & Caccioli, Fabio, 2021. "Optimizing expected shortfall under an ℓ1 constraint—an analytic approach," LSE Research Online Documents on Economics 111051, London School of Economics and Political Science, LSE Library.
    10. Chavez-Bedoya, Luis & Rosales, Francisco, 2022. "Orthogonal portfolios to assess estimation risk," International Review of Economics & Finance, Elsevier, vol. 80(C), pages 906-937.
    11. Caccioli, Fabio & Kondor, Imre & Papp, Gábor, 2015. "Portfolio optimization under expected shortfall: contour maps of estimation error," LSE Research Online Documents on Economics 119463, London School of Economics and Political Science, LSE Library.
    12. Chavez-Bedoya, Luis & Rosales, Francisco, 2021. "Reduction of estimation risk in optimal portfolio choice using redundant constraints," International Review of Financial Analysis, Elsevier, vol. 78(C).
    13. Fabio Caccioli & Imre Kondor & Matteo Marsili & Susanne Still, 2016. "Liquidity Risk And Instabilities In Portfolio Optimization," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 19(05), pages 1-28, August.
    14. Bodnar, Taras & Parolya, Nestor & Schmid, Wolfgang, 2018. "Estimation of the global minimum variance portfolio in high dimensions," European Journal of Operational Research, Elsevier, vol. 266(1), pages 371-390.
    15. DeMiguel, Victor & Martin-Utrera, Alberto & Nogales, Francisco J., 2013. "Size matters: Optimal calibration of shrinkage estimators for portfolio selection," Journal of Banking & Finance, Elsevier, vol. 37(8), pages 3018-3034.
    16. Behr, Patrick & Guettler, Andre & Miebs, Felix, 2013. "On portfolio optimization: Imposing the right constraints," Journal of Banking & Finance, Elsevier, vol. 37(4), pages 1232-1242.
    17. Yen, Yu-Min & Yen, Tso-Jung, 2014. "Solving norm constrained portfolio optimization via coordinate-wise descent algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 737-759.
    18. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    19. Füss, Roland & Miebs, Felix & Trübenbach, Fabian, 2014. "A jackknife-type estimator for portfolio revision," Journal of Banking & Finance, Elsevier, vol. 43(C), pages 14-28.
    20. Imre Kondor & G'abor Papp & Fabio Caccioli, 2017. "Analytic approach to variance optimization under an $\ell_1$ constraint," Papers 1709.08755, arXiv.org, revised Jul 2018.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1612.07067. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.