IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2103.04375.html
   My bibliography  Save this paper

Optimizing Expected Shortfall under an $\ell_1$ constraint -- an analytic approach

Author

Listed:
  • G'abor Papp
  • Imre Kondor
  • Fabio Caccioli

Abstract

Expected Shortfall (ES), the average loss above a high quantile, is the current financial regulatory market risk measure. Its estimation and optimization are highly unstable against sample fluctuations and become impossible above a critical ratio $r=N/T$, where $N$ is the number of different assets in the portfolio, and $T$ is the length of the available time series. The critical ratio depends on the confidence level $\alpha$, which means we have a line of critical points on the $\alpha-r$ plane. The large fluctuations in the estimation of ES can be attenuated by the application of regularizers. In this paper, we calculate ES analytically under an $\ell_1$ regularizer by the method of replicas borrowed from the statistical physics of random systems. The ban on short selling, i.e. a constraint rendering all the portfolio weights non-negative, is a special case of an asymmetric $\ell_1$ regularizer. Results are presented for the out-of-sample and the in-sample estimator of the regularized ES, the estimation error, the distribution of the optimal portfolio weights and the density of the assets eliminated from the portfolio by the regularizer. It is shown that the no-short constraint acts as a high volatility cutoff, in the sense that it sets the weights of the high volatility elements to zero with higher probability than those of the low volatility items. This cutoff renormalizes the aspect ratio $r=N/T$, thereby extending the range of the feasibility of optimization. We find that there is a nontrivial mapping between the regularized and unregularized problems, corresponding to a renormalization of the order parameters.

Suggested Citation

  • G'abor Papp & Imre Kondor & Fabio Caccioli, 2021. "Optimizing Expected Shortfall under an $\ell_1$ constraint -- an analytic approach," Papers 2103.04375, arXiv.org.
  • Handle: RePEc:arx:papers:2103.04375
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2103.04375
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Frahm, Gabriel & Memmel, Christoph, 2010. "Dominating estimators for minimum-variance portfolios," Journal of Econometrics, Elsevier, vol. 159(2), pages 289-302, December.
    2. repec:hal:journl:peer-00741629 is not listed on IDEAS
    3. Imre Kondor & Fabio Caccioli & G'abor Papp & Matteo Marsili, 2015. "Contour map of estimation error for Expected Shortfall," Papers 1502.06217, arXiv.org.
    4. Imre Kondor & Gábor Papp & Fabio Caccioli, 2019. "Analytic approach to variance optimization under an ℓ1 constraint," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 92(1), pages 1-16, January.
    5. Istvan Varga-Haszonits & Imre Kondor, 2008. "The instability of downside risk measures," Papers 0811.0800, arXiv.org, revised Nov 2008.
    6. Fabio Caccioli & Susanne Still & Matteo Marsili & Imre Kondor, 2013. "Optimal liquidation strategies regularize portfolio selection," The European Journal of Finance, Taylor & Francis Journals, vol. 19(6), pages 554-571, July.
    7. Gopal K. Basak & Ravi Jagannathan & Tongshu Ma, 2009. "Jackknife Estimator for Tracking Error Variance of Optimal Portfolios," Management Science, INFORMS, vol. 55(6), pages 990-1002, June.
    8. Alexander Kempf & Christoph Memmel, 2006. "Estimating the global Minimum Variance Portfolio," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 58(4), pages 332-348, October.
    9. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    10. Carlo Acerbi & Dirk Tasche, 2002. "Expected Shortfall: A Natural Coherent Alternative to Value at Risk," Economic Notes, Banca Monte dei Paschi di Siena SpA, vol. 31(2), pages 379-388, July.
    11. S. Ciliberti & M. Mézard, 2007. "Risk minimization through portfolio replication," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 57(2), pages 175-180, May.
    12. Papp, Gábor & Caccioli, Fabio & Kondor, Imre, 2019. "Bias-variance trade-off in portfolio optimization under expected shortfall with ℓ 2 regularization," LSE Research Online Documents on Economics 100294, London School of Economics and Political Science, LSE Library.
    13. Stefano Ciliberti & Imre Kondor & Marc Mezard, 2007. "On the feasibility of portfolio optimization under expected shortfall," Quantitative Finance, Taylor & Francis Journals, vol. 7(4), pages 389-396.
    14. Imre Kondor & G'abor Papp & Fabio Caccioli, 2016. "Analytic solution to variance optimization with no short-selling," Papers 1612.07067, arXiv.org, revised Jan 2017.
    15. Kondor, Imre & Pafka, Szilard & Nagy, Gabor, 2007. "Noise sensitivity of portfolio selection under various risk measures," Journal of Banking & Finance, Elsevier, vol. 31(5), pages 1545-1573, May.
    16. Fabio Caccioli & Imre Kondor & Matteo Marsili & Susanne Still, 2016. "Liquidity Risk And Instabilities In Portfolio Optimization," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 19(05), pages 1-28, August.
    17. Fabio Caccioli & Imre Kondor & Gábor Papp, 2018. "Portfolio optimization under Expected Shortfall: contour maps of estimation error," Quantitative Finance, Taylor & Francis Journals, vol. 18(8), pages 1295-1313, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Papp, Gábor & Kondor, Imre & Caccioli, Fabio, 2021. "Optimizing expected shortfall under an ℓ1 constraint—an analytic approach," LSE Research Online Documents on Economics 111051, London School of Economics and Political Science, LSE Library.
    2. Axel Pruser & Imre Kondor & Andreas Engel, 2021. "Aspects of a phase transition in high-dimensional random geometry," Papers 2105.04395, arXiv.org, revised Jun 2021.
    3. Varga-Haszonits, Istvan & Caccioli, Fabio & Kondor, Imre, 2016. "Replica approach to mean-variance portfolio optimization," LSE Research Online Documents on Economics 68955, London School of Economics and Political Science, LSE Library.
    4. Istvan Varga-Haszonits & Fabio Caccioli & Imre Kondor, 2016. "Replica approach to mean-variance portfolio optimization," Papers 1606.08679, arXiv.org.
    5. Fabio Caccioli & Imre Kondor & G'abor Papp, 2015. "Portfolio Optimization under Expected Shortfall: Contour Maps of Estimation Error," Papers 1510.04943, arXiv.org.
    6. Fabio Caccioli & Imre Kondor & G'abor Papp, 2015. "Portfolio Optimization under Expected Shortfall: Contour Maps of Estimation Error," Papers 1510.04943, arXiv.org.
    7. Caccioli, Fabio & Kondor, Imre & Papp, Gábor, 2015. "Portfolio optimization under expected shortfall: contour maps of estimation error," LSE Research Online Documents on Economics 119463, London School of Economics and Political Science, LSE Library.
    8. Imre Kondor & G'abor Papp & Fabio Caccioli, 2016. "Analytic solution to variance optimization with no short-selling," Papers 1612.07067, arXiv.org, revised Jan 2017.
    9. Imre Kondor, 2014. "Estimation Error of Expected Shortfall," Papers 1402.5534, arXiv.org.
    10. Fabio Caccioli & Imre Kondor & Matteo Marsili & Susanne Still, 2016. "Liquidity Risk And Instabilities In Portfolio Optimization," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 19(05), pages 1-28, August.
    11. Papp, Gábor & Caccioli, Fabio & Kondor, Imre, 2019. "Bias-variance trade-off in portfolio optimization under expected shortfall with ℓ 2 regularization," LSE Research Online Documents on Economics 100294, London School of Economics and Political Science, LSE Library.
    12. Fabio Caccioli & Imre Kondor & Matteo Marsili & Susanne Still, 2014. "$L_p$ regularized portfolio optimization," Papers 1404.4040, arXiv.org.
    13. G'abor Papp & Fabio Caccioli & Imre Kondor, 2016. "Bias-variance trade-off in portfolio optimization under Expected Shortfall with $\ell_2$ regularization," Papers 1602.08297, arXiv.org, revised Jul 2018.
    14. Imre Kondor & Fabio Caccioli & G'abor Papp & Matteo Marsili, 2015. "Contour map of estimation error for Expected Shortfall," Papers 1502.06217, arXiv.org.
    15. Giovanni Bonaccolto & Massimiliano Caporin & Sandra Paterlini, 2018. "Asset allocation strategies based on penalized quantile regression," Computational Management Science, Springer, vol. 15(1), pages 1-32, January.
    16. Longfeng Zhao & Chao Wang & Gang-Jin Wang & H. Eugene Stanley & Lin Chen, 2021. "Community detection and portfolio optimization," Papers 2112.13383, arXiv.org.
    17. Martin Herdegen & Nazem Khan, 2020. "Mean-$\rho$ portfolio selection and $\rho$-arbitrage for coherent risk measures," Papers 2009.05498, arXiv.org, revised Jul 2021.
    18. Shinzato, Takashi, 2018. "Maximizing and minimizing investment concentration with constraints of budget and investment risk," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 490(C), pages 986-993.
    19. Giovanni Bonaccolto, 2019. "Critical Decisions for Asset Allocation via Penalized Quantile Regression," Papers 1908.04697, arXiv.org.
    20. Giovanni Bonaccolto, 2021. "Quantile– based portfolios: post– model– selection estimation with alternative specifications," Computational Management Science, Springer, vol. 18(3), pages 355-383, July.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2103.04375. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.