IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v35y2019i2p540-554.html
   My bibliography  Save this article

Testing out-of-sample portfolio performance

Author

Listed:
  • Kazak, Ekaterina
  • Pohlmeier, Winfried

Abstract

This paper studies the quality of portfolio performance tests based on out-of-sample returns. By disentangling the components of the out-of-sample performance, we show that the observed differences are driven largely by the differences in estimation risk. Our Monte Carlo study reveals that the puzzling empirical findings of inferior performances of theoretically superior strategies result mainly from the low power of these tests. Thus, our results provide an explanation as to why the null hypothesis of equal performance of the simple equally-weighted portfolio compared to many theoretically-superior alternative strategies cannot be rejected in many out-of-sample horse races. Our findings turn out to be robust with respect to different designs and the implementation strategies of the tests.

Suggested Citation

  • Kazak, Ekaterina & Pohlmeier, Winfried, 2019. "Testing out-of-sample portfolio performance," International Journal of Forecasting, Elsevier, vol. 35(2), pages 540-554.
  • Handle: RePEc:eee:intfor:v:35:y:2019:i:2:p:540-554
    DOI: 10.1016/j.ijforecast.2018.09.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207018301808
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2018.09.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. repec:hal:journl:peer-00741629 is not listed on IDEAS
    2. Tu, Jun & Zhou, Guofu, 2011. "Markowitz meets Talmud: A combination of sophisticated and naive diversification strategies," Journal of Financial Economics, Elsevier, vol. 99(1), pages 204-215, January.
    3. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    4. Ledoit, Oliver & Wolf, Michael, 2008. "Robust performance hypothesis testing with the Sharpe ratio," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 850-859, December.
    5. David D Cho, 2011. "Estimation risk in covariance," Journal of Asset Management, Palgrave Macmillan, vol. 12(4), pages 248-259, September.
    6. repec:oup:jfinec:v:10:y:2012:i:1:p:164-197 is not listed on IDEAS
    7. Kan, Raymond & Zhou, Guofu, 2007. "Optimal Portfolio Choice with Parameter Uncertainty," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 42(3), pages 621-656, September.
    8. Victor DeMiguel & Lorenzo Garlappi & Francisco J. Nogales & Raman Uppal, 2009. "A Generalized Approach to Portfolio Optimization: Improving Performance by Constraining Portfolio Norms," Management Science, INFORMS, vol. 55(5), pages 798-812, May.
    9. Victor DeMiguel & Francisco J. Nogales, 2009. "Portfolio Selection with Robust Estimation," Operations Research, INFORMS, vol. 57(3), pages 560-577, June.
    10. Frahm, Gabriel & Memmel, Christoph, 2010. "Dominating estimators for minimum-variance portfolios," Journal of Econometrics, Elsevier, vol. 159(2), pages 289-302, December.
    11. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    12. Okhrin, Yarema & Schmid, Wolfgang, 2006. "Distributional properties of portfolio weights," Journal of Econometrics, Elsevier, vol. 134(1), pages 235-256, September.
    13. Vasyl Golosnoy & Yarema Okhrin, 2007. "Multivariate Shrinkage for Optimal Portfolio Weights," The European Journal of Finance, Taylor & Francis Journals, vol. 13(5), pages 441-458.
    14. Alexander Kempf & Christoph Memmel, 2006. "Estimating the global Minimum Variance Portfolio," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 58(4), pages 332-348, October.
    15. Mark Britten‐Jones, 1999. "The Sampling Error in Estimates of Mean‐Variance Efficient Portfolio Weights," Journal of Finance, American Finance Association, vol. 54(2), pages 655-671, April.
    16. Jobson, J D & Korkie, Bob M, 1981. "Performance Hypothesis Testing with the Sharpe and Treynor Measures," Journal of Finance, American Finance Association, vol. 36(4), pages 889-908, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Platanakis, Emmanouil & Sutcliffe, Charles & Ye, Xiaoxia, 2021. "Horses for courses: Mean-variance for asset allocation and 1/N for stock selection," European Journal of Operational Research, Elsevier, vol. 288(1), pages 302-317.
    2. Wang, Feng & Ye, Xin & Chen, HongTao & Wu, Congxin, 2021. "A portfolio strategy of stock market based on mean-MF-X-DMA model," Chaos, Solitons & Fractals, Elsevier, vol. 143(C).
    3. Ibrahim Filiz & Jan René Judek & Marco Lorenz & Markus Spiwoks, 2021. "Sticky Stock Market Analysts," JRFM, MDPI, vol. 14(12), pages 1-27, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. DeMiguel, Victor & Martin-Utrera, Alberto & Nogales, Francisco J., 2013. "Size matters: Optimal calibration of shrinkage estimators for portfolio selection," Journal of Banking & Finance, Elsevier, vol. 37(8), pages 3018-3034.
    2. Istvan Varga-Haszonits & Fabio Caccioli & Imre Kondor, 2016. "Replica approach to mean-variance portfolio optimization," Papers 1606.08679, arXiv.org.
    3. Varga-Haszonits, Istvan & Caccioli, Fabio & Kondor, Imre, 2016. "Replica approach to mean-variance portfolio optimization," LSE Research Online Documents on Economics 68955, London School of Economics and Political Science, LSE Library.
    4. Taras Bodnar & Holger Dette & Nestor Parolya & Erik Thors'en, 2019. "Sampling Distributions of Optimal Portfolio Weights and Characteristics in Low and Large Dimensions," Papers 1908.04243, arXiv.org, revised Apr 2023.
    5. Chavez-Bedoya, Luis & Rosales, Francisco, 2022. "Orthogonal portfolios to assess estimation risk," International Review of Economics & Finance, Elsevier, vol. 80(C), pages 906-937.
    6. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    7. Maillet, Bertrand & Tokpavi, Sessi & Vaucher, Benoit, 2015. "Global minimum variance portfolio optimisation under some model risk: A robust regression-based approach," European Journal of Operational Research, Elsevier, vol. 244(1), pages 289-299.
    8. Chavez-Bedoya, Luis & Rosales, Francisco, 2021. "Reduction of estimation risk in optimal portfolio choice using redundant constraints," International Review of Financial Analysis, Elsevier, vol. 78(C).
    9. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2022. "Sparsity and stability for minimum-variance portfolios," Risk Management, Palgrave Macmillan, vol. 24(3), pages 214-235, September.
    10. Kourtis, Apostolos & Dotsis, George & Markellos, Raphael N., 2012. "Parameter uncertainty in portfolio selection: Shrinking the inverse covariance matrix," Journal of Banking & Finance, Elsevier, vol. 36(9), pages 2522-2531.
    11. Imre Kondor & G'abor Papp & Fabio Caccioli, 2016. "Analytic solution to variance optimization with no short-selling," Papers 1612.07067, arXiv.org, revised Jan 2017.
    12. Frahm, Gabriel & Memmel, Christoph, 2010. "Dominating estimators for minimum-variance portfolios," Journal of Econometrics, Elsevier, vol. 159(2), pages 289-302, December.
    13. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2019. "Sparsity and Stability for Minimum-Variance Portfolios," Papers 1910.11840, arXiv.org.
    14. Thomas Trier Bjerring & Omri Ross & Alex Weissensteiner, 2017. "Feature selection for portfolio optimization," Annals of Operations Research, Springer, vol. 256(1), pages 21-40, September.
    15. Chen, Jia & Li, Degui & Linton, Oliver, 2019. "A new semiparametric estimation approach for large dynamic covariance matrices with multiple conditioning variables," Journal of Econometrics, Elsevier, vol. 212(1), pages 155-176.
    16. Kourtis, Apostolos, 2014. "On the distribution and estimation of trading costs," Journal of Empirical Finance, Elsevier, vol. 28(C), pages 104-117.
    17. Lassance, Nathan & Vanderveken, Rodolphe & Vrins, Frédéric, 2022. "On the optimal combination of naive and mean-variance portfolio strategies," LIDAM Discussion Papers LFIN 2022006, Université catholique de Louvain, Louvain Finance (LFIN).
    18. Hongseon Kim & Soonbong Lee & Seung Bum Soh & Seongmoon Kim, 2022. "Improving portfolio investment performance with distance‐based portfolio‐combining algorithms," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 45(4), pages 941-959, December.
    19. Thomas Conlon & John Cotter & Iason Kynigakis, 2021. "Machine Learning and Factor-Based Portfolio Optimization," Papers 2107.13866, arXiv.org.
    20. Fabio Caccioli & Imre Kondor & G'abor Papp, 2015. "Portfolio Optimization under Expected Shortfall: Contour Maps of Estimation Error," Papers 1510.04943, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:35:y:2019:i:2:p:540-554. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.