IDEAS home Printed from https://ideas.repec.org/a/spr/alstar/v96y2012i3p343-383.html
   My bibliography  Save this article

Multiple tests for the performance of different investment strategies

Author

Listed:
  • Gabriel Frahm
  • Tobias Wickern
  • Christof Wiechers

Abstract

In the context of modern portfolio theory, we compare the out-of-sample performance of eight investment strategies which are based on statistical methods with the out-of-sample performance of a family of trivial strategies. A wide range of approaches is considered in this work, including the traditional sample-based approach, several minimum-variance techniques, a shrinkage, and a minimax approach. In contrast to similar studies in the literature, we also consider short-selling constraints and a risk-free asset. We provide a way to extend the concept of minimum-variance strategies in the context of short-selling constraints. A main drawback of most empirical studies on that topic is the use of simple testing procedures which do not account for the effects of multiple testing. For that reason we conduct several hypothesis tests which are proposed in the multiple-testing literature. We test whether it is possible to beat a trivial strategy by at least one of the non-trivial strategies, whether the trivial strategy is better than every non-trivial strategy, and which of the non-trivial strategies is significantly outperformed by naive diversification. The empirical part of our study is conducted using US stock returns from the last four decades, obtained via the CRSP database. Copyright Springer-Verlag 2012

Suggested Citation

  • Gabriel Frahm & Tobias Wickern & Christof Wiechers, 2012. "Multiple tests for the performance of different investment strategies," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 96(3), pages 343-383, July.
  • Handle: RePEc:spr:alstar:v:96:y:2012:i:3:p:343-383
    DOI: 10.1007/s10182-011-0166-1
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10182-011-0166-1
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10182-011-0166-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kan, Raymond & Zhou, Guofu, 2007. "Optimal Portfolio Choice with Parameter Uncertainty," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 42(3), pages 621-656, September.
    2. Jorion, Philippe, 1986. "Bayes-Stein Estimation for Portfolio Analysis," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 21(3), pages 279-292, September.
    3. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, July.
    4. J. Tobin, 1958. "Liquidity Preference as Behavior Towards Risk," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 25(2), pages 65-86.
    5. Lorenzo Garlappi & Raman Uppal & Tan Wang, 2007. "Portfolio Selection with Parameter and Model Uncertainty: A Multi-Prior Approach," Review of Financial Studies, Society for Financial Studies, vol. 20(1), pages 41-81, January.
    6. Romano, Joseph P. & Shaikh, Azeem M. & Wolf, Michael, 2008. "Formalized Data Snooping Based On Generalized Error Rates," Econometric Theory, Cambridge University Press, vol. 24(2), pages 404-447, April.
    7. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    8. Frahm, Gabriel & Memmel, Christoph, 2008. "Dominating estimators for the global minimum variance portfolio," Discussion Papers in Econometrics and Statistics 2/08, University of Cologne, Institute of Econometrics and Statistics.
    9. Ledoit, Olivier & Wolf, Michael, 2003. "Improved estimation of the covariance matrix of stock returns with an application to portfolio selection," Journal of Empirical Finance, Elsevier, vol. 10(5), pages 603-621, December.
    10. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    11. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1684, August.
    12. Ledoit, Oliver & Wolf, Michael, 2008. "Robust performance hypothesis testing with the Sharpe ratio," Journal of Empirical Finance, Elsevier, vol. 15(5), pages 850-859, December.
    13. Klein, Roger W. & Bawa, Vijay S., 1976. "The effect of estimation risk on optimal portfolio choice," Journal of Financial Economics, Elsevier, vol. 3(3), pages 215-231, June.
    14. Sebastián Ceria & Robert A Stubbs, 2006. "Incorporating estimation errors into portfolio selection: Robust portfolio construction," Journal of Asset Management, Palgrave Macmillan, vol. 7(2), pages 109-127, July.
    15. Jobson, J D & Korkie, Bob M, 1981. "Performance Hypothesis Testing with the Sharpe and Treynor Measures," Journal of Finance, American Finance Association, vol. 36(4), pages 889-908, September.
    16. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    17. Kalymon, Basil A., 1971. "Estimation Risk in the Portfolio Selection Model," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 6(1), pages 559-582, January.
    18. Frahm, Gabriel, 2007. "Testing for the best alternative with an application to performance measurement," Discussion Papers in Econometrics and Statistics 7/07, University of Cologne, Institute of Econometrics and Statistics.
    19. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    20. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    21. D. Goldfarb & G. Iyengar, 2003. "Robust Portfolio Selection Problems," Mathematics of Operations Research, INFORMS, vol. 28(1), pages 1-38, February.
    22. Alexander Kempf & Christoph Memmel, 2006. "Estimating the global Minimum Variance Portfolio," Schmalenbach Business Review (sbr), LMU Munich School of Management, vol. 58(4), pages 332-348, October.
    23. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    24. Bade, Alexander & Frahm, Gabriel & Jaekel, Uwe, 2008. "A general approach to Bayesian portfolio optimization," Discussion Papers in Econometrics and Statistics 1/08, University of Cologne, Institute of Econometrics and Statistics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. A. Burak Paç & Mustafa Ç. Pınar, 2018. "On robust portfolio and naïve diversification: mixing ambiguous and unambiguous assets," Annals of Operations Research, Springer, vol. 266(1), pages 223-253, July.
    2. Gabriel Frahm, 2018. "An Intersection–Union Test for the Sharpe Ratio," Risks, MDPI, vol. 6(2), pages 1-13, April.
    3. Gabriel Frahm, 2015. "A theoretical foundation of portfolio resampling," Theory and Decision, Springer, vol. 79(1), pages 107-132, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hsu, Po-Hsuan & Han, Qiheng & Wu, Wensheng & Cao, Zhiguang, 2018. "Asset allocation strategies, data snooping, and the 1 / N rule," Journal of Banking & Finance, Elsevier, vol. 97(C), pages 257-269.
    2. André Alves Portela Santos, 2010. "The Out-of-Sample Performance of Robust Portfolio Optimization," Brazilian Review of Finance, Brazilian Society of Finance, vol. 8(2), pages 141-166.
    3. Behr, Patrick & Guettler, Andre & Truebenbach, Fabian, 2012. "Using industry momentum to improve portfolio performance," Journal of Banking & Finance, Elsevier, vol. 36(5), pages 1414-1423.
    4. repec:hal:journl:peer-00741629 is not listed on IDEAS
    5. DeMiguel, Victor & Martin-Utrera, Alberto & Nogales, Francisco J., 2013. "Size matters: Optimal calibration of shrinkage estimators for portfolio selection," Journal of Banking & Finance, Elsevier, vol. 37(8), pages 3018-3034.
    6. Schanbacher Peter, 2015. "Averaging Across Asset Allocation Models," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 235(1), pages 61-81, February.
    7. Istvan Varga-Haszonits & Fabio Caccioli & Imre Kondor, 2016. "Replica approach to mean-variance portfolio optimization," Papers 1606.08679, arXiv.org.
    8. Han, Chulwoo, 2020. "A nonparametric approach to portfolio shrinkage," Journal of Banking & Finance, Elsevier, vol. 120(C).
    9. Joo, Young C. & Park, Sung Y., 2021. "Optimal portfolio selection using a simple double-shrinkage selection rule," Finance Research Letters, Elsevier, vol. 43(C).
    10. Kourtis, Apostolos & Dotsis, George & Markellos, Raphael N., 2012. "Parameter uncertainty in portfolio selection: Shrinking the inverse covariance matrix," Journal of Banking & Finance, Elsevier, vol. 36(9), pages 2522-2531.
    11. Caner, Mehmet & Medeiros, Marcelo & Vasconcelos, Gabriel F.R., 2023. "Sharpe Ratio analysis in high dimensions: Residual-based nodewise regression in factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 393-417.
    12. Wickern, Tobias, 2011. "Confidence in prior knowledge: Calibration and impact on portfolio performance," Discussion Papers in Econometrics and Statistics 7/11, University of Cologne, Institute of Econometrics and Statistics.
    13. Frahm, Gabriel, 2010. "An analytical investigation of estimators for expected asset returns from the perspective of optimal asset allocation," Discussion Papers in Econometrics and Statistics 1/10, University of Cologne, Institute of Econometrics and Statistics.
    14. Olivier Ledoit & Michael Wolf, 2018. "Robust performance hypothesis testing with smooth functions of population moments," ECON - Working Papers 305, Department of Economics - University of Zurich.
    15. Frahm, Gabriel & Memmel, Christoph, 2010. "Dominating estimators for minimum-variance portfolios," Journal of Econometrics, Elsevier, vol. 159(2), pages 289-302, December.
    16. Varga-Haszonits, Istvan & Caccioli, Fabio & Kondor, Imre, 2016. "Replica approach to mean-variance portfolio optimization," LSE Research Online Documents on Economics 68955, London School of Economics and Political Science, LSE Library.
    17. Chakrabarti, Deepayan, 2021. "Parameter-free robust optimization for the maximum-Sharpe portfolio problem," European Journal of Operational Research, Elsevier, vol. 293(1), pages 388-399.
    18. Yuanyuan Zhang & Xiang Li & Sini Guo, 2018. "Portfolio selection problems with Markowitz’s mean–variance framework: a review of literature," Fuzzy Optimization and Decision Making, Springer, vol. 17(2), pages 125-158, June.
    19. Miguel, Victor de & Martín Utrera, Alberto & Nogales, Francisco J., 2013. "Parameter uncertainty in multiperiod portfolio optimization with transaction costs," DES - Working Papers. Statistics and Econometrics. WS ws132119, Universidad Carlos III de Madrid. Departamento de Estadística.
    20. Candelon, B. & Hurlin, C. & Tokpavi, S., 2012. "Sampling error and double shrinkage estimation of minimum variance portfolios," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 511-527.
    21. Maillet, Bertrand & Tokpavi, Sessi & Vaucher, Benoit, 2015. "Global minimum variance portfolio optimisation under some model risk: A robust regression-based approach," European Journal of Operational Research, Elsevier, vol. 244(1), pages 289-299.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:alstar:v:96:y:2012:i:3:p:343-383. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.