IDEAS home Printed from https://ideas.repec.org/p/arx/papers/0810.1922.html
   My bibliography  Save this paper

Look-Ahead Benchmark Bias in Portfolio Performance Evaluation

Author

Listed:
  • Gilles Daniel
  • Didier Sornette
  • Peter Wohrmann

Abstract

Performance of investment managers are evaluated in comparison with benchmarks, such as financial indices. Due to the operational constraint that most professional databases do not track the change of constitution of benchmark portfolios, standard tests of performance suffer from the "look-ahead benchmark bias," when they use the assets constituting the benchmarks of reference at the end of the testing period, rather than at the beginning of the period. Here, we report that the "look-ahead benchmark bias" can exhibit a surprisingly large amplitude for portfolios of common stocks (up to 8% annum for the S&P500 taken as the benchmark) -- while most studies have emphasized related survival biases in performance of mutual and hedge funds for which the biases can be expected to be even larger. We use the CRSP database from 1926 to 2006 and analyze the running top 500 US capitalizations to demonstrate that this bias can account for a gross overestimation of performance metrics such as the Sharpe ratio as well as an underestimation of risk, as measured for instance by peak-to-valley drawdowns. We demonstrate the presence of a significant bias in the estimation of the survival and look-ahead biases studied in the literature. A general methodology to test the properties of investment strategies is advanced in terms of random strategies with similar investment constraints.

Suggested Citation

  • Gilles Daniel & Didier Sornette & Peter Wohrmann, 2008. "Look-Ahead Benchmark Bias in Portfolio Performance Evaluation," Papers 0810.1922, arXiv.org.
    • Handle: RePEc:arx:papers:0810.1922
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/0810.1922
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, July.
    2. Brown, Stephen J & Goetzmann, William N & Ibbotson, Roger G, 1999. "Offshore Hedge Funds: Survival and Performance, 1989-95," The Journal of Business, University of Chicago Press, vol. 72(1), pages 91-117, January.
    3. Ryan Sullivan & Allan Timmermann & Halbert White, 1999. "Data‐Snooping, Technical Trading Rule Performance, and the Bootstrap," Journal of Finance, American Finance Association, vol. 54(5), pages 1647-1691, October.
    4. Eric Bartelsman & Stefano Scarpetta & Fabiano Schivardi, 2003. "Comparative Analysis of Firm Demographics and Survival: Micro-Level Evidence for the OECD Countries," OECD Economics Department Working Papers 348, OECD Publishing.
    5. Lo, Andrew W & MacKinlay, A Craig, 1990. "Data-Snooping Biases in Tests of Financial Asset Pricing Models," The Review of Financial Studies, Society for Financial Studies, vol. 3(3), pages 431-467.
    6. Elton, Edwin J & Gruber, Martin J & Blake, Christopher R, 1996. "Survivorship Bias and Mutual Fund Performance," The Review of Financial Studies, Society for Financial Studies, vol. 9(4), pages 1097-1120.
    7. Brown, Stephen J & Goetzmann, William N, 1995. "Performance Persistence," Journal of Finance, American Finance Association, vol. 50(2), pages 679-698, June.
    8. Grinblatt, Mark & Titman, Sheridan, 1992. "The Persistence of Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 47(5), pages 1977-1984, December.
    9. Brown, Stephen J, et al, 1992. "Survivorship Bias in Performance Studies," The Review of Financial Studies, Society for Financial Studies, vol. 5(4), pages 553-580.
    10. Mark M. Carhart & Jennifer N. Carpenter & Anthony W. Lynch & David K. Musto, 2002. "Mutual Fund Survivorship," The Review of Financial Studies, Society for Financial Studies, vol. 15(5), pages 1439-1463.
    11. Jenke Ter Horst & Marno Verbeek, 2007. "Fund Liquidation, Self-selection, and Look-ahead Bias in the Hedge Fund Industry," Review of Finance, European Finance Association, vol. 11(4), pages 605-632.
    12. Baquero, Guillermo & ter Horst, Jenke & Verbeek, Marno, 2005. "Survival, Look-Ahead Bias, and Persistence in Hedge Fund Performance," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 40(3), pages 493-517, September.
    13. ter Horst, Jenke R. & Nijman, Theo E. & Verbeek, Marno, 2001. "Eliminating look-ahead bias in evaluating persistence in mutual fund performance," Journal of Empirical Finance, Elsevier, vol. 8(4), pages 345-373, September.
    14. Stephen J. Brown & William N. Goetzmann & Roger G. Ibbotson & Stephen A. Ross, 1997. "Rejoinder: The J-Shape Of Performance Persistence Given Survivorship Bias," The Review of Economics and Statistics, MIT Press, vol. 79(2), pages 167-170, May.
    15. Carpenter, Jennifer N. & Lynch, Anthony W., 1999. "Survivorship bias and attrition effects in measures of performance persistence," Journal of Financial Economics, Elsevier, vol. 54(3), pages 337-374, December.
    16. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vikas Agarwal & Vyacheslav Fos & Wei Jiang, 2013. "Inferring Reporting-Related Biases in Hedge Fund Databases from Hedge Fund Equity Holdings," Management Science, INFORMS, vol. 59(6), pages 1271-1289, June.
    2. Agarwal, Vikas & Fos, Vyacheslav & Jiang, Wei, 2012. "Inferring reporting biases in hedge fund databases from hedge fund equity holdings," CFR Working Papers 10-08 [rev.], University of Cologne, Centre for Financial Research (CFR).
    3. Michael Busack & Wolfgang Drobetz & Jan Tille, 2017. "Can investors benefit from the performance of alternative UCITS funds?," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 31(1), pages 69-111, February.
    4. Hung-Cheng Lai & Kuan-Min Wang, 2016. "Does Survivorship Bias of Mutual Funds Differ Between Liquidations and Mergers?," Eastern European Business and Economics Journal, Eastern European Business and Economics Studies Centre, vol. 2(4), pages 299-314.
    5. Martin Eling, 2009. "Does Hedge Fund Performance Persist? Overview and New Empirical Evidence," European Financial Management, European Financial Management Association, vol. 15(2), pages 362-401, March.
    6. Martin Rohleder & Hendrik Scholz & Marco Wilkens, 2010. "Survivorship Bias and Mutual Fund Performance: Relevance, Significance, and Methodical Differences," Review of Finance, European Finance Association, vol. 15(2), pages 441-474.
    7. Bajgrowicz, Pierre & Scaillet, Olivier, 2012. "Technical trading revisited: False discoveries, persistence tests, and transaction costs," Journal of Financial Economics, Elsevier, vol. 106(3), pages 473-491.
    8. Dong‐Hyun Ahn & H. Henry Cao & Stéphane Chrétien, 2009. "Portfolio Performance Measurement: a No Arbitrage Bounds Approach," European Financial Management, European Financial Management Association, vol. 15(2), pages 298-339, March.
    9. Elton, Edwin J. & Gruber, Martin J., 2013. "Mutual Funds," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1011-1061, Elsevier.
    10. Veeravel. V & A. Balakrishnan, 2023. "Persistence of Large-Cap Equity Funds performance, market timing ability, and selectivity: evidence from India," Asia-Pacific Financial Markets, Springer;Japanese Association of Financial Economics and Engineering, vol. 30(1), pages 37-48, March.
    11. Deaves, Richard, 2004. "Data-conditioning biases, performance, persistence and flows: The case of Canadian equity funds," Journal of Banking & Finance, Elsevier, vol. 28(3), pages 673-694, March.
    12. Vidal-García, Javier & Vidal, Marta & Boubaker, Sabri & Uddin, Gazi Salah, 2016. "The short-term persistence of international mutual fund performance," Economic Modelling, Elsevier, vol. 52(PB), pages 926-938.
    13. Terrence Hallahan & Robert Faff, 2001. "Induced persistence or reversals in fund performance?: the effect of survivorship bias," Applied Financial Economics, Taylor & Francis Journals, vol. 11(2), pages 119-126.
    14. Ian Tonks, 2005. "Performance Persistence of Pension-Fund Managers," The Journal of Business, University of Chicago Press, vol. 78(5), pages 1917-1942, September.
    15. Roberto Casarin & Andrea Piva & Loriana Pelizzon, 2008. "Italian Equity Funds: Efficiency and Performance Persistence," The IUP Journal of Financial Economics, IUP Publications, vol. 0(1), pages 7-28, March.
    16. Omneya Abdelsalam & Meryem Duygun & Juan Carlos Matallín-Sáez & Emili Tortosa-Ausina, 2014. "Is Ethical Money Sensitive to Past Returns? The Case of Portfolio Constraints and Persistence of Islamic and Socially Responsible Funds," Working Papers 2014/19, Economics Department, Universitat Jaume I, Castellón (Spain).
    17. ter Horst, Jenke R. & Nijman, Theo E. & Verbeek, Marno, 2001. "Eliminating look-ahead bias in evaluating persistence in mutual fund performance," Journal of Empirical Finance, Elsevier, vol. 8(4), pages 345-373, September.
    18. Francesco Lisi, 2011. "Dicing with the market: randomized procedures for evaluation of mutual funds," Quantitative Finance, Taylor & Francis Journals, vol. 11(2), pages 163-172.
    19. Klubinski, William & Verousis, Thanos, 2019. "On the underestimation of risk in hedge fund performance persistence: geolocation and investment strategy effects," MPRA Paper 109766, University Library of Munich, Germany, revised 03 May 2021.
    20. Bessler, Wolfgang & Blake, David & Lückoff, Peter & Tonks, Ian, 2010. "Why does mutual fund performance not persist? The impact and interaction of fund flows and manager changes," MPRA Paper 34185, University Library of Munich, Germany.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:0810.1922. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.