IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2604.18821.html

Evaluating Structured Strategy Backtests: Peer Benchmarks, Regime Timing, and Live Performance

Author

Listed:
  • Chang Liu

Abstract

Institutional allocators often evaluate structured strategies on the basis of marketed backtests -- hypothetical track records constructed by applying a strategy's rules to historical data prior to any live trading, also referred to as pro-forma performance. It is unclear how much of that signal survives once the strategy is actually traded. Using 1,726 commercially distributed structured strategies from ten global institutions, this paper shows that raw pro-forma performance has only limited portability into the live period and weakens sharply once live outcomes are measured relative to peer and external benchmarks. The evidence indicates that marketed backtests predominantly reflect the common factor regime present before launch rather than strategy-specific skill. Strategies launched after unusually strong bucket-factor conditions experience materially worse subsequent deterioration. For allocators, the implication is practical: backtests should be judged relative to appropriate peer benchmarks, and the discount applied to them should increase when launch occurs after an extreme factor run.

Suggested Citation

  • Chang Liu, 2026. "Evaluating Structured Strategy Backtests: Peer Benchmarks, Regime Timing, and Live Performance," Papers 2604.18821, arXiv.org.
  • Handle: RePEc:arx:papers:2604.18821
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2604.18821
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Irina Bezhentseva Mateus & Cesario Mateus & Natasa Todorovic, 2019. "Correction to: Benchmark-adjusted performance of US equity mutual funds and the issue of prospectus benchmarks," Journal of Asset Management, Palgrave Macmillan, vol. 20(3), pages 250-250, May.
    2. Ravi Jagannathan & Alexey Malakhov & Dmitry Novikov, 2010. "Do Hot Hands Exist among Hedge Fund Managers? An Empirical Evaluation," Journal of Finance, American Finance Association, vol. 65(1), pages 217-255, February.
    3. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    4. Lasse Pedersen, 2009. "When Everyone Runs for the Exit," International Journal of Central Banking, International Journal of Central Banking, vol. 5(4), pages 177-199, December.
    5. Daniel, Kent, et al, 1997. "Measuring Mutual Fund Performance with Characteristic-Based Benchmarks," Journal of Finance, American Finance Association, vol. 52(3), pages 1035-1058, July.
    6. Antti Ilmanen, 2012. "Do Financial Markets Reward Buying or Selling Insurance and Lottery Tickets?," Financial Analysts Journal, Taylor & Francis Journals, vol. 68(5), pages 26-36, September.
    7. R. David Mclean & Jeffrey Pontiff, 2016. "Does Academic Research Destroy Stock Return Predictability?," Journal of Finance, American Finance Association, vol. 71(1), pages 5-32, February.
    8. Noël Amenc & Lionel Martellini & Mathieu Vaissié, 2003. "Benefits and risks of alternative investment strategies," Journal of Asset Management, Palgrave Macmillan, vol. 4(2), pages 96-118, August.
    9. Richard B. Evans, 2010. "Mutual Fund Incubation," Journal of Finance, American Finance Association, vol. 65(4), pages 1581-1611, August.
    10. Theis Ingerslev Jensen & Bryan Kelly & Lasse Heje Pedersen, 2023. "Is There a Replication Crisis in Finance?," Journal of Finance, American Finance Association, vol. 78(5), pages 2465-2518, October.
    11. Hunter, David & Kandel, Eugene & Kandel, Shmuel & Wermers, Russ, 2014. "Mutual fund performance evaluation with active peer benchmarks," Journal of Financial Economics, Elsevier, vol. 112(1), pages 1-29.
    12. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    13. Robin Greenwood & Andrei Shleifer, 2014. "Expectations of Returns and Expected Returns," The Review of Financial Studies, Society for Financial Studies, vol. 27(3), pages 714-746.
    14. François-Serge LHABITANT, 2001. "Assessing Market Risk for Hedge Funds Portfolios," FAME Research Paper Series rp24, International Center for Financial Asset Management and Engineering.
    15. Antoine Falck & Adam Rej & David Thesmar, 2022. "When do systematic strategies decay?," Quantitative Finance, Taylor & Francis Journals, vol. 22(11), pages 1955-1969, November.
    16. Robert Kosowski & Allan Timmermann & Russ Wermers & Hal White, 2006. "Can Mutual Fund “Stars” Really Pick Stocks? New Evidence from a Bootstrap Analysis," Journal of Finance, American Finance Association, vol. 61(6), pages 2551-2595, December.
    17. William Fung & David A. Hsieh, 2004. "Hedge Fund Benchmarks: A Risk-Based Approach," Financial Analysts Journal, Taylor & Francis Journals, vol. 60(5), pages 65-80, September.
    18. François‐Serge Lhabitant, 2001. "Assessing Market Risk for Hedge Funds and Hedge Fund Portfolios," Journal of Risk Finance, Emerald Group Publishing Limited, vol. 2(4), pages 16-32, March.
    19. Jonathan B. Berk & Richard C. Green, 2004. "Mutual Fund Flows and Performance in Rational Markets," Journal of Political Economy, University of Chicago Press, vol. 112(6), pages 1269-1295, December.
    20. Baquero, Guillermo & ter Horst, Jenke & Verbeek, Marno, 2005. "Survival, Look-Ahead Bias, and Persistence in Hedge Fund Performance," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 40(3), pages 493-517, September.
    21. Rockafellar, R. Tyrrell & Uryasev, Stanislav, 2002. "Conditional value-at-risk for general loss distributions," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1443-1471, July.
    22. Eugene F. Fama & Kenneth R. French, 2010. "Luck versus Skill in the Cross‐Section of Mutual Fund Returns," Journal of Finance, American Finance Association, vol. 65(5), pages 1915-1947, October.
    23. Clifford S. Asness & Tobias J. Moskowitz & Lasse Heje Pedersen, 2013. "Value and Momentum Everywhere," Journal of Finance, American Finance Association, vol. 68(3), pages 929-985, June.
    24. Cremers, Martijn & Petajisto, Antti & Zitzewitz, Eric, 2013. "Should Benchmark Indices Have Alpha? Revisiting Performance Evaluation," Critical Finance Review, now publishers, vol. 2(1), pages 1-48, July.
    25. repec:dau:papers:123456789/1378 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. DeMiguel, Victor & Gil-Bazo, Javier & Nogales, Francisco J. & Santos, André A.P., 2023. "Machine learning and fund characteristics help to select mutual funds with positive alpha," Journal of Financial Economics, Elsevier, vol. 150(3).
    2. Pástor, Ľuboš & Stambaugh, Robert F. & Taylor, Lucian A., 2015. "Scale and skill in active management," Journal of Financial Economics, Elsevier, vol. 116(1), pages 23-45.
    3. Benoît Dewaele, 2013. "Portfolio Optimization for Hedge Funds through Time-Varying Coefficients," Working Papers CEB 13-032, ULB -- Universite Libre de Bruxelles.
    4. Pástor, Ľuboš & Stambaugh, Robert F. & Taylor, Lucian A., 2015. "Scale and skill in active management," Journal of Financial Economics, Elsevier, vol. 116(1), pages 23-45.
    5. Liu, Yuekun & Riley, Timothy B., 2025. "How should we measure the performance of corporate bond mutual funds? Evaluating model quality and impact on inferences," Journal of Banking & Finance, Elsevier, vol. 173(C).
    6. Dahlquist, Magnus & Odegaard, Bernt Arne, 2018. "A Review of Norges Bank's Active Management of the Government Pension Fund Global," UiS Working Papers in Economics and Finance 2018/1, University of Stavanger.
    7. Mateus, Irina B. & Mateus, Cesario & Todorovic, Natasa, 2019. "Review of new trends in the literature on factor models and mutual fund performance," International Review of Financial Analysis, Elsevier, vol. 63(C), pages 344-354.
    8. Mason, Andrew & Agyei-Ampomah, Sam & Skinner, Frank, 2016. "Realism, skill, and incentives: Current and future trends in investment management and investment performance," International Review of Financial Analysis, Elsevier, vol. 43(C), pages 31-40.
    9. Malakhov, Alexey & Riley, Timothy B. & Yan, Qing, 2024. "Do hedge funds bet against beta?," International Review of Economics & Finance, Elsevier, vol. 93(PA), pages 1507-1525.
    10. Benoît Dewaele, 2013. "Leverage and Alpha: The Case of Funds of Hedge Funds," Working Papers CEB 13-033, ULB -- Universite Libre de Bruxelles.
    11. Müller, Sebastian & Pugachyov, Nikolay & Weigert, Florian, 2026. "Forecasting mutual fund performance: Combining return-based with portfolio holdings-based predictors," CFR Working Papers 26-01, University of Cologne, Centre for Financial Research (CFR).
    12. Cai, Biqing & Cheng, Tingting & Yan, Cheng, 2018. "Time-varying skills (versus luck) in U.S. active mutual funds and hedge funds," Journal of Empirical Finance, Elsevier, vol. 49(C), pages 81-106.
    13. Wolfgang Bessler & Thomas Conlon & Diego Víctor de Mingo‐López & Juan Carlos Matallín‐Sáez, 2022. "Mutual fund performance and changes in factor exposure," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 45(1), pages 17-52, March.
    14. Victor DeMiguel & Javier Gil-Bazo & Francisco J. Nogales & André A. P. Santos, 2021. "Can machine learning help to select portfolios of mutual funds?," Economics Working Papers 1772, Department of Economics and Business, Universitat Pompeu Fabra.
    15. repec:bge:wpaper:1245 is not listed on IDEAS
    16. Angelidis, Timotheos & Babalos, Vassilios & Fessas, Michalis, 2021. "The economic gain of being small in the mutual fund industry: U.S. and international evidence," International Review of Financial Analysis, Elsevier, vol. 77(C).
    17. Timothy B. Riley, 2021. "Portfolios of actively managed mutual funds," The Financial Review, Eastern Finance Association, vol. 56(2), pages 205-230, May.
    18. Cai, Yu & Lau, Sie Ting, 2015. "Informed trading around earnings and mutual fund alphas," Journal of Banking & Finance, Elsevier, vol. 60(C), pages 168-180.
    19. Elyasiani, Elyas & Rytchkov, Oleg & Stetsyuk, Ivan, 2022. "Do real estate mutual fund managers create value?," The Quarterly Review of Economics and Finance, Elsevier, vol. 86(C), pages 396-406.
    20. Cuthbertson, Keith & Nitzsche, Dirk & O'Sullivan, Niall, 2016. "A review of behavioural and management effects in mutual fund performance," International Review of Financial Analysis, Elsevier, vol. 44(C), pages 162-176.
    21. Hunter, David & Kandel, Eugene & Kandel, Shmuel & Wermers, Russ, 2014. "Mutual fund performance evaluation with active peer benchmarks," Journal of Financial Economics, Elsevier, vol. 112(1), pages 1-29.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2604.18821. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.