IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v41y2025i4p1383-1394.html

Benchmarking M6 competitors: An analysis of financial metrics and discussion of incentives

Author

Listed:
  • Schneider, Matthew J.
  • Rankin, Rufus
  • Burman, Prabir
  • Aue, Alexander

Abstract

The M6 Competition assessed the performance of competitors using a ranked probability score and an information ratio. While these metrics do well at picking the winners in the competition, crucial questions remain for investors with longer-term incentives. To address these questions, we compare the competitors’ performance with a number of conventional (long-only) and alternative indices using industry-relevant metrics. We apply factor models to measure the competitors’ value-adds above industry-standard benchmarks and find that competitors with more extreme performance are less dependent on the benchmarks. We further introduce two new strategies by picking the competitors with the best (Superstars) and worst (Superlosers) recent performance and show that it is challenging to identify skill amongst investment managers. Finally, we discuss the incentives of winning the competition compared with professional investors, where investors wish to maximize fees over an extended period of time, and provide suggestions for future competition improvements.

Suggested Citation

  • Schneider, Matthew J. & Rankin, Rufus & Burman, Prabir & Aue, Alexander, 2025. "Benchmarking M6 competitors: An analysis of financial metrics and discussion of incentives," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1383-1394.
    • Handle: RePEc:eee:intfor:v:41:y:2025:i:4:p:1383-1394
    DOI: 10.1016/j.ijforecast.2025.03.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207025000366
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2025.03.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Kenneth C. Lichtendahl, Jr. & Robert L. Winkler, 2007. "Probability Elicitation, Scoring Rules, and Competition Among Forecasters," Management Science, INFORMS, vol. 53(11), pages 1745-1755, November.
    2. Stefano Giglio & Yuan Liao & Dacheng Xiu, 2021. "Thousands of Alpha Tests," NBER Chapters, in: Big Data: Long-Term Implications for Financial Markets and Firms, pages 3456, National Bureau of Economic Research, Inc.
    3. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," The Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    4. Bali, Turan G. & Cakici, Nusret & Whitelaw, Robert F., 2011. "Maxing out: Stocks as lotteries and the cross-section of expected returns," Journal of Financial Economics, Elsevier, vol. 99(2), pages 427-446, February.
    5. Edwin J. Elton & Martin J. Gruber & Christopher R. Blake, 2003. "Incentive Fees and Mutual Funds," Journal of Finance, American Finance Association, vol. 58(2), pages 779-804, April.
    6. Hsing, Tailen, 1988. "On the extreme order statistics for a stationary sequence," Stochastic Processes and their Applications, Elsevier, vol. 29(1), pages 155-169.
    7. Gibbons, Michael R & Ross, Stephen A & Shanken, Jay, 1989. "A Test of the Efficiency of a Given Portfolio," Econometrica, Econometric Society, vol. 57(5), pages 1121-1152, September.
    8. Clifford S. Asness & Tobias J. Moskowitz & Lasse Heje Pedersen, 2013. "Value and Momentum Everywhere," Journal of Finance, American Finance Association, vol. 68(3), pages 929-985, June.
    9. repec:bla:jfinan:v:44:y:1989:i:4:p:889-908 is not listed on IDEAS
    10. Moskowitz, Tobias J. & Ooi, Yao Hua & Pedersen, Lasse Heje, 2012. "Time series momentum," Journal of Financial Economics, Elsevier, vol. 104(2), pages 228-250.
    11. Jegadeesh, Narasimhan & Titman, Sheridan, 1993. "Returns to Buying Winners and Selling Losers: Implications for Stock Market Efficiency," Journal of Finance, American Finance Association, vol. 48(1), pages 65-91, March.
    12. Matthew J. Schneider & Jethro Browell & Rufus Rankin, 2024. "Limiting Extreme Behavior in Forecasting Competitions," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 75, pages 32-37, Q4.
    13. Francesco Lisi, 2011. "Dicing with the market: randomized procedures for evaluation of mutual funds," Quantitative Finance, Taylor & Francis Journals, vol. 11(2), pages 163-172.
    14. Jens Witkowski & Rupert Freeman & Jennifer Wortman Vaughan & David M. Pennock & Andreas Krause, 2023. "Incentive-Compatible Forecasting Competitions," Management Science, INFORMS, vol. 69(3), pages 1354-1374, March.
    15. Fama, Eugene F & French, Kenneth R, 1995. "Size and Book-to-Market Factors in Earnings and Returns," Journal of Finance, American Finance Association, vol. 50(1), pages 131-155, March.
    16. Raja, Aitazaz Ali & Pinson, Pierre & Kazempour, Jalal & Grammatico, Sergio, 2024. "A market for trading forecasts: A wagering mechanism," International Journal of Forecasting, Elsevier, vol. 40(1), pages 142-159.
    17. Woo Chang Kim & Yongjae Lee, 2016. "A uniformly distributed random portfolio," Quantitative Finance, Taylor & Francis Journals, vol. 16(2), pages 297-307, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cederburg, Scott & O’Doherty, Michael S. & Wang, Feifei & Yan, Xuemin (Sterling), 2020. "On the performance of volatility-managed portfolios," Journal of Financial Economics, Elsevier, vol. 138(1), pages 95-117.
    2. Jangkoo Kang & Kyung Yoon Kwon, 2021. "Volatility‐managed commodity futures portfolios," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 41(2), pages 159-178, February.
    3. Cakici, Nusret & Zaremba, Adam, 2022. "Salience theory and the cross-section of stock returns: International and further evidence," Journal of Financial Economics, Elsevier, vol. 146(2), pages 689-725.
    4. Adam Zaremba & Jacob Koby Shemer, 2018. "Price-Based Investment Strategies," Springer Books, Springer, number 978-3-319-91530-2, December.
    5. Guillaume Coqueret, 2016. "Empirical properties of a heterogeneous agent model in large dimensions," Post-Print hal-02088097, HAL.
    6. Sina Ehsani & Juhani T. Linnainmaa, 2019. "Factor Momentum and the Momentum Factor," NBER Working Papers 25551, National Bureau of Economic Research, Inc.
    7. Ardila-Alvarez, Diego & Forro, Zalan & Sornette, Didier, 2021. "The acceleration effect and Gamma factor in asset pricing," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 569(C).
    8. Yukun Liu & Aleh Tsyvinski & Xi Wu, 2019. "Common Risk Factors in Cryptocurrency," NBER Working Papers 25882, National Bureau of Economic Research, Inc.
    9. Chiah, Mardy & Long, Huaigang & Zaremba, Adam & Umar, Zaghum, 2023. "Trade competitiveness and the aggregate returns in global stock markets," Journal of Economic Dynamics and Control, Elsevier, vol. 148(C).
    10. Shi, Huai-Long & Zhou, Wei-Xing, 2021. "Horse race of weekly idiosyncratic momentum strategies with respect to various risk metrics: Evidence from the Chinese stock market," The North American Journal of Economics and Finance, Elsevier, vol. 58(C).
    11. Hongwei Chuang, 2021. "Momentum Has Its Own Values," Working Papers EMS_2021_02, Research Institute, International University of Japan.
    12. Ding Du & Karen Craft Denning & Xiaobing Zhao, 2014. "Market states and momentum in sector exchange-traded funds," Journal of Asset Management, Palgrave Macmillan, vol. 15(4), pages 223-237, August.
    13. Guillaume Coqueret, 2017. "Empirical properties of a heterogeneous agent model in large dimensions," Post-Print hal-02000726, HAL.
    14. Lei, Jian, 2021. "Curve momentum in currency markets," Finance Research Letters, Elsevier, vol. 42(C).
    15. Zhang, Shaojun, 2022. "Dissecting currency momentum," Journal of Financial Economics, Elsevier, vol. 144(1), pages 154-173.
    16. Hollstein, Fabian, 2022. "The world of anomalies: Smaller than we think?," Journal of International Money and Finance, Elsevier, vol. 129(C).
    17. Alles Rodrigues, Alexandre & Casalin, Fabrizio, 2022. "Factor investing in Brazil: Diversifying across factor tilts and allocation strategies," Emerging Markets Review, Elsevier, vol. 52(C).
    18. Coqueret, Guillaume, 2017. "Empirical properties of a heterogeneous agent model in large dimensions," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 180-201.
    19. Skočir, Matevž & Lončarski, Igor, 2018. "Multi-factor asset pricing models: Factor construction choices and the revisit of pricing factors," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 55(C), pages 65-80.
    20. Loïc Maréchal, 2023. "A tale of two premiums revisited," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 43(5), pages 580-614, May.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:41:y:2025:i:4:p:1383-1394. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.