IDEAS home Printed from https://ideas.repec.org/a/bpj/jqsprt/v17y2021i2p91-105n6.html
   My bibliography  Save this article

How well do Elo-based ratings predict professional tennis matches?

Author

Listed:
  • Vaughan Williams Leighton
  • Liu Chunping
  • Dixon Lerato
  • Gerrard Hannah

    (Nottingham Business School, Nottingham Trent University, Nottingham, UK)

Abstract

This paper examines the performance of five different measures for forecasting men’s and women’s professional tennis matches. We use data derived from every match played at the 2018 and 2019 Wimbledon tennis championships, the 2019 French Open, the 2019 US Open, and the 2020 Australian Open. We look at the betting odds, the official tennis rankings, the standard Elo ratings, surface-specific Elo ratings, and weighted composites of these ratings, including and excluding the betting odds. The performance indicators used are prediction accuracy, calibration, model discrimination, Brier score, and expected return. We find that the betting odds perform relatively well across these tournaments, while standard Elo (especially for women’s tennis) and surface-adjusted Elo (especially for men’s tennis) also perform well on a range of indicators. For all but the hard-court surfaces, a forecasting model which incorporates the betting odds tends also to perform well on some indicators. We find that the official ranking system proved to be a relatively poor measure of likely performance compared to betting odds and Elo-related methods. Our results add weight to the case for a wider use of Elo-based approaches within sports forecasting, as well as arguably within the player rankings methodologies.

Suggested Citation

  • Vaughan Williams Leighton & Liu Chunping & Dixon Lerato & Gerrard Hannah, 2021. "How well do Elo-based ratings predict professional tennis matches?," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 17(2), pages 91-105, June.
  • Handle: RePEc:bpj:jqsprt:v:17:y:2021:i:2:p:91-105:n:6
    DOI: 10.1515/jqas-2019-0110
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jqas-2019-0110
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

    File URL: https://libkey.io/10.1515/jqas-2019-0110?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J Reade & C Singleton & L Vaughan Williams, 2020. "Betting Markets for English Premier League Results and Scorelines: Evaluating a Simple Forecasting Model," Economic Issues Journal Articles, Economic Issues, vol. 25(1), pages 87-106, March.
    2. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    3. Ruth N. Bolton & Randall G. Chapman, 2008. "Searching For Positive Returns At The Track: A Multinomial Logit Model For Handicapping Horse Races," World Scientific Book Chapters, in: Donald B Hausch & Victor SY Lo & William T Ziemba (ed.), Efficiency Of Racetrack Betting Markets, chapter 17, pages 151-171, World Scientific Publishing Co. Pte. Ltd..
    4. Roger C. Vergin & Michael Scriabin, 1978. "Winning Strategies for Wagering on National Football League Games," Management Science, INFORMS, vol. 24(8), pages 809-818, April.
    5. Kovalchik, Stephanie & Reid, Machar, 2019. "A calibration method with dynamic updates for within-match forecasting of wins in tennis," International Journal of Forecasting, Elsevier, vol. 35(2), pages 756-766.
    6. Stekler, H.O. & Sendor, David & Verlander, Richard, 2010. "Issues in sports forecasting," International Journal of Forecasting, Elsevier, vol. 26(3), pages 606-621, July.
      • Herman O. Stekler & David Sendor & Richard Verlander, 2009. "Issues in Sports Forecasting," Working Papers 2009-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    7. Angelini, Giovanni & De Angelis, Luca, 2019. "Efficiency of online football betting markets," International Journal of Forecasting, Elsevier, vol. 35(2), pages 712-721.
    8. Snyder, Wayne W, 1978. "Horse Racing: Testing the Efficient Markets Model," Journal of Finance, American Finance Association, vol. 33(4), pages 1109-1118, September.
    9. Irons David J. & Buckley Stephen & Paulden Tim, 2014. "Developing an improved tennis ranking system," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 10(2), pages 1-10, June.
    10. I. Graham & H. Stott, 2008. "Predicting bookmaker odds and efficiency for UK football," Applied Economics, Taylor & Francis Journals, vol. 40(1), pages 99-109.
    11. Martin Spann & Bernd Skiera, 2009. "Sports forecasting: a comparison of the forecast accuracy of prediction markets, betting odds and tipsters," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(1), pages 55-72.
    12. Ryall, Richard & Bedford, Anthony, 2010. "An optimized ratings-based model for forecasting Australian Rules football," International Journal of Forecasting, Elsevier, vol. 26(3), pages 511-517, July.
    13. Easton, Stephen & Uylangco, Katherine, 2010. "Forecasting outcomes in tennis matches using within-match betting markets," International Journal of Forecasting, Elsevier, vol. 26(3), pages 564-575, July.
    14. Leitner, Christoph & Zeileis, Achim & Hornik, Kurt, 2010. "Forecasting sports tournaments by ratings of (prob)abilities: A comparison for the EUROÂ 2008," International Journal of Forecasting, Elsevier, vol. 26(3), pages 471-481, July.
    15. Vaughan Williams,Leighton (ed.), 2005. "Information Efficiency in Financial and Betting Markets," Cambridge Books, Cambridge University Press, number 9780521816038.
    16. Hvattum, Lars Magnus & Arntzen, Halvard, 2010. "Using ELO ratings for match result prediction in association football," International Journal of Forecasting, Elsevier, vol. 26(3), pages 460-470, July.
    17. Kovalchik Stephanie Ann, 2016. "Searching for the GOAT of tennis win prediction," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 12(3), pages 127-138, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Angelini, Giovanni & Candila, Vincenzo & De Angelis, Luca, 2022. "Weighted Elo rating for tennis match predictions," European Journal of Operational Research, Elsevier, vol. 297(1), pages 120-132.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Angelini, Giovanni & Candila, Vincenzo & De Angelis, Luca, 2022. "Weighted Elo rating for tennis match predictions," European Journal of Operational Research, Elsevier, vol. 297(1), pages 120-132.
    2. Stekler, H.O. & Sendor, David & Verlander, Richard, 2010. "Issues in sports forecasting," International Journal of Forecasting, Elsevier, vol. 26(3), pages 606-621, July.
      • Herman O. Stekler & David Sendor & Richard Verlander, 2009. "Issues in Sports Forecasting," Working Papers 2009-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    3. Ramirez, Philip & Reade, J. James & Singleton, Carl, 2023. "Betting on a buzz: Mispricing and inefficiency in online sportsbooks," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1413-1423.
    4. Marc Garnica-Caparrós & Daniel Memmert & Fabian Wunderlich, 2022. "Artificial data in sports forecasting: a simulation framework for analysing predictive models in sports," Information Systems and e-Business Management, Springer, vol. 20(3), pages 551-580, September.
    5. Kovalchik, Stephanie & Reid, Machar, 2019. "A calibration method with dynamic updates for within-match forecasting of wins in tennis," International Journal of Forecasting, Elsevier, vol. 35(2), pages 756-766.
    6. He, Xue-Zhong & Treich, Nicolas, 2017. "Prediction market prices under risk aversion and heterogeneous beliefs," Journal of Mathematical Economics, Elsevier, vol. 70(C), pages 105-114.
    7. da Costa, Igor Barbosa & Marinho, Leandro Balby & Pires, Carlos Eduardo Santos, 2022. "Forecasting football results and exploiting betting markets: The case of “both teams to score”," International Journal of Forecasting, Elsevier, vol. 38(3), pages 895-909.
    8. Lessmann, Stefan & Sung, Ming-Chien & Johnson, Johnnie E.V. & Ma, Tiejun, 2012. "A new methodology for generating and combining statistical forecasting models to enhance competitive event prediction," European Journal of Operational Research, Elsevier, vol. 218(1), pages 163-174.
    9. Sung, Ming-Chien & McDonald, David C.J. & Johnson, Johnnie E.V. & Tai, Chung-Ching & Cheah, Eng-Tuck, 2019. "Improving prediction market forecasts by detecting and correcting possible over-reaction to price movements," European Journal of Operational Research, Elsevier, vol. 272(1), pages 389-405.
    10. Brown, Alasdair & Reade, J. James, 2019. "The wisdom of amateur crowds: Evidence from an online community of sports tipsters," European Journal of Operational Research, Elsevier, vol. 272(3), pages 1073-1081.
    11. Roberto Gásquez & Vicente Royuela, 2016. "The Determinants of International Football Success: A Panel Data Analysis of the Elo Rating," Social Science Quarterly, Southwestern Social Science Association, vol. 97(2), pages 125-141, June.
    12. Alistair C. Bruce & Johnnie E. V. Johnson & John D. Peirson & Jiejun Yu, 2009. "An Examination of the Determinants of Biased Behaviour in a Market for State Contingent Claims," Economica, London School of Economics and Political Science, vol. 76(302), pages 282-303, April.
    13. Angelini, Giovanni & De Angelis, Luca, 2019. "Efficiency of online football betting markets," International Journal of Forecasting, Elsevier, vol. 35(2), pages 712-721.
    14. Adrian R. Bell & Chris Brooks & David Matthews & Charles Sutcliffe, 2012. "Over the moon or sick as a parrot? The effects of football results on a club's share price," Applied Economics, Taylor & Francis Journals, vol. 44(26), pages 3435-3452, September.
    15. M. Sung & J. E. V. Johnson, 2010. "Revealing Weak‐Form Inefficiency in a Market for State Contingent Claims: The Importance of Market Ecology, Modelling Procedures and Investment Strategies," Economica, London School of Economics and Political Science, vol. 77(305), pages 128-147, January.
    16. Kovalchik, Stephanie, 2020. "Extension of the Elo rating system to margin of victory," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1329-1341.
    17. J. James Reade & Carl Singleton & Alasdair Brown, 2021. "Evaluating strange forecasts: The curious case of football match scorelines," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(2), pages 261-285, May.
    18. Gross, Johannes & Rebeggiani, Luca, 2018. "Chance or Ability? The Efficiency of the Football Betting Market Revisited," MPRA Paper 87230, University Library of Munich, Germany.
    19. Bernardo, Giovanni & Ruberti, Massimo & Verona, Roberto, 2019. "Semi-strong inefficiency in the fixed odds betting market: Underestimating the positive impact of head coach replacement in the main European soccer leagues," The Quarterly Review of Economics and Finance, Elsevier, vol. 71(C), pages 239-246.
    20. Smith, Michael A. & Paton, David & Williams, Leighton Vaughan, 2009. "Do bookmakers possess superior skills to bettors in predicting outcomes?," Journal of Economic Behavior & Organization, Elsevier, vol. 71(2), pages 539-549, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:jqsprt:v:17:y:2021:i:2:p:91-105:n:6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.