IDEAS home Printed from https://ideas.repec.org/p/rdg/emxxdp/em-dp2019-18.html
   My bibliography  Save this paper

Evaluating Strange Forecasts: The Curious Case of Football Match Scorelines

Author

Listed:
  • J. James Reade

    (Department of Economics, University of Reading)

  • Carl Singleton

    (Department of Economics, University of Reading)

  • Alasdair Brown

    (School of Economics, University of East Anglia)

Abstract

This study analyses point forecasts for a common set of events. These forecasts were made for distinct competitions and originally judged differently. The event outcomes were low-probability but had more predictable sub-outcomes, upon which they were also judged. Hence, the forecasts were multi-dimensional, complicating any evaluation. The events were association football matches in the English Premier League. The forecasts were of exact scoreline outcomes. We compare these with implied probability forecasts using bookmaker odds and a crowd of tipsters, as well as point and probability forecasts generated from a statistical model suited to predicting football match scorelines. From evaluating these sources and types of forecast, using various methods, we argue that regression encompassing is the most appropriate way to compare point and probability forecasts, and find that both these types of forecasts for football match scorelines generally add information to one another.

Suggested Citation

  • J. James Reade & Carl Singleton & Alasdair Brown, 2019. "Evaluating Strange Forecasts: The Curious Case of Football Match Scorelines," Economics Discussion Papers em-dp2019-18, Department of Economics, University of Reading.
  • Handle: RePEc:rdg:emxxdp:em-dp2019-18
    as

    Download full text from publisher

    File URL: http://www.reading.ac.uk/web/FILES/economics/emdp201918v3.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Fair, Ray C & Shiller, Robert J, 1989. "The Informational Context of Ex Ante Forecasts," The Review of Economics and Statistics, MIT Press, vol. 71(2), pages 325-331, May.
    2. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    3. Erik Snowberg & Justin Wolfers, 2010. "Explaining the Favorite-Long Shot Bias: Is it Risk-Love or Misperceptions?," Journal of Political Economy, University of Chicago Press, vol. 118(4), pages 723-746, August.
    4. Strumbelj, E. & Sikonja, M. Robnik, 2010. "Online bookmakers' odds as forecasts: The case of European soccer leagues," International Journal of Forecasting, Elsevier, vol. 26(3), pages 482-488, July.
    5. James Reade, 2014. "Information And Predictability: Bookmakers, Prediction Markets And Tipsters As Forecasters," Journal of Prediction Markets, University of Buckingham Press, vol. 8(1), pages 43-76.
    6. Brown, Alasdair & Reade, J. James, 2019. "The wisdom of amateur crowds: Evidence from an online community of sports tipsters," European Journal of Operational Research, Elsevier, vol. 272(3), pages 1073-1081.
    7. Michael P. Clements, 2004. "Evaluating the Bank of England Density Forecasts of Inflation," Economic Journal, Royal Economic Society, vol. 114(498), pages 844-866, October.
    8. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," Review of Economic Studies, Oxford University Press, vol. 53(4), pages 671-690.
    9. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    10. Boshnakov, Georgi & Kharrat, Tarak & McHale, Ian G., 2017. "A bivariate Weibull count model for forecasting association football scores," International Journal of Forecasting, Elsevier, vol. 33(2), pages 458-466.
    11. Dixon, Mark J. & Pope, Peter F., 2004. "The value of statistical forecasts in the UK association football betting market," International Journal of Forecasting, Elsevier, vol. 20(4), pages 697-711.
    12. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    13. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    14. Peeters, Thomas, 2018. "Testing the Wisdom of Crowds in the field: Transfermarkt valuations and international soccer results," International Journal of Forecasting, Elsevier, vol. 34(1), pages 17-29.
    15. Forrest, David & Simmons, Robert, 2000. "Forecasting sport: the behaviour and performance of football tipsters," International Journal of Forecasting, Elsevier, vol. 16(3), pages 317-331.
    16. Fawcett, Nicholas & Koerber, Lena & Masolo, Riccardo & Waldron, Matthew, 2015. "Evaluating UK point and density forecasts from an estimated DSGE model: the role of off-model information over the financial crisis," Bank of England working papers 538, Bank of England.
    17. Forrest, David & Goddard, John & Simmons, Robert, 2005. "Odds-setters as forecasters: The case of English football," International Journal of Forecasting, Elsevier, vol. 21(3), pages 551-564.
    18. Pope, Peter F & Peel, David A, 1989. "Information, Prices and Efficiency in a Fixed-Odds Betting Market," Economica, London School of Economics and Political Science, vol. 56(223), pages 323-341, August.
    19. O'Leary, Daniel E., 2017. "Crowd performance in prediction of the World Cup 2014," European Journal of Operational Research, Elsevier, vol. 260(2), pages 715-724.
    20. Martin Spann & Bernd Skiera, 2009. "Sports forecasting: a comparison of the forecast accuracy of prediction markets, betting odds and tipsters," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(1), pages 55-72.
    21. Steven D. Levitt, 2004. "Why are gambling markets organised so differently from financial markets?," Economic Journal, Royal Economic Society, vol. 114(495), pages 223-246, April.
    22. Michael Clements, 2006. "Evaluating the survey of professional forecasters probability distributions of expected inflation based on derived event probability forecasts," Empirical Economics, Springer, vol. 31(1), pages 49-64, March.
    23. Granger, C.W.J. & Pesaran, M. H., 1999. "Economic and Statistical Measures of Forecast Accuracy," Cambridge Working Papers in Economics 9910, Faculty of Economics, University of Cambridge.
    24. Goddard, John, 2005. "Regression models for forecasting goals and match results in association football," International Journal of Forecasting, Elsevier, vol. 21(2), pages 331-340.
    25. Hvattum, Lars Magnus & Arntzen, Halvard, 2010. "Using ELO ratings for match result prediction in association football," International Journal of Forecasting, Elsevier, vol. 26(3), pages 460-470, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sarah Jewell & J. James Reade & Carl Singleton, 2020. "It's Just Not Cricket: The Uncontested Toss and the Gentleman's Game," Economics Discussion Papers em-dp2020-10, Department of Economics, University of Reading.
    2. Meshael Batarfi & James Reade, 2021. "Why are We So Good At Football, and They So Bad? Institutions and National Footballing Performance," De Economist, Springer, vol. 169(1), pages 63-80, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. James Reade & Carl Singleton & Leighton Vaughan Williams, 2020. "Betting markets for English Premier League results and scorelines: evaluating a forecasting model," Economics Discussion Papers em-dp2020-03, Department of Economics, University of Reading.
    2. Butler, David & Butler, Robert & Eakins, John, 2021. "Expert performance and crowd wisdom: Evidence from English Premier League predictions," European Journal of Operational Research, Elsevier, vol. 288(1), pages 170-182.
    3. Angelini, Giovanni & De Angelis, Luca, 2019. "Efficiency of online football betting markets," International Journal of Forecasting, Elsevier, vol. 35(2), pages 712-721.
    4. Singleton, Carl & Reade, J. James & Brown, Alasdair, 2020. "Going with your gut: The (In)accuracy of forecast revisions in a football score prediction game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 89(C).
    5. Brown, Alasdair & Reade, J. James, 2019. "The wisdom of amateur crowds: Evidence from an online community of sports tipsters," European Journal of Operational Research, Elsevier, vol. 272(3), pages 1073-1081.
    6. Wunderlich, Fabian & Memmert, Daniel, 2020. "Are betting returns a useful measure of accuracy in (sports) forecasting?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 713-722.
    7. Gross, Johannes & Rebeggiani, Luca, 2018. "Chance or Ability? The Efficiency of the Football Betting Market Revisited," MPRA Paper 87230, University Library of Munich, Germany.
    8. Elaad, Guy & Reade, J. James & Singleton, Carl, 2020. "Information, prices and efficiency in an online betting market," Finance Research Letters, Elsevier, vol. 35(C).
    9. Giovanni Angelini & Luca De Angelis & Carl Singleton, 2019. "Informational efficiency and behaviour within in-play prediction markets," Economics Discussion Papers em-dp2019-20, Department of Economics, University of Reading.
    10. Stekler, H.O. & Sendor, David & Verlander, Richard, 2010. "Issues in sports forecasting," International Journal of Forecasting, Elsevier, vol. 26(3), pages 606-621, July.
      • Herman O. Stekler & David Sendor & Richard Verlander, 2009. "Issues in Sports Forecasting," Working Papers 2009-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    11. Leitner, Christoph & Zeileis, Achim & Hornik, Kurt, 2010. "Forecasting sports tournaments by ratings of (prob)abilities: A comparison for the EUROÂ 2008," International Journal of Forecasting, Elsevier, vol. 26(3), pages 471-481, July.
    12. Egon Franck & Erwin Verbeek & Stephan Nüesch, 2013. "Inter-market Arbitrage in Betting," Economica, London School of Economics and Political Science, vol. 80(318), pages 300-325, April.
    13. Sung, Ming-Chien & McDonald, David C.J. & Johnson, Johnnie E.V. & Tai, Chung-Ching & Cheah, Eng-Tuck, 2019. "Improving prediction market forecasts by detecting and correcting possible over-reaction to price movements," European Journal of Operational Research, Elsevier, vol. 272(1), pages 389-405.
    14. Hubáček, Ondřej & Šourek, Gustav & Železný, Filip, 2019. "Exploiting sports-betting market using machine learning," International Journal of Forecasting, Elsevier, vol. 35(2), pages 783-796.
    15. Philip Ramirez & J. James Reade & Carl Singleton, 2021. "Betting on a buzz, mispricing and inefficiency in online sportsbooks," Economics Discussion Papers em-dp2021-10, Department of Economics, University of Reading.
    16. S Lessmann & M-C Sung & J E V Johnson, 2011. "Towards a methodology for measuring the true degree of efficiency in a speculative market," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(12), pages 2120-2132, December.
    17. Christoph Buehren & Tim Meyer & Christian Pierdzioch, 2020. "Experimental Evidence on Forecaster (anti-) Herding in Sports Markets," MAGKS Papers on Economics 202038, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    18. Alexis Direr, 2013. "Are betting markets efficient? Evidence from European Football Championships," Applied Economics, Taylor & Francis Journals, vol. 45(3), pages 343-356, January.
    19. He, Xue-Zhong & Treich, Nicolas, 2017. "Prediction market prices under risk aversion and heterogeneous beliefs," Journal of Mathematical Economics, Elsevier, vol. 70(C), pages 105-114.
    20. Jinook Jeong & Jee Young Kim & Yoon Jae Ro, 2019. "On the efficiency of racetrack betting market: a new test for the favourite-longshot bias," Applied Economics, Taylor & Francis Journals, vol. 51(54), pages 5817-5828, November.

    More about this item

    Keywords

    Forecasting; Statistical modelling; Regression models; Prediction markets;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • L83 - Industrial Organization - - Industry Studies: Services - - - Sports; Gambling; Restaurants; Recreation; Tourism
    • G14 - Financial Economics - - General Financial Markets - - - Information and Market Efficiency; Event Studies; Insider Trading
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation
    • Z2 - Other Special Topics - - Sports Economics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rdg:emxxdp:em-dp2019-18. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/derdguk.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alexander Mihailov (email available below). General contact details of provider: https://edirc.repec.org/data/derdguk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.