IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v288y2021i1p170-182.html
   My bibliography  Save this article

Expert performance and crowd wisdom: Evidence from English Premier League predictions

Author

Listed:
  • Butler, David
  • Butler, Robert
  • Eakins, John

Abstract

This paper analyses the forecasting accuracy of experts vis-à-vis laypeople over three seasons of English Premier League matches. We find that former professional football players have superior forecasting ability when compared to laypeople. The results give partial support to the view that a crowd forecast offers the greatest precision. Pundits generate a positive return while both the crowd and laypeople generate losses. As the prediction of multiple score outcomes represents a computationally difficult task, both groups display forecasting biases including a preference toward specific score forecasts. The results are relevant for those concerned with gambling behaviour if the forecasting strategies adopted here generalise to match betting markets.

Suggested Citation

  • Butler, David & Butler, Robert & Eakins, John, 2021. "Expert performance and crowd wisdom: Evidence from English Premier League predictions," European Journal of Operational Research, Elsevier, vol. 288(1), pages 170-182.
  • Handle: RePEc:eee:ejores:v:288:y:2021:i:1:p:170-182
    DOI: 10.1016/j.ejor.2020.05.034
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S037722172030480X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2020.05.034?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Figlewski, Stephen, 1979. "Subjective Information and Market Efficiency in a Betting Market," Journal of Political Economy, University of Chicago Press, vol. 87(1), pages 75-88, February.
    2. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    3. James Reade, 2014. "Information And Predictability: Bookmakers, Prediction Markets And Tipsters As Forecasters," Journal of Prediction Markets, University of Buckingham Press, vol. 8(1), pages 43-76.
    4. Ethan Mollick & Ramana Nanda, 2016. "Wisdom or Madness? Comparing Crowds with Expert Evaluation in Funding the Arts," Management Science, INFORMS, vol. 62(6), pages 1533-1553, June.
    5. Brown, Alasdair & Reade, J. James, 2019. "The wisdom of amateur crowds: Evidence from an online community of sports tipsters," European Journal of Operational Research, Elsevier, vol. 272(3), pages 1073-1081.
    6. repec:cup:judgdm:v:9:y:2014:i:3:p:259-273 is not listed on IDEAS
    7. Koning, Ruud H. & Koolhaas, Michael & Renes, Gusta & Ridder, Geert, 2003. "A simulation model for football championships," European Journal of Operational Research, Elsevier, vol. 148(2), pages 268-276, July.
    8. Alasdair Brown & Dooruj Rambaccussing & J. James Reade & Giambattista Rossi, 2018. "Forecasting With Social Media: Evidence From Tweets On Soccer Matches," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1748-1763, July.
    9. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1, March.
    10. Boulier, Bryan L. & Stekler, H. O., 2003. "Predicting the outcomes of National Football League games," International Journal of Forecasting, Elsevier, vol. 19(2), pages 257-270.
    11. Andersson, Patric & Edman, Jan & Ekman, Mattias, 2005. "Predicting the World Cup 2002 in soccer: Performance and confidence of experts and non-experts," International Journal of Forecasting, Elsevier, vol. 21(3), pages 565-576.
    12. Boshnakov, Georgi & Kharrat, Tarak & McHale, Ian G., 2017. "A bivariate Weibull count model for forecasting association football scores," International Journal of Forecasting, Elsevier, vol. 33(2), pages 458-466.
    13. I. D. Hill, 1974. "Association Football and Statistical Inference," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 23(2), pages 203-208, June.
    14. Koopman, Siem Jan & Lit, Rutger, 2019. "Forecasting football match results in national league competitions using score-driven time series models," International Journal of Forecasting, Elsevier, vol. 35(2), pages 797-809.
    15. Rodney J. Paul & Andrew P. Weinbach, 2009. "Are Behavioral Biases Consistent Across the Atlantic?: The Over/Under Market for European Soccer," Journal of Gambling Business and Economics, University of Buckingham Press, vol. 3(2), pages 89-101, September.
    16. repec:cup:judgdm:v:10:y:2015:i:3:p:225-231 is not listed on IDEAS
    17. Peeters, Thomas, 2018. "Testing the Wisdom of Crowds in the field: Transfermarkt valuations and international soccer results," International Journal of Forecasting, Elsevier, vol. 34(1), pages 17-29.
    18. Forrest, David & Simmons, Robert, 2000. "Forecasting sport: the behaviour and performance of football tipsters," International Journal of Forecasting, Elsevier, vol. 16(3), pages 317-331.
    19. Dobson,Stephen & Goddard,John, 2011. "The Economics of Football," Cambridge Books, Cambridge University Press, number 9780521517140.
    20. Forrest, David & Goddard, John & Simmons, Robert, 2005. "Odds-setters as forecasters: The case of English football," International Journal of Forecasting, Elsevier, vol. 21(3), pages 551-564.
    21. Pope, Peter F & Peel, David A, 1989. "Information, Prices and Efficiency in a Fixed-Odds Betting Market," Economica, London School of Economics and Political Science, vol. 56(223), pages 323-341, August.
    22. O'Leary, Daniel E., 2017. "Crowd performance in prediction of the World Cup 2014," European Journal of Operational Research, Elsevier, vol. 260(2), pages 715-724.
    23. Baboota, Rahul & Kaur, Harleen, 2019. "Predictive analysis and modelling football results using machine learning approach for English Premier League," International Journal of Forecasting, Elsevier, vol. 35(2), pages 741-755.
    24. Martin Spann & Bernd Skiera, 2009. "Sports forecasting: a comparison of the forecast accuracy of prediction markets, betting odds and tipsters," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(1), pages 55-72.
    25. Page, Lionel, 2009. "Is there an optimistic bias on betting markets?," Economics Letters, Elsevier, vol. 102(2), pages 70-72, February.
    26. Brown, Alasdair & Reade, J. James & Vaughan Williams, Leighton, 2019. "When are prediction market prices most informative?," International Journal of Forecasting, Elsevier, vol. 35(1), pages 420-428.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. J. James Reade & Carl Singleton & Alasdair Brown, 2021. "Evaluating strange forecasts: The curious case of football match scorelines," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(2), pages 261-285, May.
    3. Jaspersen, Johannes G., 2022. "Convex combinations in judgment aggregation," European Journal of Operational Research, Elsevier, vol. 299(2), pages 780-794.
    4. Principe, Francesco & van Ours, Jan C., 2022. "Racial bias in newspaper ratings of professional football players," European Economic Review, Elsevier, vol. 141(C).
    5. Michels, Rouven & Ötting, Marius & Langrock, Roland, 2023. "Bettors’ reaction to match dynamics: Evidence from in-game betting," European Journal of Operational Research, Elsevier, vol. 310(3), pages 1118-1127.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. James Reade & Carl Singleton & Alasdair Brown, 2021. "Evaluating strange forecasts: The curious case of football match scorelines," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(2), pages 261-285, May.
    2. Angelini, Giovanni & De Angelis, Luca, 2019. "Efficiency of online football betting markets," International Journal of Forecasting, Elsevier, vol. 35(2), pages 712-721.
    3. Brown, Alasdair & Reade, J. James, 2019. "The wisdom of amateur crowds: Evidence from an online community of sports tipsters," European Journal of Operational Research, Elsevier, vol. 272(3), pages 1073-1081.
    4. Singleton, Carl & Reade, J. James & Brown, Alasdair, 2020. "Going with your gut: The (In)accuracy of forecast revisions in a football score prediction game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 89(C).
    5. Angelini, Giovanni & De Angelis, Luca & Singleton, Carl, 2022. "Informational efficiency and behaviour within in-play prediction markets," International Journal of Forecasting, Elsevier, vol. 38(1), pages 282-299.
    6. Stekler, H.O. & Sendor, David & Verlander, Richard, 2010. "Issues in sports forecasting," International Journal of Forecasting, Elsevier, vol. 26(3), pages 606-621, July.
      • Herman O. Stekler & David Sendor & Richard Verlander, 2009. "Issues in Sports Forecasting," Working Papers 2009-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    7. Hubáček, Ondřej & Šír, Gustav, 2023. "Beating the market with a bad predictive model," International Journal of Forecasting, Elsevier, vol. 39(2), pages 691-719.
    8. Ramirez, Philip & Reade, J. James & Singleton, Carl, 2023. "Betting on a buzz: Mispricing and inefficiency in online sportsbooks," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1413-1423.
    9. Leitner, Christoph & Zeileis, Achim & Hornik, Kurt, 2010. "Forecasting sports tournaments by ratings of (prob)abilities: A comparison for the EUROÂ 2008," International Journal of Forecasting, Elsevier, vol. 26(3), pages 471-481, July.
    10. Green, Lawrence & Sung, Ming-Chien & Ma, Tiejun & Johnson, Johnnie E. V., 2019. "To what extent can new web-based technology improve forecasts? Assessing the economic value of information derived from Virtual Globes and its rate of diffusion in a financial market," European Journal of Operational Research, Elsevier, vol. 278(1), pages 226-239.
    11. J Reade & C Singleton & L Vaughan Williams, 2020. "Betting Markets for English Premier League Results and Scorelines: Evaluating a Simple Forecasting Model," Economic Issues Journal Articles, Economic Issues, vol. 25(1), pages 87-106, March.
    12. Oliver Merz & Raphael Flepp & Egon Franck, 2019. "Does sentiment harm market efficiency? An empirical analysis using a betting exchange setting," Working Papers 381, University of Zurich, Department of Business Administration (IBW).
    13. Brown, Alasdair & Reade, J. James & Vaughan Williams, Leighton, 2019. "When are prediction market prices most informative?," International Journal of Forecasting, Elsevier, vol. 35(1), pages 420-428.
    14. Alessandro Innocenti & Tommaso Nannicini & Roberto Ricciuti, 2021. "The Importance of Betting Early," Risks, MDPI, vol. 9(4), pages 1-15, April.
    15. Elaad, Guy & Reade, J. James & Singleton, Carl, 2020. "Information, prices and efficiency in an online betting market," Finance Research Letters, Elsevier, vol. 35(C).
    16. He, Xue-Zhong & Treich, Nicolas, 2017. "Prediction market prices under risk aversion and heterogeneous beliefs," Journal of Mathematical Economics, Elsevier, vol. 70(C), pages 105-114.
    17. da Costa, Igor Barbosa & Marinho, Leandro Balby & Pires, Carlos Eduardo Santos, 2022. "Forecasting football results and exploiting betting markets: The case of “both teams to score”," International Journal of Forecasting, Elsevier, vol. 38(3), pages 895-909.
    18. Wunderlich, Fabian & Memmert, Daniel, 2020. "Are betting returns a useful measure of accuracy in (sports) forecasting?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 713-722.
    19. Sperb, Luis Felipe Costa & Sung, Ming-Chien & Johnson, Johnnie E.V. & Ma, Tiejun, 2019. "Keeping a weather eye on prediction markets: The influence of environmental conditions on forecasting accuracy," International Journal of Forecasting, Elsevier, vol. 35(1), pages 321-335.
    20. Scheibehenne, Benjamin & Broder, Arndt, 2007. "Predicting Wimbledon 2005 tennis results by mere player name recognition," International Journal of Forecasting, Elsevier, vol. 23(3), pages 415-426.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:288:y:2021:i:1:p:170-182. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.