IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v260y2017i2p715-724.html
   My bibliography  Save this article

Crowd performance in prediction of the World Cup 2014

Author

Listed:
  • O'Leary, Daniel E.

Abstract

This paper investigates the performance of the Yahoo crowd and experts in predicting the outcomes of matches in the World Cup in 2014. The analysis finds that the Yahoo crowd was statistically significantly better at predicting outcomes of matches than experts and very similar in performance to established betting odds. In addition, this paper finds that there was a statistically significant difference between the Yahoo crowd and a different crowd's performances, for the same task, suggesting that characteristics of the “crowd matter.” Finally, this paper finds that different crowdsourcing approaches apparently provide different results. Accordingly, it is important to specify the particular crowdsourcing approach, rather than simply “crowdsource.”

Suggested Citation

  • O'Leary, Daniel E., 2017. "Crowd performance in prediction of the World Cup 2014," European Journal of Operational Research, Elsevier, vol. 260(2), pages 715-724.
  • Handle: RePEc:eee:ejores:v:260:y:2017:i:2:p:715-724
    DOI: 10.1016/j.ejor.2016.12.043
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221716310773
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Forrest, David & Simmons, Robert, 2000. "Forecasting sport: the behaviour and performance of football tipsters," International Journal of Forecasting, Elsevier, vol. 16(3), pages 317-331.
    2. Forrest, David & Goddard, John & Simmons, Robert, 2005. "Odds-setters as forecasters: The case of English football," International Journal of Forecasting, Elsevier, vol. 21(3), pages 551-564.
    3. Stefan M. Herzog & Ralph Hertwig, 2011. "The wisdom of ignorant crowds: Predicting sport outcomes by mere recognition," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 6(1), pages 58-72, February.
    4. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    5. Koning, Ruud H. & Koolhaas, Michael & Renes, Gusta & Ridder, Geert, 2003. "A simulation model for football championships," European Journal of Operational Research, Elsevier, vol. 148(2), pages 268-276, July.
    6. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    7. B. D. McCullough & Thomas McWilliams, 2010. "Baseball players with the initial “K” do not strike out more often," Journal of Applied Statistics, Taylor & Francis Journals, vol. 37(6), pages 881-891.
    8. Dixon, Mark J. & Pope, Peter F., 2004. "The value of statistical forecasts in the UK association football betting market," International Journal of Forecasting, Elsevier, vol. 20(4), pages 697-711.
    9. Goddard, John, 2005. "Regression models for forecasting goals and match results in association football," International Journal of Forecasting, Elsevier, vol. 21(2), pages 331-340.
    10. Howard Margolis, 1976. "A note on incompetence," Public Choice, Springer, vol. 26(1), pages 119-127, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. J. James Reade & Carl Singleton & Alasdair Brown, 2021. "Evaluating strange forecasts: The curious case of football match scorelines," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(2), pages 261-285, May.
    2. Butler, David & Butler, Robert & Eakins, John, 2021. "Expert performance and crowd wisdom: Evidence from English Premier League predictions," European Journal of Operational Research, Elsevier, vol. 288(1), pages 170-182.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. James Reade & Carl Singleton & Alasdair Brown, 2021. "Evaluating strange forecasts: The curious case of football match scorelines," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(2), pages 261-285, May.
    2. Gross, Johannes & Rebeggiani, Luca, 2018. "Chance or Ability? The Efficiency of the Football Betting Market Revisited," MPRA Paper 87230, University Library of Munich, Germany.
    3. Bernardo, Giovanni & Ruberti, Massimo & Verona, Roberto, 2019. "Semi-strong inefficiency in the fixed odds betting market: Underestimating the positive impact of head coach replacement in the main European soccer leagues," The Quarterly Review of Economics and Finance, Elsevier, vol. 71(C), pages 239-246.
    4. Brown, Alasdair & Reade, J. James, 2019. "The wisdom of amateur crowds: Evidence from an online community of sports tipsters," European Journal of Operational Research, Elsevier, vol. 272(3), pages 1073-1081.
    5. Stekler, H.O. & Sendor, David & Verlander, Richard, 2010. "Issues in sports forecasting," International Journal of Forecasting, Elsevier, vol. 26(3), pages 606-621, July.
      • Herman O. Stekler & David Sendor & Richard Verlander, 2009. "Issues in Sports Forecasting," Working Papers 2009-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    6. J. James Reade & Carl Singleton & Leighton Vaughan Williams, 2020. "Betting markets for English Premier League results and scorelines: evaluating a forecasting model," Economics Discussion Papers em-dp2020-03, Department of Economics, Reading University.
    7. Constantinou Anthony Costa & Fenton Norman Elliott, 2012. "Solving the Problem of Inadequate Scoring Rules for Assessing Probabilistic Football Forecast Models," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 8(1), pages 1-14, March.
    8. Sung, Ming-Chien & McDonald, David C.J. & Johnson, Johnnie E.V. & Tai, Chung-Ching & Cheah, Eng-Tuck, 2019. "Improving prediction market forecasts by detecting and correcting possible over-reaction to price movements," European Journal of Operational Research, Elsevier, vol. 272(1), pages 389-405.
    9. Martin Spann & Bernd Skiera, 2009. "Sports forecasting: a comparison of the forecast accuracy of prediction markets, betting odds and tipsters," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(1), pages 55-72.
    10. Angelini, Giovanni & De Angelis, Luca, 2019. "Efficiency of online football betting markets," International Journal of Forecasting, Elsevier, vol. 35(2), pages 712-721.
    11. Bernardo, Giovanni & Ruberti, Massimo & Verona, Roberto, 2015. "Testing semi-strong efficiency in a fixed odds betting market: Evidence from principal European football leagues," MPRA Paper 66414, University Library of Munich, Germany.
    12. Dries Goossens & Jeroen Beliën & Frits Spieksma, 2012. "Comparing league formats with respect to match importance in Belgian football," Annals of Operations Research, Springer, vol. 194(1), pages 223-240, April.
    13. Green, Lawrence & Sung, Ming-Chien & Ma, Tiejun & Johnson, Johnnie E. V., 2019. "To what extent can new web-based technology improve forecasts? Assessing the economic value of information derived from Virtual Globes and its rate of diffusion in a financial market," European Journal of Operational Research, Elsevier, vol. 278(1), pages 226-239.
    14. Singleton, Carl & Reade, J. James & Brown, Alasdair, 2020. "Going with your gut: The (In)accuracy of forecast revisions in a football score prediction game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 89(C).
    15. Jinook Jeong & Jee Young Kim & Yoon Jae Ro, 2019. "On the efficiency of racetrack betting market: a new test for the favourite-longshot bias," Applied Economics, Taylor & Francis Journals, vol. 51(54), pages 5817-5828, November.
    16. Forrest, David & Goddard, John & Simmons, Robert, 2005. "Odds-setters as forecasters: The case of English football," International Journal of Forecasting, Elsevier, vol. 21(3), pages 551-564.
    17. Christoph Buehren & Tim Meyer & Christian Pierdzioch, 2020. "Experimental Evidence on Forecaster (anti-) Herding in Sports Markets," MAGKS Papers on Economics 202038, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    18. Song, ChiUng & Boulier, Bryan L. & Stekler, Herman O., 2007. "The comparative accuracy of judgmental and model forecasts of American football games," International Journal of Forecasting, Elsevier, vol. 23(3), pages 405-413.
    19. Peter Dawson & Stephen Dobson & John Goddard & John Wilson, 2007. "Are football referees really biased and inconsistent?: evidence on the incidence of disciplinary sanction in the English Premier League," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(1), pages 231-250, January.
    20. Butler, David & Butler, Robert & Eakins, John, 2021. "Expert performance and crowd wisdom: Evidence from English Premier League predictions," European Journal of Operational Research, Elsevier, vol. 288(1), pages 170-182.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:260:y:2017:i:2:p:715-724. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Nithya Sathishkumar). General contact details of provider: http://www.elsevier.com/locate/eor .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.