IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v34y2018i1p17-29.html
   My bibliography  Save this article

Testing the Wisdom of Crowds in the field: Transfermarkt valuations and international soccer results

Author

Listed:
  • Peeters, Thomas

Abstract

This paper investigates the value of collective judgments which stem from settings that have not been designed explicitly to elicit the ‘Wisdom of Crowds’. In particular, I investigate information obtained from transfermarkt.de, an online platform where a crowd of registered users assess the value of professional soccer players. I show that forecasts of international soccer results based on the crowd’s valuations are more accurate than those based on standard predictors, such as the FIFA ranking and the ELO rating. When this improvement in forecasting performance is applied to betting strategies, it leads to sizable monetary gains. I further exploit information on the preferences of individual crowd members in order to investigate whether wishful thinking hampers the accuracy of crowd valuations, but fail to find evidence that such is the case.

Suggested Citation

  • Peeters, Thomas, 2018. "Testing the Wisdom of Crowds in the field: Transfermarkt valuations and international soccer results," International Journal of Forecasting, Elsevier, vol. 34(1), pages 17-29.
    • Handle: RePEc:eee:intfor:v:34:y:2018:i:1:p:17-29
    DOI: 10.1016/j.ijforecast.2017.08.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207017300754
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2017.08.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alasdair Brown & Dooruj Rambaccussing & J. James Reade & Giambattista Rossi, 2016. "Using Social Media to Identify Market Inefficiencies: Evidence from Twitter and Betfair," Dundee Discussion Papers in Economics 293, Economic Studies, University of Dundee.
    2. Economo, Evan & Hong, Lu & Page, Scott E., 2016. "Social structure, endogenous diversity, and collective accuracy," Journal of Economic Behavior & Organization, Elsevier, vol. 125(C), pages 212-231.
    3. Alex Bryson & Bernd Frick & Rob Simmons, 2013. "The Returns to Scarce Talent," Journal of Sports Economics, , vol. 14(6), pages 606-628, December.
    4. Ethan Mollick & Ramana Nanda, 2016. "Wisdom or Madness? Comparing Crowds with Expert Evaluation in Funding the Arts," Management Science, INFORMS, vol. 62(6), pages 1533-1553, June.
    5. Stefan Szymanski, 2010. "A Market Test for Discrimination in the English Professional Soccer Leagues," Palgrave Macmillan Books, in: Football Economics and Policy, chapter 6, pages 136-150, Palgrave Macmillan.
    6. David V. Budescu & Eva Chen, 2015. "Identifying Expertise to Extract the Wisdom of Crowds," Management Science, INFORMS, vol. 61(2), pages 267-280, February.
    7. Franck, Egon & Nüesch, Stephan, 2010. "The effect of talent disparity on team productivity in soccer," Journal of Economic Psychology, Elsevier, vol. 31(2), pages 218-229, April.
    8. Justin Wolfers & Eric Zitzewitz, 2004. "Prediction Markets," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 107-126, Spring.
    9. David Forrest & Robert Simmons, 2008. "Sentiment in the betting market on Spanish football," Applied Economics, Taylor & Francis Journals, vol. 40(1), pages 119-126.
    10. Smith, Michael A. & Paton, David & Williams, Leighton Vaughan, 2009. "Do bookmakers possess superior skills to bettors in predicting outcomes?," Journal of Economic Behavior & Organization, Elsevier, vol. 71(2), pages 539-549, August.
    11. Joseph P. Simmons & Leif D. Nelson & Jeff Galak & Shane Frederick, 2011. "Intuitive Biases in Choice versus Estimation: Implications for the Wisdom of Crowds," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 38(1), pages 1-15.
    12. Egon Franck & Erwin Verbeek & Stephan Nüesch, 2011. "Sentimental Preferences and the Organizational Regime of Betting Markets," Southern Economic Journal, John Wiley & Sons, vol. 78(2), pages 502-518, October.
    13. Camara, Fanny & Dupuis, Nicolas, 2014. "Structural Estimation of Expert Strategic Bias: The Case of Movie Reviewers," TSE Working Papers 14-534, Toulouse School of Economics (TSE).
    14. Franck, Egon & Verbeek, Erwin & Nüesch, Stephan, 2010. "Prediction accuracy of different market structures -- bookmakers versus a betting exchange," International Journal of Forecasting, Elsevier, vol. 26(3), pages 448-459, July.
    15. Luis Garicano & Ignacio Palacios-Huerta & Canice Prendergast, 2005. "Favoritism Under Social Pressure," The Review of Economics and Statistics, MIT Press, vol. 87(2), pages 208-216, May.
    16. Bo Cowgill & Eric Zitzewitz, 2015. "Corporate Prediction Markets: Evidence from Google, Ford, and Firm X," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(4), pages 1309-1341.
    17. Forrest, David & Goddard, John & Simmons, Robert, 2005. "Odds-setters as forecasters: The case of English football," International Journal of Forecasting, Elsevier, vol. 21(3), pages 551-564.
    18. Forsythe, Robert & Rietz, Thomas A. & Ross, Thomas W., 1999. "Wishes, expectations and actions: a survey on price formation in election stock markets," Journal of Economic Behavior & Organization, Elsevier, vol. 39(1), pages 83-110, May.
    19. Pavel Atanasov & Phillip Rescober & Eric Stone & Samuel A. Swift & Emile Servan-Schreiber & Philip Tetlock & Lyle Ungar & Barbara Mellers, 2017. "Distilling the Wisdom of Crowds: Prediction Markets vs. Prediction Polls," Management Science, INFORMS, vol. 63(3), pages 691-706, March.
    20. Stekler, H.O. & Sendor, David & Verlander, Richard, 2010. "Issues in sports forecasting," International Journal of Forecasting, Elsevier, vol. 26(3), pages 606-621, July.
      • Herman O. Stekler & David Sendor & Richard Verlander, 2009. "Issues in Sports Forecasting," Working Papers 2009-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    21. Dennis Coates & Bernd Frick & Todd Jewell, 2016. "Superstar Salaries and Soccer Success," Journal of Sports Economics, , vol. 17(7), pages 716-735, October.
    22. Erik Å trumbelj, 2016. "A Comment on the Bias of Probabilities Derived From Betting Odds and Their Use in Measuring Outcome Uncertainty," Journal of Sports Economics, , vol. 17(1), pages 12-26, January.
    23. Herm, Steffen & Callsen-Bracker, Hans-Markus & Kreis, Henning, 2014. "When the crowd evaluates soccer players’ market values: Accuracy and evaluation attributes of an online community," Sport Management Review, Elsevier, vol. 17(4), pages 484-492.
    24. Steffen Herm & Hans-Markus Callsen-Bracker & Henning Kreis, 2014. "When the crowd evaluates soccer players’ market values: Accuracy and evaluation attributes of an online community," Sport Management Review, Taylor & Francis Journals, vol. 17(4), pages 484-492, October.
    25. repec:cup:judgdm:v:6:y:2011:i:1:p:58-72 is not listed on IDEAS
    26. Alasdair Brown & Dooruj Rambaccussing & J. James Reade & Giambattista Rossi, 2016. "Using Social Media to Identify Market Ine!ciencies: Evidence from Twitter and Betfair," Working Papers 2016-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    27. Hailiang Chen & Prabuddha De & Yu (Jeffrey) Hu & Byoung-Hyoun Hwang, 2014. "Wisdom of Crowds: The Value of Stock Opinions Transmitted Through Social Media," Review of Financial Studies, Society for Financial Studies, vol. 27(5), pages 1367-1403.
    28. P. J. Lamberson & Scott E. Page, 2012. "Optimal Forecasting Groups," Management Science, INFORMS, vol. 58(4), pages 805-810, April.
    29. Goddard, John, 2005. "Regression models for forecasting goals and match results in association football," International Journal of Forecasting, Elsevier, vol. 21(2), pages 331-340.
    30. Hvattum, Lars Magnus & Arntzen, Halvard, 2010. "Using ELO ratings for match result prediction in association football," International Journal of Forecasting, Elsevier, vol. 26(3), pages 460-470, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bernd Frick & Franziska Prockl, 2018. "Information Precision In Online Communities: Player Valuations On Www.Transfermarkt.De," Working Papers Dissertations 37, Paderborn University, Faculty of Business Administration and Economics.
    2. Maribel Serna Rodríguez & Andrés Ramírez Hassan & Alexander Coad, 2019. "Uncovering Value Drivers of High Performance Soccer Players," Journal of Sports Economics, , vol. 20(6), pages 819-849, August.
    3. Egon Franck & Erwin Verbeek & Stephan Nüesch, 2013. "Inter-market Arbitrage in Betting," Economica, London School of Economics and Political Science, vol. 80(318), pages 300-325, April.
    4. Sung, Ming-Chien & McDonald, David C.J. & Johnson, Johnnie E.V. & Tai, Chung-Ching & Cheah, Eng-Tuck, 2019. "Improving prediction market forecasts by detecting and correcting possible over-reaction to price movements," European Journal of Operational Research, Elsevier, vol. 272(1), pages 389-405.
    5. Rebeggiani, Luca & Gross, Johannes, 2018. "Chance or Ability? The Efficiency of the Football Betting Market Revisited," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181563, Verein für Socialpolitik / German Economic Association.
    6. Miquel Carreras-Simó & Jaume García, 2022. "Offensive/Defensive Talent and Sporting Success in Football: Evidence From the Big Five European Leagues," Journal of Sports Economics, , vol. 23(3), pages 251-276, April.
    7. Tai, Chung-Ching & Lin, Hung-Wen & Chie, Bin-Tzong & Tung, Chen-Yuan, 2019. "Predicting the failures of prediction markets: A procedure of decision making using classification models," International Journal of Forecasting, Elsevier, vol. 35(1), pages 297-312.
    8. Oliver Merz & Raphael Flepp & Egon Franck, 2019. "Does sentiment harm market efficiency? An empirical analysis using a betting exchange setting," Working Papers 381, University of Zurich, Department of Business Administration (IBW).
    9. Vincenzo Candila & Antonio Scognamillo, 2019. "On the Longshot Bias in Tennis Betting Markets: The Casco Normalization," Working Papers 3_236, Dipartimento di Scienze Economiche e Statistiche, Università degli Studi di Salerno.
    10. Joshua Becker & Abdullah Almaatouq & EmH{o}ke-'Agnes Horv'at, 2020. "Network Structures of Collective Intelligence: The Contingent Benefits of Group Discussion," Papers 2009.07202, arXiv.org, revised Mar 2021.
    11. Marc Garnica-Caparrós & Daniel Memmert & Fabian Wunderlich, 2022. "Artificial data in sports forecasting: a simulation framework for analysing predictive models in sports," Information Systems and e-Business Management, Springer, vol. 20(3), pages 551-580, September.
    12. Angelini, Giovanni & De Angelis, Luca & Singleton, Carl, 2022. "Informational efficiency and behaviour within in-play prediction markets," International Journal of Forecasting, Elsevier, vol. 38(1), pages 282-299.
    13. Babatunde Buraimo & David Peel & Rob Simmons, 2013. "Systematic Positive Expected Returns in the UK Fixed Odds Betting Market: An Analysis of the Fink Tank Predictions," IJFS, MDPI, vol. 1(4), pages 1-15, December.
    14. Hubáček, Ondřej & Šír, Gustav, 2023. "Beating the market with a bad predictive model," International Journal of Forecasting, Elsevier, vol. 39(2), pages 691-719.
    15. Clintin P. Davis-Stober & David V. Budescu & Stephen B. Broomell & Jason Dana, 2015. "The Composition of Optimally Wise Crowds," Decision Analysis, INFORMS, vol. 12(3), pages 130-143.
    16. David Winkelmann & Christian Deutscher & Marius Ötting, 2021. "Bookmakers’ mispricing of the disappeared home advantage in the German Bundesliga after the COVID-19 break," Applied Economics, Taylor & Francis Journals, vol. 53(26), pages 3054-3064, June.
    17. Štrumbelj, Erik & Vračar, Petar, 2012. "Simulating a basketball match with a homogeneous Markov model and forecasting the outcome," International Journal of Forecasting, Elsevier, vol. 28(2), pages 532-542.
    18. Merz, Oliver & Flepp, Raphael & Franck, Egon, 2021. "Sonic Thunder vs. Brian the Snail: Are people affected by uninformative racehorse names?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 93(C).
    19. Christian Deutscher & David Winkelmann & Marius Otting, 2020. "Bookmakers' mispricing of the disappeared home advantage in the German Bundesliga after the COVID-19 break," Papers 2008.05417, arXiv.org, revised Aug 2020.
    20. Robert L. Winkler & Yael Grushka-Cockayne & Kenneth C. Lichtendahl Jr. & Victor Richmond R. Jose, 2019. "Probability Forecasts and Their Combination: A Research Perspective," Decision Analysis, INFORMS, vol. 16(4), pages 239-260, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:34:y:2018:i:1:p:17-29. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.