IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2009.07202.html
   My bibliography  Save this paper

Network Structures of Collective Intelligence: The Contingent Benefits of Group Discussion

Author

Listed:
  • Joshua Becker
  • Abdullah Almaatouq
  • EmH{o}ke-'Agnes Horv'at

Abstract

Research on belief formation has produced contradictory findings on whether and when communication between group members will improve the accuracy of numeric estimates such as economic forecasts, medical diagnoses, and job candidate assessments. While some evidence suggests that carefully mediated processes such as the "Delphi method" produce more accurate beliefs than unstructured discussion, others argue that unstructured discussion outperforms mediated processes. Still others argue that independent individuals produce the most accurate beliefs. This paper shows how network theories of belief formation can resolve these inconsistencies, even when groups lack apparent structure as in informal conversation. Emergent network structures of influence interact with the pre-discussion belief distribution to moderate the effect of communication on belief formation. As a result, communication sometimes increases and sometimes decreases the accuracy of the average belief in a group. The effects differ for mediated processes and unstructured communication, such that the relative benefit of each communication format depends on both group dynamics as well as the statistical properties of pre-interaction beliefs. These results resolve contradictions in previous research and offer practical recommendations for teams and organizations.

Suggested Citation

  • Joshua Becker & Abdullah Almaatouq & EmH{o}ke-'Agnes Horv'at, 2020. "Network Structures of Collective Intelligence: The Contingent Benefits of Group Discussion," Papers 2009.07202, arXiv.org, revised Mar 2021.
  • Handle: RePEc:arx:papers:2009.07202
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2009.07202
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Albert E. Mannes, 2009. "Are We Wise About the Wisdom of Crowds? The Use of Group Judgments in Belief Revision," Management Science, INFORMS, vol. 55(8), pages 1267-1279, August.
    2. James G. March, 1991. "Exploration and Exploitation in Organizational Learning," Organization Science, INFORMS, vol. 2(1), pages 71-87, February.
    3. Hartnett, Nicole & Kennedy, Rachel & Sharp, Byron & Greenacre, Luke, 2016. "Marketers' Intuitions about the Sales Effectiveness of Advertisements," Journal of Marketing Behavior, now publishers, vol. 2(2-3), pages 177-194, December.
    4. Bo Cowgill & Eric Zitzewitz, 2015. "Corporate Prediction Markets: Evidence from Google, Ford, and Firm X," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(4), pages 1309-1341.
    5. Ethan Mollick & Ramana Nanda, 2016. "Wisdom or Madness? Comparing Crowds with Expert Evaluation in Funding the Arts," Management Science, INFORMS, vol. 62(6), pages 1533-1553, June.
    6. Pavel Atanasov & Phillip Rescober & Eric Stone & Samuel A. Swift & Emile Servan-Schreiber & Philip Tetlock & Lyle Ungar & Barbara Mellers, 2017. "Distilling the Wisdom of Crowds: Prediction Markets vs. Prediction Polls," Management Science, INFORMS, vol. 63(3), pages 691-706, March.
    7. Abdullah Almaatouq & Alejandro Noriega-Campero & Abdulrahman Alotaibi & P. M. Krafft & Mehdi Moussaid & Alex Pentland, 2020. "Adaptive social networks promote the wisdom of crowds," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(21), pages 11379-11386, May.
    8. Kesten Green & J. Scott Armstrong & Andreas Graefe, 2007. "Methods to Elicit Forecasts from Groups: Delphi and Prediction Markets Compared," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 8, pages 17-20, Fall.
    9. Rowe, Gene & Wright, George, 1999. "The Delphi technique as a forecasting tool: issues and analysis," International Journal of Forecasting, Elsevier, vol. 15(4), pages 353-375, October.
    10. Scott E. Page, 2007. "Prologue to The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies," Introductory Chapters, in: The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies, Princeton University Press.
    11. Hailiang Chen & Prabuddha De & Yu (Jeffrey) Hu & Byoung-Hyoun Hwang, 2014. "Wisdom of Crowds: The Value of Stock Opinions Transmitted Through Social Media," The Review of Financial Studies, Society for Financial Studies, vol. 27(5), pages 1367-1403.
    12. P. J. Lamberson & Scott E. Page, 2012. "Optimal Forecasting Groups," Management Science, INFORMS, vol. 58(4), pages 805-810, April.
    13. Karl E. Weick & Kathleen M. Sutcliffe & David Obstfeld, 2005. "Organizing and the Process of Sensemaking," Organization Science, INFORMS, vol. 16(4), pages 409-421, August.
    14. Julia A. Minson & Jennifer S. Mueller & Richard P. Larrick, 2018. "The Contingent Wisdom of Dyads: When Discussion Enhances vs. Undermines the Accuracy of Collaborative Judgments," Management Science, INFORMS, vol. 64(9), pages 4177-4192, September.
    15. Badham, Jennifer M., 2013. "Commentary: Measuring the shape of degree distributions," Network Science, Cambridge University Press, vol. 1(2), pages 213-225, August.
    16. Norman Dalkey & Olaf Helmer, 1963. "An Experimental Application of the DELPHI Method to the Use of Experts," Management Science, INFORMS, vol. 9(3), pages 458-467, April.
    17. Turner, Marlene E. & Pratkanis, Anthony R., 1998. "Twenty-Five Years of Groupthink Theory and Research: Lessons from the Evaluation of a Theory," Organizational Behavior and Human Decision Processes, Elsevier, vol. 73(2-3), pages 105-115, February.
    18. Brenner, Lyle A. & Koehler, Derek J. & Liberman, Varda & Tversky, Amos, 1996. "Overconfidence in Probability and Frequency Judgments: A Critical Examination," Organizational Behavior and Human Decision Processes, Elsevier, vol. 65(3), pages 212-219, March.
    19. Barry L. Bayus, 2013. "Crowdsourcing New Product Ideas over Time: An Analysis of the Dell IdeaStorm Community," Management Science, INFORMS, vol. 59(1), pages 226-244, June.
    20. Jansen, W. Jos & Jin, Xiaowen & de Winter, Jasper M., 2016. "Forecasting and nowcasting real GDP: Comparing statistical models and subjective forecasts," International Journal of Forecasting, Elsevier, vol. 32(2), pages 411-436.
    21. Abhijit V. Banerjee, 1992. "A Simple Model of Herd Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(3), pages 797-817.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joshua Becker & Douglas Guilbeault & Ned Smith, 2021. "The Crowd Classification Problem: Social Dynamics of Binary Choice Accuracy," Papers 2104.11300, arXiv.org.
    2. Joshua Aaron Becker & Douglas Guilbeault & Edward Bishop Smith, 2022. "The Crowd Classification Problem: Social Dynamics of Binary-Choice Accuracy," Management Science, INFORMS, vol. 68(5), pages 3949-3965, May.
    3. Peeters, Thomas, 2018. "Testing the Wisdom of Crowds in the field: Transfermarkt valuations and international soccer results," International Journal of Forecasting, Elsevier, vol. 34(1), pages 17-29.
    4. Bernd Frick & Franziska Prockl, 2018. "Information Precision In Online Communities: Player Valuations On Www.Transfermarkt.De," Working Papers Dissertations 37, Paderborn University, Faculty of Business Administration and Economics.
    5. Vincenz Frey & Arnout van de Rijt, 2021. "Social Influence Undermines the Wisdom of the Crowd in Sequential Decision Making," Management Science, INFORMS, vol. 67(7), pages 4273-4286, July.
    6. Philipp B. Cornelius & Bilal Gokpinar, 2020. "The Role of Customer Investor Involvement in Crowdfunding Success," Management Science, INFORMS, vol. 66(1), pages 452-472, January.
    7. Förster, Bernadette & von der Gracht, Heiko, 2014. "Assessing Delphi panel composition for strategic foresight — A comparison of panels based on company-internal and external participants," Technological Forecasting and Social Change, Elsevier, vol. 84(C), pages 215-229.
    8. Greg Fisher & Emily Neubert, 2023. "Evaluating Ventures Fast and Slow: Sensemaking, Intuition, and Deliberation in Entrepreneurial Resource Provision Decisions," Entrepreneurship Theory and Practice, , vol. 47(4), pages 1298-1326, July.
    9. Jon Atwell & Marlon Twyman II, 2023. "Metawisdom of the Crowd: How Choice Within Aided Decision Making Can Make Crowd Wisdom Robust," Papers 2308.15451, arXiv.org.
    10. Rohit Aggarwal & Michael J Lee & Braxton Osting & Harpreet Singh, 2021. "Improving Funding Operations of Equity‐based Crowdfunding Platforms," Production and Operations Management, Production and Operations Management Society, vol. 30(11), pages 4121-4139, November.
    11. Philipp Ecken & Richard Pibernik, 2016. "Hit or Miss: What Leads Experts to Take Advice for Long-Term Judgments?," Management Science, INFORMS, vol. 62(7), pages 2002-2021, July.
    12. Prommer, Lisa & Tiberius, Victor & Kraus, Sascha, 2020. "Exploring the future of startup leadership development," Journal of Business Venturing Insights, Elsevier, vol. 14(C).
    13. Douglas Cumming & Lars Hornuf & Moein Karami & Denis Schweizer, 2023. "Disentangling Crowdfunding from Fraudfunding," Journal of Business Ethics, Springer, vol. 182(4), pages 1103-1128, February.
    14. Dindo, Pietro & Massari, Filippo, 2020. "The wisdom of the crowd in dynamic economies," Theoretical Economics, Econometric Society, vol. 15(4), November.
    15. Prianto Budi Saptono & Gustofan Mahmud & Intan Pratiwi & Dwi Purwanto & Ismail Khozen & Muhamad Akbar Aditama & Siti Khodijah & Maria Eurelia Wayan & Rina Yuliastuty Asmara & Ferry Jie, 2023. "Development of Climate-Related Disclosure Indicators for Application in Indonesia: A Delphi Method Study," Sustainability, MDPI, vol. 15(14), pages 1-25, July.
    16. Nuzzo, Simone & Morone, Andrea, 2017. "Asset markets in the lab: A literature review," Journal of Behavioral and Experimental Finance, Elsevier, vol. 13(C), pages 42-50.
    17. Di Zio, Simone & Bolzan, Mario & Marozzi, Marco, 2021. "Classification of Delphi outputs through robust ranking and fuzzy clustering for Delphi-based scenarios," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    18. Alyami, Saleh. H. & Rezgui, Yacine & Kwan, Alan, 2013. "Developing sustainable building assessment scheme for Saudi Arabia: Delphi consultation approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 43-54.
    19. He, Xue-Zhong & Li, Kai & Santi, Caterina & Shi, Lei, 2022. "Social interaction, volatility clustering, and momentum," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 125-149.
    20. Brice Corgnet & Cary Deck & Mark DeSantis & Kyle Hampton & Erik O. Kimbrough, 2023. "When Do Security Markets Aggregate Dispersed Information?," Management Science, INFORMS, vol. 69(6), pages 3697-3729, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2009.07202. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.