IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v67y2021i9p5921-5942.html
   My bibliography  Save this article

The Psychology of Second Guesses: Implications for the Wisdom of the Inner Crowd

Author

Listed:
  • Celia Gaertig

    (Booth School of Business, University of Chicago, Chicago, Illinois 60637)

  • Joseph P. Simmons

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19148)

Abstract

Prior research suggests that averaging two guesses from the same person can improve quantitative judgments, a phenomenon known as the “wisdom of the inner crowd.” In this article, we find that this effect hinges on whether people explicitly decide in which direction their first guess had erred before making their second guess. In nine studies ( N = 8,465), we found that asking people to explicitly indicate whether their first guess was too high or too low before making their second guess made people more likely to provide a second guess that was more extreme (in the same direction) than their first guess. As a consequence, the introduction of that “Too High/Too Low” question reduced (and sometimes eliminated or reversed) the wisdom-of-the-inner-crowd effect for (the majority of) questions with non-extreme correct answers and increased the wisdom-of-the-inner-crowd effect for questions with extreme correct answers. Our findings suggest that the wisdom-of-the-inner-crowd effect is not inevitable but rather that it depends on the processes people use to generate their second guesses.

Suggested Citation

  • Celia Gaertig & Joseph P. Simmons, 2021. "The Psychology of Second Guesses: Implications for the Wisdom of the Inner Crowd," Management Science, INFORMS, vol. 67(9), pages 5921-5942, September.
  • Handle: RePEc:inm:ormnsc:v:67:y:2021:i:9:p:5921-5942
    DOI: 10.1287/mnsc.2020.3781
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.3781
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.3781?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Robert L. Winkler & Robert T. Clemen, 2004. "Multiple Experts vs. Multiple Methods: Combining Correlation Assessments," Decision Analysis, INFORMS, vol. 1(3), pages 167-176, September.
    2. Dennie van Dolder & Martijn J. van den Assem, 2018. "The wisdom of the inner crowd in three large natural experiments," Nature Human Behaviour, Nature, vol. 2(1), pages 21-26, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fifić, Mario & Gigerenzer, Gerd, 2014. "Are two interviewers better than one?," Journal of Business Research, Elsevier, vol. 67(8), pages 1771-1779.
    2. L. Robin Keller & Ali Abbas & Manel Baucells & Vicki M. Bier & David Budescu & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Ahti Salo & George Wu, 2010. "From the Editors..," Decision Analysis, INFORMS, vol. 7(4), pages 327-330, December.
      • L. Robin Keller & Manel Baucells & Kevin F. McCardle & Gregory S. Parnell & Ahti Salo, 2007. "From the Editors..," Decision Analysis, INFORMS, vol. 4(4), pages 173-175, December.
      • L. Robin Keller & Manel Baucells & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Gregory S. Parnell & Ahti Salo, 2008. "From the Editors..," Decision Analysis, INFORMS, vol. 5(4), pages 173-176, December.
      • L. Robin Keller & Manel Baucells & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Gregory S. Parnell & Ahti Salo, 2009. "From the Editors ..," Decision Analysis, INFORMS, vol. 6(4), pages 199-201, December.
    3. Srinivas Bollapragada & Salil Gupta & Brett Hurwitz & Paul Miles & Rajesh Tyagi, 2008. "NBC-Universal Uses a Novel Qualitative Forecasting Technique to Predict Advertising Demand," Interfaces, INFORMS, vol. 38(2), pages 103-111, April.
    4. repec:cup:judgdm:v:13:y:2018:i:6:p:607-621 is not listed on IDEAS
    5. Marttunen, Mika & Haara, Arto & Hjerppe, Turo & Kurttila, Mikko & Liesiö, Juuso & Mustajoki, Jyri & Saarikoski, Heli & Tolvanen, Anne, 2023. "Parallel and comparative use of three multicriteria decision support methods in an environmental portfolio problem," European Journal of Operational Research, Elsevier, vol. 307(2), pages 842-859.
    6. Baker, Erin & Keisler, Jeffrey M., 2011. "Cellulosic biofuels: Expert views on prospects for advancement," Energy, Elsevier, vol. 36(1), pages 595-605.
    7. L. Robin Keller & Kelly M. Kophazi, 2010. "From the Editors..," Decision Analysis, INFORMS, vol. 7(2), pages 151-154, June.
    8. David J. Johnstone, 2007. "The Parimutuel Kelly Probability Scoring Rule," Decision Analysis, INFORMS, vol. 4(2), pages 66-75, June.
    9. Andrew T. Ching & Robert Clark & Ignatius Horstmann & Hyunwoo Lim, 2016. "The Effects of Publicity on Demand: The Case of Anti-Cholesterol Drugs," Marketing Science, INFORMS, vol. 35(1), pages 158-181, January.
    10. Graefe, Andreas & Armstrong, J. Scott & Jones, Randall J. & Cuzán, Alfred G., 2014. "Combining forecasts: An application to elections," International Journal of Forecasting, Elsevier, vol. 30(1), pages 43-54.
    11. L. Robin Keller & Kelly M. Kophazi, 2008. "From the Editors..," Decision Analysis, INFORMS, vol. 5(2), pages 57-59, June.
    12. Jessop, Alan, 2014. "IMP: A decision aid for multiattribute evaluation using imprecise weight estimates," Omega, Elsevier, vol. 49(C), pages 18-29.
    13. Grant, Andrew & Johnstone, David, 2010. "Finding profitable forecast combinations using probability scoring rules," International Journal of Forecasting, Elsevier, vol. 26(3), pages 498-510, July.
    14. L. Robin Keller & Ali Abbas & J. Eric Bickel & Vicki M. Bier & David V. Budescu & John C. Butler & Philippe Delquié & Kenneth C. Lichtendahl & Jason R. W. Merrick & Ahti Salo & George Wu, 2011. "From the Editors ---Probability Scoring Rules, Ambiguity, Multiattribute Terrorist Utility, and Sensitivity Analysis," Decision Analysis, INFORMS, vol. 8(4), pages 251-255, December.
    15. Christopher W. Karvetski & David R. Mandel & Daniel Irwin, 2020. "Improving Probability Judgment in Intelligence Analysis: From Structured Analysis to Statistical Aggregation," Risk Analysis, John Wiley & Sons, vol. 40(5), pages 1040-1057, May.
    16. Rakesh K. Sarin, 2013. "From the Editor ---Median Aggregation, Scoring Rules, Expert Forecasts, Choices with Binary Attributes, Portfolio with Dependent Projects, and Information Security," Decision Analysis, INFORMS, vol. 10(4), pages 277-278, December.
    17. Werner, Christoph & Bedford, Tim & Cooke, Roger M. & Hanea, Anca M. & Morales-Nápoles, Oswaldo, 2017. "Expert judgement for dependence in probabilistic modelling: A systematic literature review and future research directions," European Journal of Operational Research, Elsevier, vol. 258(3), pages 801-819.
    18. Abbas, Ali E., 2007. "Moments of utility functions and their applications," European Journal of Operational Research, Elsevier, vol. 180(1), pages 378-395, July.
    19. L. Robin Keller, 2007. "From the Editor..," Decision Analysis, INFORMS, vol. 4(2), pages 47-48, June.
    20. Simone Cerreia-Vioglio & Roberto Corrao & Giacomo Lanzani, 2020. "Robust Opinion Aggregation and its Dynamics," Working Papers 662, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    21. Anil Gaba & Dana G. Popescu & Zhi Chen, 2019. "Assessing Uncertainty from Point Forecasts," Management Science, INFORMS, vol. 65(1), pages 90-106, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:67:y:2021:i:9:p:5921-5942. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.