IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i4p2949-2969.html
   My bibliography  Save this article

The Bad Thing About Good Advice: Understanding When and How Advice Exacerbates Overconfidence

Author

Listed:
  • Jack B. Soll

    (Fuqua School of Business, Duke University, Durham, North Carolina 27708)

  • Asa B. Palley

    (Kelley School of Business, Indiana University, Bloomington, Indiana, 47405)

  • Christina A. Rader

    (Economics and Business Department, Colorado College, Colorado Springs, Colorado 80903)

Abstract

Much research on advice taking examines how people revise point estimates given input from others. This work has established that people often egocentrically discount advice. If they were to place more weight on advice, their point estimates would be more accurate. Yet the focus on point estimates and accuracy has resulted in a narrow conception of what it means to heed advice. We distinguish between revisions of point estimates and revisions of attendant probability distributions. Point estimates represent a single best guess; distributions represent the probabilities that people assign to all possible answers. A more complete picture of advice taking is provided by considering revisions of distributions, which reflect changes in both confidence and best guesses. We capture this using a new measure of advice utilization: the influence of advice. We observe that, when input from a high-quality advisor largely agrees with a person’s initial opinion, it engenders little change in one’s point estimate and, hence, little change in accuracy yet significantly increases confidence. This pattern suggests more advice taking than generally suspected. However, it is not necessarily beneficial. Because people are typically overconfident to begin with, receiving advice that agrees with their initial opinion can exacerbate overconfidence. In several experiments, we manipulate advisor quality and measure the extent to which advice agrees with a person’s initial opinion. The results allow us to pinpoint circumstances in which heeding advice is beneficial, improving accuracy or reducing overconfidence, as well as circumstances in which it is harmful, hurting accuracy or exacerbating overconfidence.

Suggested Citation

  • Jack B. Soll & Asa B. Palley & Christina A. Rader, 2022. "The Bad Thing About Good Advice: Understanding When and How Advice Exacerbates Overconfidence," Management Science, INFORMS, vol. 68(4), pages 2949-2969, April.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:4:p:2949-2969
    DOI: 10.1287/mnsc.2021.3987
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2021.3987
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2021.3987?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Rader, Christina A. & Soll, Jack B. & Larrick, Richard P., 2015. "Pushing away from representative advice: Advice taking, anchoring, and adjustment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 130(C), pages 26-43.
    2. Richard P. Larrick & Jack B. Soll, 2006. "Erratum--Intuitions About Combining Opinions: Misappreciation of the Averaging Principle," Management Science, INFORMS, vol. 52(2), pages 309-310, February.
    3. Sniezek, Janet A. & Buckley, Timothy, 1995. "Cueing and Cognitive Conflict in Judge-Advisor Decision Making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 62(2), pages 159-174, May.
    4. Yaniv, Ilan & Kleinberger, Eli, 2000. "Advice Taking in Decision Making: Egocentric Discounting and Reputation Formation," Organizational Behavior and Human Decision Processes, Elsevier, vol. 83(2), pages 260-281, November.
    5. Sah, Sunita & Moore, Don A. & MacCoun, Robert J., 2013. "Cheap talk and credibility: The consequences of confidence and accuracy on advisor credibility and persuasiveness," Organizational Behavior and Human Decision Processes, Elsevier, vol. 121(2), pages 246-255.
    6. Larrick, Richard P. & Burson, Katherine A. & Soll, Jack B., 2007. "Social comparison and confidence: When thinking you're better than average predicts overconfidence (and when it does not)," Organizational Behavior and Human Decision Processes, Elsevier, vol. 102(1), pages 76-94, January.
    7. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    8. Harvey, Nigel & Fischer, Ilan, 1997. "Taking Advice: Accepting Help, Improving Judgment, and Sharing Responsibility," Organizational Behavior and Human Decision Processes, Elsevier, vol. 70(2), pages 117-133, May.
    9. Heath, Chip & Gonzalez, Rich, 1995. "Interaction with Others Increases Decision Confidence but Not Decision Quality: Evidence against Information Collection Views of Interactive Decision Making," Organizational Behavior and Human Decision Processes, Elsevier, vol. 61(3), pages 305-326, March.
    10. repec:cup:judgdm:v:10:y:2015:i:2:p:144-171 is not listed on IDEAS
    11. repec:cup:judgdm:v:11:y:2016:i:4:p:401-415 is not listed on IDEAS
    12. Alison Wood Brooks & Francesca Gino & Maurice E. Schweitzer, 2015. "Smart People Ask for (My) Advice: Seeking Advice Boosts Perceptions of Competence," Management Science, INFORMS, vol. 61(6), pages 1421-1435, June.
    13. Philipp Ecken & Richard Pibernik, 2016. "Hit or Miss: What Leads Experts to Take Advice for Long-Term Judgments?," Management Science, INFORMS, vol. 62(7), pages 2002-2021, July.
    14. Bonaccio, Silvia & Dalal, Reeshad S., 2006. "Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 127-151, November.
    15. Richard P. Larrick & Jack B. Soll, 2006. "Intuitions About Combining Opinions: Misappreciation of the Averaging Principle," Management Science, INFORMS, vol. 52(1), pages 111-127, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. See, Kelly E. & Morrison, Elizabeth W. & Rothman, Naomi B. & Soll, Jack B., 2011. "The detrimental effects of power on confidence, advice taking, and accuracy," Organizational Behavior and Human Decision Processes, Elsevier, vol. 116(2), pages 272-285.
    2. Kausel, Edgar E. & Culbertson, Satoris S. & Leiva, Pedro I. & Slaughter, Jerel E. & Jackson, Alexander T., 2015. "Too arrogant for their own good? Why and when narcissists dismiss advice," Organizational Behavior and Human Decision Processes, Elsevier, vol. 131(C), pages 33-50.
    3. repec:cup:judgdm:v:10:y:2015:i:3:p:265-276 is not listed on IDEAS
    4. Rader, Christina A. & Soll, Jack B. & Larrick, Richard P., 2015. "Pushing away from representative advice: Advice taking, anchoring, and adjustment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 130(C), pages 26-43.
    5. repec:cup:judgdm:v:11:y:2016:i:4:p:401-415 is not listed on IDEAS
    6. Soll, Jack B. & Mannes, Albert E., 2011. "Judgmental aggregation strategies depend on whether the self is involved," International Journal of Forecasting, Elsevier, vol. 27(1), pages 81-102.
    7. Soll, Jack B. & Mannes, Albert E., 2011. "Judgmental aggregation strategies depend on whether the self is involved," International Journal of Forecasting, Elsevier, vol. 27(1), pages 81-102, January.
    8. Mandy Hütter & Fabian Ache, 2016. "Seeking advice: A sampling approach to advice taking," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 11(4), pages 401-415, July.
    9. Peter Bednarik & Thomas Schultze, 2015. "The effectiveness of imperfect weighting in advice taking," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(3), pages 265-276, May.
    10. Gino, Francesca, 2008. "Do we listen to advice just because we paid for it? The impact of advice cost on its use," Organizational Behavior and Human Decision Processes, Elsevier, vol. 107(2), pages 234-245, November.
    11. Alison Wood Brooks & Francesca Gino & Maurice E. Schweitzer, 2015. "Smart People Ask for (My) Advice: Seeking Advice Boosts Perceptions of Competence," Management Science, INFORMS, vol. 61(6), pages 1421-1435, June.
    12. Johannes Müller-Trede & Shoham Choshen-Hillel & Meir Barneron & Ilan Yaniv, 2018. "The Wisdom of Crowds in Matters of Taste," Management Science, INFORMS, vol. 64(4), pages 1779-1803, April.
    13. Albert E. Mannes, 2009. "Are We Wise About the Wisdom of Crowds? The Use of Group Judgments in Belief Revision," Management Science, INFORMS, vol. 55(8), pages 1267-1279, August.
    14. Johannes Müller-Trede & Shoham Choshen-Hillel & Meir Barneron & Ilan Yaniv, 2017. "The Wisdom of Crowds in Matters of Taste," Discussion Paper Series dp709, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    15. Back, Camila & Morana, Stefan & Spann, Martin, 2023. "When do robo-advisors make us better investors? The impact of social design elements on investor behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 103(C).
    16. Yaniv, Ilan & Milyavsky, Maxim, 2007. "Using advice from multiple sources to revise and improve judgments," Organizational Behavior and Human Decision Processes, Elsevier, vol. 103(1), pages 104-120, May.
    17. Julia A. Minson & Jennifer S. Mueller & Richard P. Larrick, 2018. "The Contingent Wisdom of Dyads: When Discussion Enhances vs. Undermines the Accuracy of Collaborative Judgments," Management Science, INFORMS, vol. 64(9), pages 4177-4192, September.
    18. Bonaccio, Silvia & Dalal, Reeshad S., 2006. "Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 127-151, November.
    19. Palmeira, Mauricio, 2020. "Advice in the presence of external cues: The impact of conflicting judgments on perceptions of expertise," Organizational Behavior and Human Decision Processes, Elsevier, vol. 156(C), pages 82-96.
    20. Irene Scopelliti & Carey K. Morewedge & Erin McCormick & H. Lauren Min & Sophie Lebrecht & Karim S. Kassam, 2015. "Bias Blind Spot: Structure, Measurement, and Consequences," Management Science, INFORMS, vol. 61(10), pages 2468-2486, October.
    21. Leiby, Justin, 2018. "The role of consultants and management prestige in management control system adoption," Accounting, Organizations and Society, Elsevier, vol. 66(C), pages 1-13.
    22. Tomás Lejarraga & Johannes Müller-Trede, 2017. "When Experience Meets Description: How Dyads Integrate Experiential and Descriptive Information in Risky Decisions," Management Science, INFORMS, vol. 63(6), pages 1953-1971, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:4:p:2949-2969. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.