IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i6p4685-4702.html
   My bibliography  Save this article

From Noise to Bias: Overconfidence in New Product Forecasting

Author

Listed:
  • Daniel Feiler

    (Tuck School of Business, Dartmouth College, Hanover, New Hampshire 03755)

  • Jordan Tong

    (Wisconsin School of Business, University of Wisconsin-Madison, Madison, Wisconsin 53706)

Abstract

We study decision behavior in the selection, forecasting, and production for a new product. In a stylized behavioral model and five experiments, we generate new insight into when and why this combination of tasks can lead to overconfidence (specifically, overestimating the demand). We theorize that cognitive limitations lead to noisy interpretations of signal information, which itself is noisy. Because people are statistically naive, they directly use their noisy interpretation of the signal information as their forecast, thereby underaccounting for the uncertainty that underlies it. This process leads to unbiased forecast errors when considering products in isolation, but leads to positively biased forecasts for the products people choose to launch due to a selection effect. We show that this selection-driven overconfidence can be sufficiently problematic that, under certain conditions, choosing the product randomly can actually yield higher profits than when individuals themselves choose the product to launch. We provide mechanism evidence by manipulating the interpretation noise through information complexity—showing that even when the information is equivalent from a Bayesian perspective, more complicated information leads to more noise, which, in turn, leads to more overconfidence in the chosen products. Finally, we leverage this insight to show that getting a second independent forecast for a chosen product can significantly mitigate the overconfidence problem, even when both individuals have the same information.

Suggested Citation

  • Daniel Feiler & Jordan Tong, 2022. "From Noise to Bias: Overconfidence in New Product Forecasting," Management Science, INFORMS, vol. 68(6), pages 4685-4702, June.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:6:p:4685-4702
    DOI: 10.1287/mnsc.2021.4102
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2021.4102
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2021.4102?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mirko Kremer & Brent Moritz & Enno Siemsen, 2011. "Demand Forecasting Behavior: System Neglect and Change Detection," Management Science, INFORMS, vol. 57(10), pages 1827-1843, October.
    2. Meng Li & Nicholas C. Petruzzi & Jun Zhang, 2017. "Overconfident Competing Newsvendors," Management Science, INFORMS, vol. 63(8), pages 2637-2646, August.
    3. Evgeny Kagan & Stephen Leider & William S. Lovejoy, 2018. "Ideation–Execution Transition in Product Development: An Experimental Analysis," Management Science, INFORMS, vol. 64(5), pages 2238-2262, May.
    4. Yun Shin Lee & Enno Siemsen, 2017. "Task Decomposition and Newsvendor Decision Making," Management Science, INFORMS, vol. 63(10), pages 3226-3245, October.
    5. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    6. Robin M. Hogarth & Spyros Makridakis, 1981. "Forecasting and Planning: An Evaluation," Management Science, INFORMS, vol. 27(2), pages 115-138, February.
    7. Brown, Keith C, 1974. "A Note on the Apparent Bias of Net Revenue Estimates for Capital Investment Projects," Journal of Finance, American Finance Association, vol. 29(4), pages 1215-1216, September.
    8. Phillip M. Yelland & Shinji Kim & Renée Stratulate, 2010. "A Bayesian Model for Sales Forecasting at Sun Microsystems," Interfaces, INFORMS, vol. 40(2), pages 118-129, April.
    9. Soll, Jack B., 1996. "Determinants of Overconfidence and Miscalibration: The Roles of Random Error and Ecological Structure," Organizational Behavior and Human Decision Processes, Elsevier, vol. 65(2), pages 117-137, February.
    10. Yufei Ren & Rachel Croson, 2013. "Overconfidence in Newsvendor Orders: An Experimental Study," Management Science, INFORMS, vol. 59(11), pages 2502-2517, November.
    11. Maurice E. Schweitzer & Gérard P. Cachon, 2000. "Decision Bias in the Newsvendor Problem with a Known Demand Distribution: Experimental Evidence," Management Science, INFORMS, vol. 46(3), pages 404-420, March.
    12. Mirko Kremer & Enno Siemsen & Douglas J. Thomas, 2016. "The Sum and Its Parts: Judgmental Hierarchical Forecasting," Management Science, INFORMS, vol. 62(9), pages 2745-2764, September.
    13. Robin M. Hogarth & Natalia Karelaia, 2012. "Entrepreneurial Success and Failure: Confidence and Fallible Judgment," Organization Science, INFORMS, vol. 23(6), pages 1733-1747, December.
    14. Simon, Mark & Shrader, Rodney C., 2012. "Entrepreneurial actions and optimistic overconfidence: The role of motivated reasoning in new product introductions," Journal of Business Venturing, Elsevier, vol. 27(3), pages 291-309.
    15. Daniel C. Feiler & Jordan D. Tong & Richard P. Larrick, 2013. "Biased Judgment in Censored Environments," Management Science, INFORMS, vol. 59(3), pages 573-591, January.
    16. James E. Smith & Robert L. Winkler, 2006. "The Optimizer's Curse: Skepticism and Postdecision Surprise in Decision Analysis," Management Science, INFORMS, vol. 52(3), pages 311-322, March.
    17. Kagel, John H. & Levin, Dan, 1986. "The Winner's Curse and Public Information in Common Value Auctions," American Economic Review, American Economic Association, vol. 76(5), pages 894-920, December.
    18. Tyebjee, Tyzoon T., 1987. "Behavioral biases in new product forecasting," International Journal of Forecasting, Elsevier, vol. 3(3-4), pages 393-404.
    19. Eric Van den Steen, 2004. "Rational Overoptimism (and Other Biases)," American Economic Review, American Economic Association, vol. 94(4), pages 1141-1151, September.
    20. J. Michael Harrison & David M. Kreps, 1978. "Speculative Investor Behavior in a Stock Market with Heterogeneous Expectations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 92(2), pages 323-336.
    21. Jordan Tong & Daniel Feiler, 2017. "A Behavioral Model of Forecasting: Naive Statistics on Mental Samples," Management Science, INFORMS, vol. 63(11), pages 3609-3627, November.
    22. Karan Girotra & Christian Terwiesch & Karl T. Ulrich, 2010. "Idea Generation and the Quality of the Best Idea," Management Science, INFORMS, vol. 56(4), pages 591-605, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jordan Tong & Daniel Feiler, 2017. "A Behavioral Model of Forecasting: Naive Statistics on Mental Samples," Management Science, INFORMS, vol. 63(11), pages 3609-3627, November.
    2. Anna‐Lena Sachs & Michael Becker‐Peth & Stefan Minner & Ulrich W. Thonemann, 2022. "Empirical newsvendor biases: Are target service levels achieved effectively and efficiently?," Production and Operations Management, Production and Operations Management Society, vol. 31(4), pages 1839-1855, April.
    3. Song-Hee Kim & Jordan Tong & Carol Peden, 2020. "Admission Control Biases in Hospital Unit Capacity Management: How Occupancy Information Hurdles and Decision Noise Impact Utilization," Management Science, INFORMS, vol. 66(11), pages 5151-5170, November.
    4. Robert J. Batt & Jordan D. Tong, 2020. "Mean Service Metrics: Biased Quality Judgment and the Customer–Server Quality Gap," Manufacturing & Service Operations Management, INFORMS, vol. 22(5), pages 975-995, September.
    5. Khosrowabadi, Naghmeh & Hoberg, Kai & Imdahl, Christina, 2022. "Evaluating human behaviour in response to AI recommendations for judgemental forecasting," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1151-1167.
    6. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    7. Karen Donohue & Özalp Özer, 2020. "Behavioral Operations: Past, Present, and Future," Manufacturing & Service Operations Management, INFORMS, vol. 22(1), pages 191-202, January.
    8. Yun Shin Lee & Enno Siemsen, 2017. "Task Decomposition and Newsvendor Decision Making," Management Science, INFORMS, vol. 63(10), pages 3226-3245, October.
    9. Hao, Zhongyuan & Li, Juan & Cai, Jinling, 2023. "Allocation of inventory responsibilities in overconfident supply chains," European Journal of Operational Research, Elsevier, vol. 305(1), pages 207-221.
    10. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    11. Mirko Kremer & Enno Siemsen & Douglas J. Thomas, 2016. "The Sum and Its Parts: Judgmental Hierarchical Forecasting," Management Science, INFORMS, vol. 62(9), pages 2745-2764, September.
    12. Pennings, Clint L.P. & van Dalen, Jan & Rook, Laurens, 2019. "Coordinating judgmental forecasting: Coping with intentional biases," Omega, Elsevier, vol. 87(C), pages 46-56.
    13. Kraft, Priscilla S. & Günther, Christina & Kammerlander, Nadine H. & Lampe, Jan, 2022. "Overconfidence and entrepreneurship: A meta-analysis of different types of overconfidence in the entrepreneurial process," Journal of Business Venturing, Elsevier, vol. 37(4).
    14. Choi, Tsan-Ming & Zhang, Ting, 2023. "Will being an angel bring more harm than good? Altruistic newsvendors with different risk attitudes," European Journal of Operational Research, Elsevier, vol. 305(3), pages 1153-1165.
    15. Zhisong Chen & Chaonan Tang & Jianhui Peng, 2023. "Nominal effect vs actual effect: overconfidence in a consignment omnichannel," Electronic Commerce Research, Springer, vol. 23(2), pages 843-876, June.
    16. Liu, Jie & Yang, Yang & Yu, Yugang, 2021. "Ordering and interest rate strategies in platform finance with an overconfident and commerce retailer," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 153(C).
    17. Robert E. Marks, 2013. "The Satisficer’s Curse," Discussion Papers 2013-28, School of Economics, The University of New South Wales.
    18. Samuel Nathan Kirshner & Anton Ovchinnikov, 2019. "Heterogeneity of Reference Effects in the Competitive Newsvendor Problem," Manufacturing & Service Operations Management, INFORMS, vol. 21(3), pages 571-581, July.
    19. Hofstra, Nienke & Spiliotopoulou, Eirini, 2022. "Behavior in rationing inventory across retail channels," European Journal of Operational Research, Elsevier, vol. 299(1), pages 208-222.
    20. Tian Bai & Samuel N. Kirshner & Meng Wu, 2021. "Managing Overconfident Newsvendors: A Target‐Setting Approach," Production and Operations Management, Production and Operations Management Society, vol. 30(11), pages 3967-3986, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:6:p:4685-4702. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.