IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v87y2019icp46-56.html
   My bibliography  Save this article

Coordinating judgmental forecasting: Coping with intentional biases

Author

Listed:
  • Pennings, Clint L.P.
  • van Dalen, Jan
  • Rook, Laurens

Abstract

Human judgment, an almost inextricable ingredient in demand forecasting, introduces many unintentional and intentional biases to the forecasting and operations planning process. In the present research, we isolate intentional biases from this process and relate them to heterogeneous departmental roles and incentives. Through a laboratory experiment, which simulates forecasting operations planning in an interdepartmental decision-making context, we examine the effects of departmental roles, incentives and various weighting schemes on forecasting behavior and performance. We find that departmental roles, even without role-specific incentives, entail intentional biases of 8% of the forecast, and that role-specific incentives increase these biases to 14%. We further test the claim that accuracy-weighted schemes can remove biases in forecasting, and conclude that they halve, but don’t fully remove them. Finally, a weighting scheme that explicitly corrects biased inputs shows great promise in reducing intentional and unintentional biases. In our experiment, this scheme reduces biases by 35%. This shows the importance of disentangling intentional and unintentional biases for more effective forecasting adjustments. Our insights have substantial ramifications for the design of the forecasting operations planning process in dynamic business environments determined by high levels of role- and incentive-based heterogeneity.

Suggested Citation

  • Pennings, Clint L.P. & van Dalen, Jan & Rook, Laurens, 2019. "Coordinating judgmental forecasting: Coping with intentional biases," Omega, Elsevier, vol. 87(C), pages 46-56.
  • Handle: RePEc:eee:jomega:v:87:y:2019:i:c:p:46-56
    DOI: 10.1016/j.omega.2018.08.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048317311763
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.omega.2018.08.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Swanson, Norman R & Zeng, Tian, 2001. "Choosing among Competing Econometric Forecasts: Regression-Based Forecast Combination Using Model Selection," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(6), pages 425-440, September.
    2. Hilde C. Bjørnland & Karsten Gerdrup & Anne Sofie Jore & Christie Smith & Leif Anders Thorsrud, 2012. "Does Forecast Combination Improve Norges Bank Inflation Forecasts?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 163-179, April.
    3. Mirko Kremer & Brent Moritz & Enno Siemsen, 2011. "Demand Forecasting Behavior: System Neglect and Change Detection," Management Science, INFORMS, vol. 57(10), pages 1827-1843, October.
    4. Lawrence, Michael & O'Connor, Marcus, 1992. "Exploring judgemental forecasting," International Journal of Forecasting, Elsevier, vol. 8(1), pages 15-26, June.
    5. Yaniv, Ilan, 2011. "Group diversity and decision quality: Amplification and attenuation of the framing effect," International Journal of Forecasting, Elsevier, vol. 27(1), pages 41-49, January.
    6. Palm, F. & Zellner, A., 1991. "To combine or not to combine? issues of combining forecasts," LIDAM Discussion Papers CORE 1991022, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    7. Maurice E. Schweitzer & Gérard P. Cachon, 2000. "Decision Bias in the Newsvendor Problem with a Known Demand Distribution: Experimental Evidence," Management Science, INFORMS, vol. 46(3), pages 404-420, March.
    8. Kerr, Norbert L. & Tindale, R. Scott, 2011. "Group-based forecasting?: A social psychological analysis," International Journal of Forecasting, Elsevier, vol. 27(1), pages 14-40, January.
    9. Robert T. Clemen & Robert L. Winkler, 1999. "Combining Probability Distributions From Experts in Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 19(2), pages 187-203, April.
    10. Yaniv, Ilan, 2011. "Group diversity and decision quality: Amplification and attenuation of the framing effect," International Journal of Forecasting, Elsevier, vol. 27(1), pages 41-49.
    11. Önkal, Dilek & Zeynep Sayım, K. & Lawrence, Michael, 2012. "Wisdom of group forecasts: Does role-playing play a role?," Omega, Elsevier, vol. 40(6), pages 693-702.
    12. Min, Chung-ki & Zellner, Arnold, 1993. "Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 89-118, March.
    13. Lee, Wing Yee & Goodwin, Paul & Fildes, Robert & Nikolopoulos, Konstantinos & Lawrence, Michael, 2007. "Providing support for the use of analogies in demand forecasting tasks," International Journal of Forecasting, Elsevier, vol. 23(3), pages 377-390.
    14. Armstrong, J. Scott & Green, Kesten C. & Graefe, Andreas, 2015. "Golden rule of forecasting: Be conservative," Journal of Business Research, Elsevier, vol. 68(8), pages 1717-1731.
    15. AJ A. Bostian & Charles A. Holt & Angela M. Smith, 2008. "Newsvendor "Pull-to-Center" Effect: Adaptive Learning in a Laboratory Experiment," Manufacturing & Service Operations Management, INFORMS, vol. 10(4), pages 590-608, July.
    16. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    17. Wright, George & Rowe, Gene, 2011. "Group-based judgmental forecasting: An integration of extant knowledge and the development of priorities for a new research agenda," International Journal of Forecasting, Elsevier, vol. 27(1), pages 1-13, January.
    18. Gerd Gigerenzer & Reinhard Selten (ed.), 2002. "Bounded Rationality: The Adaptive Toolbox," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262571641, December.
    19. Donna F. Davis & John T. Mentzer & Teresa M. Mccarthy & Susan L. Golicic, 2006. "The evolution of sales forecasting management: a 20-year longitudinal study of forecasting practices," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(5), pages 303-324.
    20. Sanders, Nada R. & Manrodt, Karl B., 2003. "The efficacy of using judgmental versus quantitative forecasting methods in practice," Omega, Elsevier, vol. 31(6), pages 511-522, December.
    21. Wichard, Jörg D., 2011. "Forecasting the NN5 time series with hybrid models," International Journal of Forecasting, Elsevier, vol. 27(3), pages 700-707, July.
    22. Eksoz, Can & Mansouri, S. Afshin & Bourlakis, Michael, 2014. "Collaborative forecasting in the food supply chain: A conceptual framework," International Journal of Production Economics, Elsevier, vol. 158(C), pages 120-135.
    23. Graefe, Andreas & Armstrong, J. Scott, 2011. "Comparing face-to-face meetings, nominal groups, Delphi and prediction markets on an estimation task," International Journal of Forecasting, Elsevier, vol. 27(1), pages 183-195, January.
    24. Spyros Makridakis & Robert L. Winkler, 1983. "Averages of Forecasts: Some Empirical Results," Management Science, INFORMS, vol. 29(9), pages 987-996, September.
    25. Jeong-Ryeol Kurz-Kim, 2008. "Combining forecasts using optimal combination weight and generalized autoregression," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(5), pages 419-432.
    26. Fildes, Robert & Petropoulos, Fotios, 2015. "Is there a Golden Rule?," Journal of Business Research, Elsevier, vol. 68(8), pages 1742-1745.
    27. Lawrence, Michael & O'Connor, Marcus, 2005. "Judgmental forecasting in the presence of loss functions," International Journal of Forecasting, Elsevier, vol. 21(1), pages 3-14.
    28. Syntetos, Aris A. & Nikolopoulos, Konstantinos & Boylan, John E. & Fildes, Robert & Goodwin, Paul, 2009. "The effects of integrating management judgement into intermittent demand forecasts," International Journal of Production Economics, Elsevier, vol. 118(1), pages 72-81, March.
    29. Fang, Yue, 2003. "Forecasting combination and encompassing tests," International Journal of Forecasting, Elsevier, vol. 19(1), pages 87-94.
    30. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    31. Robert L. Winkler & Robert T. Clemen, 1992. "Sensitivity of Weights in Combining Forecasts," Operations Research, INFORMS, vol. 40(3), pages 609-614, June.
    32. repec:eee:intfor:v:27:y:2011:i:1:p:1-13 is not listed on IDEAS
    33. Danese, Pamela & Kalchschmidt, Matteo, 2011. "The role of the forecasting process in improving forecast accuracy and operational performance," International Journal of Production Economics, Elsevier, vol. 131(1), pages 204-214, May.
    34. Peter A. Morris, 1977. "Combining Expert Judgments: A Bayesian Approach," Management Science, INFORMS, vol. 23(7), pages 679-693, March.
    35. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    36. Gary E. Bolton & Axel Ockenfels & Ulrich W. Thonemann, 2012. "Managers and Students as Newsvendors," Management Science, INFORMS, vol. 58(12), pages 2225-2233, December.
    37. Yeung Lewis Chan & James H. Stock & Mark W. Watson, 1999. "A dynamic factor model framework for forecast combination," Spanish Economic Review, Springer;Spanish Economic Association, vol. 1(2), pages 91-121.
    38. Önkal, Dilek & Lawrence, Michael & Zeynep Sayım, K., 2011. "Influence of differentiated roles on group forecasting accuracy," International Journal of Forecasting, Elsevier, vol. 27(1), pages 50-68.
    39. Diebold, Francis X. & Pauly, Peter, 1990. "The use of prior information in forecast combination," International Journal of Forecasting, Elsevier, vol. 6(4), pages 503-508, December.
    40. Brockhoff, Klaus, 1983. "Group processes for forecasting," European Journal of Operational Research, Elsevier, vol. 13(2), pages 115-127, June.
    41. Mauro Costantini & Robert M. Kunst, 2011. "Combining forecasts based on multiple encompassing tests in a macroeconomic core system," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 30(6), pages 579-596, September.
    42. Kerr, Norbert L. & Tindale, R. Scott, 2011. "Group-based forecasting?: A social psychological analysis," International Journal of Forecasting, Elsevier, vol. 27(1), pages 14-40.
    43. Moon, Mark A. & Mentzer, John T. & Smith, Carlo D., 2003. "Conducting a sales forecasting audit," International Journal of Forecasting, Elsevier, vol. 19(1), pages 5-25.
    44. Wichard, Jörg D., 2011. "Forecasting the NN5 time series with hybrid models," International Journal of Forecasting, Elsevier, vol. 27(3), pages 700-707.
    45. Masahiro Ashiya, 2009. "Strategic bias and professional affiliations of macroeconomic forecasters," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(2), pages 120-130.
    46. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    47. Alison Hubbard Ashton & Robert H. Ashton, 1985. "Aggregating Subjective Forecasts: Some Empirical Results," Management Science, INFORMS, vol. 31(12), pages 1499-1508, December.
    48. Gary E. Bolton & Elena Katok, 2008. "Learning by Doing in the Newsvendor Problem: A Laboratory Investigation of the Role of Experience and Feedback," Manufacturing & Service Operations Management, INFORMS, vol. 10(3), pages 519-538, September.
    49. Francesca Gino & Gary Pisano, 2008. "Toward a Theory of Behavioral Operations," Manufacturing & Service Operations Management, INFORMS, vol. 10(4), pages 676-691, March.
    50. M C Hughes, 2001. "Forecasting practice: organisational issues," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 52(2), pages 143-149, February.
    51. Lawrence, Michael & O'Connor, Marcus & Edmundson, Bob, 2000. "A field study of sales forecasting accuracy and processes," European Journal of Operational Research, Elsevier, vol. 122(1), pages 151-160, April.
    52. Syntetos, Aris A. & Nikolopoulos, Konstantinos & Boylan, John E., 2010. "Judging the judges through accuracy-implication metrics: The case of inventory forecasting," International Journal of Forecasting, Elsevier, vol. 26(1), pages 134-143, January.
    53. R Fildes & K Nikolopoulos & S F Crone & A A Syntetos, 2008. "Forecasting and operational research: a review," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(9), pages 1150-1172, September.
    54. Stasser, Garold, 1992. "Information salience and the discovery of hidden profiles by decision-making groups: A "thought experiment"," Organizational Behavior and Human Decision Processes, Elsevier, vol. 52(1), pages 156-181, June.
    55. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    56. Önkal, Dilek & Lawrence, Michael & Zeynep SayIm, K., 2011. "Influence of differentiated roles on group forecasting accuracy," International Journal of Forecasting, Elsevier, vol. 27(1), pages 50-68, January.
    57. Davis, Donna F. & Mentzer, John T., 2007. "Organizational factors in sales forecasting management," International Journal of Forecasting, Elsevier, vol. 23(3), pages 475-495.
    58. David E. Rapach & Jack K. Strauss, 2008. "Forecasting US employment growth using forecast combining methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(1), pages 75-93.
    59. Kuo-Yuan Liang & Yu-Ying Kuo, 2004. "Human judgments in New York state sales and use tax forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(4), pages 297-314.
    60. Clemon, Robert T & Winkler, Robert L, 1986. "Combining Economic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 39-46, January.
    61. Joseph Lipscomb & Giovanni Parmigiani & Vic Hasselblad, 1998. "Combining Expert Judgment by Hierarchical Modeling: An Application to Physician Staffing," Management Science, INFORMS, vol. 44(2), pages 149-161, February.
    62. Colin Camerer, 2003. "Behavioural studies of strategic thinking," Levine's Bibliography 506439000000000490, UCLA Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    2. Eksoz, Can & Mansouri, S. Afshin & Bourlakis, Michael, 2014. "Collaborative forecasting in the food supply chain: A conceptual framework," International Journal of Production Economics, Elsevier, vol. 158(C), pages 120-135.
    3. Eksoz, Can & Mansouri, S. Afshin & Bourlakis, Michael & Önkal, Dilek, 2019. "Judgmental adjustments through supply integration for strategic partnerships in food chains," Omega, Elsevier, vol. 87(C), pages 20-33.
    4. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    5. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    6. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    7. Van den Broeke, Maud & De Baets, Shari & Vereecke, Ann & Baecke, Philippe & Vanderheyden, Karlien, 2019. "Judgmental forecast adjustments over different time horizons," Omega, Elsevier, vol. 87(C), pages 34-45.
    8. De Baets, Shari & Harvey, Nigel, 2018. "Forecasting from time series subject to sporadic perturbations: Effectiveness of different types of forecasting support," International Journal of Forecasting, Elsevier, vol. 34(2), pages 163-180.
    9. Wright, George & Rowe, Gene, 2011. "Group-based judgmental forecasting: An integration of extant knowledge and the development of priorities for a new research agenda," International Journal of Forecasting, Elsevier, vol. 27(1), pages 1-13, January.
    10. repec:eee:intfor:v:27:y:2011:i:1:p:1-13 is not listed on IDEAS
    11. Önkal, Dilek & Zeynep Sayım, K. & Lawrence, Michael, 2012. "Wisdom of group forecasts: Does role-playing play a role?," Omega, Elsevier, vol. 40(6), pages 693-702.
    12. F Caniato & M Kalchschmidt & S Ronchi, 2011. "Integrating quantitative and qualitative forecasting approaches: organizational learning in an action research case," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 413-424, March.
    13. Baecke, Philippe & De Baets, Shari & Vanderheyden, Karlien, 2017. "Investigating the added value of integrating human judgement into statistical demand forecasting systems," International Journal of Production Economics, Elsevier, vol. 191(C), pages 85-96.
    14. Mirko Kremer & Enno Siemsen & Douglas J. Thomas, 2016. "The Sum and Its Parts: Judgmental Hierarchical Forecasting," Management Science, INFORMS, vol. 62(9), pages 2745-2764, September.
    15. Yun Shin Lee & Enno Siemsen, 2017. "Task Decomposition and Newsvendor Decision Making," Management Science, INFORMS, vol. 63(10), pages 3226-3245, October.
    16. Winkler, Jens & Moser, Roger, 2016. "Biases in future-oriented Delphi studies: A cognitive perspective," Technological Forecasting and Social Change, Elsevier, vol. 105(C), pages 63-76.
    17. Asimakopoulos, Stavros & Dix, Alan, 2013. "Forecasting support systems technologies-in-practice: A model of adoption and use for product forecasting," International Journal of Forecasting, Elsevier, vol. 29(2), pages 322-336.
    18. Abolghasemi, Mahdi & Hurley, Jason & Eshragh, Ali & Fahimnia, Behnam, 2020. "Demand forecasting in the presence of systematic events: Cases in capturing sales promotions," International Journal of Production Economics, Elsevier, vol. 230(C).
    19. von der Gracht, Heiko A. & Hommel, Ulrich & Prokesch, Tobias & Wohlenberg, Holger, 2016. "Testing weighting approaches for forecasting in a Group Wisdom Support System environment," Journal of Business Research, Elsevier, vol. 69(10), pages 4081-4094.
    20. Surti, Chirag & Celani, Anthony & Gajpal, Yuvraj, 2020. "The newsvendor problem: The role of prospect theory and feedback," European Journal of Operational Research, Elsevier, vol. 287(1), pages 251-261.
    21. Wilson, Kevin J., 2017. "An investigation of dependence in expert judgement studies with multiple experts," International Journal of Forecasting, Elsevier, vol. 33(1), pages 325-336.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:87:y:2019:i:c:p:46-56. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.