IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v68y2015i8p1678-1685.html
   My bibliography  Save this article

Simple versus complex forecasting: The evidence

Author

Listed:
  • Green, Kesten C.
  • Armstrong, J. Scott

Abstract

This article introduces this JBR Special Issue on simple versus complex methods in forecasting. Simplicity in forecasting requires that (1) method, (2) representation of cumulative knowledge, (3) relationships in models, and (4) relationships among models, forecasts, and decisions are all sufficiently uncomplicated as to be easily understood by decision-makers. Our review of studies comparing simple and complex methods – including those in this special issue – found 97 comparisons in 32 papers. None of the papers provide a balance of evidence that complexity improves forecast accuracy. Complexity increases forecast error by 27 percent on average in the 25 papers with quantitative comparisons. The finding is consistent with prior research to identify valid forecasting methods: all 22 previously identified evidence-based forecasting procedures are simple. Nevertheless, complexity remains popular among researchers, forecasters, and clients. Some evidence suggests that the popularity of complexity may be due to incentives: (1) researchers are rewarded for publishing in highly ranked journals, which favor complexity; (2) forecasters can use complex methods to provide forecasts that support decision-makers’ plans; and (3) forecasters’ clients may be reassured by incomprehensibility. Clients who prefer accuracy should accept forecasts only from simple evidence-based procedures. They can rate the simplicity of forecasters’ procedures using the questionnaire at simple-forecasting.com.

Suggested Citation

  • Green, Kesten C. & Armstrong, J. Scott, 2015. "Simple versus complex forecasting: The evidence," Journal of Business Research, Elsevier, vol. 68(8), pages 1678-1685.
  • Handle: RePEc:eee:jbrese:v:68:y:2015:i:8:p:1678-1685
    DOI: 10.1016/j.jbusres.2015.03.026
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S014829631500140X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jbusres.2015.03.026?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James T. Peach & James L. Webb, 1983. "Randomly Specified Macroeconomic Models: Some Implications for Model Selection," Journal of Economic Issues, Taylor & Francis Journals, vol. 17(3), pages 697-720, September.
    2. Armstrong, J. Scott & Overton, Terry, 1971. "Brief vs. comprehensive descriptions in measuring intentions to purchase," MPRA Paper 81697, University Library of Munich, Germany.
    3. Huddleston, Samuel H. & Porter, John H. & Brown, Donald E., 2015. "Improving forecasts for noisy geographic time series," Journal of Business Research, Elsevier, vol. 68(8), pages 1810-1818.
    4. Schnaars, Steven P. & Bavuso, R. Joseph, 1986. "Extrapolation models on very short-term forecasts," Journal of Business Research, Elsevier, vol. 14(1), pages 27-36, February.
    5. Wright, Malcolm J. & Stern, Philip, 2015. "Forecasting new product trial with analogous series," Journal of Business Research, Elsevier, vol. 68(8), pages 1732-1738.
    6. Green, Kesten C. & Armstrong, J. Scott, 2007. "Structured analogies for forecasting," International Journal of Forecasting, Elsevier, vol. 23(3), pages 365-376.
    7. Brighton, Henry & Gigerenzer, Gerd, 2015. "The bias bias," Journal of Business Research, Elsevier, vol. 68(8), pages 1772-1784.
    8. Armstrong, J. Scott & Green, Kesten C. & Graefe, Andreas, 2015. "Golden rule of forecasting: Be conservative," Journal of Business Research, Elsevier, vol. 68(8), pages 1717-1731.
    9. Makridakis, Spyros & Chatfield, Chris & Hibon, Michele & Lawrence, Michael & Mills, Terence & Ord, Keith & Simmons, LeRoy F., 1993. "The M2-competition: A real-time judgmentally based forecasting study," International Journal of Forecasting, Elsevier, vol. 9(1), pages 5-22, April.
    10. Armstrong, J. Scott, 1970. "How to avoid exploratory research," MPRA Paper 81666, University Library of Munich, Germany.
    11. Lyon, Aidan & Wintle, Bonnie C. & Burgman, Mark, 2015. "Collective wisdom: Methods of confidence interval aggregation," Journal of Business Research, Elsevier, vol. 68(8), pages 1759-1767.
    12. repec:cup:judgdm:v:7:y:2012:i:6:p:746-749 is not listed on IDEAS
    13. Armstrong, J Scott, 1978. "Forecasting with Econometric Methods: Folklore versus Fact," The Journal of Business, University of Chicago Press, vol. 51(4), pages 549-564, October.
    14. Smith, Stanley K., 1997. "Further thoughts on simplicity and complexity in population projection models," International Journal of Forecasting, Elsevier, vol. 13(4), pages 557-565, December.
    15. Ziliak, Stephen T. & McCloskey, Deirdre N., 2004. "Size matters: the standard error of regressions in the American Economic Review," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(5), pages 527-546, November.
    16. Armstrong, J. Scott & Shapiro, Alan C., 1974. "Analyzing Quantitative Models," MPRA Paper 81696, University Library of Munich, Germany.
    17. Fildes, Robert & Wei, Yingqi & Ismail, Suzilah, 2011. "Evaluating the forecasting performance of econometric models of air passenger traffic flows using multiple error measures," International Journal of Forecasting, Elsevier, vol. 27(3), pages 902-922, July.
    18. Crone, Sven F. & Hibon, Michèle & Nikolopoulos, Konstantinos, 2011. "Advances in forecasting with neural networks? Empirical evidence from the NN3 competition on time series prediction," International Journal of Forecasting, Elsevier, vol. 27(3), pages 635-660, July.
    19. Green, Kesten C. & Armstrong, J. Scott, 2011. "Role thinking: Standing in other people’s shoes to forecast decisions in conflicts," International Journal of Forecasting, Elsevier, vol. 27(1), pages 69-80.
    20. Hogarth, Robin M. & Soyer, Emre, 2015. "Communicating forecasts: The simplicity of simulated experience," Journal of Business Research, Elsevier, vol. 68(8), pages 1800-1809.
    21. J. Scott Armstrong, 1980. "Unintelligible Management Research and Academic Prestige," Interfaces, INFORMS, vol. 10(2), pages 80-86, April.
    22. Deirdre N. McCloskey & Stephen T. Ziliak, 1996. "The Standard Error of Regressions," Journal of Economic Literature, American Economic Association, vol. 34(1), pages 97-114, March.
    23. Tessier, Thomas H. & Armstrong, J. Scott, 2015. "Decomposition of time-series by level and change," Journal of Business Research, Elsevier, vol. 68(8), pages 1755-1758.
    24. Gorr, Wilpen L. & Nagin, Daniel & Szczypula, Janusz, 1994. "Comparative study of artificial neural network and statistical models for predicting student grade point averages," International Journal of Forecasting, Elsevier, vol. 10(1), pages 17-34, June.
    25. John Boylan & Aris Syntetos, 2006. "Accuracy and Accuracy Implication Metrics for Intermittent Demand," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 4, pages 39-42, June.
    26. Fildes, Robert & Petropoulos, Fotios, 2015. "Simple versus complex selection rules for forecasting many time series," Journal of Business Research, Elsevier, vol. 68(8), pages 1692-1701.
    27. Soyer, Emre & Hogarth, Robin M., 2012. "The illusion of predictability: How regression statistics mislead experts," International Journal of Forecasting, Elsevier, vol. 28(3), pages 695-711.
    28. J. Scott Armstrong, 1984. "Forecasting by Extrapolation: Conclusions from 25 Years of Research," Interfaces, INFORMS, vol. 14(6), pages 52-66, December.
    29. Syntetos, Aris A. & Zied Babai, M. & Gardner, Everette S., 2015. "Forecasting intermittent inventory demands: simple parametric methods vs. bootstrapping," Journal of Business Research, Elsevier, vol. 68(8), pages 1746-1752.
    30. Willemain, Thomas R. & Smart, Charles N. & Schwarz, Henry F., 2004. "A new approach to forecasting intermittent demand for service parts inventories," International Journal of Forecasting, Elsevier, vol. 20(3), pages 375-387.
    31. Nikolopoulos, Konstantinos & Litsa, Akrivi & Petropoulos, Fotios & Bougioukos, Vasileios & Khammash, Marwan, 2015. "Relative performance of methods for forecasting special events," Journal of Business Research, Elsevier, vol. 68(8), pages 1785-1791.
    32. Woike, Jan K. & Hoffrage, Ulrich & Petty, Jeffrey S., 2015. "Picking profitable investments: The success of equal weighting in simulated venture capitalist decision making," Journal of Business Research, Elsevier, vol. 68(8), pages 1705-1716.
    33. Green, Kesten C., 2005. "Game theory, simulated interaction, and unaided judgement for forecasting decisions in conflicts: Further evidence," International Journal of Forecasting, Elsevier, vol. 21(3), pages 463-472.
    34. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
    35. Graefe, Andreas, 2015. "Improving forecasts using equally weighted predictors," Journal of Business Research, Elsevier, vol. 68(8), pages 1792-1799.
    36. Garcia-Ferrer, A. & de Juan, A. & Poncela, P., 2006. "Forecasting traffic accidents using disaggregated data," International Journal of Forecasting, Elsevier, vol. 22(2), pages 203-222.
    37. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    38. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    39. Goodwin, Paul, 2015. "When simple alternatives to Bayes formula work well: Reducing the cognitive load when updating probability forecasts," Journal of Business Research, Elsevier, vol. 68(8), pages 1686-1691.
    40. Nikolopoulos, K. & Goodwin, P. & Patelis, A. & Assimakopoulos, V., 2007. "Forecasting with cue information: A comparison of multiple regression with alternative forecasting approaches," European Journal of Operational Research, Elsevier, vol. 180(1), pages 354-368, July.
    41. R H Teunter & L Duncan, 2009. "Forecasting intermittent demand: a comparative study," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(3), pages 321-329, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Armstrong, J. Scott & Green, Kesten C. & Graefe, Andreas, 2015. "Golden rule of forecasting: Be conservative," Journal of Business Research, Elsevier, vol. 68(8), pages 1717-1731.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    4. Blanc, Sebastian M. & Setzer, Thomas, 2016. "When to choose the simple average in forecast combination," Journal of Business Research, Elsevier, vol. 69(10), pages 3951-3962.
    5. Petropoulos, Fotios & Makridakis, Spyros & Assimakopoulos, Vassilios & Nikolopoulos, Konstantinos, 2014. "‘Horses for Courses’ in demand forecasting," European Journal of Operational Research, Elsevier, vol. 237(1), pages 152-163.
    6. Deepa Mishra & Angappa Gunasekaran & Thanos Papadopoulos & Stephen J. Childe, 2018. "Big Data and supply chain management: a review and bibliometric analysis," Annals of Operations Research, Springer, vol. 270(1), pages 313-336, November.
    7. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    8. Fildes, Robert & Petropoulos, Fotios, 2015. "Is there a Golden Rule?," Journal of Business Research, Elsevier, vol. 68(8), pages 1742-1745.
    9. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    10. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    11. Jaganathan, Srihari & Prakash, P.K.S., 2020. "A combination-based forecasting method for the M4-competition," International Journal of Forecasting, Elsevier, vol. 36(1), pages 98-104.
    12. Katsikopoulos, Konstantinos V. & Durbach, Ian N. & Stewart, Theodor J., 2018. "When should we use simple decision models? A synthesis of various research strands," Omega, Elsevier, vol. 81(C), pages 17-25.
    13. Litsiou, Konstantia & Polychronakis, Yiannis & Karami, Azhdar & Nikolopoulos, Konstantinos, 2022. "Relative performance of judgmental methods for forecasting the success of megaprojects," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1185-1196.
    14. Prak, Derk & Teunter, Rudolf & Babai, M. Z. & Syntetos, A. A. & Boylan, D, 2018. "Forecasting and Inventory Control with Compound Poisson Demand Using Periodic Demand Data," Research Report 2018010, University of Groningen, Research Institute SOM (Systems, Organisations and Management).
    15. López Menéndez, Ana Jesús & Pérez Suárez, Rigoberto, 2017. "Forecasting Performance and Information Measures. Revisiting the M-Competition /Evaluación de Predicciones y Medidas de Información. Reexamen de la M-Competición," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 35, pages 299-314, Mayo.
    16. Kück, Mirko & Freitag, Michael, 2021. "Forecasting of customer demands for production planning by local k-nearest neighbor models," International Journal of Production Economics, Elsevier, vol. 231(C).
    17. Kourentzes, Nikolaos & Barrow, Devon & Petropoulos, Fotios, 2019. "Another look at forecast selection and combination: Evidence from forecast pooling," International Journal of Production Economics, Elsevier, vol. 209(C), pages 226-235.
    18. Syntetos, Aris A. & Zied Babai, M. & Gardner, Everette S., 2015. "Forecasting intermittent inventory demands: simple parametric methods vs. bootstrapping," Journal of Business Research, Elsevier, vol. 68(8), pages 1746-1752.
    19. Konstantinos Nikolopoulos & Waleed S. Alghassab & Konstantia Litsiou & Stelios Sapountzis, 2019. "Long-Term Economic Forecasting with Structured Analogies and Interaction Groups," Working Papers 19018, Bangor Business School, Prifysgol Bangor University (Cymru / Wales).
    20. Armstrong, J. Scott, 2006. "Findings from evidence-based forecasting: Methods for reducing forecast error," International Journal of Forecasting, Elsevier, vol. 22(3), pages 583-598.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:68:y:2015:i:8:p:1678-1685. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.