IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v35y2019i1p197-212.html
   My bibliography  Save this article

Demand forecasting with user-generated online information

Author

Listed:
  • Schaer, Oliver
  • Kourentzes, Nikolaos
  • Fildes, Robert

Abstract

Recently, there has been substantial research on the augmentation of aggregate forecasts with individual consumer data from internet platforms, such as search traffic or social network shares. Although the majority of studies have reported increases in accuracy, many exhibit design weaknesses, including a lack of adequate benchmarks or rigorous evaluation. Furthermore, their usefulness over the product life-cycle has not been investigated, even though this may change, as consumers may search initially for pre-purchase information, but later for after-sales support. This study begins by reviewing the relevant literature, then attempts to support the key findings using two forecasting case studies. Our findings are in stark contrast to those in the previous literature, as we find that established univariate forecasting benchmarks, such as exponential smoothing, consistently perform better those that include online information. Our research underlines the need for a thorough forecast evaluation and argues that the usefulness of online platform data for supporting operational decisions may be limited.

Suggested Citation

  • Schaer, Oliver & Kourentzes, Nikolaos & Fildes, Robert, 2019. "Demand forecasting with user-generated online information," International Journal of Forecasting, Elsevier, vol. 35(1), pages 197-212.
  • Handle: RePEc:eee:intfor:v:35:y:2019:i:1:p:197-212
    DOI: 10.1016/j.ijforecast.2018.03.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207018300505
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2018.03.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    2. Shuba Srinivasan & Oliver J. Rutz & Koen Pauwels, 2016. "Paths to and off purchase: quantifying the impact of traditional marketing and online consumer activity," Journal of the Academy of Marketing Science, Springer, vol. 44(4), pages 440-453, July.
    3. Schneider, Matthew J. & Gupta, Sachin, 2016. "Forecasting sales of new and existing products using consumer reviews: A random projections approach," International Journal of Forecasting, Elsevier, vol. 32(2), pages 243-256.
    4. Hamid, Alain & Heiden, Moritz, 2015. "Forecasting volatility with empirical similarity and Google Trends," Journal of Economic Behavior & Organization, Elsevier, vol. 117(C), pages 62-81.
    5. Kim, Taegu & Hong, Jungsik & Kang, Pilsung, 2015. "Box office forecasting using machine learning algorithms based on SNS data," International Journal of Forecasting, Elsevier, vol. 31(2), pages 364-390.
    6. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    7. D’Amuri, Francesco & Marcucci, Juri, 2017. "The predictive power of Google searches in forecasting US unemployment," International Journal of Forecasting, Elsevier, vol. 33(4), pages 801-816.
    8. Dmitri Kuksov & Ron Shachar & Kangkang Wang, 2013. "Advertising and Consumers' Communications," Marketing Science, INFORMS, vol. 32(2), pages 294-309, March.
    9. Levent Bulut, 2018. "Google Trends and the forecasting performance of exchange rate models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 37(3), pages 303-315, April.
    10. Fantazzini, Dean & Toktamysova, Zhamal, 2015. "Forecasting German car sales using Google data and multivariate models," International Journal of Production Economics, Elsevier, vol. 170(PA), pages 97-135.
    11. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    12. Marcelo S. Perlin & João F. Caldeira & André A. P. Santos & Martin Pontuschka, 2017. "Can We Predict the Financial Markets Based on Google's Search Queries?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(4), pages 454-467, July.
    13. Lynn Wu & Erik Brynjolfsson, 2015. "The Future of Prediction: How Google Searches Foreshadow Housing Prices and Sales," NBER Chapters, in: Economic Analysis of the Digital Economy, pages 89-118, National Bureau of Economic Research, Inc.
    14. Hyunyoung Choi & Hal Varian, 2012. "Predicting the Present with Google Trends," The Economic Record, The Economic Society of Australia, vol. 88(s1), pages 2-9, June.
    15. Sagaert, Yves R. & Aghezzaf, El-Houssaine & Kourentzes, Nikolaos & Desmet, Bram, 2018. "Tactical sales forecasting using a very large set of macroeconomic indicators," European Journal of Operational Research, Elsevier, vol. 264(2), pages 558-569.
    16. Boylan, John E. & Goodwin, Paul & Mohammadipour, Maryam & Syntetos, Aris A., 2015. "Reproducibility in forecasting research," International Journal of Forecasting, Elsevier, vol. 31(1), pages 79-90.
    17. Yu, Lean & Zhao, Yaqing & Tang, Ling & Yang, Zebin, 2019. "Online big data-driven oil consumption forecasting with Google trends," International Journal of Forecasting, Elsevier, vol. 35(1), pages 213-223.
    18. Bijl, Laurens & Kringhaug, Glenn & Molnár, Peter & Sandvik, Eirik, 2016. "Google searches and stock returns," International Review of Financial Analysis, Elsevier, vol. 45(C), pages 150-156.
    19. Simeon Vosen & Torsten Schmidt, 2011. "Forecasting private consumption: survey‐based indicators vs. Google trends," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 30(6), pages 565-578, September.
    20. Huang, Xiankai & Zhang, Lifeng & Ding, Yusi, 2017. "The Baidu Index: Uses in predicting tourism flows –A case study of the Forbidden City," Tourism Management, Elsevier, vol. 58(C), pages 301-306.
    21. Stephan Seiler & Song Yao & Wenbo Wang, 2017. "Does Online Word of Mouth Increase Demand? (And How?) Evidence from a Natural Experiment," Marketing Science, INFORMS, vol. 36(6), pages 838-861, November.
    22. Li, Xin & Pan, Bing & Law, Rob & Huang, Xiankai, 2017. "Forecasting tourism demand with composite search index," Tourism Management, Elsevier, vol. 59(C), pages 57-66.
    23. Nuno Barreira & Pedro Godinho & Paulo Melo, 2013. "Nowcasting unemployment rate and new car sales in south-western Europe with Google Trends," Netnomics, Springer, vol. 14(3), pages 129-165, November.
    24. Paul Smith, 2016. "Google's MIDAS Touch: Predicting UK Unemployment with Internet Search Data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 35(3), pages 263-284, April.
    25. Thomas Dimpfl & Stephan Jank, 2016. "Can Internet Search Queries Help to Predict Stock Market Volatility?," European Financial Management, European Financial Management Association, vol. 22(2), pages 171-192, March.
    26. Tonya Boone & Ram Ganeshan & Robert L. Hicks & Nada R. Sanders, 2018. "Can Google Trends Improve Your Sales Forecast?," Production and Operations Management, Production and Operations Management Society, vol. 27(10), pages 1770-1774, October.
    27. Seshadri Tirunillai & Gerard J. Tellis, 2012. "Does Chatter Really Matter? Dynamics of User-Generated Content and Stock Performance," Marketing Science, INFORMS, vol. 31(2), pages 198-215, March.
    28. Xinxin Li & Lorin M. Hitt, 2008. "Self-Selection and Information Role of Online Product Reviews," Information Systems Research, INFORMS, vol. 19(4), pages 456-474, December.
    29. Tonya Boone & Ram Ganeshan & Robert L. Hicks, 2015. "Incorporating Google Trends Data Into Sales Forecasting," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 38, pages 9-14, Summer.
    30. Xiao Liu & Param Vir Singh & Kannan Srinivasan, 2016. "A Structured Analysis of Unstructured Big Data by Leveraging Cloud Computing," Marketing Science, INFORMS, vol. 35(3), pages 363-388, May.
    31. V. Kumar & JeeWon Brianna Choi & Mallik Greene, 2017. "Synergistic effects of social media and traditional marketing on brand sales: capturing the time-varying effects," Journal of the Academy of Marketing Science, Springer, vol. 45(2), pages 268-288, March.
    32. Qinneng Xu & Yulia R Gel & L Leticia Ramirez Ramirez & Kusha Nezafati & Qingpeng Zhang & Kwok-Leung Tsui, 2017. "Forecasting influenza in Hong Kong with Google search queries and statistical model fusion," PLOS ONE, Public Library of Science, vol. 12(5), pages 1-17, May.
    33. Lee, Jung Eun & Watkins, Brandi, 2016. "YouTube vloggers' influence on consumer luxury brand perceptions and intentions," Journal of Business Research, Elsevier, vol. 69(12), pages 5753-5760.
    34. Jun, Seung-Pyo & Sung, Tae-Eung & Park, Hyun-Woo, 2017. "Forecasting by analogy using the web search traffic," Technological Forecasting and Social Change, Elsevier, vol. 115(C), pages 37-51.
    35. Bangwayo-Skeete, Prosper F. & Skeete, Ryan W., 2015. "Can Google data improve the forecasting performance of tourist arrivals? Mixed-data sampling approach," Tourism Management, Elsevier, vol. 46(C), pages 454-464.
    36. Zeynalov, Ayaz, 2017. "Forecasting Tourist Arrivals in Prague: Google Econometrics," MPRA Paper 83268, University Library of Munich, Germany.
    37. Jukka Ruohonen & Sami Hyrynsalmi, 2017. "Evaluating the use of internet search volumes for time series modeling of sales in the video game industry," Electronic Markets, Springer;IIM University of St. Gallen, vol. 27(4), pages 351-370, November.
    38. Steven L. Scott & Hal R. Varian, 2015. "Bayesian Variable Selection for Nowcasting Economic Time Series," NBER Chapters, in: Economic Analysis of the Digital Economy, pages 119-135, National Bureau of Economic Research, Inc.
    39. Huberty, Mark, 2015. "Can we vote with our tweet? On the perennial difficulty of election forecasting with social media," International Journal of Forecasting, Elsevier, vol. 31(3), pages 992-1007.
    40. Wendy W. Moe & David A. Schweidel, 2012. "Online Product Opinions: Incidence, Evaluation, and Evolution," Marketing Science, INFORMS, vol. 31(3), pages 372-386, May.
    41. Declan Butler, 2013. "When Google got flu wrong," Nature, Nature, vol. 494(7436), pages 155-156, February.
    42. Shun†Yang Lee & Liangfei Qiu & Andrew Whinston, 2018. "Sentiment Manipulation in Online Platforms: An Analysis of Movie Tweets," Production and Operations Management, Production and Operations Management Society, vol. 27(3), pages 393-416, March.
    43. Hong-Hee Won & Woojae Myung & Gil-Young Song & Won-Hee Lee & Jong-Won Kim & Bernard J Carroll & Doh Kwan Kim, 2013. "Predicting National Suicide Numbers with Social Media Data," PLOS ONE, Public Library of Science, vol. 8(4), pages 1-6, April.
    44. Liwen Vaughan & Yue Chen, 2015. "Data mining from web search queries: A comparison of google trends and baidu index," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(1), pages 13-22, January.
    45. Shannon M. Fast & Louis Kim & Emily L. Cohn & Sumiko R. Mekaru & John S. Brownstein & Natasha Markuzon, 2018. "Predicting social response to infectious disease outbreaks from internet-based news streams," Annals of Operations Research, Springer, vol. 263(1), pages 551-564, April.
    46. Guiyang Xiong & Sundar Bharadwaj, 2014. "Prerelease Buzz Evolution Patterns and New Product Performance," Marketing Science, INFORMS, vol. 33(3), pages 401-421, May.
    47. Davydenko, Andrey & Fildes, Robert, 2013. "Measuring forecasting accuracy: The case of judgmental adjustments to SKU-level demand forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 510-522.
    48. Chris Hand & Guy Judge, 2012. "Searching for the picture: forecasting UK cinema admissions using Google Trends data," Applied Economics Letters, Taylor & Francis Journals, vol. 19(11), pages 1051-1055, July.
    49. Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
    50. Wang, Xia & Yu, Chunling & Wei, Yujie, 2012. "Social Media Peer Communication and Impacts on Purchase Intentions: A Consumer Socialization Framework," Journal of Interactive Marketing, Elsevier, vol. 26(4), pages 198-208.
    51. Koning, Alex J. & Franses, Philip Hans & Hibon, Michele & Stekler, H.O., 2005. "The M3 competition: Statistical tests of the results," International Journal of Forecasting, Elsevier, vol. 21(3), pages 397-409.
    52. Siliverstovs, Boriss & Wochner, Daniel S., 2018. "Google Trends and reality: Do the proportions match?," Journal of Economic Behavior & Organization, Elsevier, vol. 145(C), pages 1-23.
    53. Rivera, Roberto, 2016. "A dynamic linear model to forecast hotel registrations in Puerto Rico using Google Trends data," Tourism Management, Elsevier, vol. 57(C), pages 12-20.
    54. Jacques Bughin, 2015. "Google searches and twitter mood: nowcasting telecom sales performance," Netnomics, Springer, vol. 16(1), pages 87-105, August.
    55. Mavragani, Amaryllis & Tsagarakis, Konstantinos P., 2016. "YES or NO: Predicting the 2015 GReferendum results using Google Trends," Technological Forecasting and Social Change, Elsevier, vol. 109(C), pages 1-5.
    56. Armstrong, J. Scott, 2006. "Findings from evidence-based forecasting: Methods for reducing forecast error," International Journal of Forecasting, Elsevier, vol. 22(3), pages 583-598.
    57. David Godes & José C. Silva, 2012. "Sequential and Temporal Dynamics of Online Opinion," Marketing Science, INFORMS, vol. 31(3), pages 448-473, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fildes, Robert & Kolassa, Stephan & Ma, Shaohui, 2022. "Post-script—Retail forecasting: Research and practice," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1319-1324.
    2. Levent Bulut, 2018. "Google Trends and the forecasting performance of exchange rate models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 37(3), pages 303-315, April.
    3. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2022. "Retail forecasting: Research and practice," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1283-1318.
    4. Donthu, Naveen & Kumar, Satish & Pandey, Neeraj & Pandey, Nitesh & Mishra, Akanksha, 2021. "Mapping the electronic word-of-mouth (eWOM) research: A systematic review and bibliometric analysis," Journal of Business Research, Elsevier, vol. 135(C), pages 758-773.
    5. Shuyun Ren & Hau-Ling Chan & Tana Siqin, 2020. "Demand forecasting in retail operations for fashionable products: methods, practices, and real case study," Annals of Operations Research, Springer, vol. 291(1), pages 761-777, August.
    6. Liu, Zhenyuan & Han, Shuihua & Li, Chao & Gupta, Shivam & Sivarajah, Uthayasankar, 2022. "Leveraging customer engagement to improve the operational efficiency of social commerce start-ups," Journal of Business Research, Elsevier, vol. 140(C), pages 572-582.
    7. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2019. "Retail forecasting: research and practice," MPRA Paper 89356, University Library of Munich, Germany.
    8. Chuan Zhang & Yu-Xin Tian & Ling-Wei Fan, 2020. "Improving the Bass model’s predictive power through online reviews, search traffic and macroeconomic data," Annals of Operations Research, Springer, vol. 295(2), pages 881-922, December.
    9. Boone, Tonya & Ganeshan, Ram & Jain, Aditya & Sanders, Nada R., 2019. "Forecasting sales in the supply chain: Consumer analytics in the big data era," International Journal of Forecasting, Elsevier, vol. 35(1), pages 170-180.
    10. Jun Hao & Xiaolei Sun & Qianqian Feng, 2020. "A Novel Ensemble Approach for the Forecasting of Energy Demand Based on the Artificial Bee Colony Algorithm," Energies, MDPI, vol. 13(3), pages 1-25, January.
    11. Gang Xie & Xin Li & Yatong Qian & Shouyang Wang, 2021. "Forecasting tourism demand with KPCA-based web search indexes," Tourism Economics, , vol. 27(4), pages 721-743, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chumnumpan, Pattarin & Shi, Xiaohui, 2019. "Understanding new products’ market performance using Google Trends," Australasian marketing journal, Elsevier, vol. 27(2), pages 91-103.
    2. Boone, Tonya & Ganeshan, Ram & Jain, Aditya & Sanders, Nada R., 2019. "Forecasting sales in the supply chain: Consumer analytics in the big data era," International Journal of Forecasting, Elsevier, vol. 35(1), pages 170-180.
    3. Emmanuel Sirimal Silva & Hossein Hassani & Dag Øivind Madsen & Liz Gee, 2019. "Googling Fashion: Forecasting Fashion Consumer Behaviour Using Google Trends," Social Sciences, MDPI, vol. 8(4), pages 1-23, April.
    4. France, Stephen L. & Shi, Yuying & Kazandjian, Brett, 2021. "Web Trends: A valuable tool for business research," Journal of Business Research, Elsevier, vol. 132(C), pages 666-679.
    5. Zhang, Chuan & Tian, Yu-Xin & Fan, Zhi-Ping, 2022. "Forecasting sales using online review and search engine data: A method based on PCA–DSFOA–BPNN," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1005-1024.
    6. Chuan Zhang & Yu-Xin Tian & Ling-Wei Fan, 2020. "Improving the Bass model’s predictive power through online reviews, search traffic and macroeconomic data," Annals of Operations Research, Springer, vol. 295(2), pages 881-922, December.
    7. Zhongchen Song & Tom Coupé, 2023. "Predicting Chinese consumption series with Baidu," Journal of Chinese Economic and Business Studies, Taylor & Francis Journals, vol. 21(3), pages 429-463, July.
    8. Coble, David & Pincheira, Pablo, 2017. "Nowcasting Building Permits with Google Trends," MPRA Paper 76514, University Library of Munich, Germany.
    9. Abay,Kibrom A. & Hirfrfot,Kibrom Tafere & Woldemichael,Andinet, 2020. "Winners and Losers from COVID-19 : Global Evidence from Google Search," Policy Research Working Paper Series 9268, The World Bank.
    10. Caperna, Giulio & Colagrossi, Marco & Geraci, Andrea & Mazzarella, Gianluca, 2022. "A babel of web-searches: Googling unemployment during the pandemic," Labour Economics, Elsevier, vol. 74(C).
    11. Dean Fantazzini & Julia Pushchelenko & Alexey Mironenkov & Alexey Kurbatskii, 2021. "Forecasting Internal Migration in Russia Using Google Trends: Evidence from Moscow and Saint Petersburg," Forecasting, MDPI, vol. 3(4), pages 1-30, October.
    12. Blazquez, Desamparados & Domenech, Josep, 2018. "Big Data sources and methods for social and economic analyses," Technological Forecasting and Social Change, Elsevier, vol. 130(C), pages 99-113.
    13. Gang Xie & Xin Li & Yatong Qian & Shouyang Wang, 2021. "Forecasting tourism demand with KPCA-based web search indexes," Tourism Economics, , vol. 27(4), pages 721-743, June.
    14. Ulrich Gunter & Irem Önder & Stefan Gindl, 2019. "Exploring the predictive ability of LIKES of posts on the Facebook pages of four major city DMOs in Austria," Tourism Economics, , vol. 25(3), pages 375-401, May.
    15. Caperna, Giulio & Colagrossi, Marco & Geraci, Andrea & Mazzarella, Gianluca, 2020. "Googling Unemployment During the Pandemic: Inference and Nowcast Using Search Data," Working Papers 2020-04, Joint Research Centre, European Commission.
    16. Tomas Havranek & Ayaz Zeynalov, 2021. "Forecasting tourist arrivals: Google Trends meets mixed-frequency data," Tourism Economics, , vol. 27(1), pages 129-148, February.
    17. Jun, Seung-Pyo & Yoo, Hyoung Sun & Choi, San, 2018. "Ten years of research change using Google Trends: From the perspective of big data utilizations and applications," Technological Forecasting and Social Change, Elsevier, vol. 130(C), pages 69-87.
    18. Long Wen & Chang Liu & Haiyan Song, 2019. "Forecasting tourism demand using search query data: A hybrid modelling approach," Tourism Economics, , vol. 25(3), pages 309-329, May.
    19. Oliver Schaer & Nikolaos Kourentzes & Robert Fildes, 2022. "Predictive competitive intelligence with prerelease online search traffic," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3823-3839, October.
    20. F. Antolini & L. Grassini, 2019. "Foreign arrivals nowcasting in Italy with Google Trends data," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(5), pages 2385-2401, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:35:y:2019:i:1:p:197-212. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.