IDEAS home Printed from https://ideas.repec.org/a/eee/ijrema/v41y2024i4p632-647.html
   My bibliography  Save this article

Enhanced sales forecasting model using textual search data: Fusing dynamics with big data

Author

Listed:
  • Borah, Abhishek
  • Rutz, Oliver

Abstract

Forecasting sales is an essential marketing function, and, for most businesses, sales are driven by own and competitive activities. Most firms use their own marketing efforts or a selection of their competitor’s marketing efforts for forecasting sales. Due to data availability limitations, data on the full set of competitors are rarely used when forecasting sales. The emergence of online search data provides access to a novel data source on own as well as never-before observed competitive activities. We propose a novel regularized dynamic forecasting model utilizing all available competitive search data in a market vs. constructing ad-hoc and potentially subjective smaller competitive sets. Our model addresses the inherent statistical issue that arises when including a large number of competitive effects and parsimoniously utilizes all competitive data. We demonstrate our model using data from the US automobile industry over a twelve-year period and forecast car-model sales for 14 exemplary car-models utilizing multiple search measures for all 374 potential competitive car-models. We show that our model fits and forecasts sales better than models not leveraging the full competitive search data, e.g., using subjective sets of relevant competitors or narrowly defined category competitors. We also find that market research done via novel large-language models (also called LLMs) to obtain a narrower set of competitors does not outperform our proposed model that includes the full set of competitors.

Suggested Citation

  • Borah, Abhishek & Rutz, Oliver, 2024. "Enhanced sales forecasting model using textual search data: Fusing dynamics with big data," International Journal of Research in Marketing, Elsevier, vol. 41(4), pages 632-647.
  • Handle: RePEc:eee:ijrema:v:41:y:2024:i:4:p:632-647
    DOI: 10.1016/j.ijresmar.2024.05.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167811624000454
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijresmar.2024.05.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Seth Stephens-Davidowitz & Hal Varian & Michael D. Smith, 2017. "Super returns to Super Bowl ads?," Quantitative Marketing and Economics (QME), Springer, vol. 15(1), pages 1-28, March.
    2. Oliver J. Rutz & Michael Trusov & Randolph E. Bucklin, 2011. "Modeling Indirect Effects of Paid Search Advertising: Which Keywords Lead to More Future Visits?," Marketing Science, INFORMS, vol. 30(4), pages 646-665, July.
    3. Ashwin Aravindakshan & Olivier Rubel & Oliver Rutz, 2015. "Managing Blood Donations with Marketing," Marketing Science, INFORMS, vol. 34(2), pages 269-280, March.
    4. Ruomeng Cui & Santiago Gallino & Antonio Moreno & Dennis J. Zhang, 2018. "The Operational Value of Social Media Information," Production and Operations Management, Production and Operations Management Society, vol. 27(10), pages 1749-1769, October.
    5. Krista J. Li & Yan Liu, 2019. "Same or Different? An Aesthetic Design Question," Production and Operations Management, Production and Operations Management Society, vol. 28(6), pages 1465-1485, June.
    6. Deepa Chandrasekaran & Raji Srinivasan & Debika Sihi, 2018. "Effects of offline ad content on online brand search: insights from super bowl advertising," Journal of the Academy of Marketing Science, Springer, vol. 46(3), pages 403-430, May.
    7. Prasad Naik & Michel Wedel & Lynd Bacon & Anand Bodapati & Eric Bradlow & Wagner Kamakura & Jeffrey Kreulen & Peter Lenk & David Madigan & Alan Montgomery, 2008. "Challenges and opportunities in high-dimensional choice data analyses," Marketing Letters, Springer, vol. 19(3), pages 201-213, December.
    8. Garrett P. Sonnier & Leigh McAlister & Oliver J. Rutz, 2011. "A Dynamic Model of the Effect of Online Communications on Firm Sales," Marketing Science, INFORMS, vol. 30(4), pages 702-716, July.
    9. Armstrong, J. Scott & Brodie, Roderick J., 1999. "Forecasting for Marketing," MPRA Paper 81690, University Library of Munich, Germany.
    10. Zhi Da & Joseph Engelberg & Pengjie Gao, 2011. "In Search of Attention," Journal of Finance, American Finance Association, vol. 66(5), pages 1461-1499, October.
    11. Hyunyoung Choi & Hal Varian, 2012. "Predicting the Present with Google Trends," The Economic Record, The Economic Society of Australia, vol. 88(s1), pages 2-9, June.
    12. Daniel M. Ringel & Bernd Skiera, 2016. "Visualizing Asymmetric Competition Among More Than 1,000 Products Using Big Search Data," Marketing Science, INFORMS, vol. 35(3), pages 511-534, May.
    13. Jeremy Ginsberg & Matthew H. Mohebbi & Rajan S. Patel & Lynnette Brammer & Mark S. Smolinski & Larry Brilliant, 2009. "Detecting influenza epidemics using search engine query data," Nature, Nature, vol. 457(7232), pages 1012-1014, February.
    14. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    15. Marc Vanhuele & Shuba Srinivasan & Koen Pauwels, 2010. "Mindset Metrics in Market Response Models: An Integrative Approach," Post-Print hal-00528411, HAL.
    16. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stig Vinther Møller & Thomas Pedersen & Erik Christian Montes Schütte & Allan Timmermann, 2024. "Search and Predictability of Prices in the Housing Market," Management Science, INFORMS, vol. 70(1), pages 415-438, January.
    2. Szczygielski, Jan Jakub & Charteris, Ailie & Bwanya, Princess Rutendo & Brzeszczyński, Janusz, 2023. "Which COVID-19 information really impacts stock markets?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 84(C).
    3. Gelper, Sarah & Stremersch, Stefan, 2014. "Variable selection in international diffusion models," International Journal of Research in Marketing, Elsevier, vol. 31(4), pages 356-367.
    4. Daniel Borup & Erik Christian Montes Schütte, 2022. "In Search of a Job: Forecasting Employment Growth Using Google Trends," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(1), pages 186-200, January.
    5. James Chapman & Ajit Desai, . "Using payments data to nowcast macroeconomic variables during the onset of Covid-19," Journal of Financial Market Infrastructures, Journal of Financial Market Infrastructures.
    6. Abay,Kibrom A. & Hirfrfot,Kibrom Tafere & Woldemichael,Andinet, 2020. "Winners and Losers from COVID-19 : Global Evidence from Google Search," Policy Research Working Paper Series 9268, The World Bank.
    7. Qian Chen & Xiang Gao & Jianming Mo & Zhouling Xu, 2022. "Market Reaction to Local Attention around Earnings Announcements in China: Evidence from Internet Search Activity," IJFS, MDPI, vol. 10(4), pages 1-26, October.
    8. Barbara Rossi, 2021. "Forecasting in the Presence of Instabilities: How We Know Whether Models Predict Well and How to Improve Them," Journal of Economic Literature, American Economic Association, vol. 59(4), pages 1135-1190, December.
    9. Smales, L.A., 2021. "Investor attention and global market returns during the COVID-19 crisis," International Review of Financial Analysis, Elsevier, vol. 73(C).
    10. Massimo Ferrari Minesso & Frederik Kurcz & Maria Sole Pagliari, 2022. "Do words hurt more than actions? The impact of trade tensions on financial markets," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1138-1159, September.
    11. Chang, Young Bong & Kwon, YoungOk, 2018. "Ambiguities in valuing information technology firms: Do internet searches help?," Journal of Business Research, Elsevier, vol. 92(C), pages 260-269.
    12. Massimiliano Caporin & Francesco Poli, 2017. "Building News Measures from Textual Data and an Application to Volatility Forecasting," Econometrics, MDPI, vol. 5(3), pages 1-46, August.
    13. Keane, Michael & Neal, Timothy, 2021. "Consumer panic in the COVID-19 pandemic," Journal of Econometrics, Elsevier, vol. 220(1), pages 86-105.
    14. James T. E. Chapman & Ajit Desai, 2023. "Macroeconomic Predictions Using Payments Data and Machine Learning," Forecasting, MDPI, vol. 5(4), pages 1-32, November.
    15. Qadan, Mahmoud & Nama, Hazar, 2018. "Investor sentiment and the price of oil," Energy Economics, Elsevier, vol. 69(C), pages 42-58.
    16. Arabinda Basistha & Alexander Kurov & Marketa Halova Wolfe, . "Volatility forecasting: the role of internet search activity and implied volatility," Journal of Risk Model Validation, Journal of Risk Model Validation.
    17. Maarouf, Abdurahman & Feuerriegel, Stefan & Pröllochs, Nicolas, 2025. "A fused large language model for predicting startup success," European Journal of Operational Research, Elsevier, vol. 322(1), pages 198-214.
    18. Fabio Milani, 2021. "COVID-19 outbreak, social response, and early economic effects: a global VAR analysis of cross-country interdependencies," Journal of Population Economics, Springer;European Society for Population Economics, vol. 34(1), pages 223-252, January.
    19. Hamid, Alain & Heiden, Moritz, 2015. "Forecasting volatility with empirical similarity and Google Trends," Journal of Economic Behavior & Organization, Elsevier, vol. 117(C), pages 62-81.
    20. Tariq Aziz & Valeed Ahmad Ansari, 2021. "How Does Google Search Affect the Stock Market? Evidence from Indian Companies," Vision, , vol. 25(2), pages 224-232, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijrema:v:41:y:2024:i:4:p:632-647. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-research-in-marketing/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.