IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/63nbc_v1.html
   My bibliography  Save this paper

Automated Video Analytics in Marketing Research: A Systematic Literature Review and a Novel Multimodal Large Language Model Method

Author

Listed:
  • Schraml, Christopher

Abstract

The exponential growth of online video content presents significant opportunities for marketing researchers to analyze online consumer behavior. However, effectively using this data requires advanced methods for managing the complexity and sheer volume of video data. This research presents a systematic literature review of video analytics in marketing research, outlining the types of information extracted automatically from video data and examining the specific methodologies employed by researchers. Furthermore, we evaluate a multimodal large language model, specifically ChatGPT-4o, for complex, zero-shot image coding tasks in marketing research. Building on these image coding capabilities, we introduce a novel multimodal large language model-based pipeline for zero-shot video analysis. This innovative method allows researchers to efficiently extract meaningful information from video data without prior training or labeled datasets. Our findings highlight how multimodal large language models can advance video analytics into a scalable and cost-effective tool for marketing research.

Suggested Citation

  • Schraml, Christopher, 2025. "Automated Video Analytics in Marketing Research: A Systematic Literature Review and a Novel Multimodal Large Language Model Method," OSF Preprints 63nbc_v1, Center for Open Science.
  • Handle: RePEc:osf:osfxxx:63nbc_v1
    DOI: 10.31219/osf.io/63nbc_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/682cebe1f8b3e01b3bf07f42/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/63nbc_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jeremy Yang & Juanjuan Zhang & Yuhan Zhang, 2025. "Engagement That Sells: Influencer Video Advertising on TikTok," Marketing Science, INFORMS, vol. 44(2), pages 247-267, March.
    2. Shunyuan Zhang & Kaiquan Xu & Kannan Srinivasan, 2023. "Frontiers: Unmasking Social Compliance Behavior During the Pandemic," Marketing Science, INFORMS, vol. 42(3), pages 440-450, May.
    3. Giovanni Luca Cascio Rizzo & Jonah Berger & Matteo De Angelis & Rumen Pozharliev & Andrew T Stephen & Jacob Goldenberg, 2023. "How Sensory Language Shapes Influencer’s Impact," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 50(4), pages 810-825.
    4. Grewal, Dhruv & Herhausen, Dennis & Ludwig, Stephan & Villarroel Ordenes, Francisco, 2022. "The Future of Digital Communication Research: Considering Dynamics and Multimodality," Journal of Retailing, Elsevier, vol. 98(2), pages 224-240.
    5. Shijie Lu & Dai Yao & Xingyu Chen & Rajdeep Grewal, 2021. "Do Larger Audiences Generate Greater Revenues Under Pay What You Want? Evidence from a Live Streaming Platform," Marketing Science, INFORMS, vol. 40(5), pages 964-984, September.
    6. Bitty Balducci & Detelina Marinova, 2018. "Unstructured data in marketing," Journal of the Academy of Marketing Science, Springer, vol. 46(4), pages 557-590, July.
    7. Richard L. Daft & Robert H. Lengel, 1986. "Organizational Information Requirements, Media Richness and Structural Design," Management Science, INFORMS, vol. 32(5), pages 554-571, May.
    8. Xin (Shane) Wang & Neil Bendle & Yinjie Pan, 2024. "Beyond text: Marketing strategy in a world turned upside down," Journal of the Academy of Marketing Science, Springer, vol. 52(4), pages 939-954, July.
    9. Li Chen & Yajie Yan & Andrew N. Smith, 2023. "What drives digital engagement with sponsored videos? An investigation of video influencers’ authenticity management strategies," Journal of the Academy of Marketing Science, Springer, vol. 51(1), pages 198-221, January.
    10. Prithwiraj Choudhury & Dan Wang & Natalie A. Carlson & Tarun Khanna, 2019. "Machine learning approaches to facial and text analysis: Discovering CEO oral communication styles," Strategic Management Journal, Wiley Blackwell, vol. 40(11), pages 1705-1732, November.
    11. Philippe Mongeon & Adèle Paul-Hus, 2016. "The journal coverage of Web of Science and Scopus: a comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 213-228, January.
    12. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    13. Matthew McGranaghan & Jura Liaukonyte & Kenneth C. Wilbur, 2022. "How Viewer Tuning, Presence, and Attention Respond to Ad Content and Predict Brand Search Lift," Marketing Science, INFORMS, vol. 41(5), pages 873-895, September.
    14. Li, Xi & Shi, Mengze & Wang, Xin (Shane), 2019. "Video mining: Measuring visual information using automatic methods," International Journal of Research in Marketing, Elsevier, vol. 36(2), pages 216-231.
    15. Rajiv D. Banker & Hui Ding & Rong Huang & Xiaorong Li, 2024. "Market Reaction to CEOs’ Dynamic Hemifacial Asymmetry of Expressions," Management Science, INFORMS, vol. 70(7), pages 4847-4874, July.
    16. Xiaoling Zhang & Shibo Li & Raymond R. Burke, 2018. "Modeling the effects of dynamic group influence on shopper zone choice, purchase conversion, and spending," Journal of the Academy of Marketing Science, Springer, vol. 46(6), pages 1089-1107, November.
    17. Qiang Zhang & Wenbo Wang & Yuxin Chen, 2020. "Frontiers: In-Consumption Social Listening with Moment-to-Moment Unstructured Data: The Case of Movie Appreciation and Live Comments," Marketing Science, INFORMS, vol. 39(2), pages 285-295, March.
    18. Jayson Shi Jia & Baba Shiv & Sanjay Rao, 2014. "The Product-Agnosia Effect: How More Visual Impressions Affect Product Distinctiveness in Comparative Choice," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 41(2), pages 342-360.
    19. Shasha Lu & Li Xiao & Min Ding, 2016. "A Video-Based Automated Recommender (VAR) System for Garments," Marketing Science, INFORMS, vol. 35(3), pages 484-510, May.
    20. Hortense Fong & Vineet Kumar & K. Sudhir, 2025. "A Theory-Based Explainable Deep Learning Architecture for Music Emotion," Marketing Science, INFORMS, vol. 44(1), pages 196-219, January.
    21. Xin (Shane) Wang & Shijie Lu & X I Li & Mansur Khamitov & Neil Bendle & J. Jeffrey Inman & Andrew T Stephen, 2021. "Audio Mining: The Role of Vocal Tone in Persuasion," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 48(2), pages 189-211.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xin (Shane) Wang & Neil Bendle & Yinjie Pan, 2024. "Beyond text: Marketing strategy in a world turned upside down," Journal of the Academy of Marketing Science, Springer, vol. 52(4), pages 939-954, July.
    2. Schwenzow, Jasper & Hartmann, Jochen & Schikowsky, Amos & Heitmann, Mark, 2021. "Understanding videos at scale: How to extract insights for business research," Journal of Business Research, Elsevier, vol. 123(C), pages 367-379.
    3. Laura Toschi & Elisa Ughetto & Andrea Fronzetti Colladon, 2023. "The identity of social impact venture capitalists: exploring social linguistic positioning and linguistic distinctiveness through text mining," Small Business Economics, Springer, vol. 60(3), pages 1249-1280, March.
    4. Feng, Cong & Fay, Scott, 2022. "An empirical investigation of forward-looking retailer performance using parking lot traffic data derived from satellite imagery," Journal of Retailing, Elsevier, vol. 98(4), pages 633-646.
    5. Song, Danyang & Wang, Shichao & Ou, Carol & Chen, Xi & Liu, Ruitao & Tang, Haihong, 2021. "How do video features matter in visual advertising? An elaboration likelihood model perspective," Other publications TiSEM 37845995-5426-470a-8630-8, Tilburg University, School of Economics and Management.
    6. Xiao, Quan & Huang, Weiling & Qu, Lu & Li, Xia, 2025. "The impact of multimodal information features of short sales videos on consumer engagement behavior: A multi-method approach," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    7. Zhu, Jingjie & Cheng, Mingming, 2024. "Automatic video analytics in tourism: A methodological review," Annals of Tourism Research, Elsevier, vol. 108(C).
    8. Shuili Du & Assaad El Akremi & Ming Jia, 2023. "Quantitative Research on Corporate Social Responsibility: A Quest for Relevance and Rigor in a Quickly Evolving, Turbulent World," Journal of Business Ethics, Springer, vol. 187(1), pages 1-15, September.
    9. Grewal, Dhruv & Herhausen, Dennis & Ludwig, Stephan & Villarroel Ordenes, Francisco, 2022. "The Future of Digital Communication Research: Considering Dynamics and Multimodality," Journal of Retailing, Elsevier, vol. 98(2), pages 224-240.
    10. de Haan, Evert & Padigar, Manjunath & El Kihal, Siham & Kübler, Raoul & Wieringa, Jaap E., 2024. "Unstructured data research in business: Toward a structured approach," Journal of Business Research, Elsevier, vol. 177(C).
    11. Huang, Ming-Hui & Rust, Roland T., 2022. "A Framework for Collaborative Artificial Intelligence in Marketing," Journal of Retailing, Elsevier, vol. 98(2), pages 209-223.
    12. Zecong Ma & Sergio Palacios, 2021. "Image-mining: exploring the impact of video content on the success of crowdfunding," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(4), pages 265-285, December.
    13. Carlson, Keith & Kopalle, Praveen K. & Riddell, Allen & Rockmore, Daniel & Vana, Prasad, 2023. "Complementing human effort in online reviews: A deep learning approach to automatic content generation and review synthesis," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 54-74.
    14. He, Jiaxiu & Li, Bingqing & Wang, Xin (Shane), 2023. "Image features and demand in the sharing economy: A study of Airbnb," International Journal of Research in Marketing, Elsevier, vol. 40(4), pages 760-780.
    15. Yang, Yang & Zhao, Jichang & Li, Yashuai, 2025. "More than enough is too much: Curvilinear relationship between anchor body movements and sales in live streaming e-commerce," Journal of Retailing and Consumer Services, Elsevier, vol. 84(C).
    16. Zhou, Yuanyuan & Fei, Zhuoying & Yang, Jun & Kong, Demei, 2025. "Serve with voice: The role of agents’ vocal cues in the call center service," Journal of Business Research, Elsevier, vol. 192(C).
    17. Ma, Liye & Sun, Baohong, 2020. "Machine learning and AI in marketing – Connecting computing power to human insights," International Journal of Research in Marketing, Elsevier, vol. 37(3), pages 481-504.
    18. Holmlund, Maria & Van Vaerenbergh, Yves & Ciuchita, Robert & Ravald, Annika & Sarantopoulos, Panagiotis & Ordenes, Francisco Villarroel & Zaki, Mohamed, 2020. "Customer experience management in the age of big data analytics: A strategic framework," Journal of Business Research, Elsevier, vol. 116(C), pages 356-365.
    19. Bitty Balducci & Detelina Marinova, 2018. "Unstructured data in marketing," Journal of the Academy of Marketing Science, Springer, vol. 46(4), pages 557-590, July.
    20. Blasco-Arcas, Lorena & Lee, Hsin-Hsuan Meg & Kastanakis, Minas N. & Alcañiz, Mariano & Reyes-Menendez, Ana, 2022. "The role of consumer data in marketing: A research agenda," Journal of Business Research, Elsevier, vol. 146(C), pages 436-452.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:63nbc_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.