IDEAS home Printed from https://ideas.repec.org/a/eee/joreco/v82y2025ics0969698924004326.html
   My bibliography  Save this article

The impact of multimodal information features of short sales videos on consumer engagement behavior: A multi-method approach

Author

Listed:
  • Xiao, Quan
  • Huang, Weiling
  • Qu, Lu
  • Li, Xia

Abstract

In the emerging business model of short video commerce, consumers can engage in short sales videos by liking, commenting, and sharing. Compared with traditional shopping contexts, consumer engagement behavior in short video commerce settings is affected quickly and simultaneously by text, audio, and visual information, but the extant literature lacks sufficient exploration of the effects of such multimodal information. Based on the multimodal theory and signaling theory, this study aims to investigate the role of multimodal information including textual sentiment score, audio spectrum and visual effects of short sales videos on consumer engagement behavior. We collect 4292 veridical short sales videos from short video platform Douyin, while based on a multi-method approach of multiple regression analysis (MRA) and fuzzy set qualitative comparative analysis (fsQCA), it is found that the multimodal information features of short sales videos contribute to the promotion of consumer engagement behavior, and the cross-modal configurational solutions to enhance engagement is not unique. This study bridges the gap in the existing literature by capturing the impact of multimodal information features on consumer engagement behaviors and their asymmetric effects, which also provides practical implications for sellers and marketers on attracting consumers to engage in short video commerce.

Suggested Citation

  • Xiao, Quan & Huang, Weiling & Qu, Lu & Li, Xia, 2025. "The impact of multimodal information features of short sales videos on consumer engagement behavior: A multi-method approach," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    • Handle: RePEc:eee:joreco:v:82:y:2025:i:c:s0969698924004326
    DOI: 10.1016/j.jretconser.2024.104136
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0969698924004326
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jretconser.2024.104136?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mele, Emanuele & Filieri, Raffaele & De Carlo, Manuela, 2023. "Pictures of a crisis. Destination marketing organizations’ Instagram communication before and during a global health crisis," Journal of Business Research, Elsevier, vol. 163(C).
    2. Roy, Sanjit Kumar & Balaji, M.S. & Soutar, Geoff & Lassar, Walfried M. & Roy, Rajat, 2018. "Customer engagement behavior in individualistic and collectivistic markets," Journal of Business Research, Elsevier, vol. 86(C), pages 281-290.
    3. Xie, Xuemei & Wang, Hongwei, 2020. "How can open innovation ecosystem modes push product innovation forward? An fsQCA analysis," Journal of Business Research, Elsevier, vol. 108(C), pages 29-41.
    4. Lim, Weng Marc & Rasul, Tareq & Kumar, Satish & Ala, Mamun, 2022. "Past, present, and future of customer engagement," Journal of Business Research, Elsevier, vol. 140(C), pages 439-458.
    5. Dongmei Li & Ung T’chiang Chow & Cecilia Yin Mei Cheong, 2022. "A Critical Genre Analysis of Covert Advertising Through Short-Videos in Douyin: The Chinese Version of Tik-Tok," SAGE Open, , vol. 12(4), pages 21582440221, November.
    6. E. Mele & R. Filieri & M. de Carlo, 2023. "Pictures of a crisis. Destination marketing organizations’ Instagram communication before and during a global health crisis," Post-Print hal-04781819, HAL.
    7. Wang, Qiuzhen & Ma, Da & Chen, Hanyue & Ye, Xuhong & Xu, Qing, 2020. "Effects of background complexity on consumer visual processing: An eye-tracking study," Journal of Business Research, Elsevier, vol. 111(C), pages 270-280.
    8. Harrigan, Paul & Evers, Uwana & Miles, Morgan P. & Daly, Tim, 2018. "Customer engagement and the relationship between involvement, engagement, self-brand connection and brand usage intent," Journal of Business Research, Elsevier, vol. 88(C), pages 388-396.
    9. Tong, Xinjia & Chen, Yuangao & Zhou, Shasha & Yang, Shuiqing, 2022. "How background visual complexity influences purchase intention in live streaming: The mediating role of emotion and the moderating role of gender," Journal of Retailing and Consumer Services, Elsevier, vol. 67(C).
    10. Giovanni Luca Cascio Rizzo & Jonah Berger & Matteo De Angelis & Rumen Pozharliev & Andrew T Stephen & Jacob Goldenberg, 2023. "How Sensory Language Shapes Influencer’s Impact," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 50(4), pages 810-825.
    11. Jo Thori Lind & Halvor Mehlum, 2010. "With or Without U? The Appropriate Test for a U‐Shaped Relationship," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 72(1), pages 109-118, February.
    12. Arora, Anuja & Bansal, Shivam & Kandpal, Chandrashekhar & Aswani, Reema & Dwivedi, Yogesh, 2019. "Measuring social media influencer index- insights from facebook, Twitter and Instagram," Journal of Retailing and Consumer Services, Elsevier, vol. 49(C), pages 86-101.
    13. Kaya, Bahar & Abubakar, A. Mohammed & Behravesh, Elaheh & Yildiz, Harun & Mert, Ibrahim Sani, 2020. "Antecedents of innovative performance: Findings from PLS-SEM and fuzzy sets (fsQCA)," Journal of Business Research, Elsevier, vol. 114(C), pages 278-289.
    14. Wu, Pei-Ling & Yeh, Shih-Shuo & Huan, Tzung-Cheng (.T.C.). & Woodside, Arch G., 2014. "Applying complexity theory to deepen service dominant logic: Configural analysis of customer experience-and-outcome assessments of professional services for personal transformations," Journal of Business Research, Elsevier, vol. 67(8), pages 1647-1670.
    15. Xiao, Lin & Li, Xiaofeng & Zhang, Yucheng, 2023. "Exploring the factors influencing consumer engagement behavior regarding short-form video advertising: A big data perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 70(C).
    16. Tafesse, Wondwesen & Wood, Bronwyn P., 2021. "Followers' engagement with instagram influencers: The role of influencers’ content and engagement strategy," Journal of Retailing and Consumer Services, Elsevier, vol. 58(C).
    17. Kumbure, Mahinda Mailagaha & Tarkiainen, Anssi & Luukka, Pasi & Stoklasa, Jan & Jantunen, Ari, 2020. "Relation between managerial cognition and industrial performance: An assessment with strategic cognitive maps using fuzzy-set qualitative comparative analysis," Journal of Business Research, Elsevier, vol. 114(C), pages 160-172.
    18. Oliveira, João S. & Ifie, Kemefasu & Sykora, Martin & Tsougkou, Eleni & Castro, Vitor & Elayan, Suzanne, 2022. "The effect of emotional positivity of brand-generated social media messages on consumer attention and information sharing," Journal of Business Research, Elsevier, vol. 140(C), pages 49-61.
    19. Peters, Kay & Chen, Yubo & Kaplan, Andreas M. & Ognibeni, Björn & Pauwels, Koen, 2013. "Social Media Metrics — A Framework and Guidelines for Managing Social Media," Journal of Interactive Marketing, Elsevier, vol. 27(4), pages 281-298.
    20. Hollebeek, Linda D. & Glynn, Mark S. & Brodie, Roderick J., 2014. "Consumer Brand Engagement in Social Media: Conceptualization, Scale Development and Validation," Journal of Interactive Marketing, Elsevier, vol. 28(2), pages 149-165.
    21. Liu, Xia & Shin, Hyunju & Burns, Alvin C., 2021. "Examining the impact of luxury brand's social media marketing on customer engagement​: Using big data analytics and natural language processing," Journal of Business Research, Elsevier, vol. 125(C), pages 815-826.
    22. Luo, Lijuan & Xu, Meiling & Zheng, Yujie, 2024. "Informative or affective? Exploring the effects of streamers’ topic types on user engagement in live streaming commerce," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    23. Zhang, Shengliang & Guo, Dinghao & Li, Xiaodong, 2023. "The rhythm of shopping: How background music placement in live streaming commerce affects consumer purchase intention," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    24. Linda D. Hollebeek & Rajendra K. Srivastava & Tom Chen, 2019. "Correction to: S-D logic–informed customer engagement: integrative framework, revised fundamental propositions, and application to CRM," Journal of the Academy of Marketing Science, Springer, vol. 47(1), pages 186-186, January.
    25. Dhaoui, Chedia & Webster, Cynthia M., 2021. "Brand and consumer engagement behaviors on Facebook brand pages: Let's have a (positive) conversation," International Journal of Research in Marketing, Elsevier, vol. 38(1), pages 155-175.
    26. Gligor, David & Bozkurt, Siddik, 2020. "FsQCA versus regression: The context of customer engagement," Journal of Retailing and Consumer Services, Elsevier, vol. 52(C).
    27. Kang, Kai & Lu, Jinxuan & Guo, Lingyun & Li, Wenlu, 2021. "The dynamic effect of interactivity on customer engagement behavior through tie strength: Evidence from live streaming commerce platforms," International Journal of Information Management, Elsevier, vol. 56(C).
    28. Cao, Xinyue & Qu, Zhirui & Liu, Yan & Hu, JiaJing, 2021. "How the destination short video affects the customers' attitude: The role of narrative transportation," Journal of Retailing and Consumer Services, Elsevier, vol. 62(C).
    29. Anita Pansari & V. Kumar, 2017. "Customer engagement: the construct, antecedents, and consequences," Journal of the Academy of Marketing Science, Springer, vol. 45(3), pages 294-311, May.
    30. Olya, Hossein G.T. & Altinay, Levent, 2016. "Asymmetric modeling of intention to purchase tourism weather insurance and loyalty," Journal of Business Research, Elsevier, vol. 69(8), pages 2791-2800.
    31. Linda D. Hollebeek & Rajendra K. Srivastava & Tom Chen, 2019. "S-D logic–informed customer engagement: integrative framework, revised fundamental propositions, and application to CRM," Journal of the Academy of Marketing Science, Springer, vol. 47(1), pages 161-185, January.
    32. Pappas, Ilias O. & Kourouthanassis, Panos E. & Giannakos, Michail N. & Chrissikopoulos, Vassilios, 2016. "Explaining online shopping behavior with fsQCA: The role of cognitive and affective perceptions," Journal of Business Research, Elsevier, vol. 69(2), pages 794-803.
    33. Hollebeek, Linda D. & Macky, Keith, 2019. "Digital Content Marketing's Role in Fostering Consumer Engagement, Trust, and Value: Framework, Fundamental Propositions, and Implications," Journal of Interactive Marketing, Elsevier, vol. 45(C), pages 27-41.
    34. Jianhong Gan & Si Shi & Raffaele Filieri & Wilson K.S. Leung, 2023. "Short video marketing and travel intentions: The interplay between visual perspective, visual content, and narration appeal," Post-Print hal-04779129, HAL.
    35. Mulier, Lana & Slabbinck, Hendrik & Vermeir, Iris, 2021. "This Way Up: The Effectiveness of Mobile Vertical Video Marketing," Journal of Interactive Marketing, Elsevier, vol. 55(C), pages 1-15.
    36. Zheng, Run & Li, Zhuyuan & Na, Sanggyun, 2022. "How customer engagement in the live-streaming affects purchase intention and customer acquisition, E-tailer's perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    37. Jaeyeon (Jae) Chung & Yu Ding & Ajay Kalra & Amna Kirmani & Andrew T Stephen & Sarah G Moore, 2023. "I Really Know You: How Influencers Can Increase Audience Engagement by Referencing Their Close Social Ties," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 50(4), pages 683-703.
    38. Li, Xi & Shi, Mengze & Wang, Xin (Shane), 2019. "Video mining: Measuring visual information using automatic methods," International Journal of Research in Marketing, Elsevier, vol. 36(2), pages 216-231.
    39. Qiang Zhang & Wenbo Wang & Yuxin Chen, 2020. "Frontiers: In-Consumption Social Listening with Moment-to-Moment Unstructured Data: The Case of Movie Appreciation and Live Comments," Marketing Science, INFORMS, vol. 39(2), pages 285-295, March.
    40. Tafesse, Wondwesen & Dayan, Mumin, 2023. "Content creators' participation in the creator economy: Examining the effect of creators’ content sharing frequency on user engagement behavior on digital platforms," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    41. Park, JungKun & Hong, EunPyo & Ahn, Jiseon & Hyun, Hyowon, 2023. "Role of multidimensional customer brand engagement on customer behavior for online grocery shopping," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    42. Abhijit Guha & Timna Bressgott & Dhruv Grewal & Dominik Mahr & Martin Wetzels & Elisa Schweiger, 2023. "How artificiality and intelligence affect voice assistant evaluations," Journal of the Academy of Marketing Science, Springer, vol. 51(4), pages 843-866, July.
    43. Pankaj Kumar Mohanty & Dipanjan Kumar Dey, 2020. "Consumer-Brand Engagement With E-Commerce Market Place Brands," Journal of Electronic Commerce in Organizations (JECO), IGI Global, vol. 18(3), pages 21-37, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yan, Ying & Chen, Hongquan & Shao, Bingjia & Lei, Yuanyang, 2023. "How IT affordances influence customer engagement in live streaming commerce? A dual-stage analysis of PLS-SEM and fsQCA," Journal of Retailing and Consumer Services, Elsevier, vol. 74(C).
    2. T. Ndhlovu & T. Maree, 2024. "The central role of consumer–brand engagement in product and service brand contexts," Journal of Marketing Analytics, Palgrave Macmillan, vol. 12(4), pages 944-961, December.
    3. Bazi, Saleh & Filieri, Raffaele & Gorton, Matthew, 2020. "Customers’ motivation to engage with luxury brands on social media," Journal of Business Research, Elsevier, vol. 112(C), pages 223-235.
    4. Khan, Imran, 2023. "Customer engagement outcomes in mobile applications: Self-congruence as a moderator," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    5. Islam, Jamid Ul & Hollebeek, Linda D. & Rahman, Zillur & Khan, Imran & Rasool, Aaleya, 2019. "Customer engagement in the service context: An empirical investigation of the construct, its antecedents and consequences," Journal of Retailing and Consumer Services, Elsevier, vol. 50(C), pages 277-285.
    6. Clark, Moira K. & Lages, Cristiana Raquel & Hollebeek, Linda D., 2020. "Friend or foe? Customer engagement’s value-based effects on fellow customers and the firm," Journal of Business Research, Elsevier, vol. 121(C), pages 549-556.
    7. Hollebeek, Linda D. & Belk, Russell, 2021. "Consumers’ technology-facilitated brand engagement and wellbeing: Positivist TAM/PERMA- vs. Consumer Culture Theory perspectives," International Journal of Research in Marketing, Elsevier, vol. 38(2), pages 387-401.
    8. Shi, Xiaoxiao & Evans, Richard & Shan, Wei, 2022. "Solver engagement in online crowdsourcing communities: The roles of perceived interactivity, relationship quality and psychological ownership," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    9. Lourenço, Carlos Eduardo & Hair, Joseph F. & Zambaldi, Felipe & Ponchio, Mateus Canniatti, 2022. "Consumer brand engagement concept and measurement: Toward a refined approach," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    10. Ma, Xiangyang & Chen, Hongzhong & Lang, Xiaoping & Li, Tieshan & Wu, Niwei & Duong, Bao, 2024. "Research on the impact of streamers’ linguistic emotional valence on live streaming performance in live streaming shopping environments," Journal of Retailing and Consumer Services, Elsevier, vol. 81(C).
    11. Luo, Xi & Cheah, Jun-Hwa & Hollebeek, Linda D. & Lim, Xin-Jean, 2024. "Boosting customers’ impulsive buying tendency in live-streaming commerce: The role of customer engagement and deal proneness," Journal of Retailing and Consumer Services, Elsevier, vol. 77(C).
    12. Kulikovskaja, Viktorija & Hubert, Marco & Grunert, Klaus G. & Zhao, Hong, 2023. "Driving marketing outcomes through social media-based customer engagement," Journal of Retailing and Consumer Services, Elsevier, vol. 74(C).
    13. Lim, Weng Marc & Rasul, Tareq, 2022. "Customer engagement and social media: Revisiting the past to inform the future," Journal of Business Research, Elsevier, vol. 148(C), pages 325-342.
    14. Marjeta Marolt & Hans-Dieter Zimmermann & Andreja Pucihar, 2020. "Enhancing Marketing Performance Through Enterprise-Initiated Customer Engagement," Sustainability, MDPI, vol. 12(9), pages 1-16, May.
    15. Song, Shijie & Yao, Xinlin & Zhao, Yuxiang Chris & Ba, Zhichao, 2024. "Get inspired and pay for the goods: An investigation of customer inspiration and purchase intention in livestream shopping," Journal of Retailing and Consumer Services, Elsevier, vol. 78(C).
    16. Rahman, Muhammad Sabbir & Bag, Surajit & Hossain, Md Afnan & Abdel Fattah, Fadi Abdel Muniem & Gani, Mohammad Osman & Rana, Nripendra P., 2023. "The new wave of AI-powered luxury brands online shopping experience: The role of digital multisensory cues and customers’ engagement," Journal of Retailing and Consumer Services, Elsevier, vol. 72(C).
    17. Hollebeek, Linda D. & Clark, Moira K. & Andreassen, Tor W. & Sigurdsson, Valdimar & Smith, Dale, 2020. "Virtual reality through the customer journey: Framework and propositions," Journal of Retailing and Consumer Services, Elsevier, vol. 55(C).
    18. Eberhardt, Wiebke & Brüggen, Elisabeth & Post, Thomas & Hoet, Chantal, 2021. "Engagement behavior and financial well-being: The effect of message framing in online pension communication," International Journal of Research in Marketing, Elsevier, vol. 38(2), pages 448-471.
    19. Ndhlovu, Thinkwell & Maree, Tania, 2022. "Consumer brand engagement: Refined measurement scales for product and service contexts," Journal of Business Research, Elsevier, vol. 146(C), pages 228-240.
    20. Roy, Sanjit K. & Singh, Gaganpreet & Hollebeek, Linda D. & Shabnam, Saadia & Japutra, Arnold & van Doorn, Sebastian & Ray, Subhasis & Appio, Francesco Paolo, 2024. "Smart service value: Conceptualization, scale development, and validation in the retailing context," Technovation, Elsevier, vol. 137(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joreco:v:82:y:2025:i:c:s0969698924004326. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-retailing-and-consumer-services .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.