IDEAS home Printed from https://ideas.repec.org/a/eee/joreco/v84y2025ics0969698925000402.html
   My bibliography  Save this article

Exploring multimodal factors in online reviews: A machine learning approach to evaluating content effectiveness

Author

Listed:
  • Zhang, Yuhao
  • Li, Qianru
  • Yan, Jinzhe

Abstract

Previous studies on online usefulness have focused on a single information modality's review and reviewer features. However, studies investigating the interaction of multimodal information features are limited. This study integrates the Elaboration Likelihood Model, media richness theory, and dual coding theory, leveraging text mining and image processing techniques to propose a multimodal information fusion model. The model evaluates the impact of review text quality (comprehensiveness, clarity, and readability) and the aesthetic quality of review photos on perceived usefulness. We analyzed data from 34,890 reviews and 126,675 images on the Yelp platform using natural language processing and machine learning, alongside econometric modeling approaches, to investigate bimodal factors' independent and interactive mechanisms. Our findings indicate that both review text quality and photo aesthetic quality significantly and positively influence review usefulness independently. Additionally, their interaction plays a crucial role in enhancing perceived usefulness. This study offers a novel theoretical perspective on how multimodal information affects consumer information processing and provides practical recommendations for online review platforms, reviewers, and businesses.

Suggested Citation

  • Zhang, Yuhao & Li, Qianru & Yan, Jinzhe, 2025. "Exploring multimodal factors in online reviews: A machine learning approach to evaluating content effectiveness," Journal of Retailing and Consumer Services, Elsevier, vol. 84(C).
    • Handle: RePEc:eee:joreco:v:84:y:2025:i:c:s0969698925000402
    DOI: 10.1016/j.jretconser.2025.104261
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0969698925000402
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jretconser.2025.104261?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kim, Molan & Lee, Seung Min & Choi, Sanghak & Kim, Sang Yong, 2021. "Impact of visual information on online consumer review behavior: Evidence from a hotel booking website," Journal of Retailing and Consumer Services, Elsevier, vol. 60(C).
    2. Shunyuan Zhang & Dokyun Lee & Param Vir Singh & Kannan Srinivasan, 2022. "What Makes a Good Image? Airbnb Demand Analytics Leveraging Interpretable Image Features," Management Science, INFORMS, vol. 68(8), pages 5644-5666, August.
    3. Ganguly, Boudhayan & Sengupta, Pooja & Biswas, Baidyanath, 2024. "What are the significant determinants of helpfulness of online review? An exploration across product-types," Journal of Retailing and Consumer Services, Elsevier, vol. 78(C).
    4. Fang, Bin & Ye, Qiang & Kucukusta, Deniz & Law, Rob, 2016. "Analysis of the perceived value of online tourism reviews: Influence of readability and reviewer characteristics," Tourism Management, Elsevier, vol. 52(C), pages 498-506.
    5. Srivastava, Vartika & Kalro, Arti D., 2019. "Enhancing the Helpfulness of Online Consumer Reviews: The Role of Latent (Content) Factors," Journal of Interactive Marketing, Elsevier, vol. 48(C), pages 33-50.
    6. Yi, Jisu & Oh, Yun Kyung, 2022. "The informational value of multi-attribute online consumer reviews: A text mining approach," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    7. Longstreet, Phil & Valacich, Joseph & Wells, John, 2021. "Towards an understanding of online visual aesthetics: An instantiation of the composition perspective," Technology in Society, Elsevier, vol. 65(C).
    8. Lei Lei & Sheng Yan, 2016. "Readability and citations in information science: evidence from abstracts and articles of four journals (2003–2012)," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1155-1169, September.
    9. Malcolm Smith & Richard Taffler, 1992. "Readability and Understandability: Different Measures of the Textual Complexity of Accounting Narrative," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 5(4), pages 1-1, December.
    10. Cai, Xiaowei & Cebollada, Javier & Cortiñas, Mónica, 2023. "Impact of seller- and buyer-created content on product sales in the electronic commerce platform: The role of informativeness, readability, multimedia richness, and extreme valence," Journal of Retailing and Consumer Services, Elsevier, vol. 70(C).
    11. Mohammadreza Mousavizadeh & Mehrdad Koohikamali & Mohammad Salehan & Dam J. Kim, 2022. "An Investigation of Peripheral and Central Cues of Online Customer Review Voting and Helpfulness through the Lens of Elaboration Likelihood Model," Information Systems Frontiers, Springer, vol. 24(1), pages 211-231, February.
    12. Navid Aghakhani & Onook Oh & Dawn Gregg & Hemant Jain, 2023. "How Review Quality and Source Credibility Interacts to Affect Review Usefulness: An Expansion of the Elaboration Likelihood Model," Information Systems Frontiers, Springer, vol. 25(4), pages 1513-1531, August.
    13. Yi Liu & Han-Fen Hu, 2021. "Online review helpfulness: the moderating effects of review comprehensiveness," Post-Print hal-03182905, HAL.
    14. Yubo Chen & Jinhong Xie, 2008. "Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix," Management Science, INFORMS, vol. 54(3), pages 477-491, March.
    15. Kumar, Avinash & Chakraborty, Shibashish & Bala, Pradip Kumar, 2023. "Text mining approach to explore determinants of grocery mobile app satisfaction using online customer reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    16. Narwal, Preeti & Nayak, J.K., 2020. "How consumers form product quality perceptions in absence of fixed posted prices: Interaction of product cues with seller reputation and third-party reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 52(C).
    17. Yi, Jisu & Kim, Jongdae & Oh, Yun Kyung, 2024. "Uncovering the quality factors driving the success of mobile payment apps," Journal of Retailing and Consumer Services, Elsevier, vol. 77(C).
    18. Olga Dziubaniuk & Wilhelm Barner-Rasmussen & Nikolina Koporcic & Maria Ivanova-Gongne & Tibor Mandják & Stefan Markovic, 2021. "Business-to-business marketing research: Assessing readability and discussing relevance to practitioners," Post-Print hal-05013195, HAL.
    19. Richard L. Daft & Robert H. Lengel, 1986. "Organizational Information Requirements, Media Richness and Structural Design," Management Science, INFORMS, vol. 32(5), pages 554-571, May.
    20. repec:eme:aaaj00:09513579210019549 is not listed on IDEAS
    21. Pan, Yue & Zhang, Jason Q., 2011. "Born Unequal: A Study of the Helpfulness of User-Generated Product Reviews," Journal of Retailing, Elsevier, vol. 87(4), pages 598-612.
    22. Moro, Sérgio & Pires, Guilherme & Rita, Paulo & Cortez, Paulo, 2019. "A text mining and topic modelling perspective of ethnic marketing research," Journal of Business Research, Elsevier, vol. 103(C), pages 275-285.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chuanmei Zhou & Shuiqing Yang & Yuangao Chen & Shasha Zhou & Yixiao Li & Atika Qazi, 2023. "How does topic consistency affect online review helpfulness? The role of review emotional intensity," Electronic Commerce Research, Springer, vol. 23(4), pages 2943-2978, December.
    2. Raoofpanah, Iman & Zamudio, César & Groening, Christopher, 2023. "Review reader segmentation based on the heterogeneous impacts of review and reviewer attributes on review helpfulness: A study involving ZIP code data," Journal of Retailing and Consumer Services, Elsevier, vol. 72(C).
    3. Wanshu Niu & Liqiang Huang & Xixi Li & Jie Zhang & Mingliang Chen, 2023. "Beyond the review information: an investigation of individual- and group-based presentation forms of review information," Information Technology and Management, Springer, vol. 24(2), pages 159-176, June.
    4. Shan, Wei & Wang, Jiaxuan & Shi, Xiaoxiao & David Evans, Richard, 2024. "The impact of electronic word-of-mouth on patients’ choices in online health communities: A cross-media perspective," Journal of Business Research, Elsevier, vol. 173(C).
    5. Yi, Jisu & Oh, Yun Kyung, 2022. "The informational value of multi-attribute online consumer reviews: A text mining approach," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    6. Pooja Katyal & Reetika Sehgal, 2025. "Unraveling the impact of online consumer reviews on consumer buying behavior," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 16(1), pages 330-345, January.
    7. Moqbel, Murad & Jain, Aarushi, 2025. "Mining the truth: A text mining approach to understanding perceived deceptive counterfeits and online ratings," Journal of Retailing and Consumer Services, Elsevier, vol. 84(C).
    8. Zhang, Ruonan & Yu, Zhaoyang & Yao, Weiran, 2024. "Navigating the complexities of online opinion formation: An insight into consumer cognitive heuristics," Journal of Retailing and Consumer Services, Elsevier, vol. 81(C).
    9. Lutz, Bernhard & Pröllochs, Nicolas & Neumann, Dirk, 2022. "Are longer reviews always more helpful? Disentangling the interplay between review length and line of argumentation," Journal of Business Research, Elsevier, vol. 144(C), pages 888-901.
    10. Cai, Xiaowei & Cebollada, Javier & Cortiñas, Mónica, 2023. "Impact of seller- and buyer-created content on product sales in the electronic commerce platform: The role of informativeness, readability, multimedia richness, and extreme valence," Journal of Retailing and Consumer Services, Elsevier, vol. 70(C).
    11. Yi, Jisu & Oh, Yun Kyung & Kim, Jung-Min, 2025. "Unveiling the drivers of satisfaction in mobile trading: Contextual mining of retail investor experience through BERTopic and generative AI," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    12. Swagato Chatterjee, 2025. "Effect of construal level on the drivers of online-review-helpfulness," Electronic Commerce Research, Springer, vol. 25(2), pages 1115-1143, April.
    13. Rosillo-Díaz, Elena & Muñoz-Rosas, Juan Francisco & Blanco-Encomienda, Francisco Javier, 2024. "Impact of heuristic–systematic cues on the purchase intention of the electronic commerce consumer through the perception of product quality," Journal of Retailing and Consumer Services, Elsevier, vol. 81(C).
    14. Bai, Ye & Yu-Buck, Grace, 2025. "Identifying targeted needs from online marketer- and user-generated data," Journal of Retailing and Consumer Services, Elsevier, vol. 84(C).
    15. Moradi, Masoud & Dass, Mayukh & Kumar, Piyush, 2023. "Differential effects of analytical versus emotional rhetorical style on review helpfulness," Journal of Business Research, Elsevier, vol. 154(C).
    16. Wang, Feng & Liu, Xuefeng & Fang, Eric (Er), 2015. "User Reviews Variance, Critic Reviews Variance, and Product Sales: An Exploration of Customer Breadth and Depth Effects," Journal of Retailing, Elsevier, vol. 91(3), pages 372-389.
    17. Yani Wang & Jun Wang & Tang Yao, 2019. "What makes a helpful online review? A meta-analysis of review characteristics," Electronic Commerce Research, Springer, vol. 19(2), pages 257-284, June.
    18. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    19. Guha Majumder, Madhumita & Dutta Gupta, Sangita & Paul, Justin, 2022. "Perceived usefulness of online customer reviews: A review mining approach using machine learning & exploratory data analysis," Journal of Business Research, Elsevier, vol. 150(C), pages 147-164.
    20. Raffaele Filieri & Elisabetta Raguseo & Claudio Vitari, 2018. "What moderates the influence of extremely negative ratings? The role of review and reviewer characteristics," Post-Print halshs-01923196, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joreco:v:84:y:2025:i:c:s0969698925000402. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-retailing-and-consumer-services .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.