IDEAS home Printed from https://ideas.repec.org/a/eee/ijrema/v40y2023i1p164-188.html

Automated inference of product attributes and their importance from user-generated content: Can we replace traditional market research?

Author

Listed:
  • Roelen-Blasberg, Tobias
  • Habel, Johannes
  • Klarmann, Martin

Abstract

User-generated content, particularly online product reviews by customers, provide marketers with rich data of customer evaluations of product attributes. This study proposes, benchmarks, and validates a new approach for inferring attribute-level evaluations from user-generated content. Moreover, little is known about whether and when insights from product reviews gained in such a way are consistent with traditional research methods, such as conjoint analysis and satisfaction driver analysis. To provide first insights into this question, the authors apply their approach to a dataset with almost one million product reviews from 52 product categories and run conjoint and satisfaction driver analyses for these categories. Results indicate that the consistency between methods largely varies across product categories. Initial exploratory analyses suggest that consistency might be higher for categories characterized by low experience qualities, high hedonic value, and high customer willingness to post online reviews—but further work will be necessary to validate these findings.

Suggested Citation

  • Roelen-Blasberg, Tobias & Habel, Johannes & Klarmann, Martin, 2023. "Automated inference of product attributes and their importance from user-generated content: Can we replace traditional market research?," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 164-188.
  • Handle: RePEc:eee:ijrema:v:40:y:2023:i:1:p:164-188
    DOI: 10.1016/j.ijresmar.2022.04.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167811622000246
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijresmar.2022.04.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Artem Timoshenko & John R. Hauser, 2019. "Identifying Customer Needs from User-Generated Content," Marketing Science, INFORMS, vol. 38(1), pages 1-20, January.
    2. Moon, Sangkil & Kamakura, Wagner A., 2017. "A picture is worth a thousand words: Translating product reviews into a product positioning map," International Journal of Research in Marketing, Elsevier, vol. 34(1), pages 265-285.
    3. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Management Science, INFORMS, vol. 57(8), pages 1485-1509, August.
    4. Jean-Noël Kapferer & Gilles Laurent, 1993. "Further evidence on the consumer involvement profile: five antecedents of involvement," Post-Print hal-00784124, HAL.
    5. Nelson, Phillip, 1970. "Information and Consumer Behavior," Journal of Political Economy, University of Chicago Press, vol. 78(2), pages 311-329, March-Apr.
    6. Decker, Reinhold & Trusov, Michael, 2010. "Estimating aggregate consumer preferences from online product reviews," International Journal of Research in Marketing, Elsevier, vol. 27(4), pages 293-307.
    7. Reimann, Martin & Schilke, Oliver & Thomas, Jacquelyn S., 2010. "Toward an understanding of industry commoditization: Its nature and role in evolving marketing competition," International Journal of Research in Marketing, Elsevier, vol. 27(2), pages 188-197.
    8. Nelson, Philip, 1974. "Advertising as Information," Journal of Political Economy, University of Chicago Press, vol. 82(4), pages 729-754, July/Aug..
    9. Wendy W. Moe & David A. Schweidel, 2012. "Online Product Opinions: Incidence, Evaluation, and Evolution," Marketing Science, INFORMS, vol. 31(3), pages 372-386, May.
    10. Matt Taddy, 2013. "Multinomial Inverse Regression for Text Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(503), pages 755-770, September.
    11. Joachim Büschken & Thomas Otter & Greg M. Allenby, 2013. "The Dimensionality of Customer Satisfaction Survey Responses and Implications for Driver Analysis," Marketing Science, INFORMS, vol. 32(4), pages 533-553, July.
    12. Holbrook, Morris B, et al, 1984. "Play as a Consumption Experience: The Roles of Emotions, Performance, and Personality in the Enjoyment of Games," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 11(2), pages 728-739, September.
    13. Jean-Noël Kapferer & Gilles Laurent, 1985. "Measuring consumer involvement profiles," Post-Print hal-00786781, HAL.
    14. Ishita Chakraborty & Minkyung Kim & K. Sudhir, 2019. "Attribute Sentiment Scoring With Online Text Reviews : Accounting for Language Structure and Attribute Self-Selection," Cowles Foundation Discussion Papers 2176R2, Cowles Foundation for Research in Economics, Yale University, revised Jun 2021.
    15. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    16. Joachim Büschken & Greg M. Allenby, 2016. "Sentence-Based Text Analysis for Customer Reviews," Marketing Science, INFORMS, vol. 35(6), pages 953-975, November.
    17. Daria Dzyabura & Srikanth Jagabathula & Eitan Muller, 2019. "Accounting for Discrepancies Between Online and Offline Product Evaluations," Marketing Science, INFORMS, vol. 38(1), pages 88-106, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gensler, Sonja & Oehring, Karlo & Wiesel, Thorsten, 2024. "Reported and communicated shifts in strategic emphasis and firm performance," International Journal of Research in Marketing, Elsevier, vol. 41(2), pages 220-240.
    2. Mustak, Mekhail & Hallikainen, Heli & Laukkanen, Tommi & Plé, Loïc & Hollebeek, Linda D. & Aleem, Majid, 2024. "Using machine learning to develop customer insights from user-generated content," Journal of Retailing and Consumer Services, Elsevier, vol. 81(C).
    3. Friess, Maximilian & Haumann, Till & Alavi, Sascha & Ionut Oproiescu, Alexandru & Schmitz, Christian & Wieseke, Jan, 2024. "The contingent effects of innovative digital sales technologies on B2B firms’ financial performance," International Journal of Research in Marketing, Elsevier, vol. 41(4), pages 703-723.
    4. Kadić-Maglajlić, Selma & Lages, Cristiana R. & Pantano, Eleonora, 2024. "No time to lie: Examining the identity of pro-vaccination and anti-vaccination supporters through user-generated content," Social Science & Medicine, Elsevier, vol. 347(C).
    5. Anna Kuikka & Heli Hallikainen & Sasu Tuominen & Tommi Laukkanen, 2025. "What drives customer loyalty in a pandemic? Semantic analysis of grocery retailers," Electronic Commerce Research, Springer, vol. 25(3), pages 2205-2240, June.
    6. Gonzalez, Gabriel R. & Habel, Johannes & Hunter, Gary K., 2026. "AI agents, agentic AI, and the future of sales," Journal of Business Research, Elsevier, vol. 202(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carlson, Keith & Kopalle, Praveen K. & Riddell, Allen & Rockmore, Daniel & Vana, Prasad, 2023. "Complementing human effort in online reviews: A deep learning approach to automatic content generation and review synthesis," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 54-74.
    2. Cao, Jingcun & Li, Xiaolin & Zhang, Lingling, 2025. "Is relevancy everything? A deep-learning approach to understand the effect of image-text congruence," LSE Research Online Documents on Economics 128215, London School of Economics and Political Science, LSE Library.
    3. Bitty Balducci & Detelina Marinova, 2018. "Unstructured data in marketing," Journal of the Academy of Marketing Science, Springer, vol. 46(4), pages 557-590, July.
    4. Alantari, Huwail J. & Currim, Imran S. & Deng, Yiting & Singh, Sameer, 2022. "An empirical comparison of machine learning methods for text-based sentiment analysis of online consumer reviews," International Journal of Research in Marketing, Elsevier, vol. 39(1), pages 1-19.
    5. Klostermann, Jan & Plumeyer, Anja & Böger, Daniel & Decker, Reinhold, 2018. "Extracting brand information from social networks: Integrating image, text, and social tagging data," International Journal of Research in Marketing, Elsevier, vol. 35(4), pages 538-556.
    6. Hasmat Malik & Asyraf Afthanorhan & Noor Aina Amirah & Nuzhat Fatema, 2021. "Machine Learning Approach for Targeting and Recommending a Product for Project Management," Mathematics, MDPI, vol. 9(16), pages 1-29, August.
    7. Jingcun Cao & Xiaolin Li & Lingling Zhang, 2025. "Is Relevancy Everything? A Deep-Learning Approach to Understand the Effect of Image-Text Congruence," Management Science, INFORMS, vol. 71(12), pages 10579-10602, December.
    8. Aydin Gokgoz, Zeynep & Ataman, M. Berk & van Bruggen, Gerrit H., 2025. "If it ain’t broke, should you still fix it? Effects of incorporating user feedback in product development on mobile application ratings," International Journal of Research in Marketing, Elsevier, vol. 42(2), pages 467-486.
    9. Peiyu Chen & Lorin M. Hitt & Yili Hong & Shinyi Wu, 2021. "Measuring Product Type and Purchase Uncertainty with Online Product Ratings: A Theoretical Model and Empirical Application," Information Systems Research, INFORMS, vol. 32(4), pages 1470-1489, December.
    10. Jiyeon Hong & Paul R. Hoban, 2022. "Writing More Compelling Creative Appeals: A Deep Learning-Based Approach," Marketing Science, INFORMS, vol. 41(5), pages 941-965, September.
    11. Subrahmanyam Aditya Karanam & Ashish Agarwal & Anitesh Barua, 2025. "Follow Your Heart or Listen to Users? The Case of Mobile App Design," Information Systems Research, INFORMS, vol. 36(3), pages 1846-1870, September.
    12. Engler, Tobias H. & Winter, Patrick & Schulz, Michael, 2015. "Understanding online product ratings: A customer satisfaction model," Journal of Retailing and Consumer Services, Elsevier, vol. 27(C), pages 113-120.
    13. Hallie S. Cho & Manuel E. Sosa & Sameer Hasija, 2022. "Reading Between the Stars: Understanding the Effects of Online Customer Reviews on Product Demand," Manufacturing & Service Operations Management, INFORMS, vol. 24(4), pages 1977-1996, July.
    14. Christof Naumzik & Stefan Feuerriegel & Markus Weinmann, 2022. "I Will Survive: Predicting Business Failures from Customer Ratings," Marketing Science, INFORMS, vol. 41(1), pages 188-207, January.
    15. Boegershausen, Johannes & Datta, Hannes & Borah, Abhishek & Stephen, Andrew, 2022. "Fields of Gold: Web Scraping and APIs for Impactful Marketing Insights," Other publications TiSEM 5f1ed70a-48c3-422c-bc10-0, Tilburg University, School of Economics and Management.
    16. Dinesh Puranam & Vishal Narayan & Vrinda Kadiyali, 2017. "The Effect of Calorie Posting Regulation on Consumer Opinion: A Flexible Latent Dirichlet Allocation Model with Informative Priors," Marketing Science, INFORMS, vol. 36(5), pages 726-746, September.
    17. Shimi Naurin Ahmad & Michel Laroche, 2023. "Extracting marketing information from product reviews: a comparative study of latent semantic analysis and probabilistic latent semantic analysis," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(4), pages 662-676, December.
    18. Jianwei Liu & Karen Xie & Wei Chen & Yong Liu & Yunlong Sun, 2023. "How incumbents beat disruption? Evidence from hotel responses to home sharing," Production and Operations Management, Production and Operations Management Society, vol. 32(9), pages 2758-2774, September.
    19. Baier, Daniel & Karasenko, Andreas & Rese, Alexandra, 2025. "Measuring technology acceptance over time using transfer models based on online customer reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 85(C).
    20. Dokyun “DK” Lee & Zhaoqi “ZQ” Cheng & Chengfeng Mao & Emaad Manzoor, 2025. "Guided Diverse Concept Miner (GDCM): Uncovering Relevant Constructs for Managerial Insights from Text," Information Systems Research, INFORMS, vol. 36(1), pages 370-393, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijrema:v:40:y:2023:i:1:p:164-188. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-research-in-marketing/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.