IDEAS home Printed from https://ideas.repec.org/a/cog/meanco/v8y2020i3p153-163.html
   My bibliography  Save this article

What Is Important When We Evaluate Movies? Insights from Computational Analysis of Online Reviews

Author

Listed:
  • Frank M. Schneider

    (Institute for Media and Communication Studies, University of Mannheim, Germany)

  • Emese Domahidi

    (Institute for Media and Communication Science, TU Ilmenau, Germany)

  • Felix Dietrich

    (Institute for Media and Communication Studies, University of Mannheim, Germany)

Abstract

The question of what is important when we evaluate movies is crucial for understanding how lay audiences experience and evaluate entertainment products such as films. In line with this, subjective movie evaluation criteria (SMEC) have been conceptualized as mental representations of important attitudes toward specific film features. Based on exploratory and confirmatory factor analyses of self-report data from online surveys, previous research has found and validated eight dimensions. Given the large-scale evaluative information that is available in online users’ comments in movie databases, it seems likely that what online users write about movies may enrich our knowledge about SMEC. As a first fully exploratory attempt, drawing on an open-source dataset including movie reviews from IMDb, we estimated a correlated topic model to explore the underlying topics of those reviews. In 35,136 online movie reviews, the most prevalent topics tapped into three major categories—Hedonism, Actors’ Performance, and Narrative—and indicated what reviewers mostly wrote about. Although a qualitative analysis of the reviews revealed that users mention certain SMEC, results of the topic model covered only two SMEC: Story Innovation and Light-heartedness. Implications for SMEC and entertainment research are discussed.

Suggested Citation

  • Frank M. Schneider & Emese Domahidi & Felix Dietrich, 2020. "What Is Important When We Evaluate Movies? Insights from Computational Analysis of Online Reviews," Media and Communication, Cogitatio Press, vol. 8(3), pages 153-163.
  • Handle: RePEc:cog:meanco:v8:y:2020:i:3:p:153-163
    DOI: 10.17645/mac.v8i3.3134
    as

    Download full text from publisher

    File URL: https://www.cogitatiopress.com/mediaandcommunication/article/view/3134
    Download Restriction: no

    File URL: https://libkey.io/10.17645/mac.v8i3.3134?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Grün, Bettina & Hornik, Kurt, 2011. "topicmodels: An R Package for Fitting Topic Models," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 40(i13).
    2. Jehoshua Eliashberg & Jedid-Jah Jonker & Mohanbir S. Sawhney & Berend Wierenga, 2000. "MOVIEMOD: An Implementable Decision-Support System for Prerelease Market Evaluation of Motion Pictures," Marketing Science, INFORMS, vol. 19(3), pages 226-243, January.
    3. Pradeep K. Chintagunta & Shyam Gopinath & Sriram Venkataraman, 2010. "The Effects of Online User Reviews on Movie Box Office Performance: Accounting for Sequential Rollout and Aggregation Across Local Markets," Marketing Science, INFORMS, vol. 29(5), pages 944-957, 09-10.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Frank M. Schneider & Emese Domahidi & Felix Dietrich, 2020. "What Is Important When We Evaluate Movies? Insights from Computational Analysis of Online Reviews," Media and Communication, Cogitatio Press, vol. 8(3), pages 153-163.
    2. Jason M. T. Roos & Ron Shachar, 2014. "When Kerry Met Sally: Politics and Perceptions in the Demand for Movies," Management Science, INFORMS, vol. 60(7), pages 1617-1631, July.
    3. Warut Khern-am-nuai & Karthik Kannan & Hossein Ghasemkhani, 2018. "Extrinsic versus Intrinsic Rewards for Contributing Reviews in an Online Platform," Information Systems Research, INFORMS, vol. 29(4), pages 871-892, December.
    4. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    5. Kim, Taegu & Hong, Jungsik & Kang, Pilsung, 2015. "Box office forecasting using machine learning algorithms based on SNS data," International Journal of Forecasting, Elsevier, vol. 31(2), pages 364-390.
    6. Moez Hababou & Nawel Amrouche & Kamel Jedidi, 2016. "Measuring Economic Efficiency in the Motion Picture Industry: a Data Envelopment Analysis Approach," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 3(3), pages 144-158, December.
    7. Huang Dongling & Strijnev Andrei & Ratchford Brian, 2015. "Role of Advertising and Consumer Interest in the Motion Picture Industry," Review of Marketing Science, De Gruyter, vol. 13(1), pages 1-40, November.
    8. Daekook Kang, 2021. "Box-office forecasting in Korea using search trend data: a modified generalized Bass diffusion model," Electronic Commerce Research, Springer, vol. 21(1), pages 41-72, March.
    9. Shijie Lu & Xin (Shane) Wang & Neil Bendle, 2020. "Does Piracy Create Online Word of Mouth? An Empirical Analysis in the Movie Industry," Management Science, INFORMS, vol. 66(5), pages 2140-2162, May.
    10. Sumit Raut & Sanjeev Swami & Eunkyu Lee & Charles B. Weinberg, 2008. "How Complex Do Movie Channel Contracts Need to Be?," Marketing Science, INFORMS, vol. 27(4), pages 627-641, 07-08.
    11. Cho, Daegon & Hwang, Youngdeok & Park, Jongwon, 2018. "More buzz, more vibes: Impact of social media on concert distribution," Journal of Economic Behavior & Organization, Elsevier, vol. 156(C), pages 103-113.
    12. Tingting Song & Jinghua Huang & Yong Tan & Yifan Yu, 2019. "Using User- and Marketer-Generated Content for Box Office Revenue Prediction: Differences Between Microblogging and Third-Party Platforms," Service Science, INFORMS, vol. 30(1), pages 191-203, March.
    13. Khim-Yong Goh & Cheng-Suang Heng & Zhijie Lin, 2013. "Social Media Brand Community and Consumer Behavior: Quantifying the Relative Impact of User- and Marketer-Generated Content," Information Systems Research, INFORMS, vol. 24(1), pages 88-107, March.
    14. Pengkun Wu & Eric W. T. Ngai & Yuanyuan Wu, 2023. "Impact of praise cashback strategy: Implications for consumers and e‐businesses," Production and Operations Management, Production and Operations Management Society, vol. 32(9), pages 2825-2845, September.
    15. Maksym Polyakov & Morteza Chalak & Md. Sayed Iftekhar & Ram Pandit & Sorada Tapsuwan & Fan Zhang & Chunbo Ma, 2018. "Authorship, Collaboration, Topics, and Research Gaps in Environmental and Resource Economics 1991–2015," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 71(1), pages 217-239, September.
    16. Martin Baumgaertner & Johannes Zahner, 2021. "Whatever it takes to understand a central banker - Embedding their words using neural networks," MAGKS Papers on Economics 202130, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    17. Kaushik, Kapil & Mishra, Rajhans & Rana, Nripendra P. & Dwivedi, Yogesh K., 2018. "Exploring reviews and review sequences on e-commerce platform: A study of helpful reviews on Amazon.in," Journal of Retailing and Consumer Services, Elsevier, vol. 45(C), pages 21-32.
    18. Cui, Geng & Chung, Yuho & Peng, Ling & Wang, Qiaofei, 2024. "Clicks for money: Predicting video views through a sentiment analysis of titles and thumbnails," Journal of Business Research, Elsevier, vol. 183(C).
    19. Daoud, Adel & Kohl, Sebastian, 2016. "How much do sociologists write about economic topics? Using big data to test some conventional views in economic sociology, 1890 to 2014," MPIfG Discussion Paper 16/7, Max Planck Institute for the Study of Societies.
    20. Cardinale, Roberto & Cardinale, Ivano & Zupic, Ivan, 2024. "The EU's vulnerability to gas price and supply shocks: The role of mismatches between policy beliefs and changing international gas markets," Energy Economics, Elsevier, vol. 131(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cog:meanco:v8:y:2020:i:3:p:153-163. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: António Vieira or IT Department (email available below). General contact details of provider: https://www.cogitatiopress.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.