IDEAS home Printed from https://ideas.repec.org/a/eee/tefoso/v169y2021ics0040162521002328.html
   My bibliography  Save this article

Professional reviews as service: A mix method approach to assess the value of recommender systems in the entertainment industry

Author

Listed:
  • Perano, Mirko
  • Casali, Gian Luca
  • Liu, Yulin
  • Abbate, Tindara

Abstract

As a recommender system, Metacritic (metacritic.com) quantifies and aggregates reviews of entertainment products. The metascore published by Metacritic is controversial in its process for gathering, translating, and aggregating reviews. This study aims to assess the quality of Metacritic's scoring of movie critics’ reviews. By using a mixed methods approach integrating content analysis and multilevel analysis, we found that the movie review scores assigned by Metacritic reflecting the reviews’ semantic contents, being unbiased across the critics, and differentiating the movies reviewed. The paper provides, also, both theoretical implications, referred to an original framing of professional reviews in the service science, service systems and service quality; and practical implications related to the potential customers and for the entertainment industry.

Suggested Citation

  • Perano, Mirko & Casali, Gian Luca & Liu, Yulin & Abbate, Tindara, 2021. "Professional reviews as service: A mix method approach to assess the value of recommender systems in the entertainment industry," Technological Forecasting and Social Change, Elsevier, vol. 169(C).
    • Handle: RePEc:eee:tefoso:v:169:y:2021:i:c:s0040162521002328
    DOI: 10.1016/j.techfore.2021.120800
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0040162521002328
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techfore.2021.120800?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Francesco Polese & Sergio Barile & Francesco Caputo & Luca Carrubbo & Leonard Waletzky, 2018. "Determinants for Value Cocreation and Collaborative Paths in Complex Service Systems: A Focus on (Smart) Cities," Service Science, INFORMS, vol. 10(4), pages 397-407, December.
    2. Karimi, Sahar & Holland, Christopher P. & Papamichail, K. Nadia, 2018. "The impact of consumer archetypes on online purchase decision-making processes and outcomes: A behavioural process perspective," Journal of Business Research, Elsevier, vol. 91(C), pages 71-82.
    3. Alba, Joseph W & Hutchinson, J Wesley, 2000. "Knowledge Calibration: What Consumers Know and What They Think They Know," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 27(2), pages 123-156, September.
    4. Jonah Berger & Alan T. Sorensen & Scott J. Rasmussen, 2010. "Positive Effects of Negative Publicity: When Negative Reviews Increase Sales," Marketing Science, INFORMS, vol. 29(5), pages 815-827, 09-10.
    5. Santoro, Gabriele & Bresciani, Stefano & Papa, Armando, 2020. "Collaborative modes with Cultural and Creative Industries and innovation performance: The moderating role of heterogeneous sources of knowledge and absorptive capacity," Technovation, Elsevier, vol. 92.
    6. Manlio Del Giudice & Elias G. Carayannis & Maria Rosaria Della Peruta, 2012. "Cross-Cultural Knowledge Management," Innovation, Technology, and Knowledge Management, Springer, number 978-1-4614-2089-7, March.
    7. Francesco Polese & Luca Carrubbo & Roberto Bruni & Francesco Caputo, 2018. "Enabling actors' viable behaviour: reflections upon the link between viability and complexity within smart service system," International Journal of Markets and Business Systems, Inderscience Enterprises Ltd, vol. 3(2), pages 111-120.
    8. Byeng-Hee Chang & Eyun-Jung Ki, 2005. "Devising a Practical Model for Predicting Theatrical Movie Success: Focusing on the Experience Good Property," Journal of Media Economics, Taylor & Francis Journals, vol. 18(4), pages 247-269.
    9. Ponnamma Divakaran, Pradeep Kumar, 2018. "Technology-enabled community data for gaining pre-release brand insights," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 217-226.
    10. Petter Gottschalk, 2011. "Corporate Social Responsibility, Governance and Corporate Reputation," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 8024, January.
    11. Xinxin Li & Lorin M. Hitt, 2008. "Self-Selection and Information Role of Online Product Reviews," Information Systems Research, INFORMS, vol. 19(4), pages 456-474, December.
    12. Ana Babić Rosario & Kristine Valck & Francesca Sotgiu, 2020. "Conceptualizing the electronic word-of-mouth process: What we know and need to know about eWOM creation, exposure, and evaluation," Journal of the Academy of Marketing Science, Springer, vol. 48(3), pages 422-448, May.
    13. M. Bagella & L. Becchetti, 1999. "The Determinants of Motion Picture Box Office Performance: Evidence from Movies Produced in Italy," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 23(4), pages 237-256, November.
    14. Jehoshua Eliashberg & Jedid-Jah Jonker & Mohanbir S. Sawhney & Berend Wierenga, 2000. "MOVIEMOD: An Implementable Decision-Support System for Prerelease Market Evaluation of Motion Pictures," Marketing Science, INFORMS, vol. 19(3), pages 226-243, January.
    15. Michaely, Roni & Womack, Kent L, 1999. "Conflict of Interest and the Credibility of Underwriter Analyst Recommendations," Review of Financial Studies, Society for Financial Studies, vol. 12(4), pages 653-686.
    16. Chen, Ching-Fu & Chen, Fu-Shian, 2010. "Experience quality, perceived value, satisfaction and behavioral intentions for heritage tourists," Tourism Management, Elsevier, vol. 31(1), pages 29-35.
    17. Gerda Gemser & Martine Oostrum & Mark Leenders, 2007. "The impact of film reviews on the box office performance of art house versus mainstream motion pictures," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 31(1), pages 43-63, March.
    18. Francesco Caputo & Luca Carrubbo & Debora Sarno, 2018. "The Influence of Cognitive Dimensions on the Consumer-SME Relationship: A Sustainability-Oriented View," Sustainability, MDPI, vol. 10(9), pages 1-19, September.
    19. Pradeep Kumar Ponnamma Divakaran, 2018. "Technology-enabled community data for gaining pre-release brand insights," Post-Print hal-01999624, HAL.
    20. Thakur, Rakhi, 2018. "Customer engagement and online reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 41(C), pages 48-59.
    21. Mark Baimbridge, 1997. "Movie admissions and rental income: the case of James Bond," Applied Economics Letters, Taylor & Francis Journals, vol. 4(1), pages 57-61.
    22. David A. Reinstein & Christopher M. Snyder, 2005. "The Influence Of Expert Reviews On Consumer Demand For Experience Goods: A Case Study Of Movie Critics," Journal of Industrial Economics, Wiley Blackwell, vol. 53(1), pages 27-51, March.
    23. Ravid, S Abraham, 1999. "Information, Blockbusters, and Stars: A Study of the Film Industry," The Journal of Business, University of Chicago Press, vol. 72(4), pages 463-492, October.
    24. Monic Sun, 2012. "How Does the Variance of Product Ratings Matter?," Management Science, INFORMS, vol. 58(4), pages 696-707, April.
    25. De Vany, A. & Walls, W.D., 1999. ""Uncertainty in the Movies: Does Star Power Reduce the Terror of the Box Office?"," Papers 98-99-10, California Irvine - School of Social Sciences.
    26. S. Ravid & John Wald & Suman Basuroy, 2006. "Distributors and film critics: does it take two to Tango?," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 30(3), pages 201-218, December.
    27. Alba, Joseph W & Marmorstein, Howard, 1987. "The Effects of Frequency Knowledge on Consumer Decision Making," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 14(1), pages 14-25, June.
    28. Sanjeev Swami & Jehoshua Eliashberg & Charles B. Weinberg, 1999. "SilverScreener: A Modeling Approach to Movie Screens Management," Marketing Science, INFORMS, vol. 18(3), pages 352-372.
    29. Filieri, Raffaele, 2015. "What makes online reviews helpful? A diagnosticity-adoption framework to explain informational and normative influences in e-WOM," Journal of Business Research, Elsevier, vol. 68(6), pages 1261-1270.
    30. Vithala R. Rao & S. Abraham (Avri) Ravid & Richard T. Gretz & Jialie Chen & Suman Basuroy, 2017. "The impact of advertising content on movie revenues," Marketing Letters, Springer, vol. 28(3), pages 341-355, September.
    31. Bezjian, James & Stoyanova, Veselina & McKiernan, Peter & MacKay, R. Bradley, 2020. "Synthesizing scenario planning and industry recipes through an analysis of the Hollywood film industry," Technological Forecasting and Social Change, Elsevier, vol. 150(C).
    32. Morgan, John & Stocken, Phillip C, 2003. "An Analysis of Stock Recommendations," RAND Journal of Economics, The RAND Corporation, vol. 34(1), pages 183-203, Spring.
    33. Muhammad Ibrahim & Imran Sarwar Bajwa, 2018. "Design and Application of a Multi-Variant Expert System Using Apache Hadoop Framework," Sustainability, MDPI, vol. 10(11), pages 1-21, November.
    34. Barile, Sergio & Saviano, Marialuisa & Polese, Francesco & Di Nauta, Primiano, 2012. "Reflections on service systems boundaries: A viable systems perspective," European Management Journal, Elsevier, vol. 30(5), pages 451-465.
    35. Narasimhan Jegadeesh & Joonghyuk Kim & Susan D. Krische & Charles M. C. Lee, 2004. "Analyzing the Analysts: When Do Recommendations Add Value?," Journal of Finance, American Finance Association, vol. 59(3), pages 1083-1124, June.
    36. Arthur De Vany & W. Walls, 1999. "Uncertainty in the Movie Industry: Does Star Power Reduce the Terror of the Box Office?," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 23(4), pages 285-318, November.
    37. Manlio Giudice & Elias G. Carayannis & Maria Rosaria Della Peruta, 2012. "Culture and Cooperative Strategies: Knowledge Management Perspectives," Innovation, Technology, and Knowledge Management, in: Cross-Cultural Knowledge Management, chapter 0, pages 49-62, Springer.
    38. Angelo Bonfanti & Manlio Del Giudice & Armando Papa, 2018. "Italian Craft Firms Between Digital Manufacturing, Open Innovation, and Servitization," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 9(1), pages 136-149, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Natalia Gmerek, 2015. "The determinants of Polish movies’ box office performance in Poland," Journal of Marketing and Consumer Behaviour in Emerging Markets, University of Warsaw, Faculty of Management, vol. 1(1), pages 15-35.
    2. Wen-jhan Jane & Wei-peng Chen & Yuan-lin Hsu, 2015. "The impact of deregulation on the movie box office after Taiwan’s entry into the WTO: the difference-in-differences estimation," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 5(2), pages 289-308, December.
    3. Ana Suárez-Vázquez, 2011. "Critic power or star power? The influence of hallmarks of quality of motion pictures: an experimental approach," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 35(2), pages 119-135, May.
    4. Gazley, Aaron & Clark, Gemma & Sinha, Ashish, 2011. "Understanding preferences for motion pictures," Journal of Business Research, Elsevier, vol. 64(8), pages 854-861, August.
    5. Sven Heidenreich & Franziska Handrich & Tobias Kraemer, 2023. "Flawless victory! Investigating search and experience qualities as antecedent predictors of video game success," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-20, December.
    6. Brinja Meiseberg & Thomas Ehrmann, 2013. "Diversity in teams and the success of cultural products," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 37(1), pages 61-86, February.
    7. Jordi McKenzie, 2023. "The economics of movies (revisited): A survey of recent literature," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 480-525, April.
    8. Jordi McKenzie, 2010. "Do 'African American' films perform better or worse at the box office? An empirical analysis of motion picture revenues and profits," Applied Economics Letters, Taylor & Francis Journals, vol. 17(16), pages 1559-1564.
    9. Hofmann, Julian & Clement, Michel & Völckner, Franziska & Hennig-Thurau, Thorsten, 2017. "Empirical generalizations on the impact of stars on the economic success of movies," International Journal of Research in Marketing, Elsevier, vol. 34(2), pages 442-461.
    10. Legoux, Renaud & Larocque, Denis & Laporte, Sandra & Belmati, Soraya & Boquet, Thomas, 2016. "The effect of critical reviews on exhibitors' decisions: Do reviews affect the survival of a movie on screen?," International Journal of Research in Marketing, Elsevier, vol. 33(2), pages 357-374.
    11. Suman Basuroy & S. Abraham Ravid & Richard T. Gretz & B. J. Allen, 2020. "Is everybody an expert? An investigation into the impact of professional versus user reviews on movie revenues," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 44(1), pages 57-96, March.
    12. Keuschnigg, Marc, 2015. "Product Success in Cultural Markets: The Mediating Role of Familiarity, Peers, and Experts," MPRA Paper 63444, University Library of Munich, Germany.
    13. Jordi Mckenzie, 2008. "Bayesian Information Transmission and Stable Distributions: Motion Picture Revenues at the Australian Box Office," The Economic Record, The Economic Society of Australia, vol. 84(266), pages 338-353, September.
    14. Anita Elberse & Jehoshua Eliashberg, 2003. "Demand and Supply Dynamics for Sequentially Released Products in International Markets: The Case of Motion Pictures," Marketing Science, INFORMS, vol. 22(3), pages 329-354.
    15. Jordi McKenzie, 2009. "Revealed word-of-mouth demand and adaptive supply: survival of motion pictures at the Australian box office," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 33(4), pages 279-299, November.
    16. Gaenssle Sophia & Budzinski Oliver & Astakhova Daria, 2018. "Conquering the Box Office: Factors Influencing Success of International Movies in Russia," Review of Network Economics, De Gruyter, vol. 17(4), pages 245-266, December.
    17. Sayantan Ghosh Dastidar & Caroline Elliott, 2020. "The Indian film industry in a changing international market," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 44(1), pages 97-116, March.
    18. Azuela Flores José Ignacio & Fernandez Blanco Víctor & Sanzo Pérez María José, 2012. "The effects of critics reviews on movie demand," Contaduría y Administración, Accounting and Management, vol. 57(2), pages 201-222, abril-jun.
    19. Jose Ignacio Azuela Flores & Victor Fernandez-Blanco & Maria Jose Sanzo-Perez, 2012. "Movie reviews: Who are the readers?," ACEI Working Paper Series AWP-03-2012, Association for Cultural Economics International, revised May 2012.
    20. Thorsten Hennig-Thurau, 2004. "Spielfilme als Anlageobjekte: Die Höhe des Filmbudgets als Grundlage der Investitionsentscheidung," Schmalenbach Journal of Business Research, Springer, vol. 56(2), pages 171-188, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:tefoso:v:169:y:2021:i:c:s0040162521002328. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/00401625 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.