IDEAS home Printed from https://ideas.repec.org/a/inm/ormksc/v45y2026i1p63-79.html

Bad Apples on Rotten Tomatoes: Critics, Crowds, and Gender Bias in Product Ratings

Author

Listed:
  • Luis Aguiar

    (Department of Business Administration, University of Zurich, 8032 Zurich, Switzerland; and CESifo (Center for Economic Studies and Ifo Institute), 81679 Munich, Germany)

Abstract

Consumers considering the purchase of experience goods can rely on both critics and crowd-based evaluations to guide their decisions. Because of divergent incentives, however, critics and crowd assessments may incorporate different information. In the context of the movie industry, I investigate whether crowd reviewers provide gender-neutral product evaluations relative to professional critics. I classify movies as male or female based on the gender composition of their cast and estimate how the gender gap in movie rating scores differs across critics and crowds. Results show that although critics tend to assess both male and female movies similarly, the gender gap in ratings increases substantially under crowd-based ratings and at the expense of female movies. Notably, female movies receive a higher proportion of extremely low ratings, predominantly from male crowd reviewers. Using a rating design change implemented by the review-aggregating platform Rotten Tomatoes, results indicate that this overall increase in gender inequality is driven by a selected group of online reviewers rather than by a general bias against movies with more prominent female presence. These findings have important implications for the gatekeeping role of review-aggregating platforms in reducing bias against female representation in product ratings.

Suggested Citation

  • Luis Aguiar, 2026. "Bad Apples on Rotten Tomatoes: Critics, Crowds, and Gender Bias in Product Ratings," Marketing Science, INFORMS, vol. 45(1), pages 63-79, January.
  • Handle: RePEc:inm:ormksc:v:45:y:2026:i:1:p:63-79
    DOI: 10.1287/mksc.2023.0236
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mksc.2023.0236
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mksc.2023.0236?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Imke Reimers & Joel Waldfogel, 2021. "Digitization and Pre-purchase Information: The Causal and Welfare Impacts of Reviews and Crowd Ratings," American Economic Review, American Economic Association, vol. 111(6), pages 1944-1971, June.
    2. Tristan L. Botelho & Marina Gertsberg, 2022. "The Disciplining Effect of Status: Evaluator Status Awards and Observed Gender Bias in Evaluations," Management Science, INFORMS, vol. 68(7), pages 5311-5329, July.
    3. David A. Reinstein & Christopher M. Snyder, 2005. "The Influence Of Expert Reviews On Consumer Demand For Experience Goods: A Case Study Of Movie Critics," Journal of Industrial Economics, Wiley Blackwell, vol. 53(1), pages 27-51, March.
    4. Fowdur, Lona & Kadiyali, Vrinda & Prince, Jeffrey, 2012. "Racial bias in expert quality assessment: A study of newspaper movie reviews," Journal of Economic Behavior & Organization, Elsevier, vol. 84(1), pages 292-307.
    5. Anja Lambrecht & Catherine Tucker, 2019. "Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads," Management Science, INFORMS, vol. 65(7), pages 2966-2981, July.
    6. Ethan Mollick & Ramana Nanda, 2016. "Wisdom or Madness? Comparing Crowds with Expert Evaluation in Funding the Arts," Management Science, INFORMS, vol. 62(6), pages 1533-1553, June.
    7. J. Aislinn Bohren & Alex Imas & Michael Rosenberg, 2019. "The Dynamics of Discrimination: Theory and Evidence," American Economic Review, American Economic Association, vol. 109(10), pages 3395-3436, October.
    8. Aguiar, Luis & Waldfogel, Joel & Waldfogel, Sarah, 2021. "Playlisting favorites: Measuring platform bias in the music industry," International Journal of Industrial Organization, Elsevier, vol. 78(C).
    9. Wendy W. Moe & David A. Schweidel, 2012. "Online Product Opinions: Incidence, Evaluation, and Evolution," Marketing Science, INFORMS, vol. 31(3), pages 372-386, May.
    10. Shane Greenstein & Grace Gu & Feng Zhu, 2021. "Ideology and Composition Among an Online Crowd: Evidence from Wikipedians," Management Science, INFORMS, vol. 67(5), pages 3067-3086, May.
    11. Holbrook, Morris B, 1999. "Popular Appeal versus Expert Judgments of Motion Pictures," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 26(2), pages 144-155, September.
    12. Bryan K. Stroube & David M. Waguespack, 2024. "Status and consensus: Heterogeneity in audience evaluations of female‐ versus male‐lead films," Strategic Management Journal, Wiley Blackwell, vol. 45(5), pages 994-1024, May.
    13. Bikhchandani, Sushil & Hirshleifer, David & Welch, Ivo, 1992. "A Theory of Fads, Fashion, Custom, and Cultural Change in Informational Cascades," Journal of Political Economy, University of Chicago Press, vol. 100(5), pages 992-1026, October.
    14. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    15. Sherry He & Brett Hollenbeck & Davide Proserpio, 2022. "The Market for Fake Reviews," Marketing Science, INFORMS, vol. 41(5), pages 896-921, September.
    16. Davide Proserpio & Isamar Troncoso & Francesca Valsesia, 2021. "Does Gender Matter? The Effect of Management Responses on Reviewing Behavior," Marketing Science, INFORMS, vol. 40(6), pages 1199-1213, November.
    17. Xinxin Li & Lorin M. Hitt, 2008. "Self-Selection and Information Role of Online Product Reviews," Information Systems Research, INFORMS, vol. 19(4), pages 456-474, December.
    18. Abhijit V. Banerjee, 1992. "A Simple Model of Herd Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(3), pages 797-817.
    19. Hinnosaar, Marit, 2019. "Gender inequality in new media: Evidence from Wikipedia," Journal of Economic Behavior & Organization, Elsevier, vol. 163(C), pages 262-276.
    20. Michael Luca & Georgios Zervas, 2016. "Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud," Management Science, INFORMS, vol. 62(12), pages 3412-3427, December.
    21. David Godes & José C. Silva, 2012. "Sequential and Temporal Dynamics of Online Opinion," Marketing Science, INFORMS, vol. 31(3), pages 448-473, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luis Aguiar, 2024. "Bad Apples on Rotten Tomatoes: Critics, Crowds, and Gender Bias in Product Ratings," CESifo Working Paper Series 11422, CESifo.
    2. Pocchiari, Martina & Proserpio, Davide & Dover, Yaniv, 2025. "Online reviews: A literature review and roadmap for future research," International Journal of Research in Marketing, Elsevier, vol. 42(2), pages 275-297.
    3. Tommaso Bondi, 2025. "Alone, Together: A Model of Social (Mis)Learning from Consumer Reviews," Marketing Science, INFORMS, vol. 44(6), pages 1258-1277, November.
    4. Weijia (Daisy) Dai & Ginger Jin & Jungmin Lee & Michael Luca, 2018. "Aggregation of consumer ratings: an application to Yelp.com," Quantitative Marketing and Economics (QME), Springer, vol. 16(3), pages 289-339, September.
    5. Hui, Xiang & Klein, Tobias & Stahl, Konrad, 2022. "Learning from Online Ratings," CEPR Discussion Papers 17006, Centre for Economic Policy Research.
    6. Luis Aguiar & Imke Reimers & Joel Waldfogel, 2024. "Platforms and the transformation of the content industries," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 33(2), pages 317-326, March.
    7. Tommaso Bondi & Michelangelo Rossi & Ryan L. Stevens, 2025. "The Good, the Bad and the Picky: Consumer Heterogeneity and the Reversal of Product Ratings," Management Science, INFORMS, vol. 71(8), pages 7200-7222, August.
    8. Sungsik Park & Woochoel Shin & Jinhong Xie, 2021. "The Fateful First Consumer Review," Marketing Science, INFORMS, vol. 40(3), pages 481-507, May.
    9. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    10. Young Joon Park & Jaewoo Joo & Charin Polpanumas & Yeujun Yoon, 2021. "“Worse Than What I Read?” The External Effect of Review Ratings on the Online Review Generation Process: An Empirical Analysis of Multiple Product Categories Using Amazon.com Review Data," Sustainability, MDPI, vol. 13(19), pages 1-22, September.
    11. S. Cicognani & P. Figini & M. Magnani, 2016. "Social Influence Bias in Online Ratings: A Field Experiment," Working Papers wp1060, Dipartimento Scienze Economiche, Universita' di Bologna.
    12. Warut Khern-am-nuai & Karthik Kannan & Hossein Ghasemkhani, 2018. "Extrinsic versus Intrinsic Rewards for Contributing Reviews in an Online Platform," Information Systems Research, INFORMS, vol. 29(4), pages 871-892, December.
    13. Jacobsen, Grant D., 2015. "Consumers, experts, and online product evaluations: Evidence from the brewing industry," Journal of Public Economics, Elsevier, vol. 126(C), pages 114-123.
    14. Davide Proserpio & Georgios Zervas, 2017. "Online Reputation Management: Estimating the Impact of Management Responses on Consumer Reviews," Marketing Science, INFORMS, vol. 36(5), pages 645-665, September.
    15. Young-Jin Lee & Kartik Hosanagar & Yong Tan, 2015. "Do I Follow My Friends or the Crowd? Information Cascades in Online Movie Ratings," Management Science, INFORMS, vol. 61(9), pages 2241-2258, September.
    16. Chong (Alex) Wang & Xiaoquan (Michael) Zhang & Il-Horn Hann, 2018. "Socially Nudged: A Quasi-Experimental Study of Friends’ Social Influence in Online Product Ratings," Information Systems Research, INFORMS, vol. 29(3), pages 641-655, September.
    17. Balázs Kovács, 2024. "The Turing test of online reviews: Can we tell the difference between human-written and GPT-4-written online reviews?," Marketing Letters, Springer, vol. 35(4), pages 651-666, December.
    18. Michael Luca & Georgios Zervas, 2013. "Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud," Harvard Business School Working Papers 14-006, Harvard Business School, revised May 2015.
    19. Hülya Karaman, 2021. "Online Review Solicitations Reduce Extremity Bias in Online Review Distributions and Increase Their Representativeness," Management Science, INFORMS, vol. 67(7), pages 4420-4445, July.
    20. Pei-Yu Chen & Yili Hong & Ying Liu, 2018. "The Value of Multidimensional Rating Systems: Evidence from a Natural Experiment and Randomized Experiments," Management Science, INFORMS, vol. 64(10), pages 4629-4647, October.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormksc:v:45:y:2026:i:1:p:63-79. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.