IDEAS home Printed from https://ideas.repec.org/a/inm/ormsom/v27y2025i1p249-268.html

The Choice Overload Effect in Online Recommender Systems

Author

Listed:
  • Xiaoyang Long

    (Wisconsin School of Business, University of Wisconsin–Madison, Madison, Wisconsin 53706)

  • Jiankun Sun

    (Imperial College Business School, Imperial College London, London SW7 2AZ, United Kingdom)

  • Hengchen Dai

    (Anderson School of Management, University of California, Los Angeles, Los Angeles, California 90095)

  • Dennis Zhang

    (Olin Business School, Washington University in St. Louis, St. Louis, Missouri 63130)

  • Jianfeng Zhang

    (Alibaba Group, Hangzhou, Zhejiang Province 311121, China)

  • Yujie Chen

    (Alibaba Group, Hangzhou, Zhejiang Province 311121, China)

  • Haoyuan Hu

    (Alibaba Group, Hangzhou, Zhejiang Province 311121, China)

  • Binqiang Zhao

    (Alibaba Group, Hangzhou, Zhejiang Province 311121, China)

Abstract

Problem definition : Online retailing platforms are increasingly relying on personalized recommender systems to help guide consumer choice. An important but understudied question in such settings is how many products to include in a recommendation set. In this work, we study how the number of recommended products influences consumers’ search and purchase behavior in an online personalized recommender system within a retargeting setting. Methodology/results : Via a field experiment involving 1.6 million consumers on an online retailing platform, we causally demonstrate that consumers’ likelihood of purchasing any product from the recommendation set first increases then decreases as the number of recommended products increases. Importantly, as much as 64% of the decrease in purchase probability (i.e., the choice overload effect) can be attributed to a decrease in consumers’ likelihood of starting a search (i.e., clicking on any recommended product). We discuss the possible behavioral mechanisms driving these results and analyze how these effects could be heterogeneous across different product categories, price ranges, and timing. Managerial implications : This work presents real-world experimental evidence for the choice overload effect in online retailing platforms, highlights the important role of consumer search behavior in driving this effect, and sheds light on when and how limiting the number of options in a recommender system may be beneficial to online retailers.

Suggested Citation

  • Xiaoyang Long & Jiankun Sun & Hengchen Dai & Dennis Zhang & Jianfeng Zhang & Yujie Chen & Haoyuan Hu & Binqiang Zhao, 2025. "The Choice Overload Effect in Online Recommender Systems," Manufacturing & Service Operations Management, INFORMS, vol. 27(1), pages 249-268, January.
  • Handle: RePEc:inm:ormsom:v:27:y:2025:i:1:p:249-268
    DOI: 10.1287/msom.2022.0659
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/msom.2022.0659
    Download Restriction: no

    File URL: https://libkey.io/10.1287/msom.2022.0659?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Benjamin Scheibehenne & Rainer Greifeneder & Peter M. Todd, 2010. "Can There Ever Be Too Many Options? A Meta-Analytic Review of Choice Overload," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 37(3), pages 409-425, October.
    2. Yuxin Chen & Song Yao, 2017. "Sequential Search with Refinement: Model and Application with Click-Stream Data," Management Science, INFORMS, vol. 63(12), pages 4345-4365, December.
    3. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    4. Xueming Luo & Xianghua Lu & Jing Li, 2019. "When and How to Leverage E-commerce Cart Targeting: The Relative and Moderated Effects of Scarcity and Price Incentives with a Two-Stage Field Experiment and Causal Forest Optimization," Information Systems Research, INFORMS, vol. 30(4), pages 1203-1227, December.
    5. Warut Khern-am-nuai & Hyunji So & Maxime C. Cohen & Yossiri Adulyasak, 2024. "Selecting Cover Images for Restaurant Reviews: AI vs. Wisdom of the Crowd," Manufacturing & Service Operations Management, INFORMS, vol. 26(1), pages 330-349, January.
    6. Jörg Rieskamp & Jerome R. Busemeyer & Barbara A. Mellers, 2006. "Extending the Bounds of Rationality: Evidence and Theories of Preferential Choice," Journal of Economic Literature, American Economic Association, vol. 44(3), pages 631-661, September.
    7. Raluca M. Ursu, 2018. "The Power of Rankings: Quantifying the Effect of Rankings on Online Consumer Search and Purchase Decisions," Marketing Science, INFORMS, vol. 37(4), pages 530-552, August.
    8. Gérard P. Cachon & Santiago Gallino & Marcelo Olivares, 2019. "Does Adding Inventory Increase Sales? Evidence of a Scarcity Effect in U.S. Automobile Dealerships," Management Science, INFORMS, vol. 65(4), pages 1469-1485, April.
    9. Babin, Barry J & Darden, William R & Griffin, Mitch, 1994. "Work and/or Fun: Measuring Hedonic and Utilitarian Shopping Value," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 20(4), pages 644-656, March.
    10. John T. Gourville & Dilip Soman, 2005. "Overchoice and Assortment Type: When and Why Variety Backfires," Marketing Science, INFORMS, vol. 24(3), pages 382-395, July.
    11. Elisabeth Honka, 2014. "Quantifying search and switching costs in the US auto insurance industry," RAND Journal of Economics, RAND Corporation, vol. 45(4), pages 847-884, December.
    12. Ken Moon & Kostas Bimpikis & Haim Mendelson, 2018. "Randomized Markdowns and Online Monitoring," Management Science, INFORMS, vol. 64(3), pages 1271-1290, March.
    13. Chunhua Wu & Koray Cosguner, 2020. "Profiting from the Decoy Effect: A Case Study of an Online Diamond Retailer," Marketing Science, INFORMS, vol. 39(5), pages 974-995, September.
    14. Ryan W. Buell & Basak Kalkanci, 2021. "How Transparency into Internal and External Responsibility Initiatives Influences Consumer Choice," Management Science, INFORMS, vol. 67(2), pages 932-950, February.
    15. Loomes, Graham & Sugden, Robert, 1982. "Regret Theory: An Alternative Theory of Rational Choice under Uncertainty," Economic Journal, Royal Economic Society, vol. 92(368), pages 805-824, December.
    16. Alexander Bleier & Maik Eisenbeiss, 2015. "Personalized Online Advertising Effectiveness: The Interplay of What, When, and Where," Marketing Science, INFORMS, vol. 34(5), pages 669-688, September.
    17. Zhong-Zhong Jiang & Guangwen Kong & Yinghao Zhang, 2021. "Making the Most of Your Regret: Workers’ Relocation Decisions in On-Demand Platforms," Manufacturing & Service Operations Management, INFORMS, vol. 23(3), pages 695-713, May.
    18. Jacob Feldman & Dennis J. Zhang & Xiaofei Liu & Nannan Zhang, 2022. "Customer Choice Models vs. Machine Learning: Finding Optimal Product Displays on Alibaba," Operations Research, INFORMS, vol. 70(1), pages 309-328, January.
    19. Todd Sarver, 2008. "Anticipating Regret: Why Fewer Options May Be Better," Econometrica, Econometric Society, vol. 76(2), pages 263-305, March.
    20. Jonathan Levav & Mark Heitmann & Andreas Herrmann & Sheena S. Iyengar, 2010. "Order in Product Customization Decisions: Evidence from Field Experiments," Journal of Political Economy, University of Chicago Press, vol. 118(2), pages 274-299, April.
    21. Jacoby, Jacob & Speller, Donald E & Berning, Carol A Kohn, 1974. "Brand Choice Behavior as a Function of Information Load: Replication and Extension," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 1(1), pages 33-42, June.
    22. Jun B. Kim & Paulo Albuquerque & Bart J. Bronnenberg, 2010. "Online Demand Under Limited Consumer Search," Marketing Science, INFORMS, vol. 29(6), pages 1001-1023, 11-12.
    23. Guillermo Gallego & Anran Li & Van-Anh Truong & Xinshang Wang, 2020. "Approximation Algorithms for Product Framing and Pricing," Operations Research, INFORMS, vol. 68(1), pages 134-160, January.
    24. Babur De los Santos & Sergei Koulayev, 2017. "Optimizing Click-Through in Online Rankings with Endogenous Search Refinement," Marketing Science, INFORMS, vol. 36(4), pages 542-564, July.
    25. Kalyan Talluri & Garrett van Ryzin, 2004. "Revenue Management Under a General Discrete Choice Model of Consumer Behavior," Management Science, INFORMS, vol. 50(1), pages 15-33, January.
    26. Ben Irons & Cameron Hepburn, 2007. "Regret Theory and the Tyranny of Choice," The Economic Record, The Economic Society of Australia, vol. 83(261), pages 191-203, June.
    27. Marshall Fisher & Santiago Gallino & Jun Li, 2018. "Competition-Based Dynamic Pricing in Online Retailing: A Methodology Validated with Field Experiments," Management Science, INFORMS, vol. 64(6), pages 2496-2514, June.
    28. Ruxian Wang & Ozge Sahin, 2018. "The Impact of Consumer Search Cost on Assortment Planning and Pricing," Management Science, INFORMS, vol. 64(8), pages 3649-3666, August.
    29. Babur De Los Santos & Ali Hortacsu & Matthijs R. Wildenbeest, 2012. "Testing Models of Consumer Search Using Data on Web Browsing and Purchasing Behavior," American Economic Review, American Economic Association, vol. 102(6), pages 2955-2980, October.
    30. Songtao Li & Lauren Xiaoyuan Lu & Susan Feng Lu & Simin Huang, 2023. "Estimating the Stockout-Based Demand Spillover Effect in a Fashion Retail Setting," Manufacturing & Service Operations Management, INFORMS, vol. 25(2), pages 468-488, March.
    31. Simonson, Itamar, 1992. "The Influence of Anticipating Regret and Responsibility on Purchase Decisions," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 19(1), pages 105-118, June.
    32. Yao Cui & Andrew M. Davis, 2022. "Tax-Induced Inequalities in the Sharing Economy," Management Science, INFORMS, vol. 68(10), pages 7202-7220, October.
    33. Adithya Pattabhiramaiah & Eric Overby & Lizhen Xu, 2022. "Spillovers from Online Engagement: How a Newspaper Subscriber’s Activation of Digital Paywall Access Affects Her Retention and Subscription Revenue," Management Science, INFORMS, vol. 68(5), pages 3528-3548, May.
    34. Dmitri Kuksov & J. Miguel Villas-Boas, 2010. "When More Alternatives Lead to Less Choice," Marketing Science, INFORMS, vol. 29(3), pages 507-524, 05-06.
    35. Zeelenberg, M., 1999. "The use of crying over spilled milk : A note on the rationality and functionality of regret," Other publications TiSEM 66ac04be-d1ee-4a0e-9e97-7, Tilburg University, School of Economics and Management.
    36. Gallego, Guillermo & Li, Anran & Truong, Van-Anh & Wang, Xinshang, 2020. "Approximation algorithms for product framing and pricing," LSE Research Online Documents on Economics 101983, London School of Economics and Political Science, LSE Library.
    37. Andrés Musalem & Marcelo Olivares & Eric T. Bradlow & Christian Terwiesch & Daniel Corsten, 2010. "Structural Estimation of the Effect of Out-of-Stocks," Management Science, INFORMS, vol. 56(7), pages 1180-1197, July.
    38. Eduard Calvo & Ruomeng Cui & Laura Wagner, 2023. "Disclosing Product Availability in Online Retail," Manufacturing & Service Operations Management, INFORMS, vol. 25(2), pages 427-447, March.
    39. Kris Johnson Ferreira & Bin Hong Alex Lee & David Simchi-Levi, 2016. "Analytics for an Online Retailer: Demand Forecasting and Price Optimization," Manufacturing & Service Operations Management, INFORMS, vol. 18(1), pages 69-88, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuyang Tan & Hao Gong & Chunxiang Guo, 2025. "Bi-Objective Optimization of Product Selection and Ranking Considering Sequential Search," SAGE Open, , vol. 15(3), pages 21582440251, August.
    2. Raluca M. Ursu & Qianyun Zhang & Elisabeth Honka, 2023. "Search Gaps and Consumer Fatigue," Marketing Science, INFORMS, vol. 42(1), pages 110-136, January.
    3. Kris J. Ferreira & Sunanda Parthasarathy & Shreyas Sekar, 2022. "Learning to Rank an Assortment of Products," Management Science, INFORMS, vol. 68(3), pages 1828-1848, March.
    4. Pnina Feldman & Jun Li & Hsin-Tien Tsai, 2022. "Welfare Implications of Congestion Pricing: Evidence from SF park," Manufacturing & Service Operations Management, INFORMS, vol. 24(2), pages 1091-1109, March.
    5. Robert Donnelly & Ayush Kanodia & Ilya Morozov, 2024. "Welfare Effects of Personalized Rankings," Marketing Science, INFORMS, vol. 43(1), pages 92-113, January.
    6. Rafael P. Greminger, 2022. "Trade-Offs Between Ranking Objectives: Descriptive Evidence and Structural Estimation," Papers 2210.16408, arXiv.org, revised Mar 2026.
    7. Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2019. "Modeling Consumer Footprints on Search Engines: An Interplay with Social Media," Management Science, INFORMS, vol. 65(3), pages 1363-1385, March.
    8. Ivy Chu Dang & Raluca M. Ursu & Pradeep K. Chintagunta, 2026. "Going back to move forward? How search revisits on a website we built inform us about search outcomes," Quantitative Marketing and Economics (QME), Springer, vol. 24(1), pages 1-39, December.
    9. Raluca Mihaela Ursu & Andrey Simonov & Eunkyung An, 2025. "Online Advertising as Passive Search," Management Science, INFORMS, vol. 71(2), pages 1050-1073, February.
    10. Rafael P. Greminger, 2022. "Optimal Search and Discovery," Management Science, INFORMS, vol. 68(5), pages 3904-3924, May.
    11. Ilya Morozov & Stephan Seiler & Xiaojing Dong & Liwen Hou, 2021. "Estimation of Preference Heterogeneity in Markets with Costly Search," Marketing Science, INFORMS, vol. 40(5), pages 871-899, September.
    12. Liang Guo, 2016. "Contextual Deliberation and Preference Construction," Management Science, INFORMS, vol. 62(10), pages 2977-2993, October.
    13. Ata Jameei Osgouei & Andrew T. Ching & Brian T. Ratchford & Shervin Shahrokhi Tehrani, 2026. "Estimating Position and Social Influence Effects in Online Search," Marketing Science, INFORMS, vol. 45(1), pages 203-223, January.
    14. Xueming Luo & Le Wang & Qingsheng Wu & Takeshi Moriguchi, 2025. "From Stopping to Shopping: A Field Experiment on Free Return and Free Shipping Retargeting Policies in Online Retail Operations," Manufacturing & Service Operations Management, INFORMS, vol. 27(4), pages 1224-1241, July.
    15. Leon Yang Chu & Hamid Nazerzadeh & Heng Zhang, 2020. "Position Ranking and Auctions for Online Marketplaces," Management Science, INFORMS, vol. 66(8), pages 3617-3634, August.
    16. Raluca Ursu & Stephan Seiler & Elisabeth Honka, 2025. "The sequential search model: A framework for empirical research," Quantitative Marketing and Economics (QME), Springer, vol. 23(1), pages 165-213, March.
    17. Dan Yavorsky & Elisabeth Honka & Keith Chen, 2021. "Consumer search in the U.S. auto industry: The role of dealership visits," Quantitative Marketing and Economics (QME), Springer, vol. 19(1), pages 1-52, March.
    18. Raluca Ursu & Stephan Seiler & Elisabeth Honka, 2023. "The Sequential Search Model: A Framework for Empirical Research," CESifo Working Paper Series 10264, CESifo.
    19. Xinyu Cao & Yuting Zhu, 2024. "The Power of Commitment in Group Search," Marketing Science, INFORMS, vol. 43(1), pages 213-228, January.
    20. Honka, Elisabeth & Seiler, Stephan & Ursu, Raluca, 2024. "Consumer search: What can we learn from pre-purchase data?," Journal of Retailing, Elsevier, vol. 100(1), pages 114-129.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormsom:v:27:y:2025:i:1:p:249-268. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.