IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2007.10144.html
   My bibliography  Save this paper

Competing Bandits: The Perils of Exploration Under Competition

Author

Listed:
  • Guy Aridor
  • Yishay Mansour
  • Aleksandrs Slivkins
  • Zhiwei Steven Wu

Abstract

Most online platforms strive to learn from interactions with users, and many engage in exploration: making potentially suboptimal choices for the sake of acquiring new information. We study the interplay between exploration and competition: how such platforms balance the exploration for learning and the competition for users. Here users play three distinct roles: they are customers that generate revenue, they are sources of data for learning, and they are self-interested agents which choose among the competing platforms. We consider a stylized duopoly model in which two firms face the same multi-armed bandit problem. Users arrive one by one and choose between the two firms, so that each firm makes progress on its bandit problem only if it is chosen. Through a mix of theoretical results and numerical simulations, we study whether and to what extent competition incentivizes the adoption of better bandit algorithms, and whether it leads to welfare increases for users. We find that stark competition induces firms to commit to a "greedy" bandit algorithm that leads to low welfare. However, weakening competition by providing firms with some "free" users incentivizes better exploration strategies and increases welfare. We investigate two channels for weakening the competition: relaxing the rationality of users and giving one firm a first-mover advantage. Our findings are closely related to the "competition vs. innovation" relationship, and elucidate the first-mover advantage in the digital economy.

Suggested Citation

  • Guy Aridor & Yishay Mansour & Aleksandrs Slivkins & Zhiwei Steven Wu, 2020. "Competing Bandits: The Perils of Exploration Under Competition," Papers 2007.10144, arXiv.org, revised Oct 2024.
  • Handle: RePEc:arx:papers:2007.10144
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2007.10144
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philippe Aghion & Nick Bloom & Richard Blundell & Rachel Griffith & Peter Howitt, 2005. "Competition and Innovation: an Inverted-U Relationship," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(2), pages 701-728.
    2. Robert Kleinberg & Bo Waggoner & E. Glen Weyl, 2016. "Descending Price Optimally Coordinates Search," Papers 1603.07682, arXiv.org, revised Dec 2016.
    3. Gabaix, Xavier & Laibson, David & Li, Deyuan & Li, Hongyi & Resnick, Sidney & de Vries, Casper G., 2016. "The impact of competition on prices with numerous firms," Journal of Economic Theory, Elsevier, vol. 165(C), pages 1-24.
    4. Dirk Bergemann & Juuso V‰lim‰ki, 2010. "The Dynamic Pivot Mechanism," Econometrica, Econometric Society, vol. 78(2), pages 771-789, March.
    5. Eduardo M. Azevedo & Daniel Gottlieb, 2017. "Perfect Competition in Markets With Adverse Selection," Econometrica, Econometric Society, vol. 85, pages 67-105, January.
    6. Yeon-Koo Che & Johannes Hörner, 2018. "Recommender Systems as Mechanisms for Social Learning," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 871-925.
    7. Patrick Bolton & Christopher Harris, 1999. "Strategic Experimentation," Econometrica, Econometric Society, vol. 67(2), pages 349-374, March.
    8. Marc Rysman, 2009. "The Economics of Two-Sided Markets," Journal of Economic Perspectives, American Economic Association, vol. 23(3), pages 125-143, Summer.
    9. Jeffrey M. Perloff & Steven C. Salop, 1985. "Equilibrium with Product Differentiation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 52(1), pages 107-120.
    10. Bagwell, Kyle, 1990. "Informational product differentiation as a barrier to entry," International Journal of Industrial Organization, Elsevier, vol. 8(2), pages 207-223, June.
    11. Schmalensee, Richard, 1983. "Product Differentiation Advantages of Pioneering Brands: Errata," American Economic Review, American Economic Association, vol. 73(1), pages 250-250, March.
    12. Hal Varian, 2018. "Artificial Intelligence, Economics, and Industrial Organization," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 399-419, National Bureau of Economic Research, Inc.
    13. Jens Prüfer & Christoph Schottmüller, 2021. "Competing with Big Data," Journal of Industrial Economics, Wiley Blackwell, vol. 69(4), pages 967-1008, December.
    14. Schmalensee, Richard, 1982. "Product Differentiation Advantages of Pioneering Brands," American Economic Review, American Economic Association, vol. 72(3), pages 349-365, June.
    15. Milgrom, Paul & Stokey, Nancy, 1982. "Information, trade and common knowledge," Journal of Economic Theory, Elsevier, vol. 26(1), pages 17-27, February.
    16. Xavier Vives, 2008. "Innovation And Competitive Pressure," Journal of Industrial Economics, Wiley Blackwell, vol. 56(3), pages 419-469, December.
    17. Patrick Bajari & Victor Chernozhukov & Ali Hortaçsu & Junichi Suzuki, 2019. "The Impact of Big Data on Firm Performance: An Empirical Investigation," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 33-37, May.
    18. Drew Fudenberg & Jean Tirole, 1983. "Learning-by-Doing and Market Performance," Bell Journal of Economics, The RAND Corporation, vol. 14(2), pages 522-530, Autumn.
    19. de Cornière, Alexandre & Taylor, Greg, 2020. "Data and Competition: a General Framework with Applications to Mergers, Market Structure, and Privacy Policy," TSE Working Papers 20-1076, Toulouse School of Economics (TSE).
    20. Jean Tirole, 1988. "The Theory of Industrial Organization," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262200716, December.
    21. Sham M. Kakade & Ilan Lobel & Hamid Nazerzadeh, 2013. "Optimal Dynamic Mechanism Design and the Virtual-Pivot Mechanism," Operations Research, INFORMS, vol. 61(4), pages 837-854, August.
    22. Michael Rothschild & Joseph Stiglitz, 1976. "Equilibrium in Competitive Insurance Markets: An Essay on the Economics of Imperfect Information," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 90(4), pages 629-649.
    23. Alexander White & Glen Weyl, 2014. "Let the Right “One†Win: Policy Lessons from the New Economics of Platforms," CPI Journal, Competition Policy International, vol. 10.
    24. Susan Athey & Ilya Segal, 2013. "An Efficient Dynamic Mechanism," Econometrica, Econometric Society, vol. 81(6), pages 2463-2485, November.
    25. de Cornière, Alexandre & Taylor, Greg, 2022. "Data and Competition: a Simple Framework with Applications to Mergers and Market Structure," CEPR Discussion Papers 14446, C.E.P.R. Discussion Papers.
    26. André Veiga & E. Glen Weyl, 2016. "Product Design in Selection Markets," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(2), pages 1007-1056.
    27. Daniel Russo & Benjamin Van Roy, 2014. "Learning to Optimize via Posterior Sampling," Mathematics of Operations Research, INFORMS, vol. 39(4), pages 1221-1243, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yiquan Gu & Leonardo Madio & Carlo Reggiani, 2022. "Data brokers co-opetition [The impact of big data on firm performance: an empirical investigation]," Oxford Economic Papers, Oxford University Press, vol. 74(3), pages 820-839.
    2. Yishay Mansour & Aleksandrs Slivkins & Vasilis Syrgkanis, 2019. "Bayesian Incentive-Compatible Bandit Exploration," Operations Research, INFORMS, vol. 68(4), pages 1132-1161, July.
    3. Mateusz Zawisza & Bogumił Kamiński, 2013. "Price patterns in an oligopoly with switching cost and uncertain demand," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 23(3), pages 71-89.
    4. Horst Raff & Marc von der Ruhr, 2007. "Foreign Direct Investment in Producer Services: Theory and Empirical Evidence," Applied Economics Quarterly (formerly: Konjunkturpolitik), Duncker & Humblot, Berlin, vol. 53(3), pages 299-321.
    5. Raff, Horst & Kim, Young-Han, 1999. "Optimal export policy in the presence of informational barriers to entry and imperfect competition," Journal of International Economics, Elsevier, vol. 49(1), pages 99-123, October.
    6. Unterschultz, James R. & Lerohl, Mel L. & Peng, Yanning & Gurung, Rajendra Kumar, 1998. "A Nutraceutical Industry: Policy Implications for Future Directions," Project Report Series 24051, University of Alberta, Department of Resource Economics and Environmental Sociology.
    7. MARTENS Bertin, 2020. "An economic perspective on data and platform market power," JRC Working Papers on Digital Economy 2020-09, Joint Research Centre.
    8. repec:wut:journl:v:3:y:2013:id:1089 is not listed on IDEAS
    9. Levy, Yehuda John & Veiga, Andre, 2020. "On the existence of positive equilibrium profits in competitive screening markets," Games and Economic Behavior, Elsevier, vol. 124(C), pages 140-168.
    10. Dirk Crass & Franz Schwiebacher, 2017. "The importance of trademark protection for product differentiation and innovation," Economia e Politica Industriale: Journal of Industrial and Business Economics, Springer;Associazione Amici di Economia e Politica Industriale, vol. 44(2), pages 199-220, June.
    11. Aghion, Philippe & Akcigit, Ufuk & Howitt, Peter, 2014. "What Do We Learn From Schumpeterian Growth Theory?," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 2, chapter 0, pages 515-563, Elsevier.
    12. Azevedo, Eduardo M. & Gottlieb, Daniel, 2019. "An example of non-existence of Riley equilibrium in markets with adverse selection," Games and Economic Behavior, Elsevier, vol. 116(C), pages 152-157.
    13. Baumann Florian & Friehe Tim, 2016. "Competitive Pressure and Corporate Crime," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 16(2), pages 647-687, April.
    14. Amit Kumar Bardhan & Saad Ashraf, 2024. "More buyers or more sellers: on marketing resource allocation strategies of competing two-sided platforms," Electronic Commerce Research, Springer, vol. 24(4), pages 2579-2608, December.
    15. repec:ags:aaea22:343858 is not listed on IDEAS
    16. Philip Auerswald, 2010. "Entry and Schumpeterian profits," Journal of Evolutionary Economics, Springer, vol. 20(4), pages 553-582, August.
    17. Ehsan Valavi & Joel Hestness & Newsha Ardalani & Marco Iansiti, 2022. "Time and the Value of Data," Papers 2203.09118, arXiv.org.
    18. Crass, Dirk & Schwiebacher, Franz, 2013. "Do trademarks diminish the substitutability of products in innovative knowledge-intensive services?," ZEW Discussion Papers 13-061, ZEW - Leibniz Centre for European Economic Research.
    19. Boone, J. & van Ours, J.C. & van der Wiel, H.P., 2007. "How (Not) to Measure Competition," Discussion Paper 2007-32, Tilburg University, Center for Economic Research.
    20. Richard G. Frank & David S. Salkever, 1991. "Pricing, Patent Loss and the Market For Pharmaceuticals," NBER Working Papers 3803, National Bureau of Economic Research, Inc.
    21. Gene M. Grossman & Henrik Horn, 1988. "Infant-Industry Protection Reconsidered: The Case of Informational Barriers to Entry," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 103(4), pages 767-787.
    22. Yang, Jinrui, 2016. "Monopoly VS Competition: Market Structure’s Impact on Product Innovation-with Endogenous Quality of New Product," MPRA Paper 70094, University Library of Munich, Germany.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2007.10144. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.