This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Strategic Experimentation with Exponential Bandits

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Godfrey Keller
Martin Cripps
Sven Rady

Additional information is available for the following registered author(s):

Abstract

This paper studies a game of strategic experimentation with two-armed bandits whose risky arm might yield a payoff only after some exponentially distributed random time. Because of free-riding, there is an inefficiently low level of experimentation in any equilibrium where the players use stationary Markovian strategies with posterior beliefs as the state variable. After characterizing the unique symmetric Markovian equilibrium of the game, which is in mixed strategies, we construct a variety of pure-strategy equilibria. There is no equilibrium where all players use simple cut-off strategies. Equilibria where players switch finitely often between the roles of experimenter and free-rider all lead to the same pattern of information acquisition; the efficiency of these equilibria depends on the way players share the burden of experimentation among them. In equilibria where players switch roles infinitely often, they can acquire an approximately efficient amount of information, but the rate at which it is acquired still remains inefficient; moreoever, the expected payoff of an experimenter exhibits the novel feature that it rises as players become more pessimistic. Finally, over the range of beliefs where players use both arms a positive fraction of the time, the symmetric equilibrium is dominated by any asymmetric one in terms of aggregate payoffs.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help file. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.economics.ox.ac.uk/Research/wp/pdf/paper143.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by University of Oxford, Department of Economics in its series Economics Series Working Papers with number 143.

Download reference. The following formats are available: HTML, plain text, BibTeX, RIS (EndNote), ReDIF
Length:
Date of creation: 2003
Date of revision:
Handle: RePEc:oxf:wpaper:143

Contact details of provider:
Postal: Manor Rd. Building, Oxford, OX1 3UQ
Email:
Web page: http://www.economics.ox.ac.uk/
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: (Mark George).

Related research
Keywords: strategic experimentation two-armed bandit exponential distribution Bayesian learning Markov perfect equilibrium public goods

Other versions of this item:

Find related papers by JEL classification:
C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search, Learning, and Information
H41 - Public Economics - - Publicly Provided Goods - - - Public Goods
O32 - Economic Development, Technological Change, and Growth - - Technological Change - - - Management of Technological Innovation and R&D

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

  1. Bergemann, Dirk & Hege, Ulrich, 2001. "The Financing of Innovation: Learning and Stopping," CEPR Discussion Papers 2763, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
    Other versions:
  2. Patrick Bolton & Christopher Harris, 1999. "Strategic Experimentation," Econometrica, Econometric Society, vol. 67(2), pages 349-374, March.
  3. Marx, Leslie M & Matthews, Steven A, 2000. "Dynamic Voluntary Contribution to a Public Project," Review of Economic Studies, Blackwell Publishing, vol. 67(2), pages 327-58, April.
    Other versions:
  4. Bergemann, Dirk & Hege, Ulrich, 1998. "Venture capital financing, moral hazard, and learning," Journal of Banking & Finance, Elsevier, vol. 22(6-8), pages 703-735, August. [Downloadable!] (restricted)
    Other versions:
  5. Lockwood, Ben & Thomas, Jonathan P, 2002. "Gradualism and Irreversibility," Review of Economic Studies, Blackwell Publishing, vol. 69(2), pages 339-56, April.
    Other versions:
  6. Rothschild, Michael, 1974. "A two-armed bandit theory of market pricing," Journal of Economic Theory, Elsevier, vol. 9(2), pages 185-202, October. [Downloadable!] (restricted)
  7. David A. Malueg & Shunichi O. Tsutsui, 1997. "Dynamic R&D Competition with Learning," RAND Journal of Economics, The RAND Corporation, vol. 28(4), pages 751-772, Winter. [Downloadable!] (restricted)
  8. Keller, Godfrey & Rady, Sven, 2001. "Price Dispersion and Learning in a Dynamic Differentiated-Goods Duopoly," Discussion Papers in Economics 21, University of Munich, Department of Economics. [Downloadable!]
    Other versions:
  9. Admati, Anat R & Perry, Motty, 1991. "Joint Projects without Commitment," Review of Economic Studies, Blackwell Publishing, vol. 58(2), pages 259-76, April. [Downloadable!] (restricted)
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2004. "Timing Games with Informational Externalities," Levine's Working Paper Archive 122247000000000704, UCLA Department of Economics. [Downloadable!]
  2. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2004. "Social Learning in One-Arm Bandit Problems," Discussion Papers 1396, Northwestern University, Center for Mathematical Studies in Economics and Management Science. [Downloadable!]
  3. Sorensen, Morten, 2007. "Learning by Investing: Evidence from Venture Capital," SIFR Research Report Series 53, Swedish Institute for Financial Research. [Downloadable!]
  4. Junjian Miao & Neng Wang, 2005. "Learning, Investment, and Entrepreneurial Survival," Boston University - Department of Economics - Macroeconomics Working Papers Series WP2005-015, Boston University - Department of Economics. [Downloadable!]
  5. Faruk Gul & Wolfgang Pesendorfer, 2007. "The War of Information," Levine's Bibliography 321307000000000921, UCLA Department of Economics. [Downloadable!]
  6. Daniel Krähmer, 2005. "Equilibrium Learning in Simple Contests," Discussion Papers 73, SFB/TR 15 Governance and the Efficiency of Economic Systems, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich. [Downloadable!]
  7. Vieille, Nicolas & Rosenberg, Dinah & Solan, Eilon, 2006. "Informational externalities and convergence of behavior," Les Cahiers de Recherche 856, Groupe HEC. [Downloadable!]
  8. Hikmet Gunay, 2008. "The role of externalities and information aggregation in market collapse," Economic Theory, Springer, vol. 35(2), pages 367-379, May. [Downloadable!] (restricted)
  9. Marc-Andreas Muendler, 2005. "Rational Information Choice in Financial Market Equilibrium," University of California at San Diego, Economics Working Paper Series 2005-04, Department of Economics, UC San Diego. [Downloadable!]
    Other versions:
  10. Marc-Andreas Muendler, 2005. "Rational Transparency Choice in Financial Market Equilibrium¤," University of California at San Diego, Economics Working Paper Series 2005-04R, Department of Economics, UC San Diego. [Downloadable!]
  11. Bruno Strulovici, 2008. "Learning while voting: determinants of collective experimentation," Economics Papers 2008-W08, Economics Group, Nuffield College, University of Oxford. [Downloadable!]
  12. Francisco Ruiz-Aliseda & Jianjun Wu, 2007. "Irreversible Investment in Stochastically Cyclical Markets," Economics Working Papers 1018, Department of Economics and Business, Universitat Pompeu Fabra. [Downloadable!]
  13. Marc-Andreas Muendler, 2005. "Risk Neutral Investors Do Not Acquire Information¤," University of California at San Diego, Economics Working Paper Series 2005-10, Department of Economics, UC San Diego. [Downloadable!]
  14. Marc-Andreas Muendler, 2005. "The Action Value of Information and the Natural Transparency Limit¤," University of California at San Diego, Economics Working Paper Series 2005-09, Department of Economics, UC San Diego. [Downloadable!]
Statistics
Access and download statistics

Did you know? You can include your works in the database easily by uploading them on the Munich Personal RePEc Archive (MPRA) if you do not have access to an institutional RePEc archive.

This page was last updated on 2008-8-5.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.