This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Strategic Experimentation with Exponential Bandits

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Cripps, Martin William
Keller, Godfrey
Rady, Sven

Additional information is available for the following registered author(s):

Abstract

This Paper studies a game of strategic experimentation with two-armed bandits whose risky arm might yield a pay-off only after some exponentially distributed random time. Because of free-riding, there is an inefficiently low level of experimentation in any equilibrium where the players use stationary Markovian strategies with posterior beliefs as the state variable. After characterizing the unique symmetric Markovian equilibrium of the game, which is in mixed strategies, we construct a variety of pure-strategy equilibria. There is no equilibrium where all players use simple cut-off strategies. Equilibria where players switch finitely often between the roles of experimenter and free-rider all lead to the same pattern of information acquisition; the efficiency of these equilibria depends on the way players share the burden of experimentation among them. In equilibria where players switch roles infinitely often, they can acquire an approximately efficient amount of information, but the rate at which it is acquired still remains inefficient; moreover, the expected pay-off of an experimenter exhibits the novel feature that it rises as players become more pessimistic. Finally, over the range of beliefs where players use both arms a positive fraction of the time, the symmetric equilibrium is dominated by any asymmetric one in terms of aggregate pay-offs.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.cepr.org/pubs/dps/DP3814.asp
File Format: application/pdf
File Function:
Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Publisher Info
Paper provided by C.E.P.R. Discussion Papers in its series CEPR Discussion Papers with number 3814.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: Mar 2003
Date of revision:
Handle: RePEc:cpr:ceprdp:3814

Contact details of provider:
Postal: Centre for Economic Policy Research, 53--56 Great Sutton Street, London EC1V 0DG
Phone: 44 - 20 - 7183 8801
Fax: 44 - 20 - 7183 8820

Order Information:
Email:

For technical questions regarding this item, or to correct its listing, contact: ().

Related research
Keywords: bayesian learning; exponential distribution; markov perfect equilibrium; public goods; strategic experimentation; two-armed bandits;

Other versions of this item:

Find related papers by JEL classification:
C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search, Learning, and Information
H41 - Public Economics - - Publicly Provided Goods - - - Public Goods
O32 - Economic Development, Technological Change, and Growth - - Technological Change - - - Management of Technological Innovation and R&D

This paper has been announced in the following NEP Reports:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Bergemann, Dirk & Hege, Ulrich, 2001. "The Financing of Innovation: Learning and Stopping," CEPR Discussion Papers 2763, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
    Other versions:
  2. Bergemann, Dirk & Hege, Ulrich, 1998. "Venture capital financing, moral hazard, and learning," Journal of Banking & Finance, Elsevier, vol. 22(6-8), pages 703-735, August. [Downloadable!] (restricted)
    Other versions:
  3. Lockwood, Ben & Thomas, Jonathan P, 2002. "Gradualism and Irreversibility," Review of Economic Studies, Blackwell Publishing, vol. 69(2), pages 339-56, April.
    Other versions:
  4. David A. Malueg & Shunichi O. Tsutsui, 1997. "Dynamic R&D Competition with Learning," RAND Journal of Economics, The RAND Corporation, vol. 28(4), pages 751-772, Winter. [Downloadable!] (restricted)
  5. Admati, Anat R & Perry, Motty, 1991. "Joint Projects without Commitment," Review of Economic Studies, Blackwell Publishing, vol. 58(2), pages 259-76, April. [Downloadable!] (restricted)
  6. Patrick Bolton & Christopher Harris, 1999. "Strategic Experimentation," Econometrica, Econometric Society, vol. 67(2), pages 349-374, March.
  7. Marx, Leslie M & Matthews, Steven A, 2000. "Dynamic Voluntary Contribution to a Public Project," Review of Economic Studies, Blackwell Publishing, vol. 67(2), pages 327-58, April.
    Other versions:
  8. Rothschild, Michael, 1974. "A two-armed bandit theory of market pricing," Journal of Economic Theory, Elsevier, vol. 9(2), pages 185-202, October. [Downloadable!] (restricted)
  9. Keller, Godfrey & Rady, Sven, 2001. "Price Dispersion and Learning in a Dynamic Differentiated-Goods Duopoly," Discussion Papers in Economics 21, University of Munich, Department of Economics. [Downloadable!]
    Other versions:
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. Hikmet Gunay, 2008. "The role of externalities and information aggregation in market collapse," Economic Theory, Springer, vol. 35(2), pages 367-379, May. [Downloadable!] (restricted)
  2. Marc-Andreas Muendler, 2005. "Rational Transparency Choice in Financial Market Equilibrium¤," University of California at San Diego, Economics Working Paper Series 2005-04R, Department of Economics, UC San Diego. [Downloadable!]
  3. Godfrey Keller & Sven Rady, 2009. "Strategic Experimentation with Poisson Bandits," Discussion Papers 260, SFB/TR 15 Governance and the Efficiency of Economic Systems, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich. [Downloadable!]
    Other versions:
  4. Daron Acemoglu & Kostas Bimpikis & Asuman E. Ozdaglar, 2009. "Experimentation, Patents, and Innovation," Levine's Working Paper Archive 814577000000000081, David K. Levine. [Downloadable!]
    Other versions:
  5. Marc-Andreas Muendler, 2005. "Rational Information Choice in Financial Market Equilibrium," University of California at San Diego, Economics Working Paper Series 2005-04, Department of Economics, UC San Diego. [Downloadable!]
    Other versions:
  6. Bruno Strulovici, 2008. "Learning while voting: determinants of collective experimentation," Economics Papers 2008-W08, Economics Group, Nuffield College, University of Oxford. [Downloadable!]
  7. Klein, Nicolas & Rady, Sven, 2008. "Negatively Correlated Bandits," Discussion Papers in Economics 5332, University of Munich, Department of Economics. [Downloadable!]
    Other versions:
  8. Francisco Ruiz-Aliseda & Jianjun Wu, 2007. "Irreversible Investment in Stochastically Cyclical Markets," Economics Working Papers 1018, Department of Economics and Business, Universitat Pompeu Fabra. [Downloadable!]
  9. Francisco J. Buera & Alexander Monge-Naranjo & Giorgio E. Primiceri, 2008. "Learning the Wealth of Nations," NBER Working Papers 14595, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
  10. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2004. "Timing Games with Informational Externalities," Levine's Working Paper Archive 122247000000000704, David K. Levine. [Downloadable!]
  11. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2004. "Social Learning in One-Arm Bandit Problems," Discussion Papers 1396, Northwestern University, Center for Mathematical Studies in Economics and Management Science. [Downloadable!]
    Other versions:
  12. Sorensen, Morten, 2007. "Learning by Investing: Evidence from Venture Capital," SIFR Research Report Series 53, Institute for Financial Research. [Downloadable!]
  13. Faruk Gul & Wolfgang Pesendorfer, 2007. "The War of Information," Levine's Bibliography 321307000000000921, UCLA Department of Economics. [Downloadable!]
  14. Vieille, Nicolas & Rosenberg, Dinah & Solan, Eilon, 2006. "Informational externalities and convergence of behavior," Les Cahiers de Recherche 856, HEC Paris. [Downloadable!]
  15. Marc-Andreas Muendler, 2005. "Risk Neutral Investors Do Not Acquire Information¤," University of California at San Diego, Economics Working Paper Series 2005-10, Department of Economics, UC San Diego. [Downloadable!]
  16. Marc-Andreas Muendler, 2005. "The Action Value of Information and the Natural Transparency Limit¤," University of California at San Diego, Economics Working Paper Series 2005-09, Department of Economics, UC San Diego. [Downloadable!]
  17. Daniel Krähmer, 2005. "Equilibrium Learning in Simple Contests," Discussion Papers 73, SFB/TR 15 Governance and the Efficiency of Economic Systems, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich. [Downloadable!]
Statistics
Access and download statistics

Did you know? There are NEP reports in over 80 fields that deliver new research to your email.

This page was last updated on 2009-11-24.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.