This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Bandit Problems

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Dirk Bergemann () (Department of Economics, Yale University)
Juuso Valimaki (Department of Economics, Helsinki School of Economics and University of Southampton)

Additional information is available for the following registered author(s):

Abstract

We survey the literature on multi-armed bandit models and their applications in economics. The multi-armed bandit problem is a statistical decision model of an agent trying to optimize his decisions while improving his information at the same time. This classic problem has received much attention in economics as it concisely models the trade-off between exploration (trying out each arm to find the best one) and exploitation (playing the arm believed to give the best payoff).

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://cowles.econ.yale.edu/P/cd/d15b/d1551.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by Cowles Foundation, Yale University in its series Cowles Foundation Discussion Papers with number 1551.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length: 15 pages
Date of creation: Jan 2006
Date of revision:
Handle: RePEc:cwl:cwldpp:1551

Contact details of provider:
Postal: Yale University, Box 208281, New Haven, CT 06520-8281 USA
Phone: (203) 432-3702
Fax: (203) 432-6167
Web page: http://cowles.econ.yale.edu/
More information through EDIRC

Order Information:
Postal: Cowles Foundation, Yale University, Box 208281, New Haven, CT 06520-8281 USA

For technical questions regarding this item, or to correct its listing, contact: (Glena Ames).

Related research
Keywords: One-Armed Bandit; Multi-Armed Bandit; Bayesian Learning; Experimentation; Index Policy; Matching; Experience Goods;

Find related papers by JEL classification:
C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
D43 - Microeconomics - - Market Structure and Pricing - - - Oligopoly and Other Forms of Market Imperfection
D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search, Learning, and Information

This paper has been announced in the following NEP Reports:

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)
  1. Sorensen, Morten, 2007. "Learning by Investing: Evidence from Venture Capital," SIFR Research Report Series 53, Institute for Financial Research. [Downloadable!]
  2. Eitan Altman, 2007. "Comments on: Dynamic priority allocation via restless bandit marginal productivity indices," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer, vol. 15(2), pages 202-207, December. [Downloadable!] (restricted)
Statistics
Access and download statistics

Did you know? To receive notification of recent additions to the database, subscribe to the free NEP reports.

This page was last updated on 2009-12-22.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.