IDEAS home Printed from https://ideas.repec.org/a/eee/stapro/v80y2010i5-6p381-385.html

On the optimal amount of experimentation in sequential decision problems

Author

Listed:
  • Rosenberg, Dinah
  • Solan, Eilon
  • Vieille, Nicolas

Abstract

We provide a tight bound on the amount of experimentation under the optimal strategy in sequential decision problems. We show the applicability of the result by providing a bound on the cut-off in a one-arm bandit problem.

Suggested Citation

  • Rosenberg, Dinah & Solan, Eilon & Vieille, Nicolas, 2010. "On the optimal amount of experimentation in sequential decision problems," Statistics & Probability Letters, Elsevier, vol. 80(5-6), pages 381-385, March.
    • Handle: RePEc:eee:stapro:v:80:y:2010:i:5-6:p:381-385
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-7152(09)00438-6
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or

    for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Avinash K. Dixit & Robert S. Pindyck, 1994. "Investment under Uncertainty," Economics Books, Princeton University Press, edition 1, number 5474, December.
    2. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2007. "Social Learning in One-Arm Bandit Problems," Econometrica, Econometric Society, vol. 75(6), pages 1591-1611, November.
    3. Rosenberg, Dinah & Solan, Eilon & Vieille, Nicolas, 2009. "Informational externalities and emergence of consensus," Games and Economic Behavior, Elsevier, vol. 66(2), pages 979-994, July.
    4. Godfrey Keller & Sven Rady & Martin Cripps, 2005. "Strategic Experimentation with Exponential Bandits," Econometrica, Econometric Society, vol. 73(1), pages 39-68, January.
    5. Monica Brezzi & Tze Leung Lai, 2000. "Incomplete Learning from Endogenous Data in Dynamic Allocation," Econometrica, Econometric Society, vol. 68(6), pages 1511-1516, November.
    6. Patrick Bolton & Christopher Harris, 1999. "Strategic Experimentation," Econometrica, Econometric Society, vol. 67(2), pages 349-374, March.
    7. Dirk Bergemann & Juuso Välimäki, 2000. "Experimentation in Markets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(2), pages 213-234.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rosenberg, Dinah & Solan, Eilon & Vieille, Nicolas, 2009. "Informational externalities and emergence of consensus," Games and Economic Behavior, Elsevier, vol. 66(2), pages 979-994, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Camargo, Braz, 2014. "Learning in society," Games and Economic Behavior, Elsevier, vol. 87(C), pages 381-396.
    2. Amador, Manuel & Weill, Pierre-Olivier, 2012. "Learning from private and public observations of othersʼ actions," Journal of Economic Theory, Elsevier, vol. 147(3), pages 910-940.
    3. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2004. "Timing Games with Informational Externalities," Levine's Working Paper Archive 122247000000000704, David K. Levine.
    4. Doruk Cetemen & Can Urgun & Leeat Yariv, 2023. "Collective Progress: Dynamics of Exit Waves," Journal of Political Economy, University of Chicago Press, vol. 131(9), pages 2402-2450.
    5. Dinah Rosenberg & Eilon Solan & Nicolas Vieille, 2007. "Social Learning in One-Arm Bandit Problems," Econometrica, Econometric Society, vol. 75(6), pages 1591-1611, November.
    6. Kohei Kawaguchi, 2021. "When Will Workers Follow an Algorithm? A Field Experiment with a Retail Business," Management Science, INFORMS, vol. 67(3), pages 1670-1695, March.
    7. Ahlvik, Lassi & Iho, Antti, 2018. "Optimal geoengineering experiments," Journal of Environmental Economics and Management, Elsevier, vol. 92(C), pages 148-168.
    8. Hu, Audrey & Zou, Liang, 2026. "Optimal allocation strategies in a discrete-time bandit problem," Journal of Economic Dynamics and Control, Elsevier, vol. 184(C).
    9. Boyan Jovanovic & Sai Ma, 2022. "Uncertainty and Growth Disasters," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 44, pages 33-64, April.
    10. Boyarchenko, Svetlana & Levendorskiĭ, Sergei, 2014. "Preemption games under Lévy uncertainty," Games and Economic Behavior, Elsevier, vol. 88(C), pages 354-380.
    11. Osnat Zohar, 2019. "Boom-Bust Cycles of Learning, Investment and Disagreement," Bank of Israel Working Papers 2019.06, Bank of Israel.
    12. Wagner, Peter A., 2018. "Who goes first? Strategic delay under information asymmetry," Theoretical Economics, Econometric Society, vol. 13(1), January.
    13. Wagner, Peter A. & Klein, Nicolas, 2022. "Strategic investment and learning with private information," Journal of Economic Theory, Elsevier, vol. 204(C).
    14. Renault, Jérôme & Solan, Eilon & Vieille, Nicolas, 0. "Strategic experimentation with privately observed payoffs," Theoretical Economics, Econometric Society.
    15. Wuggenig, Mirjam, 2015. "Learning faster or more precisely? Strategic experimentation in networks," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 113196, Verein für Socialpolitik / German Economic Association.
    16. Simina Br^anzei & MohammadTaghi Hajiaghayi & Reed Phillips & Suho Shin & Kun Wang, 2024. "Dueling Over Dessert, Mastering the Art of Repeated Cake Cutting," Papers 2402.08547, arXiv.org, revised Feb 2024.
    17. Boyarchenko, Svetlana, 2021. "Inefficiency of sponsored research," Journal of Mathematical Economics, Elsevier, vol. 95(C).
    18. Simina Br^anzei & Yuval Peres, 2019. "Multiplayer Bandit Learning, from Competition to Cooperation," Papers 1908.01135, arXiv.org, revised Jan 2024.
    19. Nicolas Klein & Sven Rady, 2011. "Negatively Correlated Bandits," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(2), pages 693-732.
    20. Moscarini, Giuseppe & Squintani, Francesco, 2010. "Competitive experimentation with private information: The survivor's curse," Journal of Economic Theory, Elsevier, vol. 145(2), pages 639-660, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:stapro:v:80:y:2010:i:5-6:p:381-385. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.