IDEAS home Printed from https://ideas.repec.org/p/zbw/vfsc16/145931.html
   My bibliography  Save this paper

A Bandit Model of Two-Dimensional Uncertainty -- Rationalizing Mindsets

Author

Listed:
  • Deimen, Inga
  • Wirtz, Julia

Abstract

We analyze a new type of bandit where an agent is confronted with two-dimensional uncertainty. The agent does not know whether ability or effort is required to succeed at a given task. Moreover, the agent does not know her own ability level. In each period, after deciding whether to exert effort or not, the agent observes a success or a failure and updates her beliefs about both the task and her ability accordingly. In contrast to a standard bandit model, the agent gains information even when she is not exerting effort. In this setting different agents react to failure in different ways; while some agents find it optimal to resign others prefer to increase their effort. We show that different effort costs and beliefs about the own ability and the production function together with Bayesian updating can explain the differences in behavior.

Suggested Citation

  • Deimen, Inga & Wirtz, Julia, 2016. "A Bandit Model of Two-Dimensional Uncertainty -- Rationalizing Mindsets," VfS Annual Conference 2016 (Augsburg): Demographic Change 145931, Verein für Socialpolitik / German Economic Association.
  • Handle: RePEc:zbw:vfsc16:145931
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/145931/1/VfS_2016_pid_7074.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gustavo Manso, 2011. "Motivating Innovation," Journal of Finance, American Finance Association, vol. 66(5), pages 1823-1860, October.
    2. Rothschild, Michael, 1974. "A two-armed bandit theory of market pricing," Journal of Economic Theory, Elsevier, vol. 9(2), pages 185-202, October.
    3. , & ,, 2010. "Strategic experimentation with Poisson bandits," Theoretical Economics, Econometric Society, vol. 5(2), May.
    4. Godfrey Keller & Sven Rady & Martin Cripps, 2005. "Strategic Experimentation with Exponential Bandits," Econometrica, Econometric Society, vol. 73(1), pages 39-68, January.
    5. Mathias Dewatripont & Ian Jewitt & Jean Tirole, 1999. "The Economics of Career Concerns, Part I: Comparing Information Structures," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(1), pages 183-198.
    6. Thomas Piketty, 1995. "Social Mobility and Redistributive Politics," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(3), pages 551-584.
    7. Weitzman, Martin L, 1979. "Optimal Search for the Best Alternative," Econometrica, Econometric Society, vol. 47(3), pages 641-654, May.
    8. Mathias Dewatripont & Ian Jewitt & Jean Tirole, 1999. "The Economics of Career Concerns, Part I: Comparing Information Structures," Review of Economic Studies, Oxford University Press, vol. 66(1), pages 183-198.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Keller, Godfrey & Novák, Vladimír & Willems, Tim, 2019. "A note on optimal experimentation under risk aversion," Journal of Economic Theory, Elsevier, vol. 179(C), pages 476-487.
    2. Asaf Cohen & Eilon Solan, 2013. "Bandit Problems with Lévy Processes," Mathematics of Operations Research, INFORMS, vol. 38(1), pages 92-107, February.
    3. Roland G. Fryer, Jr. & Philipp Harms, 2013. "Two-Armed Restless Bandits with Imperfect Information: Stochastic Control and Indexability," NBER Working Papers 19043, National Bureau of Economic Research, Inc.
    4. Klein, Nicolas, 2013. "Strategic learning in teams," Games and Economic Behavior, Elsevier, vol. 82(C), pages 636-657.
    5. Thomas, Caroline, 2019. "Experimentation with reputation concerns – Dynamic signalling with changing types," Journal of Economic Theory, Elsevier, vol. 179(C), pages 366-415.
    6. Roland Fryer & Philipp Harms, 2018. "Two-Armed Restless Bandits with Imperfect Information: Stochastic Control and Indexability," Mathematics of Operations Research, INFORMS, vol. 43(2), pages 399-427, May.
    7. Johannes Hörner & Larry Samuelson, 2013. "Incentives for experimenting agents," RAND Journal of Economics, RAND Corporation, vol. 44(4), pages 632-663, December.
    8. Nicolas Klein & Tymofiy Mylovanov, 2011. "Should the Flatterers be Avoided?," 2011 Meeting Papers 1273, Society for Economic Dynamics.
    9. Byun, Seong, 2022. "The role of intrinsic incentives and corporate culture in motivating innovation," Journal of Banking & Finance, Elsevier, vol. 134(C).
    10. Heidhues, Paul & Rady, Sven & Strack, Philipp, 2015. "Strategic experimentation with private payoffs," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 531-551.
    11. Deimen, Inga & Wirtz, Julia, 2022. "Control, cost, and confidence: Perseverance and procrastination in the face of failure," Games and Economic Behavior, Elsevier, vol. 134(C), pages 52-74.
    12. Sorensen, Morten, 2007. "Learning by Investing: Evidence from Venture Capital," SIFR Research Report Series 53, Institute for Financial Research.
    13. Byford, Martin C., 2017. "Moral hazard in strategic decision making," International Journal of Industrial Organization, Elsevier, vol. 55(C), pages 114-136.
    14. Bhaskar, V. & Mailath, George J., 2019. "The curse of long horizons," Journal of Mathematical Economics, Elsevier, vol. 82(C), pages 74-89.
    15. Farzad Pourbabaee, 2022. "Robust experimentation in the continuous time bandit problem," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 73(1), pages 151-181, February.
    16. Gustavo Manso & Farzad Pourbabaee, 2022. "The Impact of Connectivity on the Production and Diffusion of Knowledge," Papers 2202.00729, arXiv.org.
    17. Krahmer, Daniel, 2007. "Equilibrium learning in simple contests," Games and Economic Behavior, Elsevier, vol. 59(1), pages 105-131, April.
    18. repec:cwl:cwldpp:1726rrr is not listed on IDEAS
    19. Gomes, Renato & Gottlieb, Daniel & Maestri, Lucas, 2016. "Experimentation and project selection: Screening and learning," Games and Economic Behavior, Elsevier, vol. 96(C), pages 145-169.
    20. Johannes Hoelzemann & Nicolas Klein, 2021. "Bandits in the lab," Quantitative Economics, Econometric Society, vol. 12(3), pages 1021-1051, July.
    21. Agbo, Maxime, 2015. "A perpetual search for talents across overlapping generations: A learning process," Mathematical Social Sciences, Elsevier, vol. 76(C), pages 131-145.

    More about this item

    JEL classification:

    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D80 - Microeconomics - - Information, Knowledge, and Uncertainty - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:vfsc16:145931. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/vfsocea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.