IDEAS home Printed from https://ideas.repec.org/a/eee/dyncon/v111y2020ics0165188918302689.html
   My bibliography  Save this article

Choosing a good toolkit, II: Bayes-rule based heuristics

Author

Listed:
  • Francetich, Alejandro
  • Kreps, David

Abstract

We study heuristics for a class of complex multi-armed bandit problems, the period-by-period choice of a set of objects or “toolkit” where the decision maker learns about the value of tools within the chosen toolkit. This paper studies heuristics that involve a decision maker who employs Bayesian inference. Analytical results are combined with simulations to gain insights into the relative performance of these heuristics. We depart from the extensive bandit-learning literature in computer science and operations research by employing the discounted-expected-reward formulation that stresses the importance of the classic exploration–exploitation tradeoff. A companion paper, Francetich and Kreps (2019), studies a variety of prior-free heuristics.

Suggested Citation

  • Francetich, Alejandro & Kreps, David, 2020. "Choosing a good toolkit, II: Bayes-rule based heuristics," Journal of Economic Dynamics and Control, Elsevier, vol. 111(C).
    • Handle: RePEc:eee:dyncon:v:111:y:2020:i:c:s0165188918302689
    DOI: 10.1016/j.jedc.2019.103814
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165188918302689
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jedc.2019.103814?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gigerenzer, Gerd & Todd, Peter M. & ABC Research Group,, 2000. "Simple Heuristics That Make Us Smart," OUP Catalogue, Oxford University Press, number 9780195143812, Decembrie.
    2. Francetich, Alejandro & Kreps, David, 2014. "Bayesian inference does not lead you astray…on average," Economics Letters, Elsevier, vol. 125(3), pages 444-446.
    3. Denis Sauré & Assaf Zeevi, 2013. "Optimal Dynamic Assortment Planning with Demand Learning," Manufacturing & Service Operations Management, INFORMS, vol. 15(3), pages 387-404, July.
    4. Alejandro Francetich & David Kreps, 2014. "Bayesian Inference Does Not Lead You Astray... On Average," Working Papers 514, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fudenberg, Drew & He, Kevin, 2021. "Player-compatible learning and player-compatible equilibrium," Journal of Economic Theory, Elsevier, vol. 194(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hart, Sergiu & Rinott, Yosef, 2020. "Posterior probabilities: Dominance and optimism," Economics Letters, Elsevier, vol. 194(C).
    2. Alejandro Francetich & David M. Kreps, 2014. "Choosing a Good Toolkit: An Essay in Behavioral Economics," Working Papers 524, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    3. Sergiu Hart & Yosef Rinott, 2022. "Posterior Probabilities: Nonmonotonicity, Asymptotic Rates, Log-Concavity, and Tur\'an's Inequality," Papers 2209.11728, arXiv.org.
    4. Stephen A. Hillegeist & James P. Kavourakis & Matthew Pinnuck, 2023. "The association between quarter length, forecast errors, and firms’ voluntary disclosures," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(2), pages 1885-1918, June.
    5. Andrea Polonioli, 2013. "Re-assessing the Heuristics debate," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 12(2), pages 263-271, November.
    6. Magni, Carlo Alberto, 2007. "Investment decisions, equivalent risk and bounded rationality," MPRA Paper 6073, University Library of Munich, Germany.
    7. Marc Jekel & Susann Fiedler & Andreas Glockner, 2011. "Diagnostic task selection for strategy classification in judgment and decision making," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 6(8), pages 782-799, December.
    8. Hüsler, A. & Sornette, D. & Hommes, C.H., 2013. "Super-exponential bubbles in lab experiments: Evidence for anchoring over-optimistic expectations on price," Journal of Economic Behavior & Organization, Elsevier, vol. 92(C), pages 304-316.
    9. Gel, Esma S. & Salman, F. Sibel, 2022. "Dynamic ordering decisions with approximate learning of supply yield uncertainty," International Journal of Production Economics, Elsevier, vol. 243(C).
    10. Roberto Casarin & Flaminio Squazzoni, 2012. "Financial press and stock markets in times of crisis," Working Papers 2012_04, Department of Economics, University of Venice "Ca' Foscari".
    11. Brundin, Ethel & Gustavsson, Veronica, 2008. "Escalation of Commitment in Investment Decisions: The Role of Emotions under Uncertainty," CISEG Working Papers Series 3, Jönköping International Business School, Centre for Innovation Systems, Entrepreneurship and Growth.
    12. Dietrich, Franz & List, Christian, 2016. "Mentalism Versus Behaviourism In Economics: A Philosophy-Of-Science Perspective," Economics and Philosophy, Cambridge University Press, vol. 32(2), pages 249-281, July.
    13. Karla Hoff, 2016. "Behavioral Economics and Social Exclusion: Can Interventions Overcome Prejudice?," International Economic Association Series, in: Kaushik Basu & Joseph E. Stiglitz (ed.), Inequality and Growth: Patterns and Policy, chapter 6, pages 172-200, Palgrave Macmillan.
    14. Francesco Guala & Antonio Filippin, 2017. "The Effect of Group Identity on Distributive Choice: Social Preference or Heuristic?," Economic Journal, Royal Economic Society, vol. 127(602), pages 1047-1068, June.
    15. Heiko Rauhut & Marcel Junker, 2009. "Punishment Deters Crime Because Humans Are Bounded in Their Strategic Decision-Making," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(3), pages 1-1.
    16. Gur, Yonatan & Macnamara, Gregory & Saban, Daniela, 2020. "On the Disclosure of Promotion Value in Platforms with Learning Sellers," Research Papers 3865, Stanford University, Graduate School of Business.
    17. Thomas Dudey & Peter Todd, 2001. "Making Good Decisions with Minimal Information: Simultaneous and Sequential Choice," Journal of Bioeconomics, Springer, vol. 3(2), pages 195-215, May.
    18. Fernando Bernstein & A. Gürhan Kök & Lei Xie, 2015. "Dynamic Assortment Customization with Limited Inventories," Manufacturing & Service Operations Management, INFORMS, vol. 17(4), pages 538-553, October.
    19. Claudio Cardoso Flores & Marcelo Cunha Medeiros, 2020. "Online Action Learning in High Dimensions: A Conservative Perspective," Papers 2009.13961, arXiv.org, revised Mar 2024.
    20. repec:cup:judgdm:v:6:y:2011:i:8:p:782-799 is not listed on IDEAS
    21. Gabriel Gershenfeld, 2015. "Conjoint Analysis for Ticket Offerings at the Cleveland Indians," Interfaces, INFORMS, vol. 45(2), pages 166-174, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:dyncon:v:111:y:2020:i:c:s0165188918302689. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jedc .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.