IDEAS home Printed from https://ideas.repec.org/p/hhs/cbsnow/2022_016.html

Learning by Convex Combination

Author

Listed:

Abstract

We study how an agent evaluates the optimality of an action when she only observes a sample of its outcomes, not the outcome distribution. We characterize a model where the agent assigns an ex-ante utility to the action and then, upon seeing the sample, “updates” her evaluation by taking a convex combination of this ex-ante utility and the average utility of the outcomes in the sample. The weight on the average utility in this convex combination increases with sample size. Asymptotically, actions are evaluated using their sample average utility. The model includes Bayesian benchmarks as special cases. More generally, it describes an agent that may learn imperfectly yet consistently with a rough intuitive understanding of the Law of Large Numbers; it also enables decision-theoretic definitions of important concepts in the descriptive study of probabilistic judgement.

Suggested Citation

  • Flores-Szwagrzak, Karol, 2022. "Learning by Convex Combination," Working Papers 16-2022, Copenhagen Business School, Department of Economics.
    • Handle: RePEc:hhs:cbsnow:2022_016
    as

    Download full text from publisher

    File URL: https://hdl.handle.net/10398/cccde635-5980-4348-ac2e-9ea6acf6e3d5
    File Function: Full text
    Download Restriction: Full text not avaiable
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Rothschild, Michael, 1974. "Searching for the Lowest Price When the Distribution of Prices Is Unknown," Journal of Political Economy, University of Chicago Press, vol. 82(4), pages 689-711, July/Aug..
    2. Amit Kothiyal & Vitalie Spinu & Peter P. Wakker, 2014. "Average Utility Maximization: A Preference Foundation," Operations Research, INFORMS, vol. 62(1), pages 207-218, February.
    3. Epstein Larry G. & Le Breton Michel, 1993. "Dynamically Consistent Beliefs Must Be Bayesian," Journal of Economic Theory, Elsevier, vol. 61(1), pages 1-22, October.
    4. Gravel, Nicolas & Marchant, Thierry & Sen, Arunava, 2018. "Conditional expected utility criteria for decision making under ignorance or objective ambiguity," Journal of Mathematical Economics, Elsevier, vol. 78(C), pages 79-95.
    5. Benjamin Enke, 2020. "What You See Is All There Is," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1363-1398.
    6. Geir B. Asheim & Stéphane Zuber, 2017. "Rank-discounting as a resolution to a dilemma in population ethics," Documents de travail du Centre d'Economie de la Sorbonne 17041, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    7. repec:bla:jfinan:v:53:y:1998:i:6:p:1887-1934 is not listed on IDEAS
    8. Daniel Kahneman, 2003. "Maps of Bounded Rationality: Psychology for Behavioral Economics," American Economic Review, American Economic Association, vol. 93(5), pages 1449-1475, December.
    9. Eddie Dekel & Barton L Lipman & Aldo Rustichini & Todd Sarver, 2007. "Representing Preferences with a Unique Subjective State Space: A Corrigendum -super-1," Econometrica, Econometric Society, vol. 75(2), pages 591-600, March.
    10. ,, 2014. "Second order beliefs models of choice under imprecise risk: non-additive second order beliefs vs. nonlinear second order utility," Theoretical Economics, Econometric Society, vol. 9(3), September.
    11. Raphaël Giraud, 2014. "Second order beliefs models of choice under imprecise risk: Nonadditive second order beliefs versus nonlinear second order utility," Post-Print halshs-00102346, HAL.
    12. Manel Baucells & Juan A. Carrasco & Robin M. Hogarth, 2008. "Cumulative Dominance and Heuristic Performance in Binary Multiattribute Choice," Operations Research, INFORMS, vol. 56(5), pages 1289-1304, October.
    13. Itzhak Gilboa & David Schmeidler, 1995. "Case-Based Decision Theory," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(3), pages 605-639.
    14. , B. & ,, 2014. "Escaping the repugnant conclusion: rank-discounted utilitarianism with variable population," Theoretical Economics, Econometric Society, vol. 9(3), September.
    15. Blackorby,Charles & Bossert,Walter & Donaldson,David J., 2005. "Population Issues in Social Choice Theory, Welfare Economics, and Ethics," Cambridge Books, Cambridge University Press, number 9780521532587, January.
    16. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, December.
    17. David S. Ahn, 2008. "Ambiguity Without a State Space," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(1), pages 3-28.
    18. Constantinos Antoniou & Glenn Harrison & Morten Lau & Daniel Read, 2015. "Subjective Bayesian beliefs," Journal of Risk and Uncertainty, Springer, vol. 50(1), pages 35-54, February.
    19. Bikhchandani, Sushil & Sharma, Sunil, 1996. "Optimal search with learning," Journal of Economic Dynamics and Control, Elsevier, vol. 20(1-3), pages 333-359.
    20. David M. Grether, 1980. "Bayes Rule as a Descriptive Model: The Representativeness Heuristic," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 95(3), pages 537-557.
    21. Paolo Ghirardato, 2002. "Revisiting Savage in a conditional world," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 20(1), pages 83-92.
    22. Kreps, David M, 1979. "A Representation Theorem for "Preference for Flexibility"," Econometrica, Econometric Society, vol. 47(3), pages 565-577, May.
    23. Robin M. Hogarth & Natalia Karelaia, 2005. "Simple Models for Multiattribute Choice with Many Alternatives: When It Does and Does Not Pay to Face Trade-offs with Binary Attributes," Management Science, INFORMS, vol. 51(12), pages 1860-1872, December.
    24. Terrance Odean., 1996. "Volume, Volatility, Price and Profit When All Trader Are Above Average," Research Program in Finance Working Papers RPF-266, University of California at Berkeley.
    25. Gilboa,Itzhak & Schmeidler,David, 2001. "A Theory of Case-Based Decisions," Cambridge Books, Cambridge University Press, number 9780521802345, January.
    26. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    27. Wojciech Olszewski, 2007. "Preferences Over Sets of Lotteries -super-1," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(2), pages 567-595.
    28. Michael Jong Kim & Andrew E.B. Lim, 2016. "Robust Multiarmed Bandit Problems," Management Science, INFORMS, vol. 62(1), pages 264-285, January.
    29. Blackorby, Charles & Donaldson, David, 1984. "Social criteria for evaluating population change," Journal of Public Economics, Elsevier, vol. 25(1-2), pages 13-33, November.
    30. Barberis, Nicholas & Shleifer, Andrei & Vishny, Robert, 1998. "A model of investor sentiment," Journal of Financial Economics, Elsevier, vol. 49(3), pages 307-343, September.
    31. Easley, David & Rustichini, Aldo, 2005. "Optimal guessing: Choice in complex environments," Journal of Economic Theory, Elsevier, vol. 124(1), pages 1-21, September.
    32. David Easley & Aldo Rustichini, 1999. "Choice without Beliefs," Econometrica, Econometric Society, vol. 67(5), pages 1157-1184, September.
    33. Kannai, Yakar & Peleg, Bezalel, 1984. "A note on the extension of an order on a set to the power set," Journal of Economic Theory, Elsevier, vol. 32(1), pages 172-175, February.
    34. repec:hal:pseose:hal-01048579 is not listed on IDEAS
    35. Borgers, Tilman & Sarin, Rajiv, 1997. "Learning Through Reinforcement and Replicator Dynamics," Journal of Economic Theory, Elsevier, vol. 77(1), pages 1-14, November.
    36. Gilboa, Itzhak & Schmeidler, David & Wakker, Peter P., 2002. "Utility in Case-Based Decision Theory," Journal of Economic Theory, Elsevier, vol. 105(2), pages 483-502, August.
    37. Faruk Gul & Wolfgang Pesendorfer, 2001. "Temptation and Self-Control," Econometrica, Econometric Society, vol. 69(6), pages 1403-1435, November.
    38. Terrance Odean, 1999. "Do Investors Trade Too Much?," American Economic Review, American Economic Association, vol. 89(5), pages 1279-1298, December.
    39. Michael Rothschild, 1974. "Searching for the Lowest Price When the Distribution of Prices Is Unknown: A Summary," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 3, number 1, pages 293-294, National Bureau of Economic Research, Inc.
    40. Antoniou, Constantinos & Harrison, Glenn W. & Lau, Morten I. & Read, Daniel, 2017. "Information Characteristics and Errors in Expectations: Experimental Evidence," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 52(2), pages 737-750, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Szwagrzak, Karol, 2021. "Weighing Sample Evidence," Working Papers 3-2021, Copenhagen Business School, Department of Economics.
    2. David Hirshleifer, 2001. "Investor Psychology and Asset Pricing," Journal of Finance, American Finance Association, vol. 56(4), pages 1533-1597, August.
    3. Agastya, Murali & Slinko, Arkadii, 2015. "Dynamic choice in a complex world," Journal of Economic Theory, Elsevier, vol. 158(PA), pages 232-258.
    4. Riella, Gil, 2013. "Preference for Flexibility and Dynamic Consistency," Journal of Economic Theory, Elsevier, vol. 148(6), pages 2467-2482.
    5. Youichiro Higashi & Kazuya Hyogo & Gil Riella, 2020. "Dynamically Consistent Menu Preferences," KIER Working Papers 1047, Kyoto University, Institute of Economic Research.
    6. Minardi, Stefania & Savochkin, Andrei, 2019. "Subjective contingencies and limited Bayesian updating," Journal of Economic Theory, Elsevier, vol. 183(C), pages 1-45.
    7. Upravitelev, A., 2023. "Neoclassical roots of behavioral economics," Journal of the New Economic Association, New Economic Association, vol. 58(1), pages 110-140.
    8. Youichiro Higashi & Kazuya Hyogo & Gil Riella, 2024. "Dynamically consistent menu preferences," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 78(4), pages 1047-1074, December.
    9. André Lapied & Thomas Rongiconi, 2013. "Ambiguity as a Source of Temptation: Modeling Unstable Beliefs," Working Papers halshs-00797631, HAL.
    10. Komáromi, György, 2002. "A hatékony piacok elméletének elméleti és gyakorlati relevanciája [The theoretical and practical relevance of the theory of efficient markets]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(5), pages 377-395.
    11. Higashi, Youichiro & Hyogo, Kazuya & Takeoka, Norio, 2009. "Subjective random discounting and intertemporal choice," Journal of Economic Theory, Elsevier, vol. 144(3), pages 1015-1053, May.
    12. Li, Chen & Wakker, Peter P., 2024. "A simple and general axiomatization of average utility maximization for infinite streams," Journal of Economic Theory, Elsevier, vol. 216(C).
    13. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    14. Marek Kapera, 2022. "Learning own preferences through consumption," KAE Working Papers 2022-074, Warsaw School of Economics, Collegium of Economic Analysis.
    15. David M. Frankel, 2008. "Adaptive Expectations And Stock Market Crashes," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 49(2), pages 595-619, May.
    16. Christopher J. Tyson, 2018. "Rationalizability of menu preferences," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 65(4), pages 917-934, June.
    17. Nicolas Gravel & Thierry Marchant, 2022. "Rank Dependent Weighted Average Utility Models for Decision Making under Ignorance or Objective Ambiguity," Working Papers hal-03817362, HAL.
    18. Roee Teper, 2016. "Learning the Krepsian State: Exploration Through Consumption," Working Paper 5860, Department of Economics, University of Pittsburgh.
    19. Gary Charness & Dan Levin, 2003. "Bayesian Updating vs. Reinforcement and Affect: A Laboratory Study," Levine's Bibliography 666156000000000180, UCLA Department of Economics.
    20. Baars, Maren & Mohrschladt, Hannes, 2021. "An alternative behavioral explanation for the MAX effect," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 868-886.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:cbsnow:2022_016. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CBS Library Research Registration Team (email available below). General contact details of provider: https://edirc.repec.org/data/incbsdk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.