IDEAS home Printed from https://ideas.repec.org/a/eee/beexfi/v32y2021ics2214635021001039.html
   My bibliography  Save this article

Reinforcement learning about asset variability and correlation in repeated portfolio decisions

Author

Listed:
  • Olschewski, Sebastian
  • Diao, Linan
  • Rieskamp, Jörg

Abstract

Lay investors construct portfolios that are often not efficient and fail to take the correlation of assets into account. The present work examines whether providing people with a learning opportunity makes them sensitive to the correlation between assets. In two studies, where participants repeatedly allocated their endowment to three assets with feedback, participants changed their portfolio over time dependent on the asset correlation. To model learning about relevant characteristics of a portfolio, we developed reinforcement learning models that take learning about asset variability and correlation into account. We demonstrated via out-of-sample predictions that these models explain portfolio allocations better than basic reinforcement learning models, a static 1/N diversification strategy, and the mean–variance model using sample means, variances, and correlation. Hence, experiencing returns can help investors take asset correlations into account. The principles of reinforcement learning are a cognitively plausible and descriptively valid framework for understanding repeated portfolio allocations.

Suggested Citation

  • Olschewski, Sebastian & Diao, Linan & Rieskamp, Jörg, 2021. "Reinforcement learning about asset variability and correlation in repeated portfolio decisions," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).
  • Handle: RePEc:eee:beexfi:v:32:y:2021:i:c:s2214635021001039
    DOI: 10.1016/j.jbef.2021.100559
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214635021001039
    Download Restriction: no

    File URL: https://libkey.io/10.1016/j.jbef.2021.100559?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bossaerts, Peter & Plott, Charles, 2002. "The CAPM in thin experimental financial markets," Journal of Economic Dynamics and Control, Elsevier, vol. 26(7-8), pages 1093-1112, July.
    2. Johann Lussange & Ivan Lazarevich & Sacha Bourgeois-Gironde & Stefano Palminteri & Boris Gutkin, 2021. "Modelling Stock Markets by Multi-agent Reinforcement Learning," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 113-147, January.
    3. Uri Gneezy & Jan Potters, 1997. "An Experiment on Risk Taking and Evaluation Periods," The Quarterly Journal of Economics, Oxford University Press, vol. 112(2), pages 631-645.
    4. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    5. Peter Bossaerts & Charles Plott, 2004. "Basic Principles of Asset Pricing Theory: Evidence from Large-Scale Experimental Financial Markets," Review of Finance, European Finance Association, vol. 8(2), pages 135-169.
    6. Mullen, Katharine M. & Ardia, David & Gil, David L. & Windover, Donald & Cline, James, 2011. "DEoptim: An R Package for Global Optimization by Differential Evolution," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 40(i06).
    7. Kroll, Yoram & Levy, Haim, 1992. "Further Tests of the Separation Theorem and the Capital Asset Pricing Model," American Economic Review, American Economic Association, vol. 82(3), pages 664-670, June.
    8. Shlomo Benartzi & Richard H. Thaler, 1995. "Myopic Loss Aversion and the Equity Premium Puzzle," The Quarterly Journal of Economics, Oxford University Press, vol. 110(1), pages 73-92.
    9. Peter Bossaerts & Charles Plott & William R. Zame, 2007. "Prices and Portfolio Choices in Financial Markets: Theory, Econometrics, Experiments," Econometrica, Econometric Society, vol. 75(4), pages 993-1038, July.
    10. Markku Kaustia & Samuli Knüpfer, 2008. "Do Investors Overweight Personal Experience? Evidence from IPO Subscriptions," Journal of Finance, American Finance Association, vol. 63(6), pages 2679-2702, December.
    11. Gennotte, Gerard, 1986. "Optimal Portfolio Choice under Incomplete Information," Journal of Finance, American Finance Association, vol. 41(3), pages 733-746, July.
    12. Zion, Uri Ben & Erev, Ido & Haruvy, Ernan & Shavit, Tal, 2010. "Adaptive behavior leads to under-diversification," Journal of Economic Psychology, Elsevier, vol. 31(6), pages 985-995, December.
    13. Samuel J Gershman, 2015. "A Unifying Probabilistic View of Associative Learning," PLOS Computational Biology, Public Library of Science, vol. 11(11), pages 1-20, November.
    14. Shlomo Benartzi & Richard Thaler, 2007. "Heuristics and Biases in Retirement Savings Behavior," Journal of Economic Perspectives, American Economic Association, vol. 21(3), pages 81-104, Summer.
    15. Lubos Pastor & Pietro Veronesi, 2009. "Learning in Financial Markets," Annual Review of Financial Economics, Annual Reviews, vol. 1(1), pages 361-381, November.
    16. William N. Goetzmann & Alok Kumar, 2008. "Equity Portfolio Diversification," Review of Finance, European Finance Association, vol. 12(3), pages 433-463.
    17. James J. Choi & David Laibson & Brigitte C. Madrian & Andrew Metrick, 2009. "Reinforcement Learning and Savings Behavior," Journal of Finance, American Finance Association, vol. 64(6), pages 2515-2534, December.
    18. Shlomo Benartzi & Richard H. Thaler, 1999. "Risk Aversion or Myopia? Choices in Repeated Gambles and Retirement Investments," Management Science, INFORMS, vol. 45(3), pages 364-381, March.
    19. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    20. Uri Gneezy & Arie Kapteyn & Jan Potters, 2003. "Evaluation Periods and Asset Prices in a Market Experiment," Journal of Finance, American Finance Association, vol. 58(2), pages 821-838, April.
    21. M. J. Brennan, 1998. "The Role of Learning in Dynamic Portfolio Decisions," Review of Finance, European Finance Association, vol. 1(3), pages 295-306.
    22. Uri Gneezy & Arie Kapteyn & Jan Potters, 2003. "Evaluation Periods and Asset Prices in a Market Experiment," Journal of Finance, American Finance Association, vol. 58(2), pages 821-837, April.
    23. Terrance Odean, 1998. "Are Investors Reluctant to Realize Their Losses?," Journal of Finance, American Finance Association, vol. 53(5), pages 1775-1798, October.
    24. Weber, Martin & Laudenbach, Christine & Ungeheuer, Michael, 2019. "How to Alleviate Correlation Neglect," CEPR Discussion Papers 13737, C.E.P.R. Discussion Papers.
    25. Ulrike Malmendier & Stefan Nagel, 2011. "Depression Babies: Do Macroeconomic Experiences Affect Risk Taking?," The Quarterly Journal of Economics, Oxford University Press, vol. 126(1), pages 373-416.
    26. Richard H. Thaler & Shlomo Benartzi, 2001. "Naive Diversification Strategies in Defined Contribution Saving Plans," American Economic Review, American Economic Association, vol. 91(1), pages 79-98, March.
    27. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    28. James J. Choi & David Laibson & Brigitte C. Madrian & Andrew Metrick, 2009. "Reinforcement Learning and Savings Behavior," Journal of Finance, American Finance Association, vol. 64(6), pages 2515-2534, December.
    29. Gneezy, U. & Kapteyn, A. & Potters, J.J.M., 2003. "Evaluation periods and asset prices in a market experience," Other publications TiSEM 55910884-79d7-483c-abbb-1, Tilburg University, School of Economics and Management.
    30. Andersen, Steffen & Hanspal, Tobin & Nielsen, Kasper Meisner, 2019. "Once bitten, twice shy: The power of personal experiences in risk taking," Journal of Financial Economics, Elsevier, vol. 132(3), pages 97-117.
    31. Andreas Hefti & Steve Heinke & Frédéric Schneider, 2016. "Mental capabilities, trading styles, and asset market bubbles: theory and experiment," ECON - Working Papers 234, Department of Economics - University of Zurich.
    32. Moore, Don A. & Kurtzberg, Terri R. & Fox, Craig R. & Bazerman, Max H., 1999. "Positive Illusions and Forecasting Errors in Mutual Fund Investment Decisions, , , ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 79(2), pages 95-114, August.
    33. Christine Kaufmann & Martin Weber & Emily Haisley, 2013. "The Role of Experience Sampling and Graphical Displays on One's Investment Risk Appetite," Management Science, INFORMS, vol. 59(2), pages 323-340, July.
    34. Graham Loomes & Chris Starmer & Robert Sugden, 2003. "Do Anomalies Disappear in Repeated Markets?," Economic Journal, Royal Economic Society, vol. 113(486), pages 153-166, March.
    35. Cornil, Yann & Hardisty, David J. & Bart, Yakov, 2019. "Easy, breezy, risky: Lay investors fail to diversify because correlated assets feel more fluent and less risky," Organizational Behavior and Human Decision Processes, Elsevier, vol. 153(C), pages 103-117.
    36. Kroll, Yoram & Levy, Haim & Rapoport, Amnon, 1988. "Experimental Tests of the Separation Theorem and the Capital Asset Pricing Model," American Economic Review, American Economic Association, vol. 78(3), pages 500-519, June.
    37. Lipe, M. G., 1998. "Individual investors' risk judgments and investment decisions: The impact of accounting and market data," Accounting, Organizations and Society, Elsevier, vol. 23(7), pages 625-640, October.
    38. Ido Kallir & Doron Sonsino, 2009. "The Neglect of Correlation in Allocation Decisions," Southern Economic Journal, John Wiley & Sons, vol. 75(4), pages 1045-1066, April.
    39. Charley M. Wu & Eric Schulz & Maarten Speekenbrink & Jonathan D. Nelson & Björn Meder, 2018. "Generalization guides human exploration in vast decision spaces," Nature Human Behaviour, Nature, vol. 2(12), pages 915-924, December.
    40. Nick Feltovich, 2000. "Reinforcement-Based vs. Belief-Based Learning Models in Experimental Asymmetric-Information," Econometrica, Econometric Society, vol. 68(3), pages 605-642, May.
    41. Stefan Palan, 2013. "A Review Of Bubbles And Crashes In Experimental Asset Markets," Journal of Economic Surveys, Wiley Blackwell, vol. 27(3), pages 570-588, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Linan Diao & Jörg Rieskamp, 2011. "Reinforcement Learning in Repeated Portfolio Decisions," Jena Economics Research Papers 2011-009, Friedrich-Schiller-University Jena.
    2. Guiso, Luigi & Sodini, Paolo, 2013. "Household Finance: An Emerging Field," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1397-1532, Elsevier.
    3. Arnold, Marc & Pelster, Matthias & Subrahmanyam, Marti G., 2022. "Attention triggers and investors’ risk-taking," Journal of Financial Economics, Elsevier, vol. 143(2), pages 846-875.
    4. Borsboom, Charlotte & Janssen, Dirk-Jan & Strucks, Markus & Zeisberger, Stefan, 2022. "History matters: How short-term price charts hurt investment performance," Journal of Banking & Finance, Elsevier, vol. 134(C).
    5. Michael Ungeheuer & Martin Weber, 2021. "The Perception of Dependence, Investment Decisions, and Stock Prices," Journal of Finance, American Finance Association, vol. 76(2), pages 797-844, April.
    6. Itzhak Venezia, 2018. "Lecture Notes in Behavioral Finance," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 10751, December.
    7. Kazi Iqbal & Asad Islam & John List & Vy Nguyen, 2021. "Myopic Loss Aversion and Investment Decisions: From the Laboratory to the Field," Framed Field Experiments 000730, The Field Experiments Website.
    8. Francisco Gomes & Michael Haliassos & Tarun Ramadorai, 2021. "Household Finance," Journal of Economic Literature, American Economic Association, vol. 59(3), pages 919-1000, September.
    9. Huber, Christoph & Kirchler, Michael, 2023. "Experiments in finance: A survey of historical trends," Journal of Behavioral and Experimental Finance, Elsevier, vol. 37(C).
    10. Amos Nadler & Peiran Jiao & Cameron J. Johnson & Veronika Alexander & Paul J. Zak, 2019. "The Bull of Wall Street: Experimental Analysis of Testosterone and Asset Trading," Management Science, INFORMS, vol. 64(9), pages 4032-4051, September.
    11. Clayton Arlen Looney & Andrew M. Hardin, 2009. "Decision Support for Retirement Portfolio Management: Overcoming Myopic Loss Aversion via Technology Design," Management Science, INFORMS, vol. 55(10), pages 1688-1703, October.
    12. Ibrahim Filiz & Thomas Nahmer & Markus Spiwoks & Kilian Bizer, 2018. "Portfolio diversification: the influence of herding, status-quo bias, and the gambler’s fallacy," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 32(2), pages 167-205, May.
    13. John Beshears & James J. Choi & David Laibson & Brigitte C. Madrian, 2017. "Does Aggregated Returns Disclosure Increase Portfolio Risk Taking?," Review of Financial Studies, Society for Financial Studies, vol. 30(6), pages 1971-2005.
    14. Laura Hueber & Rene Schwaiger, 2021. "Debiasing Through Experience Sampling: The Case of Myopic Loss Aversion," Working Papers 2021-01, Faculty of Economics and Statistics, Universität Innsbruck.
    15. Khan, Mohammad Tariqul Islam & Tan, Siow-Hooi & Chong, Lee-Lee, 2017. "How past perceived portfolio returns affect financial behaviors—The underlying psychological mechanism," Research in International Business and Finance, Elsevier, vol. 42(C), pages 1478-1488.
    16. Juhani T. Linnainmaa, 2011. "Why Do (Some) Households Trade So Much?," Review of Financial Studies, Society for Financial Studies, vol. 24(5), pages 1630-1666.
    17. Weber, Martin & Langer, Thomas, 2003. "Does Binding of Feedback Influence Myopic Loss Aversion? An Experimental Analysis," CEPR Discussion Papers 4084, C.E.P.R. Discussion Papers.
    18. Hueber, Laura & Schwaiger, Rene, 2022. "Debiasing through experience sampling: The case of myopic loss aversion," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 87-138.
    19. Gao, Huasheng & Shi, Donghui & Zhao, Bin, 2021. "Does good luck make people overconfident? Evidence from a natural experiment in the stock market," Journal of Corporate Finance, Elsevier, vol. 68(C).
    20. Gregor Dorfleitner & Lars Hornuf & Martina Weber, 2018. "Paralyzed by Shock: The Portfolio Formation Behavior of Peer-to-Business Lending Investors," CESifo Working Paper Series 7092, CESifo.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:beexfi:v:32:y:2021:i:c:s2214635021001039. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-behavioral-and-experimental-finance .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.