IDEAS home Printed from https://ideas.repec.org/a/eee/empfin/v64y2021icp224-246.html
   My bibliography  Save this article

Reinforcement learning and risk preference in equity linked notes markets

Author

Listed:
  • Song, Reo
  • Jang, Sungha
  • Wang, Yingdi
  • Hanssens, Dominique M.
  • Suh, Jaebeom

Abstract

Individuals who follow a reinforcement learning heuristic put too much weight on recent failures or successes in placing their next bets. Using a large sample of equity-linked notes (ELNs) investments in South Korea, we find evidence showing a negative effect of reinforcement learning on future investments that lasts longer than one investment period. After losses, investors are less likely to repurchase equity-linked notes and spend less on their repurchases. This behavior also results in reinforcement learners underperforming rational agents. The difference in returns received by reinforcement and non-reinforcement groups is economically large at approximately 10.7%. However, these negative effects of reinforcement learning are mitigated by investors’ higher risk attitudes. We find that more risk-seeking investors are less likely to shun ELNs after undesirable prior returns and that this effect persists for more than one period. The underperformance of reinforcement learners is also reduced with high risk-taking. Overall, our findings highlight how combining different psychological traits can diagnose and improve biases in investor decision-making.

Suggested Citation

  • Song, Reo & Jang, Sungha & Wang, Yingdi & Hanssens, Dominique M. & Suh, Jaebeom, 2021. "Reinforcement learning and risk preference in equity linked notes markets," Journal of Empirical Finance, Elsevier, vol. 64(C), pages 224-246.
  • Handle: RePEc:eee:empfin:v:64:y:2021:i:c:p:224-246
    DOI: 10.1016/j.jempfin.2021.09.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0927539821000785
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jempfin.2021.09.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Terrance Odean., 1996. "Volume, Volatility, Price and Profit When All Trader Are Above Average," Research Program in Finance Working Papers RPF-266, University of California at Berkeley.
    2. James J. Choi & David Laibson & Brigitte C. Madrian & Andrew Metrick, 2009. "Reinforcement Learning and Savings Behavior," Journal of Finance, American Finance Association, vol. 64(6), pages 2515-2534, December.
    3. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    4. David Hirshleifer & Ivo Welch, 2002. "An Economic Approach to the Psychology of Change: Amnesia, Inertia, and Impulsiveness," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 11(3), pages 379-421, September.
    5. Herr, Paul M & Kardes, Frank R & Kim, John, 1991. "Effects of Word-of-Mouth and Product-Attribute Information on Persuasion: An Accessibility-Diagnosticity Perspective," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 17(4), pages 454-462, March.
    6. Alain Cohn & Jan Engelmann & Ernst Fehr & Michel André Maréchal, 2015. "Evidence for Countercyclical Risk Aversion: An Experiment with Financial Professionals," American Economic Review, American Economic Association, vol. 105(2), pages 860-885, February.
    7. Harrison, James D. & Young, Jane M. & Butow, Phyllis & Salkeld, Glenn & Solomon, Michael J., 2005. "Is it worth the risk? A systematic review of instruments that measure risk propensity for use in the health setting," Social Science & Medicine, Elsevier, vol. 60(6), pages 1385-1396, March.
    8. Gary Charness & Dan Levin, 2005. "When Optimal Choices Feel Wrong: A Laboratory Study of Bayesian Updating, Complexity, and Affect," American Economic Review, American Economic Association, vol. 95(4), pages 1300-1309, September.
    9. Yao-Min Chiang & David Hirshleifer & Yiming Qian & Ann E. Sherman, 2011. "Do Investors Learn from Experience? Evidence from Frequent IPO Investors," The Review of Financial Studies, Society for Financial Studies, vol. 24(5), pages 1560-1589.
    10. repec:feb:framed:0070 is not listed on IDEAS
    11. James J. Choi & David Laibson & Brigitte C. Madrian & Andrew Metrick, 2009. "Reinforcement Learning and Savings Behavior," Journal of Finance, American Finance Association, vol. 64(6), pages 2515-2534, December.
    12. Tao Chen & Ajay Kalra & Baohong Sun, 2009. "Why Do Consumers Buy Extended Service Contracts?," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 36(4), pages 611-623, December.
    13. Guiso, Luigi & Sapienza, Paola & Zingales, Luigi, 2018. "Time varying risk aversion," Journal of Financial Economics, Elsevier, vol. 128(3), pages 403-421.
    14. List John A. & Millimet Daniel L, 2008. "The Market: Catalyst for Rationality and Filter of Irrationality," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 8(1), pages 1-55, November.
    15. Markku Kaustia & Samuli Knüpfer, 2008. "Do Investors Overweight Personal Experience? Evidence from IPO Subscriptions," Journal of Finance, American Finance Association, vol. 63(6), pages 2679-2702, December.
    16. Cary Frydman & Baolian Wang, 2020. "The Impact of Salience on Investor Behavior: Evidence from a Natural Experiment," Journal of Finance, American Finance Association, vol. 75(1), pages 229-276, February.
    17. Markku Kaustia & Eeva Alho & Vesa Puttonen, 2008. "How Much Does Expertise Reduce Behavioral Biases? The Case of Anchoring Effects in Stock Return Estimates," Financial Management, Financial Management Association International, vol. 37(3), pages 391-412, September.
    18. John A. List, 2003. "Does Market Experience Eliminate Market Anomalies?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 41-71.
    19. Brad M. Barber & Terrance Odean, 2001. "Boys will be Boys: Gender, Overconfidence, and Common Stock Investment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 261-292.
    20. Henderson, Brian J. & Pearson, Neil D., 2011. "The dark side of financial innovation: A case study of the pricing of a retail financial product," Journal of Financial Economics, Elsevier, vol. 100(2), pages 227-247, May.
    21. Nicholas Barberis & Ming Huang & Tano Santos, 2001. "Prospect Theory and Asset Prices," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 1-53.
    22. Terrance Odean, 1998. "Volume, Volatility, Price, and Profit When All Traders Are Above Average," Journal of Finance, American Finance Association, vol. 53(6), pages 1887-1934, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arnold, Marc & Pelster, Matthias & Subrahmanyam, Marti G., 2022. "Attention triggers and investors’ risk-taking," Journal of Financial Economics, Elsevier, vol. 143(2), pages 846-875.
    2. David Hirshleife, 2015. "Behavioral Finance," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 133-159, December.
    3. Hwang, Joon Ho & Kim, Min-Su, 2015. "Misunderstanding of the binomial distribution, market inefficiency, and learning behavior: Evidence from an exotic sports betting market," European Journal of Operational Research, Elsevier, vol. 243(1), pages 333-344.
    4. Katrin Gödker & Terrance Odean & Paul Smeets, 2023. "Disposed to Be Overconfident," CESifo Working Paper Series 10357, CESifo.
    5. Barber, Brad M. & Odean, Terrance, 2013. "The Behavior of Individual Investors," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1533-1570, Elsevier.
    6. Bu, Di & Hanspal, Tobin & Liao, Yin & Liu, Yong, 2021. "Risk taking, preferences, and beliefs: Evidence from Wuhan," SAFE Working Paper Series 301, Leibniz Institute for Financial Research SAFE.
    7. Osili, Una Okonkwo & Paulson, Anna, 2014. "Crises and confidence: Systemic banking crises and depositor behavior," Journal of Financial Economics, Elsevier, vol. 111(3), pages 646-660.
    8. Khan, Mohammad Tariqul Islam & Tan, Siow-Hooi & Chong, Lee-Lee, 2017. "How past perceived portfolio returns affect financial behaviors—The underlying psychological mechanism," Research in International Business and Finance, Elsevier, vol. 42(C), pages 1478-1488.
    9. Dalton, Michael & Landry, Peter, 2020. "‘Overattention’ to first-hand experience in hiring decisions: Evidence from professional basketball," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 98-113.
    10. Gao, Huasheng & Shi, Donghui & Zhao, Bin, 2021. "Does good luck make people overconfident? Evidence from a natural experiment in the stock market," Journal of Corporate Finance, Elsevier, vol. 68(C).
    11. Gregor Dorfleitner & Lars Hornuf & Martina Weber, 2018. "Paralyzed by Shock: The Portfolio Formation Behavior of Peer-to-Business Lending Investors," CESifo Working Paper Series 7092, CESifo.
    12. Steffen Meyer & Michaela Pagel, 2022. "Fully Closed: Individual Responses to Realized Gains and Losses," Journal of Finance, American Finance Association, vol. 77(3), pages 1529-1585, June.
    13. Barrot, Jean-Noel & Kaniel, Ron & Sraer, David, 2016. "Are retail traders compensated for providing liquidity?," Journal of Financial Economics, Elsevier, vol. 120(1), pages 146-168.
    14. Heinrich H. Nax, 2016. "When is Market the Benchmark? Reinforcement Evidence from Repurchase Decisions," Economics Series Working Papers 781, University of Oxford, Department of Economics.
    15. Hayley, Simon & Marsh, Ian W., 2016. "What do retail FX traders learn?," Journal of International Money and Finance, Elsevier, vol. 64(C), pages 16-38.
    16. Carvalho, Daniel & Gao, Janet & Ma, Pengfei, 2023. "Loan spreads and credit cycles: The role of lenders’ personal economic experiences," Journal of Financial Economics, Elsevier, vol. 148(2), pages 118-149.
    17. Campbell, John Y & Ranish, Benjamin, 2014. "Getting Better or Feeling Better? How Equity Investors Respond to Investment Experience," CEPR Discussion Papers 9907, C.E.P.R. Discussion Papers.
    18. Andersen, Steffen & Hanspal, Tobin & Nielsen, Kasper Meisner, 2016. "Once Bitten, Twice Shy: The Role of Inertia and Personal Experiences in Risk Taking," CEPR Discussion Papers 11504, C.E.P.R. Discussion Papers.
    19. Xu, Rong & Liu, Yaodong & Hu, Nan & Guo, Jie (Michael), 2022. "What drives individual investors in the bear market?," The British Accounting Review, Elsevier, vol. 54(6).
    20. Pereira Reichhardt, Joaquín & Iqbal, Tabassum, 2014. "Investment Decisions: Are we fully-Rational?," MPRA Paper 57686, University Library of Munich, Germany.

    More about this item

    Keywords

    Reinforcement learning; Risk preference; Equity-linked notes; Financial decisions;
    All these keywords.

    JEL classification:

    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G40 - Financial Economics - - Behavioral Finance - - - General
    • G41 - Financial Economics - - Behavioral Finance - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making in Financial Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:empfin:v:64:y:2021:i:c:p:224-246. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jempfin .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.