IDEAS home Printed from https://ideas.repec.org/a/bla/jfinan/v64y2009i6p2515-2534.html
   My bibliography  Save this article

Reinforcement Learning and Savings Behavior

Author

Listed:
  • JAMES J. CHOI
  • DAVID LAIBSON
  • BRIGITTE C. MADRIAN
  • ANDREW METRICK

Abstract

We show that individual investors over‐extrapolate from their personal experience when making savings decisions. Investors who experience particularly rewarding outcomes from 401(k) saving—a high average and/or low variance return—increase their 401(k) savings rate more than investors who have less rewarding experiences. This finding is not driven by aggregate time‐series shocks, income effects, rational learning about investing skill, investor fixed effects, or time‐varying investor‐level heterogeneity that is correlated with portfolio allocations to stock, bond, and cash asset classes. We discuss implications for the equity premium puzzle and interventions aimed at improving household financial outcomes.

Suggested Citation

  • James J. Choi & David Laibson & Brigitte C. Madrian & Andrew Metrick, 2009. "Reinforcement Learning and Savings Behavior," Journal of Finance, American Finance Association, vol. 64(6), pages 2515-2534, December.
    • Handle: RePEc:bla:jfinan:v:64:y:2009:i:6:p:2515-2534
    DOI: 10.1111/j.1540-6261.2009.01509.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1540-6261.2009.01509.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1540-6261.2009.01509.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Richard H. Thaler & Shlomo Benartzi, 2004. "Save More Tomorrow (TM): Using Behavioral Economics to Increase Employee Saving," Journal of Political Economy, University of Chicago Press, vol. 112(S1), pages 164-187, February.
    2. Gur Huberman & Sheena Iyengar & Wei Jiang, 2007. "Defined Contribution Pension Plans: Determinants of Participation and Contributions Rates," Journal of Financial Services Research, Springer;Western Finance Association, vol. 31(1), pages 1-32, February.
    3. Shlomo Benartzi, 2001. "Excessive Extrapolation and the Allocation of 401(k) Accounts to Company Stock," Journal of Finance, American Finance Association, vol. 56(5), pages 1747-1764, October.
    4. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    5. Laurent E. Calvet & John Y. Campbell & Paolo Sodini, 2009. "Fight or Flight? Portfolio Rebalancing by Individual Investors," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(1), pages 301-348.
    6. Constantinides, George M., 1984. "Optimal stock trading with personal taxes : Implications for prices and the abnormal January returns," Journal of Financial Economics, Elsevier, vol. 13(1), pages 65-89, March.
    7. Markku Kaustia & Samuli Knüpfer, 2008. "Do Investors Overweight Personal Experience? Evidence from IPO Subscriptions," Journal of Finance, American Finance Association, vol. 63(6), pages 2679-2702, December.
    8. James J. Choi & David Laibson & Brigitte C. Madrian, 2010. "Why Does the Law of One Price Fail? An Experiment on Index Mutual Funds," The Review of Financial Studies, Society for Financial Studies, vol. 23(4), pages 1405-1432, April.
    9. James J. Choi & David Laibson & Brigitte C. Madrian, 2011. "$100 Bills on the Sidewalk: Suboptimal Investment in 401(k) Plans," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 748-763, August.
    10. James J. Choi & David Laibson & Brigitte C. Madrian, 2010. "Why Does the Law of One Price Fail? An Experiment on Index Mutual Funds," Review of Financial Studies, Society for Financial Studies, vol. 23(4), pages 1405-1432, April.
    11. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    12. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    13. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    14. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    15. Shefrin, Hersh & Statman, Meir, 1985. "The Disposition to Sell Winners Too Early and Ride Losers Too Long: Theory and Evidence," Journal of Finance, American Finance Association, vol. 40(3), pages 777-790, July.
    16. Harrison Hong & Jeffrey D. Kubik & Jeremy C. Stein, 2004. "Social Interaction and Stock-Market Participation," Journal of Finance, American Finance Association, vol. 59(1), pages 137-163, February.
    17. Wise, David A. (ed.), 2004. "Perspectives on the Economics of Aging," National Bureau of Economic Research Books, University of Chicago Press, edition 1, number 9780226903057, December.
    18. Brigitte C. Madrian & Dennis F. Shea, 2001. "The Power of Suggestion: Inertia in 401(k) Participation and Savings Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1149-1187.
    19. Terrance Odean, 1998. "Are Investors Reluctant to Realize Their Losses?," Journal of Finance, American Finance Association, vol. 53(5), pages 1775-1798, October.
    20. Ulrike Malmendier & Stefan Nagel, 2011. "Depression Babies: Do Macroeconomic Experiences Affect Risk Taking?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 373-416.
    21. Gary Charness & Dan Levin, 2005. "When Optimal Choices Feel Wrong: A Laboratory Study of Bayesian Updating, Complexity, and Affect," American Economic Review, American Economic Association, vol. 95(4), pages 1300-1309, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James J. Choi & David Laibson & Brigitte C. Madrian & Andrew Metrick, 2009. "Reinforcement Learning and Savings Behavior," Journal of Finance, American Finance Association, vol. 64(6), pages 2515-2534, December.
    2. Francisco Gomes & Michael Haliassos & Tarun Ramadorai, 2021. "Household Finance," Journal of Economic Literature, American Economic Association, vol. 59(3), pages 919-1000, September.
    3. Guiso, Luigi & Sodini, Paolo, 2013. "Household Finance: An Emerging Field," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1397-1532, Elsevier.
    4. Itzhak Venezia, 2018. "Lecture Notes in Behavioral Finance," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 10751, January.
    5. Barber, Brad M. & Odean, Terrance, 2013. "The Behavior of Individual Investors," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1533-1570, Elsevier.
    6. Balasubramaniam, Vimal & Anagol, Santosh, 2018. "Learning from Noise: Evidence from India’s IPO Lotteries," CEPR Discussion Papers 13314, C.E.P.R. Discussion Papers.
    7. James Choi & David Laibson & Brigitte Madrain & Andrew Metrick, 2007. "Reinforcement Learning in Investment Behavior," Levine's Bibliography 122247000000001737, UCLA Department of Economics.
    8. Campbell, John Y & Ranish, Benjamin, 2014. "Getting Better or Feeling Better? How Equity Investors Respond to Investment Experience," CEPR Discussion Papers 9907, C.E.P.R. Discussion Papers.
    9. Anagol, Santosh & Balasubramaniam, Vimal & Ramadorai, Tarun, 2021. "Learning from noise: Evidence from India’s IPO lotteries," Journal of Financial Economics, Elsevier, vol. 140(3), pages 965-986.
    10. Beshears, John & Choi, James J. & Laibson, David & Madrian, Brigitte C., 2011. "Behavioral economics perspectives on public sector pension plans," Journal of Pension Economics and Finance, Cambridge University Press, vol. 10(2), pages 315-336, April.
    11. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    12. Cici, Gjergji, 2011. "The prevalence of the disposition effect in mutual funds' trades," CFR Working Papers 11-05 [rev.], University of Cologne, Centre for Financial Research (CFR).
    13. Osili, Una Okonkwo & Paulson, Anna, 2014. "Crises and confidence: Systemic banking crises and depositor behavior," Journal of Financial Economics, Elsevier, vol. 111(3), pages 646-660.
    14. Khan, Mohammad Tariqul Islam & Tan, Siow-Hooi & Chong, Lee-Lee, 2017. "How past perceived portfolio returns affect financial behaviors—The underlying psychological mechanism," Research in International Business and Finance, Elsevier, vol. 42(C), pages 1478-1488.
    15. Daniel, Kent & Hirshleifer, David & Teoh, Siew Hong, 2002. "Investor psychology in capital markets: evidence and policy implications," Journal of Monetary Economics, Elsevier, vol. 49(1), pages 139-209, January.
    16. Lukas, Moritz & Nöth, Markus, 2021. "Interest rate fixation periods and reference points," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    17. Peiran Jiao, 2015. "The Double-Channeled Effects of Experience on Individual Investment Decisions: Experimental Evidence," Economics Series Working Papers 766, University of Oxford, Department of Economics.
    18. Jonathan Huntley & Valentina Michelangeli & Felix Reichling, 2021. "What drives investors to chase returns?," Temi di discussione (Economic working papers) 1334, Bank of Italy, Economic Research and International Relations Area.
    19. Blake, David & Cairns, Andrew & Dowd, Kevin, 2008. "Turning pension plans into pension planes: What investment strategy designers of defined contribution pension plans can learn from commercial aircraft designers," MPRA Paper 33749, University Library of Munich, Germany.
    20. David Hirshleife, 2015. "Behavioral Finance," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 133-159, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jfinan:v:64:y:2009:i:6:p:2515-2534. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/afaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.