IDEAS home Printed from https://ideas.repec.org/a/spr/digfin/v4y2022i2d10.1007_s42521-022-00068-4.html
   My bibliography  Save this article

Reinforcement learning with intrinsic affinity for personalized prosperity management

Author

Listed:
  • Charl Maree

    (University of Agder
    Chief Technology Office, Sparebank 1 SR-Bank)

  • Christian W. Omlin

    (University of Agder)

Abstract

The purpose of applying reinforcement learning (RL) to portfolio management is commonly the maximization of profit. The extrinsic reward function used to learn an optimal strategy typically does not take into account any other preferences or constraints. We have developed a regularization method that ensures that strategies have global intrinsic affinities, i.e., different personalities may have preferences for certain asset classes which may change over time. We capitalize on these intrinsic policy affinities to make our RL model inherently interpretable. We demonstrate how RL agents can be trained to orchestrate such individual policies for particular personality profiles and still achieve high returns.

Suggested Citation

  • Charl Maree & Christian W. Omlin, 2022. "Reinforcement learning with intrinsic affinity for personalized prosperity management," Digital Finance, Springer, vol. 4(2), pages 241-262, September.
  • Handle: RePEc:spr:digfin:v:4:y:2022:i:2:d:10.1007_s42521-022-00068-4
    DOI: 10.1007/s42521-022-00068-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s42521-022-00068-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s42521-022-00068-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Adrian Millea, 2021. "Deep Reinforcement Learning for Trading—A Critical Survey," Data, MDPI, vol. 6(11), pages 1-25, November.
    2. Longbing Cao, 2021. "AI in Finance: Challenges, Techniques and Opportunities," Papers 2107.09051, arXiv.org.
    3. Saima Rizvi & Amreen Fatima, 2015. "Behavioral Finance: A Study of Correlation Between Personality Traits with the Investment Patterns in the Stock Market," Springer Proceedings in Business and Economics, in: S. Chatterjee & N.P. Singh & D.P. Goyal & Narain Gupta (ed.), Managing in Recovering Markets, edition 127, chapter 0, pages 143-155, Springer.
    4. Muhammad Zubair Tauni & Zia-ur-Rehman Rao & Hongxing Fang & Sultan Sikandar Mirza & Zulfiqar Ali Memon & Khalil Jebran, 2017. "Do investor’s Big Five personality traits influence the association between information acquisition and stock trading behavior?," China Finance Review International, Emerald Group Publishing Limited, vol. 7(4), pages 450-477, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hou, Shehong & Niu, Yingjie & Yang, Jinqiang, 2018. "Optimal consumption-portfolio rules with biased beliefs," Economics Letters, Elsevier, vol. 173(C), pages 152-157.
    2. Charl Maree & Christian W. Omlin, 2022. "Reinforcement Learning with Intrinsic Affinity for Personalized Asset Management," Papers 2204.09218, arXiv.org.
    3. Jaydip Sen & Rajdeep Sen & Abhishek Dutta, 2021. "Machine Learning in Finance-Emerging Trends and Challenges," Papers 2110.11999, arXiv.org.
    4. Shakira MUKHTAR & Anisa JAN, 2023. "Decoding financial literacy's mediating role: analyzing the influence of biopsychosocial indicators on financial satisfaction and risk tolerance among millennial investors," Theoretical and Applied Economics, Asociatia Generala a Economistilor din Romania - AGER, vol. 0(4(637), W), pages 219-242, Winter.
    5. Rao, Aniruddha S. & Lakkol, Savitha G., 2022. "A review on personality models and investment decisions," Journal of Behavioral and Experimental Finance, Elsevier, vol. 35(C).
    6. Boian Lazov, 2023. "A Deep Reinforcement Learning Trader without Offline Training," Papers 2303.00356, arXiv.org.
    7. Tauni, Muhammad Zubair & Yousaf, Salman & Ahsan, Tanveer, 2020. "Investor-advisor Big Five personality similarity and stock trading performance," Journal of Business Research, Elsevier, vol. 109(C), pages 49-63.
    8. Thomas, Sheetal & Goel, Mridula & Agrawal, Dipak, 2020. "A framework for analyzing financial behavior using machine learning classification of personality through handwriting analysis," Journal of Behavioral and Experimental Finance, Elsevier, vol. 26(C).
    9. Guo, Mengmeng & Wei, Mengxin & Huang, Lin, 2022. "Does air pollution influence investor trading behavior? Evidence from China," Emerging Markets Review, Elsevier, vol. 50(C).
    10. Shanmuganathan, Manchuna, 2020. "Behavioural finance in an era of artificial intelligence: Longitudinal case study of robo-advisors in investment decisions," Journal of Behavioral and Experimental Finance, Elsevier, vol. 27(C).
    11. Sune Ferreira-Schenk & Zandri Dickason-Koekemoer & Naveed Hussain Shah, 2021. "Factors Influencing Individuals Short-term Investment Intentions," International Journal of Economics and Financial Issues, Econjournals, vol. 11(4), pages 73-81.
    12. Safeer Ullah Khan & Mansi Wang & Ikram Ullah Khan & Xiang‐dong Liu, 2022. "Evaluating stock trading behaviour: Information sources nexus through intrinsic and extrinsic motivation," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 27(3), pages 2965-2976, July.

    More about this item

    Keywords

    AI in banking; Personalized financial services; Explainable AI; Reinforcement learning; Policy regularization; Intrinsic affinity; Robo-advising;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C30 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C40 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - General
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C50 - Mathematical and Quantitative Methods - - Econometric Modeling - - - General
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C54 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Quantitative Policy Modeling
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics
    • D10 - Microeconomics - - Household Behavior - - - General
    • D14 - Microeconomics - - Household Behavior - - - Household Saving; Personal Finance
    • D31 - Microeconomics - - Distribution - - - Personal Income and Wealth Distribution
    • D53 - Microeconomics - - General Equilibrium and Disequilibrium - - - Financial Markets
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • E22 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Investment; Capital; Intangible Capital; Capacity
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G41 - Financial Economics - - Behavioral Finance - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making in Financial Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:digfin:v:4:y:2022:i:2:d:10.1007_s42521-022-00068-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.