IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2202.07734.html
   My bibliography  Save this paper

Solving Multi-Period Financial Planning Models: Combining Monte Carlo Tree Search and Neural Networks

Author

Listed:
  • Afc{s}ar Onat Ayd{i}nhan
  • Xiaoyue Li
  • John M. Mulvey

Abstract

This paper introduces the MCTS algorithm to the financial world and focuses on solving significant multi-period financial planning models by combining a Monte Carlo Tree Search algorithm with a deep neural network. The MCTS provides an advanced start for the neural network so that the combined method outperforms either approach alone, yielding competitive results. Several innovations improve the computations, including a variant of the upper confidence bound applied to trees (UTC) and a special lookup search. We compare the two-step algorithm with employing dynamic programs/neural networks. Both approaches solve regime switching models with 50-time steps and transaction costs with twelve asset categories. Heretofore, these problems have been outside the range of solvable optimization models via traditional algorithms.

Suggested Citation

  • Afc{s}ar Onat Ayd{i}nhan & Xiaoyue Li & John M. Mulvey, 2022. "Solving Multi-Period Financial Planning Models: Combining Monte Carlo Tree Search and Neural Networks," Papers 2202.07734, arXiv.org, revised May 2022.
    • Handle: RePEc:arx:papers:2202.07734
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2202.07734
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Guillaume M. J-B. Chaslot & Mark H. M. Winands & H. Jaap Van Den Herik & Jos W. H. M. Uiterwijk & Bruno Bouzy, 2008. "Progressive Strategies For Monte-Carlo Tree Search," New Mathematics and Natural Computation (NMNC), World Scientific Publishing Co. Pte. Ltd., vol. 4(03), pages 343-357.
    2. Merton, Robert C, 1969. "Lifetime Portfolio Selection under Uncertainty: The Continuous-Time Case," The Review of Economics and Statistics, MIT Press, vol. 51(3), pages 247-257, August.
    3. David Silver & Aja Huang & Chris J. Maddison & Arthur Guez & Laurent Sifre & George van den Driessche & Julian Schrittwieser & Ioannis Antonoglou & Veda Panneershelvam & Marc Lanctot & Sander Dieleman, 2016. "Mastering the game of Go with deep neural networks and tree search," Nature, Nature, vol. 529(7587), pages 484-489, January.
    4. Peter Nystrup & Henrik Madsen & Erik Lindström, 2018. "Dynamic portfolio optimization across hidden market regimes," Quantitative Finance, Taylor & Francis Journals, vol. 18(1), pages 83-95, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter Nystrup & Stephen Boyd & Erik Lindström & Henrik Madsen, 2019. "Multi-period portfolio selection with drawdown control," Annals of Operations Research, Springer, vol. 282(1), pages 245-271, November.
    2. Anne Lavigne, 2006. "Gouvernance et investissement des fonds de pension privés aux Etats-Unis," Working Papers halshs-00081401, HAL.
    3. An Chen & Thai Nguyen & Thorsten Sehner, 2022. "Unit-Linked Tontine: Utility-Based Design, Pricing and Performance," Risks, MDPI, vol. 10(4), pages 1-27, April.
    4. Alan J. Auerbach, 1981. "Evaluating the Taxation of Risky Assets," NBER Working Papers 0806, National Bureau of Economic Research, Inc.
    5. Hong, Claire Yurong & Lu, Xiaomeng & Pan, Jun, 2021. "FinTech adoption and household risk-taking," BOFIT Discussion Papers 14/2021, Bank of Finland Institute for Emerging Economies (BOFIT).
    6. Curatola, Giuliano, 2022. "Price impact, strategic interaction and portfolio choice," The North American Journal of Economics and Finance, Elsevier, vol. 59(C).
    7. Auffret, Philippe, 2001. "An alternative unifying measure of welfare gains from risk-sharing," Policy Research Working Paper Series 2676, The World Bank.
    8. Chen, An & Hieber, Peter & Sureth, Caren, 2022. "Pay for tax certainty? Advance tax rulings for risky investment under multi-dimensional tax uncertainty," arqus Discussion Papers in Quantitative Tax Research 273, arqus - Arbeitskreis Quantitative Steuerlehre.
    9. Mayank Goel & Suresh Kumar K., 2006. "A Risk-Sensitive Portfolio Optimisation Problem with Stochastic Interest Rate," Journal of Emerging Market Finance, Institute for Financial Management and Research, vol. 5(3), pages 263-282, December.
    10. Tian Zhu & Merry H. Ma, 2022. "Deriving the Optimal Strategy for the Two Dice Pig Game via Reinforcement Learning," Stats, MDPI, vol. 5(3), pages 1-14, August.
    11. Xiaoyue Li & John M. Mulvey, 2023. "Optimal Portfolio Execution in a Regime-switching Market with Non-linear Impact Costs: Combining Dynamic Program and Neural Network," Papers 2306.08809, arXiv.org.
    12. Andreas Fagereng & Luigi Guiso & Davide Malacrino & Luigi Pistaferri, 2020. "Heterogeneity and Persistence in Returns to Wealth," Econometrica, Econometric Society, vol. 88(1), pages 115-170, January.
    13. Yuqian Xu & Lingjiong Zhu & Michael Pinedo, 2020. "Operational Risk Management: A Stochastic Control Framework with Preventive and Corrective Controls," Operations Research, INFORMS, vol. 68(6), pages 1804-1825, November.
    14. Yuki SHIGETA, 2022. "A Continuous-Time Utility Maximization Problem with Borrowing Constraints in Macroeconomic Heterogeneous Agent Models:A Case of Regular Controls under Markov Chain Uncertainty," Discussion papers e-22-009, Graduate School of Economics , Kyoto University.
    15. John H. Cochrane, 1999. "New facts in finance," Economic Perspectives, Federal Reserve Bank of Chicago, vol. 23(Q III), pages 36-58.
    16. Dokuchaev, Nikolai, 2010. "Optimality of myopic strategies for multi-stock discrete time market with management costs," European Journal of Operational Research, Elsevier, vol. 200(2), pages 551-556, January.
    17. Pedro Afonso Fernandes, 2024. "Forecasting with Neuro-Dynamic Programming," Papers 2404.03737, arXiv.org.
    18. Mr. Christopher Carroll & Mr. Martin Sommer & Mr. Jiri Slacalek, 2012. "Dissecting Saving Dynamics: Measuring Wealth, Precautionary, and Credit Effects," IMF Working Papers 2012/219, International Monetary Fund.
    19. Bihary, Zsolt & Víg, Attila András, 2018. "Portfólióallokáció csődveszély esetén, korlátolt felelősség mellett [Portfolio allocation in case of failure risk in the presence of limited liability]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(7), pages 711-725.
    20. Dong, Yinghui & Zheng, Harry, 2019. "Optimal investment of DC pension plan under short-selling constraints and portfolio insurance," Insurance: Mathematics and Economics, Elsevier, vol. 85(C), pages 47-59.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2202.07734. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.