IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2107.09051.html
   My bibliography  Save this paper

AI in Finance: Challenges, Techniques and Opportunities

Author

Listed:
  • Longbing Cao

Abstract

AI in finance broadly refers to the applications of AI techniques in financial businesses. This area has been lasting for decades with both classic and modern AI techniques applied to increasingly broader areas of finance, economy and society. In contrast to either discussing the problems, aspects and opportunities of finance that have benefited from specific AI techniques and in particular some new-generation AI and data science (AIDS) areas or reviewing the progress of applying specific techniques to resolving certain financial problems, this review offers a comprehensive and dense roadmap of the overwhelming challenges, techniques and opportunities of AI research in finance over the past decades. The landscapes and challenges of financial businesses and data are firstly outlined, followed by a comprehensive categorization and a dense overview of the decades of AI research in finance. We then structure and illustrate the data-driven analytics and learning of financial businesses and data. The comparison, criticism and discussion of classic vs. modern AI techniques for finance are followed. Lastly, open issues and opportunities address future AI-empowered finance and finance-motivated AI research.

Suggested Citation

  • Longbing Cao, 2021. "AI in Finance: Challenges, Techniques and Opportunities," Papers 2107.09051, arXiv.org.
    • Handle: RePEc:arx:papers:2107.09051
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2107.09051
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yixiao Li & Gloria Lin & Thomas Lau & Ruochen Zeng, 2019. "A Review of Changepoint Detection Models," Papers 1908.07136, arXiv.org.
    2. Sang Il Lee & Seong Joon Yoo, 2019. "Multimodal Deep Learning for Finance: Integrating and Forecasting International Stock Markets," Papers 1903.06478, arXiv.org, revised Sep 2019.
    3. Xin Wang & Xi Chen & Peng Zhao, 2020. "The Relationship Between Bitcoin and Stock Market," International Journal of Operations Research and Information Systems (IJORIS), IGI Global, vol. 11(2), pages 22-35, April.
    4. Steven Kou & Xianhua Peng & Xingbo Xu, 2016. "EM Algorithm and Stochastic Control in Economics," Papers 1611.01767, arXiv.org.
    5. Zeda Li & Robert T. Krafty, 2019. "Adaptive Bayesian Time–Frequency Analysis of Multivariate Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 453-465, January.
    6. Marcelo Sardelich & Suresh Manandhar, 2018. "Multimodal deep learning for short-term stock volatility prediction," Papers 1812.10479, arXiv.org.
    7. Fischer, Thomas, 2011. "News Reaction in Financial Markets within a Behavioral Finance Model with Heterogeneous Agents," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 54196, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    8. Gilli, Manfred & Maringer, Dietmar & Schumann, Enrico, 2011. "Numerical Methods and Optimization in Finance," Elsevier Monographs, Elsevier, edition 1, number 9780123756626.
    9. Souradeep Chakraborty, 2019. "Capturing Financial markets to apply Deep Reinforcement Learning," Papers 1907.04373, arXiv.org, revised Dec 2019.
    10. Norman Ehrentreich, 2008. "Agent-Based Modeling," Lecture Notes in Economics and Mathematical Systems, Springer, number 978-3-540-73879-4, December.
    11. Rebonato,Riccardo & Denev,Alexander, 2014. "Portfolio Management under Stress," Cambridge Books, Cambridge University Press, number 9781107048119.
    12. Moret, Stefano & Babonneau, Frédéric & Bierlaire, Michel & Maréchal, François, 2020. "Decision support for strategic energy planning: A robust optimization framework," European Journal of Operational Research, Elsevier, vol. 280(2), pages 539-554.
    13. Johannes Wachs & Mih'aly Fazekas & J'anos Kert'esz, 2019. "Corruption Risk in Contracting Markets: A Network Science Perspective," Papers 1909.08664, arXiv.org.
    14. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    15. Kim, A. & Yang, Y. & Lessmann, S. & Ma, T. & Sung, M.-C. & Johnson, J.E.V., 2020. "Can deep learning predict risky retail investors? A case study in financial risk behavior forecasting," European Journal of Operational Research, Elsevier, vol. 283(1), pages 217-234.
    16. Longbing Cao & Xue-Zhong He, 2009. "Developing actionable trading agents," Published Paper Series 2009-5, Finance Discipline Group, UTS Business School, University of Technology, Sydney.
    17. Jing Zhang & Qi-zhi He & M. Irfan Uddin, 2021. "Dynamic Cross-Market Volatility Spillover Based on MSV Model: Evidence from Bitcoin, Gold, Crude Oil, and Stock Markets," Complexity, Hindawi, vol. 2021, pages 1-8, April.
    18. Omer Berat Sezer & Mehmet Ugur Gudelek & Ahmet Murat Ozbayoglu, 2019. "Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019," Papers 1911.13288, arXiv.org.
    19. Lukas Ryll & Sebastian Seidens, 2019. "Evaluating the Performance of Machine Learning Algorithms in Financial Market Forecasting: A Comprehensive Survey," Papers 1906.07786, arXiv.org, revised Jul 2019.
    20. Lorán Chollete & Andréas Heinen & Alfonso Valdesogo, 2009. "Modeling International Financial Returns with a Multivariate Regime-switching Copula," Journal of Financial Econometrics, Oxford University Press, vol. 7(4), pages 437-480, Fall.
    21. Luigi Troiano & Elena Mejuto & Pravesh Kriplani, 2017. "On Feature Reduction using Deep Learning for Trend Prediction in Finance," Papers 1704.03205, arXiv.org.
    22. Justin Sirignano & Rama Cont, 2019. "Universal features of price formation in financial markets: perspectives from deep learning," Quantitative Finance, Taylor & Francis Journals, vol. 19(9), pages 1449-1459, September.
    23. Yoshiharu Sato, 2019. "Model-Free Reinforcement Learning for Financial Portfolios: A Brief Survey," Papers 1904.04973, arXiv.org, revised May 2019.
    24. Cesare Fracassi, 2017. "Corporate Finance Policies and Social Networks," Management Science, INFORMS, vol. 63(8), pages 2420-2438, August.
    25. Xing Wang & Yijun Wang & Bin Weng & Aleksandr Vinel, 2020. "Stock2Vec: A Hybrid Deep Learning Framework for Stock Market Prediction with Representation Learning and Temporal Convolutional Network," Papers 2010.01197, arXiv.org.
    26. Rosdyana Mangir Irawan Kusuma & Trang-Thi Ho & Wei-Chun Kao & Yu-Yen Ou & Kai-Lung Hua, 2019. "Using Deep Learning Neural Networks and Candlestick Chart Representation to Predict Stock Market," Papers 1903.12258, arXiv.org.
    27. Wei Huang & K. K. Lai & Y. Nakamori & Shouyang Wang, 2004. "Forecasting Foreign Exchange Rates With Artificial Neural Networks: A Review," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 3(01), pages 145-165.
    28. Fischer, Thomas G., 2018. "Reinforcement learning in financial markets - a survey," FAU Discussion Papers in Economics 12/2018, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    29. Chainarong Amornbunchornvej & Elena Zheleva & Tanya Y. Berger-Wolf, 2019. "Variable-lag Granger Causality for Time Series Analysis," Papers 1912.10829, arXiv.org.
    30. Hussein A. Abdou & John Pointon, 2011. "Credit Scoring, Statistical Techniques And Evaluation Criteria: A Review Of The Literature," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 18(2-3), pages 59-88, April.
    31. David Byrd & Antigoni Polychroniadou, 2020. "Differentially Private Secure Multi-Party Computation for Federated Learning in Financial Applications," Papers 2010.05867, arXiv.org.
    32. Bernardo Nicoletti, 2017. "The Future of FinTech," Palgrave Studies in Financial Services Technology, Palgrave Macmillan, number 978-3-319-51415-4, December.
    33. R. Y. Goh & L. S. Lee, 2019. "Credit Scoring: A Review on Support Vector Machines and Metaheuristic Approaches," Advances in Operations Research, Hindawi, vol. 2019, pages 1-30, March.
    34. Susan Athey, 2018. "The Impact of Machine Learning on Economics," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 507-547, National Bureau of Economic Research, Inc.
    35. Ahmet Murat Ozbayoglu & Mehmet Ugur Gudelek & Omer Berat Sezer, 2020. "Deep Learning for Financial Applications : A Survey," Papers 2002.05786, arXiv.org.
    36. Tariq Abbasi & Hans Weigand, 2017. "The Impact of Digital Financial Services on Firm's Performance: a Literature Review," Papers 1705.10294, arXiv.org.
    37. Ali Hirsa & Tugce Karatas & Amir Oskoui, 2019. "Supervised Deep Neural Networks (DNNs) for Pricing/Calibration of Vanilla/Exotic Options Under Various Different Processes," Papers 1902.05810, arXiv.org.
    38. Masaya Abe & Hideki Nakayama, 2018. "Deep Learning for Forecasting Stock Returns in the Cross-Section," Papers 1801.01777, arXiv.org, revised Jun 2018.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Charl Maree & Christian W. Omlin, 2022. "Reinforcement Learning with Intrinsic Affinity for Personalized Asset Management," Papers 2204.09218, arXiv.org.
    2. Charl Maree & Christian W. Omlin, 2022. "Reinforcement learning with intrinsic affinity for personalized prosperity management," Digital Finance, Springer, vol. 4(2), pages 241-262, September.
    3. Jaydip Sen & Rajdeep Sen & Abhishek Dutta, 2021. "Machine Learning in Finance-Emerging Trends and Challenges," Papers 2110.11999, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Longbing Cao & Qiang Yang & Philip S. Yu, 2020. "Data science and AI in FinTech: An overview," Papers 2007.12681, arXiv.org, revised Jul 2021.
    2. Shuo Sun & Rundong Wang & Bo An, 2021. "Reinforcement Learning for Quantitative Trading," Papers 2109.13851, arXiv.org.
    3. Adrian Millea, 2021. "Deep Reinforcement Learning for Trading—A Critical Survey," Data, MDPI, vol. 6(11), pages 1-25, November.
    4. Helmut Wasserbacher & Martin Spindler, 2022. "Machine learning for financial forecasting, planning and analysis: recent developments and pitfalls," Digital Finance, Springer, vol. 4(1), pages 63-88, March.
    5. Sevcan Uzun & Ahmet Sensoy & Duc Khuong Nguyen, 2023. "Jump forecasting in foreign exchange markets: A high‐frequency analysis," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(3), pages 578-624, April.
    6. Ben Hambly & Renyuan Xu & Huining Yang, 2021. "Recent Advances in Reinforcement Learning in Finance," Papers 2112.04553, arXiv.org, revised Feb 2023.
    7. Wenyong Zhang & Lingfei Li & Gongqiu Zhang, 2021. "A Two-Step Framework for Arbitrage-Free Prediction of the Implied Volatility Surface," Papers 2106.07177, arXiv.org, revised Jan 2022.
    8. Zihao Zhang & Stefan Zohren & Stephen Roberts, 2019. "Deep Reinforcement Learning for Trading," Papers 1911.10107, arXiv.org.
    9. Longo, Luigi & Riccaboni, Massimo & Rungi, Armando, 2022. "A neural network ensemble approach for GDP forecasting," Journal of Economic Dynamics and Control, Elsevier, vol. 134(C).
    10. Pedro M. Mirete-Ferrer & Alberto Garcia-Garcia & Juan Samuel Baixauli-Soler & Maria A. Prats, 2022. "A Review on Machine Learning for Asset Management," Risks, MDPI, vol. 10(4), pages 1-46, April.
    11. Rian Dolphin & Barry Smyth & Ruihai Dong, 2022. "Stock Embeddings: Learning Distributed Representations for Financial Assets," Papers 2202.08968, arXiv.org.
    12. Omer Berat Sezer & Mehmet Ugur Gudelek & Ahmet Murat Ozbayoglu, 2019. "Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019," Papers 1911.13288, arXiv.org.
    13. Eric Benhamou & David Saltiel & Sandrine Ungari & Abhishek Mukhopadhyay, 2020. "Bridging the gap between Markowitz planning and deep reinforcement learning," Papers 2010.09108, arXiv.org.
    14. Zexin Hu & Yiqi Zhao & Matloob Khushi, 2021. "A Survey of Forex and Stock Price Prediction Using Deep Learning," Papers 2103.09750, arXiv.org.
    15. Erdinc Akyildirim & Oguzhan Cepni & Shaen Corbet & Gazi Salah Uddin, 2023. "Forecasting mid-price movement of Bitcoin futures using machine learning," Annals of Operations Research, Springer, vol. 330(1), pages 553-584, November.
    16. Liyang Tang, 2020. "Application of Nonlinear Autoregressive with Exogenous Input (NARX) neural network in macroeconomic forecasting, national goal setting and global competitiveness assessment," Papers 2005.08735, arXiv.org.
    17. Philippe Jardin, 2023. "Designing topological data to forecast bankruptcy using convolutional neural networks," Annals of Operations Research, Springer, vol. 325(2), pages 1291-1332, June.
    18. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    19. Helmut Wasserbacher & Martin Spindler, 2021. "Machine Learning for Financial Forecasting, Planning and Analysis: Recent Developments and Pitfalls," Papers 2107.04851, arXiv.org.
    20. Jia Xu & Longbing Cao, 2023. "Copula Variational LSTM for High-dimensional Cross-market Multivariate Dependence Modeling," Papers 2305.08778, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2107.09051. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.