IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2210.17030.html
   My bibliography  Save this paper

Uncertainty Aware Trader-Company Method: Interpretable Stock Price Prediction Capturing Uncertainty

Author

Listed:
  • Yugo Fujimoto
  • Kei Nakagawa
  • Kentaro Imajo
  • Kentaro Minami

Abstract

Machine learning is an increasingly popular tool with some success in predicting stock prices. One promising method is the Trader-Company~(TC) method, which takes into account the dynamism of the stock market and has both high predictive power and interpretability. Machine learning-based stock prediction methods including the TC method have been concentrating on point prediction. However, point prediction in the absence of uncertainty estimates lacks credibility quantification and raises concerns about safety. The challenge in this paper is to make an investment strategy that combines high predictive power and the ability to quantify uncertainty. We propose a novel approach called Uncertainty Aware Trader-Company Method~(UTC) method. The core idea of this approach is to combine the strengths of both frameworks by merging the TC method with the probabilistic modeling, which provides probabilistic predictions and uncertainty estimations. We expect this to retain the predictive power and interpretability of the TC method while capturing the uncertainty. We theoretically prove that the proposed method estimates the posterior variance and does not introduce additional biases from the original TC method. We conduct a comprehensive evaluation of our approach based on the synthetic and real market datasets. We confirm with synthetic data that the UTC method can detect situations where the uncertainty increases and the prediction is difficult. We also confirmed that the UTC method can detect abrupt changes in data generating distributions. We demonstrate with real market data that the UTC method can achieve higher returns and lower risks than baselines.

Suggested Citation

  • Yugo Fujimoto & Kei Nakagawa & Kentaro Imajo & Kentaro Minami, 2022. "Uncertainty Aware Trader-Company Method: Interpretable Stock Price Prediction Capturing Uncertainty," Papers 2210.17030, arXiv.org, revised Nov 2022.
  • Handle: RePEc:arx:papers:2210.17030
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2210.17030
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fama, Eugene F & French, Kenneth R, 1992. "The Cross-Section of Expected Stock Returns," Journal of Finance, American Finance Association, vol. 47(2), pages 427-465, June.
    2. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," The Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    3. Mojtaba Sedighi & Hossein Jahangirnia & Mohsen Gharakhani & Saeed Farahani Fard, 2019. "A Novel Hybrid Model for Stock Price Forecasting Based on Metaheuristics and Support Vector Machine," Data, MDPI, vol. 4(2), pages 1-28, May.
    4. C. H. Hommes, 2001. "Financial markets as nonlinear adaptive evolutionary systems," Quantitative Finance, Taylor & Francis Journals, vol. 1(1), pages 149-167.
    5. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    6. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    7. Maria Rosa Borges, 2010. "Efficient market hypothesis in European stock markets," The European Journal of Finance, Taylor & Francis Journals, vol. 16(7), pages 711-726.
    8. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    9. J. Ledolter, 1979. "Inference robustness of ARIMA models under non-normality —Special application to stock price data," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 26(1), pages 43-56, December.
    10. Zexin Hu & Yiqi Zhao & Matloob Khushi, 2021. "A Survey of Forex and Stock Price Prediction Using Deep Learning," Papers 2103.09750, arXiv.org.
    11. Zura Kakushadze & Juan Andrés Serur, 2018. "151 Trading Strategies," Springer Books, Springer, number 978-3-030-02792-6, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cheng Juan Zhan & William Rea & Alethea Rea, 2016. "Stock Selection as a Problem in Phylogenetics—Evidence from the ASX," IJFS, MDPI, vol. 4(4), pages 1-19, September.
    2. Guillaume Coqueret, 2016. "Empirical properties of a heterogeneous agent model in large dimensions," Post-Print hal-02088097, HAL.
    3. M. Raddant & T. Di Matteo, 2023. "A look at financial dependencies by means of econophysics and financial economics," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 18(4), pages 701-734, October.
    4. Hannah Cheng Juan Zhan & William Rea & Alethea Rea, 2015. "A Comparision of Three Network Portfolio Selection Methods -- Evidence from the Dow Jones," Papers 1512.01905, arXiv.org.
    5. Guillaume Coqueret, 2017. "Empirical properties of a heterogeneous agent model in large dimensions," Post-Print hal-02000726, HAL.
    6. Coqueret, Guillaume, 2017. "Empirical properties of a heterogeneous agent model in large dimensions," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 180-201.
    7. Kai Li, 2014. "Asset Price Dynamics with Heterogeneous Beliefs and Time Delays," PhD Thesis, Finance Discipline Group, UTS Business School, University of Technology, Sydney, number 1-2014.
    8. Katsuya Ito & Kentaro Minami & Kentaro Imajo & Kei Nakagawa, 2020. "Trader-Company Method: A Metaheuristic for Interpretable Stock Price Prediction," Papers 2012.10215, arXiv.org.
    9. Kai Li, 2014. "Asset Price Dynamics with Heterogeneous Beliefs and Time Delays," PhD Thesis, Finance Discipline Group, UTS Business School, University of Technology, Sydney, number 13, July-Dece.
    10. Guillaume Coqueret, 2017. "Empirical properties of a heterogeneous agent model in large dimensions," Post-Print hal-02312186, HAL.
    11. Kei Nakagawa & Yusuke Uchiyama, 2020. "GO-GJRSK Model with Application to Higher Order Risk-Based Portfolio," Mathematics, MDPI, vol. 8(11), pages 1-12, November.
    12. Michele Costola & Massimiliano Caporin, 2016. "Rational Learning For Risk-Averse Investors By Conditioning On Behavioral Choices," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 11(01), pages 1-26, March.
    13. Cathy W. S. Chen & Richard H. Gerlach & Ann M. H. Lin, 2011. "Multi-regime nonlinear capital asset pricing models," Quantitative Finance, Taylor & Francis Journals, vol. 11(9), pages 1421-1438, April.
    14. Viet Anh Nguyen & Fan Zhang & Shanshan Wang & Jose Blanchet & Erick Delage & Yinyu Ye, 2021. "Robustifying Conditional Portfolio Decisions via Optimal Transport," Papers 2103.16451, arXiv.org, revised Apr 2024.
    15. Ali Habibnia & Esfandiar Maasoumi, 2021. "Forecasting in Big Data Environments: An Adaptable and Automated Shrinkage Estimation of Neural Networks (AAShNet)," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(1), pages 363-381, December.
    16. He, Xue-Zhong & Li, Youwei, 2015. "Testing of a market fraction model and power-law behaviour in the DAX 30," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 1-17.
    17. Jian Guo & Saizhuo Wang & Lionel M. Ni & Heung-Yeung Shum, 2022. "Quant 4.0: Engineering Quantitative Investment with Automated, Explainable and Knowledge-driven Artificial Intelligence," Papers 2301.04020, arXiv.org.
    18. Boudt, Kris & Raza, Muhammad Wajid & Wauters, Marjan, 2019. "Evaluating the Shariah-compliance of equity portfolios: The weighting method matters," International Review of Financial Analysis, Elsevier, vol. 63(C), pages 406-417.
    19. Attiya Yasmeen Javid, 2000. "Alternative Capital Asset Pricing Models: A Review of Theory and Evidence," PIDE Research Report 2000:3, Pakistan Institute of Development Economics.
    20. Matthias Raddant & Friedrich Wagner, 2017. "Transitions in the stock markets of the US, UK and Germany," Quantitative Finance, Taylor & Francis Journals, vol. 17(2), pages 289-297, February.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2210.17030. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.