IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1208.4429.html
   My bibliography  Save this paper

Common Mistakes when Applying Computational Intelligence and Machine Learning to Stock Market modelling

Author

Listed:
  • E. Hurwitz
  • T. Marwala

Abstract

For a number of reasons, computational intelligence and machine learning methods have been largely dismissed by the professional community. The reasons for this are numerous and varied, but inevitably amongst the reasons given is that the systems designed often do not perform as expected by their designers. The reasons for this lack of performance is a direct result of mistakes that are commonly seen in market-prediction systems. This paper examines some of the more common mistakes, namely dataset insufficiency; inappropriate scaling; time-series tracking; inappropriate target quantification and inappropriate measures of performance. The rationale that leads to each of these mistakes is examined, as well as the nature of the errors they introduce to the analysis / design. Alternative ways of performing each task are also recommended in order to avoid perpetuating these mistakes, and hopefully to aid in clearing the way for the use of these powerful techniques in industry.

Suggested Citation

  • E. Hurwitz & T. Marwala, 2012. "Common Mistakes when Applying Computational Intelligence and Machine Learning to Stock Market modelling," Papers 1208.4429, arXiv.org.
    • Handle: RePEc:arx:papers:1208.4429
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1208.4429
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chiang, W. -C. & Urban, T. L. & Baldridge, G. W., 1996. "A neural network approach to mutual fund net asset value forecasting," Omega, Elsevier, vol. 24(2), pages 205-215, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jahangoshai Rezaee, Mustafa & Jozmaleki, Mehrdad & Valipour, Mahsa, 2018. "Integrating dynamic fuzzy C-means, data envelopment analysis and artificial neural network to online prediction performance of companies in stock exchange," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 489(C), pages 78-93.
    2. Mishra, Sasmita & Padhy, Sudarsan, 2019. "An efficient portfolio construction model using stock price predicted by support vector regression," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    3. Chen Jo-Hui & Diaz John Francis T., 2021. "Application of grey relational analysis and artificial neural networks on currency exchange-traded notes (ETNs)," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 25(2), pages 1-17, April.
    4. Nghia Chu & Binh Dao & Nga Pham & Huy Nguyen & Hien Tran, 2022. "Predicting Mutual Funds' Performance using Deep Learning and Ensemble Techniques," Papers 2209.09649, arXiv.org, revised Jul 2023.
    5. Laura Fabregat-Aibar & Maria-Teresa Sorrosal-Forradellas & Glòria Barberà-Mariné & Antonio Terceño, 2021. "Can Artificial Neural Networks Predict the Survival Capacity of Mutual Funds? Evidence from Spain," Mathematics, MDPI, vol. 9(6), pages 1-10, March.
    6. Shaogao Lv & Yongchao Hou & Hongwei Zhou, 2019. "Financial Market Directional Forecasting With Stacked Denoising Autoencoder," Papers 1912.00712, arXiv.org.
    7. Mishra, Sasmita & Padhy, Sudarsan & Mishra, Satya Narayan & Misra, Satya Narayan, 2021. "A novel LASSO – TLBO – SVR hybrid model for an efficient portfolio construction," The North American Journal of Economics and Finance, Elsevier, vol. 55(C).
    8. Azadeh, A. & Ghaderi, S.F. & Anvari, M. & Saberi, M., 2007. "Performance assessment of electric power generations using an adaptive neural network algorithm," Energy Policy, Elsevier, vol. 35(6), pages 3155-3166, June.
    9. Yasemin Deniz Akarım, 2013. "A Comparison of Linear and Nonlinear Models in Forecasting Market Risk: The Evidence from Turkish Derivative Exchange," Journal of Economics and Behavioral Studies, AMH International, vol. 5(3), pages 164-172.
    10. Zhao, Ze & Wang, Jianzhou & Zhao, Jing & Su, Zhongyue, 2012. "Using a Grey model optimized by Differential Evolution algorithm to forecast the per capita annual net income of rural households in China," Omega, Elsevier, vol. 40(5), pages 525-532.
    11. Zhang, Guoqiang & Eddy Patuwo, B. & Y. Hu, Michael, 1998. "Forecasting with artificial neural networks:: The state of the art," International Journal of Forecasting, Elsevier, vol. 14(1), pages 35-62, March.
    12. Klein, B. D. & Rossin, D. F., 1999. "Data quality in neural network models: effect of error rate and magnitude of error on predictive accuracy," Omega, Elsevier, vol. 27(5), pages 569-582, October.
    13. Tay, Francis E. H. & Cao, Lijuan, 2001. "Application of support vector machines in financial time series forecasting," Omega, Elsevier, vol. 29(4), pages 309-317, August.
    14. Sen Cheong Kon & Lindsay W. Turner, 2005. "Neural Network Forecasting of Tourism Demand," Tourism Economics, , vol. 11(3), pages 301-328, September.
    15. Victor DeMiguel & Javier Gil-Bazo & Francisco J. Nogales & André A. P. Santos, 2021. "Can Machine Learning Help to Select Portfolios of Mutual Funds?," Working Papers 1245, Barcelona School of Economics.
    16. Indro, D. C. & Jiang, C. X. & Patuwo, B. E. & Zhang, G. P., 1999. "Predicting mutual fund performance using artificial neural networks," Omega, Elsevier, vol. 27(3), pages 373-380, June.
    17. Hwarng, H. Brian, 2001. "Insights into neural-network forecasting of time series corresponding to ARMA(p,q) structures," Omega, Elsevier, vol. 29(3), pages 273-289, June.
    18. Gruca, TS & Klemz, BR, 1998. "Using Neural Networks to Identify Competitive Market Structures from Aggregate Market Response Data," Omega, Elsevier, vol. 26(1), pages 49-62, February.
    19. Adam Fadlalla & Chien-Hua Lin, 2001. "An Analysis of the Applications of Neural Networks in Finance," Interfaces, INFORMS, vol. 31(4), pages 112-122, August.
    20. Lukas Ryll & Sebastian Seidens, 2019. "Evaluating the Performance of Machine Learning Algorithms in Financial Market Forecasting: A Comprehensive Survey," Papers 1906.07786, arXiv.org, revised Jul 2019.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1208.4429. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.