IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1208.4429.html
   My bibliography  Save this paper

Common Mistakes when Applying Computational Intelligence and Machine Learning to Stock Market modelling

Author

Listed:
  • E. Hurwitz
  • T. Marwala

Abstract

For a number of reasons, computational intelligence and machine learning methods have been largely dismissed by the professional community. The reasons for this are numerous and varied, but inevitably amongst the reasons given is that the systems designed often do not perform as expected by their designers. The reasons for this lack of performance is a direct result of mistakes that are commonly seen in market-prediction systems. This paper examines some of the more common mistakes, namely dataset insufficiency; inappropriate scaling; time-series tracking; inappropriate target quantification and inappropriate measures of performance. The rationale that leads to each of these mistakes is examined, as well as the nature of the errors they introduce to the analysis / design. Alternative ways of performing each task are also recommended in order to avoid perpetuating these mistakes, and hopefully to aid in clearing the way for the use of these powerful techniques in industry.

Suggested Citation

  • E. Hurwitz & T. Marwala, 2012. "Common Mistakes when Applying Computational Intelligence and Machine Learning to Stock Market modelling," Papers 1208.4429, arXiv.org.
    • Handle: RePEc:arx:papers:1208.4429
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1208.4429
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chiang, W. -C. & Urban, T. L. & Baldridge, G. W., 1996. "A neural network approach to mutual fund net asset value forecasting," Omega, Elsevier, vol. 24(2), pages 205-215, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jahangoshai Rezaee, Mustafa & Jozmaleki, Mehrdad & Valipour, Mahsa, 2018. "Integrating dynamic fuzzy C-means, data envelopment analysis and artificial neural network to online prediction performance of companies in stock exchange," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 489(C), pages 78-93.
    2. Laura Fabregat-Aibar & Maria-Teresa Sorrosal-Forradellas & Glòria Barberà-Mariné & Antonio Terceño, 2021. "Can Artificial Neural Networks Predict the Survival Capacity of Mutual Funds? Evidence from Spain," Mathematics, MDPI, vol. 9(6), pages 1-10, March.
    3. Mishra, Sasmita & Padhy, Sudarsan & Mishra, Satya Narayan & Misra, Satya Narayan, 2021. "A novel LASSO – TLBO – SVR hybrid model for an efficient portfolio construction," The North American Journal of Economics and Finance, Elsevier, vol. 55(C).
    4. Yasemin Deniz Akarım, 2013. "A Comparison of Linear and Nonlinear Models in Forecasting Market Risk: The Evidence from Turkish Derivative Exchange," Journal of Economics and Behavioral Studies, AMH International, vol. 5(3), pages 164-172.
    5. Zhao, Ze & Wang, Jianzhou & Zhao, Jing & Su, Zhongyue, 2012. "Using a Grey model optimized by Differential Evolution algorithm to forecast the per capita annual net income of rural households in China," Omega, Elsevier, vol. 40(5), pages 525-532.
    6. Klein, B. D. & Rossin, D. F., 1999. "Data quality in neural network models: effect of error rate and magnitude of error on predictive accuracy," Omega, Elsevier, vol. 27(5), pages 569-582, October.
    7. Victor DeMiguel & Javier Gil-Bazo & Francisco J. Nogales & André A. P. Santos, 2021. "Can Machine Learning Help to Select Portfolios of Mutual Funds?," Working Papers 1245, Barcelona School of Economics.
    8. Indro, D. C. & Jiang, C. X. & Patuwo, B. E. & Zhang, G. P., 1999. "Predicting mutual fund performance using artificial neural networks," Omega, Elsevier, vol. 27(3), pages 373-380, June.
    9. Hwarng, H. Brian, 2001. "Insights into neural-network forecasting of time series corresponding to ARMA(p,q) structures," Omega, Elsevier, vol. 29(3), pages 273-289, June.
    10. Han Qiu & Rong Hu & Jiaqing Chen & Zihao Yuan, 2025. "Short-Term Electricity Load Forecasting Based on Complete Ensemble Empirical Mode Decomposition with Adaptive Noise and Improved Sparrow Search Algorithm–Convolutional Neural Network–Bidirectional Lon," Mathematics, MDPI, vol. 13(5), pages 1-32, February.
    11. Gruca, TS & Klemz, BR, 1998. "Using Neural Networks to Identify Competitive Market Structures from Aggregate Market Response Data," Omega, Elsevier, vol. 26(1), pages 49-62, February.
    12. Adam Fadlalla & Chien-Hua Lin, 2001. "An Analysis of the Applications of Neural Networks in Finance," Interfaces, INFORMS, vol. 31(4), pages 112-122, August.
    13. Onsel Sahin, Sule & Ulengin, Fusun & Ulengin, Burc, 2004. "Using neural networks and cognitive mapping in scenario analysis: The case of Turkey's inflation dynamics," European Journal of Operational Research, Elsevier, vol. 158(1), pages 124-145, October.
    14. Shouhong, Wang, 1998. "An Insight Into the Standard Back-propagation Neural Network Model for Regression Analysis," Omega, Elsevier, vol. 26(1), pages 133-140, February.
    15. Azadeh, A. & Saberi, M. & Seraj, O., 2010. "An integrated fuzzy regression algorithm for energy consumption estimation with non-stationary data: A case study of Iran," Energy, Elsevier, vol. 35(6), pages 2351-2366.
    16. Curry, B. & Morgan, P., 1997. "Neural networks: a need for caution," Omega, Elsevier, vol. 25(1), pages 123-133, February.
    17. Gupta, V. K. & Chen, J. G. & Murtaza, M. B., 1997. "A learning vector quantization neural network model for the classification of industrial construction projects," Omega, Elsevier, vol. 25(6), pages 715-727, December.
    18. Mishra, Sasmita & Padhy, Sudarsan, 2019. "An efficient portfolio construction model using stock price predicted by support vector regression," The North American Journal of Economics and Finance, Elsevier, vol. 50(C).
    19. Chen Jo-Hui & Diaz John Francis T., 2021. "Application of grey relational analysis and artificial neural networks on currency exchange-traded notes (ETNs)," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 25(2), pages 1-17, April.
    20. Nghia Chu & Binh Dao & Nga Pham & Huy Nguyen & Hien Tran, 2022. "Predicting Mutual Funds' Performance using Deep Learning and Ensemble Techniques," Papers 2209.09649, arXiv.org, revised Jul 2023.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1208.4429. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.