IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v67y2026i5d10.1007_s10614-025-10993-2.html

A Random Forest Approach to Detect and Identify Unlawful Insider Trading

Author

Listed:
  • Krishna Neupane

    (George Mason University, Department of Computational and Data Sciences)

  • Igor Griva

    (George Mason University, Department of Mathematical Science)

Abstract

Detecting Unlawful Insider Trading (UIT) remains a critical yet challenging task. The sheer volume of transactions, often numbering in the thousands per minute, necessitates the development of sophisticated algorithms to augment manual review. While previous studies have demonstrated the potential of Machine Learning (ML) methods, such as Random Forest (RF), for UIT detection, this study significantly improves upon existing approaches. We expand the feature set from 25 previously used features to 110, incorporating 85 novel features that prove highly informative for UIT identification. Features were result of merging of multiple database for the first time to best of our knowledge. Furthermore, we substantially increase the training dataset size to 3,984 transactions. Consequently, our RF model achieves a UIT detection accuracy over 95 percent, a substantial improvement over previously reported results. Our key findings also highlight the significant influence of corporate governance factors on UIT and underscore the importance of data quality and feature engineering for optimal model performance. This research demonstrates the effectiveness of ML tools in automating UIT detection, thereby reducing reliance on manual analysis and enhancing efficiency.

Suggested Citation

  • Krishna Neupane & Igor Griva, 2026. "A Random Forest Approach to Detect and Identify Unlawful Insider Trading," Computational Economics, Springer;Society for Computational Economics, vol. 67(5), pages 4063-4091, May.
  • Handle: RePEc:kap:compec:v:67:y:2026:i:5:d:10.1007_s10614-025-10993-2
    DOI: 10.1007/s10614-025-10993-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-025-10993-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-025-10993-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    2. Hans B. Christensen & Luzi Hail & Christian Leuz, 2016. "Capital-Market Effects of Securities Regulation: Prior Conditions, Implementation, and Enforcement," The Review of Financial Studies, Society for Financial Studies, vol. 29(11), pages 2885-2924.
    3. Fedor Iskhakov & John Rust & Bertel Schjerning, 2020. "Machine learning and structural econometrics: contrasts and synergies," The Econometrics Journal, Royal Economic Society, vol. 23(3), pages 81-124.
    4. Alan Gregory & John Matatko & Ian Tonks, 1997. "Detecting Information from Directors' Trades: Signal Definition and Variable Size Effects," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 24(3), pages 309-342, April.
    5. David Easley & Soeren Hvidkjaer & Maureen O'Hara, 2002. "Is Information Risk a Determinant of Asset Returns?," Journal of Finance, American Finance Association, vol. 57(5), pages 2185-2221, October.
    6. Grinblatt, Mark S. & Masulis, Ronald W. & Titman, Sheridan, 1984. "The valuation effects of stock splits and stock dividends," Journal of Financial Economics, Elsevier, vol. 13(4), pages 461-490, December.
    7. Drew Fudenberg & Annie Liang, 2019. "Predicting and Understanding Initial Play," American Economic Review, American Economic Association, vol. 109(12), pages 4112-4141, December.
    8. Ross, Stephen A, 1978. "The Current Status of the Capital Asset Pricing Model (CAPM)," Journal of Finance, American Finance Association, vol. 33(3), pages 885-901, June.
    9. Gilles Boevi Koumou, 2020. "Diversification and portfolio theory: a review," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 34(3), pages 267-312, September.
    10. Kyle, Albert S, 1985. "Continuous Auctions and Insider Trading," Econometrica, Econometric Society, vol. 53(6), pages 1315-1335, November.
    11. Driessen, Joost & Melenberg, Bertrand & Nijman, Theo, 2003. "Common factors in international bond returns," Journal of International Money and Finance, Elsevier, vol. 22(5), pages 629-656, October.
    12. Perignon, Christophe & Smith, Daniel R. & Villa, Christophe, 2007. "Why common factors in international bond returns are not so common," Journal of International Money and Finance, Elsevier, vol. 26(2), pages 284-304, March.
    13. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," The Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    14. Billio, Monica & Getmansky, Mila & Lo, Andrew W. & Pelizzon, Loriana, 2012. "Econometric measures of connectedness and systemic risk in the finance and insurance sectors," Journal of Financial Economics, Elsevier, vol. 104(3), pages 535-559.
    15. Hou, Kewei & Xue, Chen & Zhang, Lu, 2017. "Replicating Anomalies," Working Paper Series 2017-10, Ohio State University, Charles A. Dice Center for Research in Financial Economics.
    16. Shangkun Deng & Chenguang Wang & Zhe Fu & Mingyue Wang, 2021. "An Intelligent System for Insider Trading Identification in Chinese Security Market," Computational Economics, Springer;Society for Computational Economics, vol. 57(2), pages 593-616, February.
    17. Ajay Agrawal & Joshua Gans & Avi Goldfarb, 2019. "The Economics of Artificial Intelligence: An Agenda," NBER Books, National Bureau of Economic Research, Inc, number agra-1.
    18. Ali, Usman & Hirshleifer, David, 2017. "Opportunism as a firm and managerial trait: Predicting insider trading profits and misconduct," Journal of Financial Economics, Elsevier, vol. 126(3), pages 490-515.
    19. Cumming, Douglas & Johan, Sofia & Li, Dan, 2011. "Exchange trading rules and stock market liquidity," Journal of Financial Economics, Elsevier, vol. 99(3), pages 651-671, March.
    20. Millicent Chang & John Gould & Yuyun Huang & Sirimon Treepongkaruna & Joey Wenling Yang, 2022. "Insider trading and the algorithmic trading environment," International Review of Finance, International Review of Finance Ltd., vol. 22(4), pages 725-750, December.
    21. Xinyu Zhang & Howell Tong, 2022. "Asymptotic theory of principal component analysis for time series data with cautionary comments," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(2), pages 543-565, April.
    22. Malcolm Baker & Jeffrey Wurgler, 2006. "Investor Sentiment and the Cross‐Section of Stock Returns," Journal of Finance, American Finance Association, vol. 61(4), pages 1645-1680, August.
    23. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    24. Henry, Darren & Nguyen, Lily & Pham, Viet Hung, 2017. "Institutional trading before dividend reduction announcements," Journal of Financial Markets, Elsevier, vol. 36(C), pages 40-55.
    25. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    26. Amihud, Yakov & Mendelson, Haim, 1987. "Trading Mechanisms and Stock Returns: An Empirical Investigation," Journal of Finance, American Finance Association, vol. 42(3), pages 533-553, July.
    27. Driessen, J.J.A.G. & Melenberg, B. & Nijman, T.E., 2003. "Common factors in international bond returns," Other publications TiSEM 06a83942-b625-4d3c-808c-a, Tilburg University, School of Economics and Management.
    28. Benjamin Avanzi & Greg Taylor & Melantha Wang & Bernard Wong, 2023. "Machine Learning with High-Cardinality Categorical Features in Actuarial Applications," Papers 2301.12710, arXiv.org.
    29. Egloff, Daniel & Leippold, Markus & Wu, Liuren, 2010. "The Term Structure of Variance Swap Rates and Optimal Variance Swap Investments," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 45(5), pages 1279-1310, October.
    30. Fama, Eugene F, 1976. "Multiperiod Consumption-Investment Decisions: A Correction," American Economic Review, American Economic Association, vol. 66(4), pages 723-724, September.
    31. Xi Chen & Yang Ha (Tony) Cho & Yiwei Dou & Baruch Lev, 2022. "Predicting Future Earnings Changes Using Machine Learning and Detailed Financial Data," Journal of Accounting Research, John Wiley & Sons, Ltd., vol. 60(2), pages 467-515, May.
    32. Nicolai Meinshausen, 2008. "Hierarchical testing of variable importance," Biometrika, Biometrika Trust, vol. 95(2), pages 265-278.
    33. Yacine Aït-Sahalia & Dacheng Xiu, 2019. "Principal Component Analysis of High-Frequency Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 287-303, January.
    34. Black, Fischer & Scholes, Myron S, 1973. "The Pricing of Options and Corporate Liabilities," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 637-654, May-June.
    35. Henry G. Manne, 2005. "Insider Trading: Hayek, Virtual Markets, and the Dog that Did Not Bark," ICER Working Papers 07-2005, ICER - International Centre for Economic Research.
    36. Lauren Cohen & Christopher Malloy & Lukasz Pomorski, 2012. "Decoding Inside Information," Journal of Finance, American Finance Association, vol. 67(3), pages 1009-1043, June.
    37. John, Kose & Narayanan, Ranga, 1997. "Market Manipulation and the Role of Insider Trading Regulations," The Journal of Business, University of Chicago Press, vol. 70(2), pages 217-247, April.
    38. Ahern, Kenneth R., 2017. "Information networks: Evidence from illegal insider trading tips," Journal of Financial Economics, Elsevier, vol. 125(1), pages 26-47.
    39. Fishman, Michael J & Hagerty, Kathleen M, 1995. "The Mandatory Disclosure of Trades and Market Liquidity," The Review of Financial Studies, Society for Financial Studies, vol. 8(3), pages 637-676.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Krishna Neupane & Igor Griva, 2025. "An extreme Gradient Boosting (XGBoost) Trees approach to Detect and Identify Unlawful Insider Trading (UIT) Transactions," Papers 2511.08306, arXiv.org.
    2. Sadok El Ghoul & Omrane Guedhami & Robert Nash & He (Helen) Wang, 2022. "Economic policy uncertainty and insider trading," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 45(4), pages 817-854, December.
    3. Krishna Neupane & Igor Griva & Robert Axtell & William Kennedy & Jason Kinser, 2026. "Detecting and Explaining Unlawful Insider Trading: A Shapley Value and Causal Forest Approach to Identifying Key Drivers and Causal Relationships," Papers 2602.19841, arXiv.org.
    4. Ramiah, Vikash & Xu, Xiaoming & Moosa, Imad A., 2015. "Neoclassical finance, behavioral finance and noise traders: A review and assessment of the literature," International Review of Financial Analysis, Elsevier, vol. 41(C), pages 89-100.
    5. Li, Zhibing & Liu, Jia & Liu, Jie & Liu, Xiaoyu & Wu, Chonglin, 2025. "Investor attention and stock price manipulation: Evidence from daily quasi-natural experiments," Journal of Banking & Finance, Elsevier, vol. 179(C).
    6. Pierce, Andrew T., 2024. "Capital-market effects of tipper-tippee insider trading law: Evidence from the Newman ruling," Journal of Accounting and Economics, Elsevier, vol. 77(2).
    7. Reis, Pedro Nogueira & Pinto, António Pedro Soares, 2024. "Unlocking portfolio resilient and persistent risk: A holistic approach to unveiling potential grounds," The North American Journal of Economics and Finance, Elsevier, vol. 73(C).
    8. Aghanya, Daniel & Agarwal, Vineet & Poshakwale, Sunil, 2020. "Market in Financial Instruments Directive (MiFID), stock price informativeness and liquidity," Journal of Banking & Finance, Elsevier, vol. 113(C).
    9. Linnenluecke, Martina K. & Chen, Xiaoyan & Ling, Xin & Smith, Tom & Zhu, Yushu, 2017. "Research in finance: A review of influential publications and a research agenda," Pacific-Basin Finance Journal, Elsevier, vol. 43(C), pages 188-199.
    10. Cosemans, Mathijs & Frehen, Rik, 2025. "Strategic insider trading and its consequences for outsiders: Evidence from the eighteenth century," Journal of Financial Economics, Elsevier, vol. 164(C).
    11. Liu, Jun & Wu, Kai & Zhou, Ming, 2023. "News tone, investor sentiment, and liquidity premium," International Review of Economics & Finance, Elsevier, vol. 84(C), pages 167-181.
    12. Libin Yang & William Rea & Alethea Rea, 2017. "Financial Insights from the Last Few Components of a Stock Market PCA," IJFS, MDPI, vol. 5(3), pages 1-12, July.
    13. Mai, Nhat Chi, 2020. "Essays on the Vietnam Stock Market," OSF Preprints 3uaqt, Center for Open Science.
    14. Libin Yang & William Rea & Alethea Rea, 2015. "Stock Selection with Principal Component Analysis," Working Papers in Economics 15/03, University of Canterbury, Department of Economics and Finance.
    15. Siganos, Antonios & Synapis, Angelos & Tsalavoutas, Ioannis, 2024. "Information leakage prior to market switches and the importance of Nominated Advisers," The British Accounting Review, Elsevier, vol. 56(6).
    16. Munk, Claus, 2015. "Financial Asset Pricing Theory," OUP Catalogue, Oxford University Press, number 9780198716457.
    17. Cline, Brandon N. & Posylnaya, Valeriya V., 2019. "Illegal insider trading: Commission and SEC detection," Journal of Corporate Finance, Elsevier, vol. 58(C), pages 247-269.
    18. Bethke, Sebastian & Gehde-Trapp, Monika & Kempf, Alexander, 2015. "Investor sentiment, flight-to-quality, and corporate bond comovement," CFR Working Papers 13-06 [rev.3], University of Cologne, Centre for Financial Research (CFR).
    19. Libin Yang & William Rea & and Alethea Rea, 2015. "Identifying Highly Correlated Stocks Using the Last Few Principal Components," Papers 1512.03537, arXiv.org.
    20. Suchismita Mishra & Le Zhao, 2021. "Order Routing Decisions for a Fragmented Market: A Review," JRFM, MDPI, vol. 14(11), pages 1-32, November.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:67:y:2026:i:5:d:10.1007_s10614-025-10993-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.