IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2608.18099.html

FinSkillBench: Evaluating AI Agents and Domain Skills for Investment Management

Author

Listed:
  • Jermyn Zhen Yong Bek
  • Zhuang Qiang Bok
  • Zhongtian Sun

Abstract

Investment management is a high-stakes domain in which agentic AI systems must do more than generate plausible text. They must retrieve point-in-time data, assemble correct computational inputs, invoke specialized methods, and produce auditable structured outputs. We introduce FinSkillBench, an evaluation suite designed to measure whether language model agents can effectively use financial domain skills to solve investment management tasks. The benchmark spans three domains, portfolio construction, risk management, and fundamental analysis, and includes 12 subtasks with 2,603 task episodes. Each episode provides point-in-time inputs, hidden ground truth, and a task-specific verifier.We compare three conditions: no skill, curated skill packages consisting of procedural documents and executable components, and self-generated skills in which the agent writes and reuses its own procedures within an episode. Across 9 models and a large-scale evaluation, curated skills consistently improve performance, raising mean scores from 0.366 to 0.528, with the largest gains in portfolio construction and risk management. In contrast, self-generated skills provide little benefit despite higher computational cost. An independent evaluation using a separate agent framework (Hermes Agent, 8 models, 5,280 episodes total) reproduces the directional pattern across all three domains, with the magnitude of skill effects varying by subtask and harness. These results showthat in investment management agents, access to reliable procedural skills can be as important as model choice, while naive self-generation of skills is often ineffective. We release the benchmark, evaluation tools, curated skill packages, and full trajectories to support further research.

Suggested Citation

  • Jermyn Zhen Yong Bek & Zhuang Qiang Bok & Zhongtian Sun, 2026. "FinSkillBench: Evaluating AI Agents and Domain Skills for Investment Management," Papers 2608.18099, arXiv.org.
  • Handle: RePEc:arx:papers:2608.18099
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2608.18099
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Piotroski, JD, 2000. "Value investing: The use of historical financial statement information to separate winners from losers," Journal of Accounting Research, John Wiley & Sons, Ltd., vol. 38, pages 1-41.
    2. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    3. Messod D. Beneish, 1999. "The Detection of Earnings Manipulation," Financial Analysts Journal, Taylor & Francis Journals, vol. 55(5), pages 24-36, September.
    4. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Krishna Neupane & Igor Griva & Robert Axtell & William Kennedy & Jason Kinser, 2026. "Detecting and Explaining Unlawful Insider Trading: A Shapley Value and Causal Forest Approach to Identifying Key Drivers and Causal Relationships," Papers 2602.19841, arXiv.org.
    2. Eero Pätäri & Timo Leivo, 2017. "A Closer Look At Value Premium: Literature Review And Synthesis," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 79-168, February.
    3. Andreas G. Koutoupis & Christos G. Kampouris & Athanasia V. Sakellaridou, 2022. "Can Financial Strength Indicators Form A Profitable Investment Strategy? The Case Of F-Score in Europe," Accounting and Management Information Systems, Faculty of Accounting and Management Information Systems, The Bucharest University of Economic Studies, vol. 21(3), pages 355-372, September.
    4. Cederburg, Scott & O’Doherty, Michael S. & Wang, Feifei & Yan, Xuemin (Sterling), 2020. "On the performance of volatility-managed portfolios," Journal of Financial Economics, Elsevier, vol. 138(1), pages 95-117.
    5. Gikas Hardouvelis & George Papanastasopoulos & Dimitrios D. Thomakos & Tao Wang, 2007. "Accruals, Net Stock Issues and Value-Glamour Anomalies: New Evidence on their Relation," Working Paper series 47_07, Rimini Centre for Economic Analysis.
    6. Adam Zaremba & Jacob Koby Shemer, 2018. "Price-Based Investment Strategies," Springer Books, Springer, number 978-3-319-91530-2, December.
    7. Vincent, Kendro & Lin, Ching-Ting & Tsai, Kuei-Feng & Wu, Shun-Fa, 2026. "Capturing risk Premia in the Taiwanese market: A characteristic-free approach," Pacific-Basin Finance Journal, Elsevier, vol. 99(C).
    8. Pesaran, M. Hashem & Yamagata, Takashi, 2012. "Testing CAPM with a Large Number of Assets," IZA Discussion Papers 6469, IZA Network @ LISER.
    9. Davit Gondauri, 2026. "P vs NP Problem in Portfolio Optimization: Integrating the Markowitz-CAPM Framework with Cardinality Constraints and Black-Scholes Derivative Pricing," Papers 2603.15652, arXiv.org.
    10. Irene Aldridge, 2026. "Evaluating AI Investment Strategies," Papers 2606.08791, arXiv.org.
    11. Geertsema, Paul & Lu, Helen, 2020. "The correlation structure of anomaly strategies," Journal of Banking & Finance, Elsevier, vol. 119(C).
    12. Tae-Hwy Lee & Ekaterina Seregina, 2024. "Optimal Portfolio Using Factor Graphical Lasso," Journal of Financial Econometrics, Oxford University Press, vol. 22(3), pages 670-695.
    13. Bartram, Söhnke M. & Grinblatt, Mark, 2018. "Agnostic fundamental analysis works," Journal of Financial Economics, Elsevier, vol. 128(1), pages 125-147.
    14. David R Gallagher & Peter A Gardner & Camille H Schmidt, 2015. "Style factor timing: An application to the portfolio holdings of US fund managers," Australian Journal of Management, Australian School of Business, vol. 40(2), pages 318-350, May.
    15. Mary E. Barth & Jonathan Berkovitch & Doron Israeli, 2026. "The Information Content of Operational Effectiveness," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 53(2), pages 708-732, April.
    16. Zhu, Zhaobo & Ding, Wenjie & Jin, Yi & Shen, Dehua, 2023. "Dissecting the idiosyncratic volatility puzzle: A fundamental analysis approach," Research in International Business and Finance, Elsevier, vol. 66(C).
    17. Lu Zhang, 2019. "Q-factors and Investment CAPM," NBER Working Papers 26538, National Bureau of Economic Research, Inc.
    18. Kewei Hou & Haitao Mo & Chen Xue & Lu Zhang, 2019. "Security Analysis: An Investment Perspective," NBER Working Papers 26060, National Bureau of Economic Research, Inc.
    19. Walkshäusl, Christian, 2015. "Equity financing activities and European value-growth returns," Journal of Banking & Finance, Elsevier, vol. 57(C), pages 27-40.
    20. Firoozye, Nikan & Tan, Vincent & Zohren, Stefan, 2023. "Canonical portfolios: Optimal asset and signal combination," Journal of Banking & Finance, Elsevier, vol. 154(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2608.18099. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.