IDEAS home Printed from https://ideas.repec.org/p/pie/dsedps/2024-317.html

Natural Language Processing Techniques for Long Financial Document

Author

Listed:
  • Maria Saveria Mavillonio

Abstract

In finance, Natural Language Processing (NLP) has become both a powerful and challenging tool, as extensive unstructured documents—such as business plans, financial reports, and regulatory filings—hold essential insights for strategic decision-making. This paper reviews the progression of NLP text representation methods, from foundational models to advanced Transformer architectures that greatly enhance semantic and contextual analysis. Yet, these models encounter limitations when applied to long financial documents, where computational efficiency and contextual coherence are critical. Recent innovations, including sparse attention mechanisms and domain-specific model adaptations, have improved the processing of lengthy texts, allowing for more accurate analysis of financial documents by capturing field-specific semantics. This paper also highlights the transformative role of NLP in financial analysis, especially where structured data is limited. Selecting the most suitable model for specific tasks is essential for maximizing NLP's impact in finance. Organized to provide a thorough overview, the paper covers text representation techniques, strategies for handling long texts, and applications in finance, establishing a foundation for advancing NLP-driven data analysis in this field.

Suggested Citation

  • Maria Saveria Mavillonio, 2024. "Natural Language Processing Techniques for Long Financial Document," Discussion Papers 2024/317, Dipartimento di Economia e Management (DEM), University of Pisa, Pisa, Italy.
    • Handle: RePEc:pie:dsedps:2024/317
    Note: ISSN 2039-1854
    as

    Download full text from publisher

    File URL: https://www.ec.unipi.it/documents/Ricerca/papers/2024-317.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kai Li & Feng Mai & Rui Shen & Xinyan Yan, 2021. "Measuring Corporate Culture Using Machine Learning [Machine learning methods that economists should know about]," The Review of Financial Studies, Society for Financial Studies, vol. 34(7), pages 3265-3315.
    2. Luca Barbaglia & Sergio Consoli & Sebastiano Manzan, 2023. "Forecasting with Economic News," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(3), pages 708-719, July.
    3. Itay Goldstein & Chester S. Spatt & Mao Ye, 2021. "Big Data in Finance," NBER Working Papers 28615, National Bureau of Economic Research, Inc.
    4. Kathleen Weiss Hanley & Gerard Hoberg, 2019. "Dynamic Interpretation of Emerging Risks in the Financial Sector," The Review of Financial Studies, Society for Financial Studies, vol. 32(12), pages 4543-4603.
    5. Mark A Chen & Qinxi Wu & Baozhong Yang, 2019. "How Valuable Is FinTech Innovation?," The Review of Financial Studies, Society for Financial Studies, vol. 32(5), pages 2062-2106.
    6. Itay Goldstein & Chester S Spatt & Mao Ye, 2021. "Big Data in Finance [Institutional order handling and broker-affiliated trading venues]," The Review of Financial Studies, Society for Financial Studies, vol. 34(7), pages 3213-3225.
    7. Kai Li & Feng Mai & Rui Shen & Xinyan Yan, 2021. "Measuring Corporate Culture Using Machine Learning," NBER Chapters, in: Big Data: Long-Term Implications for Financial Markets and Firms, pages 3265-3315, National Bureau of Economic Research, Inc.
    8. Angelico, Cristina & Marcucci, Juri & Miccoli, Marcello & Quarta, Filippo, 2022. "Can we measure inflation expectations using Twitter?," Journal of Econometrics, Elsevier, vol. 228(2), pages 259-277.
    9. Elliott Ash & Stephen Hansen, 2023. "Text Algorithms in Economics," Annual Review of Economics, Annual Reviews, vol. 15(1), pages 659-688, September.
    10. Itay Goldstein & Chester S Spatt & Mao Ye, 2021. "Big Data in Finance," NBER Chapters, in: Big Data: Long-Term Implications for Financial Markets and Firms, pages 3213-3225, National Bureau of Economic Research, Inc.
    11. Gustaf Bellstam & Sanjai Bhagat & J. Anthony Cookson, 2021. "A Text-Based Analysis of Corporate Innovation," Management Science, INFORMS, vol. 67(7), pages 4004-4031, July.
    12. Brandyn Bok & Daniele Caratelli & Domenico Giannone & Argia M. Sbordone & Andrea Tambalotti, 2018. "Macroeconomic Nowcasting and Forecasting with Big Data," Annual Review of Economics, Annual Reviews, vol. 10(1), pages 615-643, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michalski, Lachlan & Low, Rand Kwong Yew, 2024. "Determinants of corporate credit ratings: Does ESG matter?," International Review of Financial Analysis, Elsevier, vol. 94(C).
    2. Lin William Cong & Tengyuan Liang & Xiao Zhang & Wu Zhu, 2025. "Textual Factors: A Scalable, Interpretable, and Data-Driven Approach to Analyzing Unstructured Information," Management Science, INFORMS, vol. 71(12), pages 10727-10739, December.
    3. Cao, Sean & Jiang, Wei & Wang, Junbo & Yang, Baozhong, 2024. "From Man vs. Machine to Man + Machine: The art and AI of stock analyses," Journal of Financial Economics, Elsevier, vol. 160(C).
    4. Li, Ang & Liu, Mark & Sheather, Simon, 2023. "Predicting stock splits using ensemble machine learning and SMOTE oversampling," Pacific-Basin Finance Journal, Elsevier, vol. 78(C).
    5. Yang, Jinglan & Liu, Jianghuai & Yao, Zheng & Ma, Chaoqun, 2024. "Measuring digitalization capabilities using machine learning," Research in International Business and Finance, Elsevier, vol. 70(PB).
    6. Jin, Zhuo & Zhou, Zhixiang & Wu, Huaqing, 2025. "Enhancing digital manufacturing efficiency and dominance relation driven big Data analytics," International Journal of Production Economics, Elsevier, vol. 289(C).
    7. Rad, Hossein & Low, Rand Kwong Yew & Miffre, Joëlle & Faff, Robert, 2023. "The commodity risk premium and neural networks," Journal of Empirical Finance, Elsevier, vol. 74(C).
    8. Yusuke Matsumoto & Aiko Suge & Hiroshi Takahashi, 2025. "Analysis of the relationship between technological diversification and enterprise value using patent data," Information Technology and Management, Springer, vol. 26(2), pages 247-270, June.
    9. Puri, Indira & Veldkamp, Laura, 2026. "Artificial intelligence and cognitive inequality," Journal of Monetary Economics, Elsevier, vol. 157(C).
    10. Mahsa Samsami & Ralf Wagner, 2021. "Investment Decisions with Endogeneity: A Dirichlet Tree Analysis," JRFM, MDPI, vol. 14(7), pages 1-19, July.
    11. Fengler, Matthias R. & Phan, Tri Minh, 2025. "Unveiling themes in 10-K disclosures: A new topic modeling perspective," International Review of Financial Analysis, Elsevier, vol. 103(C).
    12. Murad, S.M. Woahid & Pathan, Shams & Durand, Robert B. & Zheng, Chen, 2025. "Understanding Bank-Level Uncertainty: New insights into banking activity and its macroeconomic impacts," International Review of Economics & Finance, Elsevier, vol. 102(C).
    13. Alex Kim & Maximilian Muhn & Valeri Nikolaev, 2023. "Bloated Disclosures: Can ChatGPT Help Investors Process Information?," Papers 2306.10224, arXiv.org, revised Oct 2025.
    14. Zijia Du & Alan Guoming Huang & Russ Wermers & Wenfeng Wu, 2022. "Language and Domain Specificity: A Chinese Financial Sentiment Dictionary [The effects of analyst-country institutions on biased research: Evidence from target prices]," Review of Finance, European Finance Association, vol. 26(3), pages 673-719.
    15. Wang, Qin & Wang, Ying, 2025. "What shapes export competitiveness of home country firms? Host country environmental regulations or labor standards," International Review of Financial Analysis, Elsevier, vol. 103(C).
    16. Niu, Yuhao & Wang, Sai & Wen, Wen & Li, Sifei, 2023. "Does digital transformation speed up dynamic capital structure adjustment? Evidence from China," Pacific-Basin Finance Journal, Elsevier, vol. 79(C).
    17. Wei, Lu & Wei, Mingye & Wu, Yifei & Jing, Zhongbo, 2025. "Does party organization construction improve chinese banks' stability? Evidence from a new textual index," China Economic Review, Elsevier, vol. 94(PB).
    18. Li, Huiying & Wang, Xinchun & Chang, Yu & Zhang, Nan & Huang, Wei & Wang, Quanren, 2025. "Central government Ownership, geographic Distance, and firm Innovation: Evidence from Chinese State-owned enterprises," Journal of Business Research, Elsevier, vol. 186(C).
    19. Wei, Mingye & Zhang, Min & Wei, Lu & Chen, Meiqi, 2025. "IPOhelper: Mining features in registration statements for listing prediction of technological innovation companies," Emerging Markets Review, Elsevier, vol. 68(C).
    20. Wang, Sai & Wen, Wen & Niu, Yuhao & Li, Xin, 2024. "Digital transformation and corporate labor investment efficiency," Emerging Markets Review, Elsevier, vol. 59(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • G2 - Financial Economics - - Financial Institutions and Services
    • G23 - Financial Economics - - Financial Institutions and Services - - - Non-bank Financial Institutions; Financial Instruments; Institutional Investors
    • L26 - Industrial Organization - - Firm Objectives, Organization, and Behavior - - - Entrepreneurship

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pie:dsedps:2024/317. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/dspisit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.