IDEAS home Printed from https://ideas.repec.org/a/spr/jbecon/v93y2023i9d10.1007_s11573-022-01119-3.html
   My bibliography  Save this article

Policy making in the financial industry: A framework for regulatory impact analysis using textual analysis

Author

Listed:
  • Benjamin Clapham

    (Goethe University Frankfurt)

  • Micha Bender

    (Goethe University Frankfurt)

  • Jens Lausen

    (Goethe University Frankfurt)

  • Peter Gomber

    (Goethe University Frankfurt)

Abstract

Regulators conduct regulatory impact analyses (RIA) to evaluate whether regulatory actions fulfill the desired goals. Although there are different frameworks for conducting RIA, they are only applicable to regulations whose impact can be measured with structured data. Yet, a significant and increasing number of regulations require firms to comply by specifying and communicating textual data to consumers and supervisors. Therefore, we develop a methodological framework for RIA in case of unstructured data following the design science research paradigm. The framework enables the application of textual analysis and natural language processing to assess the impact of regulatory actions that result in unstructured data and offers guidance on how to map suitable methods to the dimensions impacted by the regulation. We evaluate the framework by applying it to the European financial market regulation MiFID II, specifically the recent regulatory changes regarding best execution. Thereby, we show that MiFID II failed to improve informativeness and comprehensibility of best execution policies.

Suggested Citation

  • Benjamin Clapham & Micha Bender & Jens Lausen & Peter Gomber, 2023. "Policy making in the financial industry: A framework for regulatory impact analysis using textual analysis," Journal of Business Economics, Springer, vol. 93(9), pages 1463-1514, November.
    • Handle: RePEc:spr:jbecon:v:93:y:2023:i:9:d:10.1007_s11573-022-01119-3
    DOI: 10.1007/s11573-022-01119-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11573-022-01119-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11573-022-01119-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gozman, Daniel & Liebenau, Jonathan & Aste, Tomaso, 2020. "A case study of using blockchain technology in regulatory technology," LSE Research Online Documents on Economics 105057, London School of Economics and Political Science, LSE Library.
    2. Omar Al‐Ubaydli & Patrick A. McLaughlin, 2017. "RegData: A numerical database on industry‐specific regulations for all United States industries and federal regulations, 1997–2012," Regulation & Governance, John Wiley & Sons, vol. 11(1), pages 109-123, March.
    3. Bonsall, Samuel B. & Leone, Andrew J. & Miller, Brian P. & Rennekamp, Kristina, 2017. "A plain English measure of financial reporting readability," Journal of Accounting and Economics, Elsevier, vol. 63(2), pages 329-357.
    4. Arner, Douglas W & Barberis, Janos & Buckley, Ross P, 2016. "The Emergence of RegTech 2.0: From Know Your Customer to Know Your Data," Journal of Financial Transformation, Capco Institute, vol. 44, pages 79-86.
    5. Bryan Kelly & Dimitris Papanikolaou & Amit Seru & Matt Taddy, 2021. "Measuring Technological Innovation over the Long Run," American Economic Review: Insights, American Economic Association, vol. 3(3), pages 303-320, September.
    6. Bommarito, Michael J. & Katz, Daniel M., 2010. "A mathematical approach to the study of the United States Code," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(19), pages 4195-4200.
    7. Tim Loughran & Bill Mcdonald, 2014. "Measuring Readability in Financial Disclosures," Journal of Finance, American Finance Association, vol. 69(4), pages 1643-1671, August.
    8. Robert Tibshirani & Guenther Walther & Trevor Hastie, 2001. "Estimating the number of clusters in a data set via the gap statistic," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 411-423.
    9. Kathleen Weiss Hanley, 2010. "The Information Content of IPO Prospectuses," The Review of Financial Studies, Society for Financial Studies, vol. 23(7), pages 2821-2864, July.
    10. Chansog (Francis) Kim & Ke Wang & Liandong Zhang, 2019. "Readability of 10‐K Reports and Stock Price Crash Risk," Contemporary Accounting Research, John Wiley & Sons, vol. 36(2), pages 1184-1216, June.
    11. Burke, Matt & Fry, John, 2019. "How easy is it to understand consumer finance?," Economics Letters, Elsevier, vol. 177(C), pages 1-4.
    12. Dyer, Travis & Lang, Mark & Stice-Lawrence, Lorien, 2017. "The evolution of 10-K textual disclosure: Evidence from Latent Dirichlet Allocation," Journal of Accounting and Economics, Elsevier, vol. 64(2), pages 221-245.
    13. Gerard Hoberg & Gordon Phillips, 2016. "Text-Based Network Industries and Endogenous Product Differentiation," Journal of Political Economy, University of Chicago Press, vol. 124(5), pages 1423-1465.
    14. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    15. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    16. Doron Reichmann & Rouven Möller & Tobias Hertel, 2022. "Nothing but good intentions: the search for equity and stock price crash risk," Journal of Business Economics, Springer, vol. 92(9), pages 1455-1489, November.
    17. repec:bla:pmomgt:v:24:y:2004:i:5:p:267-270 is not listed on IDEAS
    18. Yue Kang & Zhao Cai & Chee-Wee Tan & Qian Huang & Hefu Liu, 2020. "Natural language processing (NLP) in management research: A literature review," Journal of Management Analytics, Taylor & Francis Journals, vol. 7(2), pages 139-172, April.
    19. Ole-Kristian Hope & Danqi Hu & Hai Lu, 2016. "The benefits of specific risk-factor disclosures," Review of Accounting Studies, Springer, vol. 21(4), pages 1005-1045, December.
    20. Geerts, Guido L., 2011. "A design science research methodology and its application to accounting information systems research," International Journal of Accounting Information Systems, Elsevier, vol. 12(2), pages 142-151.
    21. José Parra Moyano & Omri Ross, 2017. "KYC Optimization Using Distributed Ledger Technology," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 59(6), pages 411-423, December.
    22. Colin Kirkpatrick & David Parker, 2004. "Editorial: Regulatory Impact Assessment—An Overview," Public Money & Management, Taylor & Francis Journals, vol. 24(5), pages 267-270, October.
    23. Lang, Mark & Stice-Lawrence, Lorien, 2015. "Textual analysis and international financial reporting: Large sample evidence," Journal of Accounting and Economics, Elsevier, vol. 60(2), pages 110-135.
    24. Allen H. Huang & Reuven Lehavy & Amy Y. Zang & Rong Zheng, 2018. "Analyst Information Discovery and Interpretation Roles: A Topic Modeling Approach," Management Science, INFORMS, vol. 64(6), pages 2833-2855, June.
    25. Claudio M. Radaelli, 2018. "Halfway Through the Better Regulation Strategy of the Juncker Commission: What Does the Evidence Say?," Journal of Common Market Studies, Wiley Blackwell, vol. 56(S1), pages 85-95, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Blankespoor, Elizabeth & deHaan, Ed & Marinovic, Iván, 2020. "Disclosure processing costs, investors’ information choice, and equity market outcomes: A review," Journal of Accounting and Economics, Elsevier, vol. 70(2).
    2. Richard Frankel & Jared Jennings & Joshua Lee, 2022. "Disclosure Sentiment: Machine Learning vs. Dictionary Methods," Management Science, INFORMS, vol. 68(7), pages 5514-5532, July.
    3. Jia, Jing & Li, Zhongtian, 2022. "Risk management committees and readability of risk management disclosure," Journal of Contemporary Accounting and Economics, Elsevier, vol. 18(3).
    4. Senave, Elseline & Jans, Mieke J. & Srivastava, Rajendra P., 2023. "The application of text mining in accounting," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).
    5. Pinto, Inês & Morais, Ana Isabel & Quick, Reiner, 2020. "The impact of the precision of accounting standards on the expanded auditor’s report in the European Union," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 40(C).
    6. Wang, Sumingyue & Wang, Xinlu & Xu, Liang, 2023. "Debt maturity structure and the quality of risk disclosures," Journal of Corporate Finance, Elsevier, vol. 83(C).
    7. Alex Kim & Maximilian Muhn & Valeri Nikolaev, 2023. "Bloated Disclosures: Can ChatGPT Help Investors Process Information?," Papers 2306.10224, arXiv.org, revised Mar 2025.
    8. Rjiba, Hatem & Saadi, Samir & Boubaker, Sabri & Ding, Xiaoya (Sara), 2021. "Annual report readability and the cost of equity capital," Journal of Corporate Finance, Elsevier, vol. 67(C).
    9. Allee, Kristian D. & Do, Chuong & Sterin, Mikhail, 2021. "Product market competition, disclosure framing, and casting in earnings conference calls," Journal of Accounting and Economics, Elsevier, vol. 72(1).
    10. Soliman, Marwa & Ben-Amar, Walid, 2022. "Corporate social responsibility orientation and textual features of financial disclosures," International Review of Financial Analysis, Elsevier, vol. 84(C).
    11. Xiaoqian Zhu & Jianping Li & Yinghui Wang, 2024. "Are risk disclosures in financial reports informative? A text mining-based perspective," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-18, December.
    12. Abukari, Kobana & Dutta, Shantanu & Li, Chen & Tang, Songlian & Zhu, Pengcheng, 2024. "Corporate communication and likelihood of data breaches," International Review of Economics & Finance, Elsevier, vol. 94(C).
    13. Steven F. Cahan & Seokjoo Chang & Wei Z. Siqueira & Kinsun Tam, 2022. "The roles of XBRL and processed XBRL in 10‐K readability," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 49(1-2), pages 33-68, January.
    14. Nguyen, Phuong Thi Thuy & Kimura, Akihisa, 2023. "Disclosure characteristics of annual reports and information asymmetry: Evidence from foreign firms listed on the US stock exchange," Finance Research Letters, Elsevier, vol. 54(C).
    15. Ahsan Habib & Mostafa Monzur Hasan, 2020. "Business strategies and annual report readability," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 60(3), pages 2513-2547, September.
    16. Kalelkar, Rachana & Xu, Hongkang & Nguyen, Duong & Chen, Zheng, 2024. "Generalist CEOs and the readability of the 10-K report," Advances in accounting, Elsevier, vol. 65(C).
    17. Muhammad Nadeem, 2022. "Board Gender Diversity and Managerial Obfuscation: Evidence from the Readability of Narrative Disclosure in 10-K Reports," Journal of Business Ethics, Springer, vol. 179(1), pages 153-177, August.
    18. John Donovan & Jared Jennings & Kevin Koharki & Joshua Lee, 2021. "Measuring credit risk using qualitative disclosure," Review of Accounting Studies, Springer, vol. 26(2), pages 815-863, June.
    19. deHaan, Ed & Song, Yang & Xie, Chloe & Zhu, Christina, 2021. "Obfuscation in mutual funds," Journal of Accounting and Economics, Elsevier, vol. 72(2).
    20. Umar, Tarik, 2022. "Complexity aversion when SeekingAlpha," Journal of Accounting and Economics, Elsevier, vol. 73(2).

    More about this item

    Keywords

    RegTech; Regulatory impact analysis; Unstructured data; Textual analysis; Natural language processing; Design science;
    All these keywords.

    JEL classification:

    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation
    • K20 - Law and Economics - - Regulation and Business Law - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jbecon:v:93:y:2023:i:9:d:10.1007_s11573-022-01119-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.