IDEAS home Printed from https://ideas.repec.org/a/eee/ijoais/v14y2013i2p138-163.html
   My bibliography  Save this article

A content analysis of auditors' reports on IT internal control weaknesses: The comparative advantages of an automated approach to control weakness identification

Author

Listed:
  • Boritz, J. Efrim
  • Hayes, Louise
  • Lim, Jee-Hae

Abstract

We employ an automated content analysis approach to provide a snapshot of the terminology auditors actually use to describe information technology weaknesses (ITWs). We develop and use a dictionary based on textual analysis of auditors' reports on internal control filed under Section 404 of the Sarbanes–Oxley Act from 2004 to 2009. Using the dictionary with content analysis software led to the identification of 14 categories of ITWs in order of decreasing frequency of occurrence: (1) access, (2) monitoring, (3) design issues, (4) change and development, (5) end-user computing, (6) segregation of incompatible functions, (7) policies, (8) documentation, (9) masterfiles, (10) backup, (11) staffing sufficiency and competency, (12) security (other than over access), (13) outsourcing and (14) operations. The use of automated content analysis methodology also helped us identify potential disconnects between terminology used in auditors' reports and that used in published frameworks and guidelines. We provide the dictionary and discuss the methodology used in creating and applying the dictionary to the analysis of the textual content of auditors' reports on internal control, including the advantages and limitations of automated ITW identification.

Suggested Citation

  • Boritz, J. Efrim & Hayes, Louise & Lim, Jee-Hae, 2013. "A content analysis of auditors' reports on IT internal control weaknesses: The comparative advantages of an automated approach to control weakness identification," International Journal of Accounting Information Systems, Elsevier, vol. 14(2), pages 138-163.
    • Handle: RePEc:eee:ijoais:v:14:y:2013:i:2:p:138-163
    DOI: 10.1016/j.accinf.2011.11.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1467089511000674
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.accinf.2011.11.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hollis Ashbaugh‐Skaife & Daniel W. Collins & William R. Kinney Jr & Ryan Lafond, 2009. "The Effect of SOX Internal Control Deficiencies on Firm Risk and Cost of Equity," Journal of Accounting Research, Wiley Blackwell, vol. 47(1), pages 1-43, March.
    2. Austen, Lizabeth A. & Eilifsen, Aasmund & Messier Jr., William F., 2004. "Auditor Detected Misstatements and the Effect of Information Technology," Discussion Papers 2004/1, Norwegian School of Economics, Department of Business and Management Science.
    3. Doyle, Jeffrey & Ge, Weili & McVay, Sarah, 2007. "Determinants of weaknesses in internal control over financial reporting," Journal of Accounting and Economics, Elsevier, vol. 44(1-2), pages 193-223, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Salman Yousaf, 2017. "Quantification of country images as stereotypes and their role in developing a nation brand: The case of Pakistan," Place Branding and Public Diplomacy, Palgrave Macmillan, vol. 13(1), pages 81-95, February.
    2. Chou, Chi-Chun & Chang, C. Janie & Peng, Jacob, 2016. "Integrating XBRL data with textual information in Chinese: A semantic web approach," International Journal of Accounting Information Systems, Elsevier, vol. 21(C), pages 32-46.
    3. Holder, Anthony & Karim, Khondkar & Lin, Karen (Jingrong) & Pinsker, Robert, 2016. "Do material weaknesses in information technology-related internal controls affect firms' 8-K filing timeliness and compliance?," International Journal of Accounting Information Systems, Elsevier, vol. 22(C), pages 26-43.
    4. Efrim Boritz, J. & Hayes, Louise & Timoshenko, Lev M., 2020. "How understandable are SOX 404 auditors reports?," International Journal of Accounting Information Systems, Elsevier, vol. 39(C).
    5. Navarro, Patricia & Robb, Sean W.G. & Sutton, Steve G. & Weisner, Martin M., 2020. "The cost stickiness of information technology material weaknesses: An intertemporal comparison between it-related and other material weaknesses," International Journal of Accounting Information Systems, Elsevier, vol. 37(C).
    6. Choi, Dongjoon & Lee, Hansol & Lee, Ho-Young & Park, Hyun-Young, 2021. "The association between human resource investment in IT controls over financial reporting and investment efficiency," International Journal of Accounting Information Systems, Elsevier, vol. 43(C).
    7. Nora Nahr & Marikka Heikkilä, 2022. "Uncovering the identity of Electronic Markets research through text mining techniques," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1257-1277, September.
    8. Ingrid E. Fisher & Margaret R. Garnsey & Mark E. Hughes, 2016. "Natural Language Processing in Accounting, Auditing and Finance: A Synthesis of the Literature with a Roadmap for Future Research," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 23(3), pages 157-214, July.
    9. Haislip, Jacob Z. & Masli, Adi & Richardson, Vernon J. & Watson, Marcia Weidenmier, 2015. "External reputational penalties for CEOs and CFOs following information technology material weaknesses," International Journal of Accounting Information Systems, Elsevier, vol. 17(C), pages 1-15.
    10. Oliver Henk, 2020. "Internal control through the lens of institutional work: a systematic literature review," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 31(3), pages 239-273, September.
    11. Berkin, Anil & Aerts, Walter & Van Caneghem, Tom, 2023. "Feasibility analysis of machine learning for performance-related attributional statements," International Journal of Accounting Information Systems, Elsevier, vol. 48(C).
    12. Senave, Elseline & Jans, Mieke J. & Srivastava, Rajendra P., 2023. "The application of text mining in accounting," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Baolei Qi & Liuchuang Li & Qing Zhou & Jinghui Sun, 2017. "Does internal control over financial reporting really alleviate agency conflicts?," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 57(4), pages 1101-1125, December.
    2. Samir El-Gazzar & Kwang-Hyun Chung & Rudolph Jacob, 2011. "Reporting of Internal Control Weaknesses and Debt Rating Changes," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 17(4), pages 421-435, November.
    3. Yu-En Lin & Hsiang-Hsuan Chih & Chia-Hsien Tang & Tai-Hsun Huang, 2015. "The Impact Of Internal Control On Firm’S Risk And Performance," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 10(02), pages 1-18, December.
    4. Elsayed, Mohamed & Elshandidy, Tamer, 2021. "Internal control effectiveness, textual risk disclosure, and their usefulness: U.S. evidence," Advances in accounting, Elsevier, vol. 53(C).
    5. Skaife, Hollis A. & Veenman, David & Wangerin, Daniel, 2013. "Internal control over financial reporting and managerial rent extraction: Evidence from the profitability of insider trading," Journal of Accounting and Economics, Elsevier, vol. 55(1), pages 91-110.
    6. Inder K. Khurana & Hoyoun Kyung, 2021. "Internal control material weakness and CEO recruitment," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 48(9-10), pages 1940-1987, October.
    7. Lenard, Mary Jane & Petruska, Karin A. & Alam, Pervaiz & Yu, Bing, 2016. "Internal control weaknesses and evidence of real activities manipulation," Advances in accounting, Elsevier, vol. 33(C), pages 47-58.
    8. Shi, Wei & Wang, Rencheng, 2012. "Dynamic internal control performance over financial reporting and external financing," Journal of Contemporary Accounting and Economics, Elsevier, vol. 8(2), pages 92-109.
    9. Haislip, Jacob Z. & Peters, Gary F. & Richardson, Vernon J., 2016. "The effect of auditor IT expertise on internal controls," International Journal of Accounting Information Systems, Elsevier, vol. 20(C), pages 1-15.
    10. Li, Yingqi & Yu, Junli & Zhang, Zhou & Zheng, Steven Xiaofan, 2016. "The effect of internal control weakness on firm valuation: Evidence from SOX Section 404 disclosures," Finance Research Letters, Elsevier, vol. 17(C), pages 17-24.
    11. Fang-Nan Liao & Xiao-Li Ji & Zhi-Ping Wang, 2019. "Firms’ Sustainability: Does Economic Policy Uncertainty Affect Internal Control?," Sustainability, MDPI, vol. 11(3), pages 1-26, February.
    12. Murad Harasheh & Roberta Provasi, 2023. "A need for assurance: Do internal control systems integrate environmental, social, and governance factors?," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(1), pages 384-401, January.
    13. Matthew J. Bloomfield, 2021. "The Asymmetric Effect of Reporting Flexibility on Priced Risk," Journal of Accounting Research, Wiley Blackwell, vol. 59(3), pages 867-910, June.
    14. Oliver Henk, 2020. "Internal control through the lens of institutional work: a systematic literature review," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 31(3), pages 239-273, September.
    15. Beng Wee Goh & Jayanthi Krishnan & Dan Li, 2013. "Auditor Reporting under Section 404: The Association between the Internal Control and Going Concern Audit Opinions," Contemporary Accounting Research, John Wiley & Sons, vol. 30(3), pages 970-995, September.
    16. Ranjan D’Mello & Xinghua Gao & Yonghong Jia, 2017. "Internal control and internal capital allocation: evidence from internal capital markets of multi-segment firms," Review of Accounting Studies, Springer, vol. 22(1), pages 251-287, March.
    17. Gerrit Sarens & Giuseppe D’Onza, 2017. "The perception of financial analysts on risk, risk management, and internal control disclosure: Evidence from Belgium and Italy," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 14(2), pages 118-138, May.
    18. Chang, Yu-Tzu & Chen, Hanchung & Cheng, Rainbow K. & Chi, Wuchun, 2019. "The impact of internal audit attributes on the effectiveness of internal control over operations and compliance," Journal of Contemporary Accounting and Economics, Elsevier, vol. 15(1), pages 1-19.
    19. Navarro, Patricia & Robb, Sean W.G. & Sutton, Steve G. & Weisner, Martin M., 2020. "The cost stickiness of information technology material weaknesses: An intertemporal comparison between it-related and other material weaknesses," International Journal of Accounting Information Systems, Elsevier, vol. 37(C).
    20. Cho, Myojung & Chung, Kwang-Hyun, 2016. "The effect of commercial banks' internal control weaknesses on loan loss reserves and provisions," Journal of Contemporary Accounting and Economics, Elsevier, vol. 12(1), pages 61-72.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijoais:v:14:y:2013:i:2:p:138-163. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-accounting-information-systems/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.