IDEAS home Printed from https://ideas.repec.org/a/eee/ijoais/v14y2013i2p138-163.html
   My bibliography  Save this article

A content analysis of auditors' reports on IT internal control weaknesses: The comparative advantages of an automated approach to control weakness identification

Author

Listed:
  • Boritz, J. Efrim
  • Hayes, Louise
  • Lim, Jee-Hae

Abstract

We employ an automated content analysis approach to provide a snapshot of the terminology auditors actually use to describe information technology weaknesses (ITWs). We develop and use a dictionary based on textual analysis of auditors' reports on internal control filed under Section 404 of the Sarbanes–Oxley Act from 2004 to 2009. Using the dictionary with content analysis software led to the identification of 14 categories of ITWs in order of decreasing frequency of occurrence: (1) access, (2) monitoring, (3) design issues, (4) change and development, (5) end-user computing, (6) segregation of incompatible functions, (7) policies, (8) documentation, (9) masterfiles, (10) backup, (11) staffing sufficiency and competency, (12) security (other than over access), (13) outsourcing and (14) operations. The use of automated content analysis methodology also helped us identify potential disconnects between terminology used in auditors' reports and that used in published frameworks and guidelines. We provide the dictionary and discuss the methodology used in creating and applying the dictionary to the analysis of the textual content of auditors' reports on internal control, including the advantages and limitations of automated ITW identification.

Suggested Citation

  • Boritz, J. Efrim & Hayes, Louise & Lim, Jee-Hae, 2013. "A content analysis of auditors' reports on IT internal control weaknesses: The comparative advantages of an automated approach to control weakness identification," International Journal of Accounting Information Systems, Elsevier, vol. 14(2), pages 138-163.
    • Handle: RePEc:eee:ijoais:v:14:y:2013:i:2:p:138-163
    DOI: 10.1016/j.accinf.2011.11.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1467089511000674
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.accinf.2011.11.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hollis Ashbaugh‐Skaife & Daniel W. Collins & William R. Kinney Jr & Ryan Lafond, 2009. "The Effect of SOX Internal Control Deficiencies on Firm Risk and Cost of Equity," Journal of Accounting Research, Wiley Blackwell, vol. 47(1), pages 1-43, March.
    2. Austen, Lizabeth A. & Eilifsen, Aasmund & Messier Jr., William F., 2004. "Auditor Detected Misstatements and the Effect of Information Technology," Discussion Papers 2004/1, Norwegian School of Economics, Department of Business and Management Science.
    3. Doyle, Jeffrey & Ge, Weili & McVay, Sarah, 2007. "Determinants of weaknesses in internal control over financial reporting," Journal of Accounting and Economics, Elsevier, vol. 44(1-2), pages 193-223, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Salman Yousaf, 2017. "Quantification of country images as stereotypes and their role in developing a nation brand: The case of Pakistan," Place Branding and Public Diplomacy, Palgrave Macmillan, vol. 13(1), pages 81-95, February.
    2. Chou, Chi-Chun & Chang, C. Janie & Peng, Jacob, 2016. "Integrating XBRL data with textual information in Chinese: A semantic web approach," International Journal of Accounting Information Systems, Elsevier, vol. 21(C), pages 32-46.
    3. Holder, Anthony & Karim, Khondkar & Lin, Karen (Jingrong) & Pinsker, Robert, 2016. "Do material weaknesses in information technology-related internal controls affect firms' 8-K filing timeliness and compliance?," International Journal of Accounting Information Systems, Elsevier, vol. 22(C), pages 26-43.
    4. Efrim Boritz, J. & Hayes, Louise & Timoshenko, Lev M., 2020. "How understandable are SOX 404 auditors reports?," International Journal of Accounting Information Systems, Elsevier, vol. 39(C).
    5. Navarro, Patricia & Robb, Sean W.G. & Sutton, Steve G. & Weisner, Martin M., 2020. "The cost stickiness of information technology material weaknesses: An intertemporal comparison between it-related and other material weaknesses," International Journal of Accounting Information Systems, Elsevier, vol. 37(C).
    6. Choi, Dongjoon & Lee, Hansol & Lee, Ho-Young & Park, Hyun-Young, 2021. "The association between human resource investment in IT controls over financial reporting and investment efficiency," International Journal of Accounting Information Systems, Elsevier, vol. 43(C).
    7. Nora Nahr & Marikka Heikkilä, 2022. "Uncovering the identity of Electronic Markets research through text mining techniques," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1257-1277, September.
    8. Ingrid E. Fisher & Margaret R. Garnsey & Mark E. Hughes, 2016. "Natural Language Processing in Accounting, Auditing and Finance: A Synthesis of the Literature with a Roadmap for Future Research," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 23(3), pages 157-214, July.
    9. Haislip, Jacob Z. & Masli, Adi & Richardson, Vernon J. & Watson, Marcia Weidenmier, 2015. "External reputational penalties for CEOs and CFOs following information technology material weaknesses," International Journal of Accounting Information Systems, Elsevier, vol. 17(C), pages 1-15.
    10. Oliver Henk, 2020. "Internal control through the lens of institutional work: a systematic literature review," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 31(3), pages 239-273, September.
    11. Berkin, Anil & Aerts, Walter & Van Caneghem, Tom, 2023. "Feasibility analysis of machine learning for performance-related attributional statements," International Journal of Accounting Information Systems, Elsevier, vol. 48(C).
    12. Senave, Elseline & Jans, Mieke J. & Srivastava, Rajendra P., 2023. "The application of text mining in accounting," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Baolei Qi & Liuchuang Li & Qing Zhou & Jinghui Sun, 2017. "Does internal control over financial reporting really alleviate agency conflicts?," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 57(4), pages 1101-1125, December.
    2. Samir El-Gazzar & Kwang-Hyun Chung & Rudolph Jacob, 2011. "Reporting of Internal Control Weaknesses and Debt Rating Changes," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 17(4), pages 421-435, November.
    3. Elsayed, Mohamed & Elshandidy, Tamer, 2021. "Internal control effectiveness, textual risk disclosure, and their usefulness: U.S. evidence," Advances in accounting, Elsevier, vol. 53(C).
    4. Haislip, Jacob Z. & Peters, Gary F. & Richardson, Vernon J., 2016. "The effect of auditor IT expertise on internal controls," International Journal of Accounting Information Systems, Elsevier, vol. 20(C), pages 1-15.
    5. Fang-Nan Liao & Xiao-Li Ji & Zhi-Ping Wang, 2019. "Firms’ Sustainability: Does Economic Policy Uncertainty Affect Internal Control?," Sustainability, MDPI, vol. 11(3), pages 1-26, February.
    6. Murad Harasheh & Roberta Provasi, 2023. "A need for assurance: Do internal control systems integrate environmental, social, and governance factors?," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(1), pages 384-401, January.
    7. Ranjan D’Mello & Xinghua Gao & Yonghong Jia, 2017. "Internal control and internal capital allocation: evidence from internal capital markets of multi-segment firms," Review of Accounting Studies, Springer, vol. 22(1), pages 251-287, March.
    8. Gerrit Sarens & Giuseppe D’Onza, 2017. "The perception of financial analysts on risk, risk management, and internal control disclosure: Evidence from Belgium and Italy," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 14(2), pages 118-138, May.
    9. Dunli Zhang & Ting Zhang & Guanghua Ma, 2020. "Can non‐executive equity incentives reduce internal control ineffectiveness? Evidence from China," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 60(5), pages 4467-4496, December.
    10. Cheng, Mei & Dhaliwal, Dan & Zhang, Yuan, 2013. "Does investment efficiency improve after the disclosure of material weaknesses in internal control over financial reporting?," Journal of Accounting and Economics, Elsevier, vol. 56(1), pages 1-18.
    11. Nishizaki, Riku & Takano, Yudai & Takeda, Fumiko, 2014. "Information Content of Internal Control Weaknesses: The Evidence from Japan," The International Journal of Accounting, Elsevier, vol. 49(1), pages 1-26.
    12. Masoud, Najeb & Al-Utaibi, Ghassan, 2022. "The determinants of cybersecurity risk disclosure in firms’ financial reporting: Empirical evidence," Research in Economics, Elsevier, vol. 76(2), pages 131-140.
    13. Ge, Weili & Koester, Allison & McVay, Sarah, 2017. "Benefits and costs of Sarbanes-Oxley Section 404(b) exemption: Evidence from small firms’ internal control disclosures," Journal of Accounting and Economics, Elsevier, vol. 63(2), pages 358-384.
    14. Stoel, M. Dale & Muhanna, Waleed A., 2011. "IT internal control weaknesses and firm performance: An organizational liability lens," International Journal of Accounting Information Systems, Elsevier, vol. 12(4), pages 280-304.
    15. Carolyn M. Callahan & Angela Wheeler Spencer, 2012. "Risk Implications of Increased Off-Balance Sheet Disclosure: The Case of FIN 46 and SOX," Accounting and Finance Research, Sciedu Press, vol. 1(2), pages 126-126, November.
    16. Ji, Xu-dong & Lu, Wei & Qu, Wen, 2015. "Determinants and economic consequences of voluntary disclosure of internal control weaknesses in China," Journal of Contemporary Accounting and Economics, Elsevier, vol. 11(1), pages 1-17.
    17. Ahsan Habib & Mostafa Monzur Hasan & Haiyan Jiang, 2018. "Stock price crash risk: review of the empirical literature," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 58(S1), pages 211-251, November.
    18. repec:kap:iaecre:v:17:y:2011:i:4:p:421-435 is not listed on IDEAS
    19. Sean T. McGuire & Stevanie S. Neuman & Sarah C. Rice, 2020. "Interim Effective Tax Rate Estimates and Internal Control Quality," Contemporary Accounting Research, John Wiley & Sons, vol. 37(1), pages 603-633, March.
    20. Suhee Kim & William Rees & Vathunyoo Sila, 2020. "Do anti‐bribery laws reduce the cost of equity? Evidence from the UK Bribery Act 2010," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 47(3-4), pages 438-455, March.
    21. Yu-En Lin & Hsiang-Hsuan Chih & Chia-Hsien Tang & Tai-Hsun Huang, 2015. "The Impact Of Internal Control On Firm’S Risk And Performance," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 10(02), pages 1-18, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijoais:v:14:y:2013:i:2:p:138-163. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-accounting-information-systems/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.