IDEAS home Printed from https://ideas.repec.org/a/eee/ijoais/v50y2023ics1467089523000301.html
   My bibliography  Save this article

Can knowledge based systems be designed to counteract deskilling effects?

Author

Listed:
  • Arnold, Vicky
  • Collier, Philip A.
  • Leech, Stewart A.
  • Rose, Jacob M.
  • Sutton, Steve G.

Abstract

Recent calls in the information systems research community argue that we know intelligent systems deskill users, and future research should focus on how to design systems that do not deskill, rather than continue to examine whether the phenomenon occurs. This should be a wakeup call for public accounting firms focused on implementing restrictive audit support systems, which leads to de-skilling of novice accounting professionals. Our research focuses on redesigning knowledge-based systems to facilitate expertise development and counteract the de-skilling effects that result from use of such systems. Specifically, we manipulate the design of the system interface by providing information cues in a screen format consistent with expert knowledge representations and manipulate automatic provision versus voluntary use of explanations for users during task completion. Results show that after using the knowledge-based system to complete a series of reenacted client engagements over a three-day period, both the interface design manipulation and automatic provision of explanations had a positive effect on novice accounting professionals’ development of expert-like knowledge structures. The results of the study have important implications for the development of knowledge-based systems intended to support accounting professionals’ (and other knowledge workers’) expertise development processes.

Suggested Citation

  • Arnold, Vicky & Collier, Philip A. & Leech, Stewart A. & Rose, Jacob M. & Sutton, Steve G., 2023. "Can knowledge based systems be designed to counteract deskilling effects?," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).
    • Handle: RePEc:eee:ijoais:v:50:y:2023:i:c:s1467089523000301
    DOI: 10.1016/j.accinf.2023.100638
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1467089523000301
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.accinf.2023.100638?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kopp, Lori S. & O'Donnell, Ed, 2005. "The influence of a business-process focus on category knowledge and internal control evaluation," Accounting, Organizations and Society, Elsevier, vol. 30(5), pages 423-434, July.
    2. Vicky Arnold & Philip A. Collier & Stewart A. Leech & Steve G. Sutton, 2004. "Impact of intelligent decision aids on expert and novice decision‐makers’ judgments," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 44(1), pages 1-26, March.
    3. Bonner, S. E. & Libby, R. & Nelson, M. W., 1997. "Audit category knowledge as a precondition to learning from experience," Accounting, Organizations and Society, Elsevier, vol. 22(5), pages 387-410, July.
    4. Mălăescu, Irina & Sutton, Steve G., 2015. "The effects of decision aid structural restrictiveness on cognitive load, perceived usefulness, and reuse intentions," International Journal of Accounting Information Systems, Elsevier, vol. 17(C), pages 16-36.
    5. Seow, Poh-Sun, 2011. "The effects of decision aid structural restrictiveness on decision-making outcomes," International Journal of Accounting Information Systems, Elsevier, vol. 12(1), pages 40-56.
    6. Vicky Arnold & Philip A. Collier & Stewart A. Leech & Steve G. Sutton & Andrew Vincent, 2013. "Incase: Simulating Experience To Accelerate Expertise Development By Knowledge Workers," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 20(1), pages 1-21, January.
    7. Bonner, Se & Lewis, Bl, 1990. "Determinants Of Auditor Expertise," Journal of Accounting Research, Wiley Blackwell, vol. 28, pages 1-20.
    8. Libby, Robert & Luft, Joan, 1993. "Determinants of judgment performance in accounting settings: Ability, knowledge, motivation, and environment," Accounting, Organizations and Society, Elsevier, vol. 18(5), pages 425-450, July.
    9. Schultz Jr., Joseph J. & Bierstaker, James Lloyd & O'Donnell, Ed, 2010. "Integrating business risk into auditor judgment about the risk of material misstatement: The influence of a strategic-systems-audit approach," Accounting, Organizations and Society, Elsevier, vol. 35(2), pages 238-251, February.
    10. Fred D. Davis & Richard P. Bagozzi & Paul R. Warshaw, 1989. "User Acceptance of Computer Technology: A Comparison of Two Theoretical Models," Management Science, INFORMS, vol. 35(8), pages 982-1003, August.
    11. Rose, Jacob M. & Wolfe, Christopher J., 2000. "The effects of system design alternatives on the acquisition of tax knowledge from a computerized tax decision aid," Accounting, Organizations and Society, Elsevier, vol. 25(3), pages 285-306, April.
    12. Vicky Arnold & Nicole Clark & Philip A. Collier & Stewart A. Leech & Steve G. Sutton, 2004. "Explanation provision and use in an intelligent decision aid," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 12(1), pages 5-27, January.
    13. Carlin Dowling & W. Robert Knechel & Robyn Moroney, 2018. "Public Oversight of Audit Firms: The Slippery Slope of Enforcing Regulation," Abacus, Accounting Foundation, University of Sydney, vol. 54(3), pages 353-380, September.
    14. Kimberly K. Moreno & Sudip Bhattacharjee & Duane M. Brandon, 2007. "The Effectiveness of Alternative Training Techniques on Analytical Procedures Performance," Contemporary Accounting Research, John Wiley & Sons, vol. 24(3), pages 983-1014, September.
    15. DeFond, Mark L. & Lennox, Clive S., 2011. "The effect of SOX on small auditor exits and audit quality," Journal of Accounting and Economics, Elsevier, vol. 52(1), pages 21-40, June.
    16. Sutton, Steve G. & Arnold, Vicky & Holt, Matthew, 2023. "An extension of the theory of technology dominance: Capturing the underlying causal complexity," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sutton, Steve G. & Arnold, Vicky & Holt, Matthew, 2023. "An extension of the theory of technology dominance: Capturing the underlying causal complexity," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cardinaels, Eddy, 2008. "The interplay between cost accounting knowledge and presentation formats in cost-based decision-making," Accounting, Organizations and Society, Elsevier, vol. 33(6), pages 582-602, August.
    2. Desai, Vikram & Bucaro, Anthony C. & Kim, Joung W. & Srivastava, Rajendra & Desai, Renu, 2023. "Toward a better expert system for auditor going concern opinions using Bayesian network inflation factors," International Journal of Accounting Information Systems, Elsevier, vol. 49(C).
    3. Seow, Poh-Sun, 2011. "The effects of decision aid structural restrictiveness on decision-making outcomes," International Journal of Accounting Information Systems, Elsevier, vol. 12(1), pages 40-56.
    4. Sutton, Steve G. & Arnold, Vicky & Holt, Matthew, 2023. "An extension of the theory of technology dominance: Capturing the underlying causal complexity," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).
    5. Mălăescu, Irina & Sutton, Steve G., 2015. "The effects of decision aid structural restrictiveness on cognitive load, perceived usefulness, and reuse intentions," International Journal of Accounting Information Systems, Elsevier, vol. 17(C), pages 16-36.
    6. Ruhnke, Klaus, 2023. "Empirical research frameworks in a changing world: The case of audit data analytics," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 51(C).
    7. Jagdish PATHAK & Mary LIND & Mohammad ABDOLMOHAMMADI, 2010. "E-Commerce Audit Judgment Expertise: Does Expertise in System Change Management and Information Technology Auditing Mediate E-Commerce Audit Judgment Expertise?," Informatica Economica, Academy of Economic Studies - Bucharest, Romania, vol. 14(1), pages 5-20.
    8. Noel Harding, 2010. "Understanding the structure of audit workpaper error knowledge and its relationship with workpaper review performance," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 50(3), pages 663-683, September.
    9. Sutton, Steve G. & Arnold, Vicky & Collier, Phil & Leech, Stewart A., 2021. "Leveraging the synergies between design science and behavioral science research methods," International Journal of Accounting Information Systems, Elsevier, vol. 43(C).
    10. Dunn, Cheryl L. & Gerard, Gregory J. & Grabski, Severin V., 2017. "The combined effects of user schemas and degree of cognitive fit on data retrieval performance," International Journal of Accounting Information Systems, Elsevier, vol. 26(C), pages 46-67.
    11. Borthick, A. Faye & Curtis, Mary B. & Sriram, Ram S., 2006. "Accelerating the acquisition of knowledge structure to improve performance in internal control reviews," Accounting, Organizations and Society, Elsevier, vol. 31(4-5), pages 323-342.
    12. Clement, Michael B. & Koonce, Lisa & Lopez, Thomas J., 2007. "The roles of task-specific forecasting experience and innate ability in understanding analyst forecasting performance," Journal of Accounting and Economics, Elsevier, vol. 44(3), pages 378-398, December.
    13. Vicky Arnold, 2018. "The changing technological environment and the future of behavioural research in accounting," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 58(2), pages 315-339, June.
    14. Knechel, W. Robert & Thomas, Edward & Driskill, Matthew, 2020. "Understanding financial auditing from a service perspective," Accounting, Organizations and Society, Elsevier, vol. 81(C).
    15. Dezoort, F. T., 1998. "An analysis of experience effects on audit committee members' oversight judgments," Accounting, Organizations and Society, Elsevier, vol. 23(1), pages 1-21, January.
    16. Lisa Frey, 2018. "Tax certified individual auditors and effective tax rates," Business Research, Springer;German Academic Association for Business Research, vol. 11(1), pages 77-114, February.
    17. Rajni Mala & Parmod Chand, 2015. "Judgment and Decision‐Making Research in Auditing and Accounting: Future Research Implications of Person, Task, and Environment Perspective," Accounting Perspectives, John Wiley & Sons, vol. 14(1), pages 1-50, March.
    18. Ugrin, Joseph C. & Honn, Darla D., 2018. "Advanced placement and CPA exam performance: Implications for recruitment of quality students into college accounting programs," Advances in accounting, Elsevier, vol. 42(C), pages 96-109.
    19. Maureen Francis Mascha & Cathleen L. Miller, 2010. "The effects of task complexity and skill on over/under-estimation of internal control," Managerial Auditing Journal, Emerald Group Publishing, vol. 25(8), pages 734-755, September.
    20. Hunton, James E. & Wier, Benson & Stone, Dan N., 2000. "Succeeding in managerial accounting. Part 2: a structural equations analysis," Accounting, Organizations and Society, Elsevier, vol. 25(8), pages 751-762, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijoais:v:50:y:2023:i:c:s1467089523000301. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-accounting-information-systems/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.