Author
Listed:
- Wayne van Zijl
- Kayleigh Burnham
- Dusan Ecim
Abstract
PurposeArtificial intelligence (AI) has the potential to radically transform the accountancy profession, starting with routine transactions and functions and moving towards more strategic, leadership and governance responsibilities. The purpose of this paper is to evaluate the extent to which various Large Language Models (LLMs) can replicate the performance of accounting students completing a professional exit-level examination. By directly comparing the outputs of multiple AI models to those of students pursuing the Chartered Accountant (South Africa) [CA(SA)] designation, the study assesses whether AI has the capacity to support or potentially replace, accounting practitioners. In doing so, it clarifies both the opportunities and limitations of AI for the profession and for accounting education.Design/methodology/approachExit-level exam questions taken by students pursuing the CA(SA) designation were given to ChatGPT, Claude, CoPilot, Grok and Gemini. A zero-shot prompt method was adopted. Each model was given the scenario and required tasks to complete, with mark allocations, as real-world students were. Basic descriptive statistics and visual representations were used to analyse the data.FindingsThe results find that AI models are not all equal as far as dealing with financial accounting questions. AI models’ primary strength is in dealing with journal entries and basic calculation questions. They struggle to critically evaluate partial and complete solutions to identify errors and correct them. These tasks require judgement and the ability to distinguish fact from fiction. This is where humans significantly outperform AI and should be where the accountancy profession focuses its student education. Of the AI models, Gemini performed the best overall but did not outperform the student average.Practical implicationsThe study provides a useful baseline for future studies to monitor the progress of AI models in completing technical accounting exams and providing support to accounting professionals.Originality/valueThe study contributes to the literature by focusing on a renowned global chartered accountant designation from a developing economy and comparing different AI models’ performance to that of exit-level university students. The study also provides objective evidence that speaks to different AI models’ ability to support accounting practitioners in real-world settings or their ability to replace accounting consultants.
Suggested Citation
Wayne van Zijl & Kayleigh Burnham & Dusan Ecim, 2026.
"How close is AI to replacing accounting consultants? Insights from a comparative study of multiple AI models and exit-level accounting students,"
Meditari Accountancy Research, Emerald Group Publishing Limited, vol. 34(7), pages 53-78, February.
Handle:
RePEc:eme:medarp:medar-07-2025-3160
DOI: 10.1108/MEDAR-07-2025-3160
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eme:medarp:medar-07-2025-3160. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emerald Support (email available below). General contact details of provider: .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.