IDEAS home Printed from https://ideas.repec.org/a/dba/jsisia/v2y2026i4p52-63.html

An Empirical Comparison of Multi-Agent LLM Collaboration Strategies for Cross-Document Fraud Evidence Aggregation and Auditable Investigation Chains

Author

Listed:
  • Ga, Yunfei

Abstract

Suspicious-activity reporting under the Bank Secrecy Act requires investigators to aggregate evidence scattered across transaction records, customer identity files, behavioural logs, and external risk intelligence, while keeping every conclusion traceable to its source. Large language model agents have been proposed to support such cross-document investigation, yet little is known about how alternative collaboration strategies behave on this task. This work presents an empirical comparison of four established strategies --- single-agent serial reasoning, single-agent reasoning with self-consistency, role-specialised multi-agent collaboration, and debate-based multi-agent reasoning --- rather than proposing a new architecture. Using investigation cases synthesised from the AMLworld, Elliptic++, and Bank Account Fraud datasets, we evaluate each strategy along four axes: evidence recall, factual consistency, hallucination rate, and audit traceability. Across 300 cases on AMLworld, role-specialised collaboration attains the highest audit traceability (0.838), debate-based reasoning attains the highest factual consistency (0.841) and the lowest hallucination rate (0.094) at 6.7 times the cost of a single agent, and no strategy dominates on every axis. The gains are moderate and accompanied by substantial cost differences, indicating that strategy choice should be matched to the evidentiary and budgetary constraints of a given investigation.

Suggested Citation

  • Ga, Yunfei, 2026. "An Empirical Comparison of Multi-Agent LLM Collaboration Strategies for Cross-Document Fraud Evidence Aggregation and Auditable Investigation Chains," Journal of Science, Innovation & Social Impact, Pinnacle Academic Press, vol. 2(4), pages 52-63.
  • Handle: RePEc:dba:jsisia:v:2:y:2026:i:4:p:52-63
    as

    Download full text from publisher

    File URL: https://pinnaclepubs.com/index.php/JSISI/article/view/846/809
    Download Restriction: no
    ---><---

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dba:jsisia:v:2:y:2026:i:4:p:52-63. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joseph Clark (email available below). General contact details of provider: https://pinnaclepubs.com/index.php/JSISI .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.