IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0360157.html

How AI agents search

Author

Listed:
  • Francesca Pezzuti
  • Ophir Frieder
  • Fabrizio Silvestri
  • Sean MacAvaney
  • Nicola Tonellotto

Abstract

Large Language Models (LLMs) have evolved from relying primarily on knowledge stored in their parametric memory to using non-parametric memory mechanisms such as Retrieval-Augmented Generation (RAG) to provide and ground knowledge. Recently, LLMs have begun to perform retrieval autonomously within a reasoning loop, an approach referred to as Agentic RAG. This shift introduces new querying behaviours, with implications for the design of retrieval systems that have yet to be evaluated. In this work, we introduce a large-scale dataset (ASQ) capturing how Agentic RAG systems perform multi-step search and reasoning. ASQ contains about 1M agentic search traces collected from open-source Agentic RAG systems over 3 corpora, 5 agent variants, and 6 retrieval settings. Our analysis of ASQ shows that, within this controlled benchmark setting, a single search query can trigger long chains of retrieval calls (up to 186) and follow query reformulation dynamics different from those observed in historical human-search data. Our results also reveal substantial behavioural variation across agent and retrieval configurations: changes in re-ranking and retrieval depth do not consistently affect search workloads in terms of search-call volume and trace length across agents. To our knowledge, publicly available production logs do not expose the agent, dataset, and retrieval configuration associated with each trace. ASQ provides a reusable resource for further analysing agent search behaviour and supporting future information retrieval studies on agentic workloads under controlled settings.

Suggested Citation

  • Francesca Pezzuti & Ophir Frieder & Fabrizio Silvestri & Sean MacAvaney & Nicola Tonellotto, 2026. "How AI agents search," PLOS ONE, Public Library of Science, vol. 21(10), pages 1-21, October.
  • Handle: RePEc:plo:pone00:0360157
    DOI: 10.1371/journal.pone.0360157
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0360157
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0360157&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0360157?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0360157. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.