IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2607.21268.html

pAI-Econ-claude: A Gated Human-in-the-Loop Multi-Agent Architecture for AI-Assisted Economic Theory Development

Author

Listed:
  • Chen Zhu
  • Xiaolu Wang
  • Weilong Zhang

Abstract

In many social-science research tasks, such as economics, LLM-based agents must produce outputs for which no cheap, task-complete, machine-readable correctness signal exists. This creates a distinctive reliability problem for multi-agent systems: how should generation, critique, coordination, and human judgment be organized when no component can certify the final result? We address this problem through pAI-Econ-claude, a gated, human-in-the-loop multi-agent architecture for AI-assisted economic theory development. Agents coordinate through a shared workspace of inspectable intermediate records; specialized gates diagnose targeted failure modes and recommend loopbacks without certifying correctness; and human checkpoints retain authority over decisions that are costly to reverse. We evaluate the architecture on five matched economic-theory tasks against an ungated baseline. Two evaluators blinded to configuration agreed on all five pairwise rankings, preferring the gated architecture in four tasks and the baseline in one. Mean failure severity fell from 1.58 to 1.16, while overall usefulness rose from 2.60 to 3.10. The largest observed gain occurred when a reality check rejected a false market-structure premise and a proof review prompted revision of a false welfare claim. The negative case shows that scaffolding can also compress an economically important mechanism too aggressively. The results support a bounded claim: gated oversight improves the auditability of AI-assisted economic theory without substituting for formal verification, and the allocation of irreversible human judgment is a more informative design variable than pure agent autonomy. The workflow is publicly available at https://github.com/maxwell2732/pAI-Econ-claude.

Suggested Citation

  • Chen Zhu & Xiaolu Wang & Weilong Zhang, 2026. "pAI-Econ-claude: A Gated Human-in-the-Loop Multi-Agent Architecture for AI-Assisted Economic Theory Development," Papers 2607.21268, arXiv.org.
  • Handle: RePEc:arx:papers:2607.21268
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2607.21268
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hamish Low & Costas Meghir, 2017. "The Use of Structural Models in Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 33-58, Spring.
    2. Chen Zhu & Xiaolu Wang, 2026. "HLER: Human-in-the-Loop Economic Research via Multi-Agent Pipelines for Empirical Discovery," Papers 2603.07444, arXiv.org.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:spo:wpmain:info:hdl:2441/5lge9h8e809258uvvpjn34ekm4 is not listed on IDEAS
    2. Fenske, James & Gupta, Bishnupriya & Mukhopadhyay, Anwesh, 2025. "Colonial Persistence," CAGE Online Working Paper Series 752, Competitive Advantage in the Global Economy (CAGE).
    3. Ning Lin & Robert E. Brooks, 2021. "Global Liquified Natural Gas Trade under Energy Transition," Energies, MDPI, vol. 14(20), pages 1-30, October.
    4. Olivier Bargain, 2017. "Welfare analysis and redistributive policies," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 15(4), pages 393-419, December.
    5. Denis Fougère & Arthur Heim, 2019. "L'évaluation socioéconomique de l'investissement social," Working Papers hal-03456048, HAL.
    6. Ahmed Khwaja & Sonal Srivastava, 2026. "Reinforcement Learning Based Computationally Efficient Conditional Choice Simulation Estimation of Dynamic Discrete Choice Models," Papers 2601.02069, arXiv.org.
    7. Pallab Kumar Biswas & Paul A. Griffin & David H. Lont, 2025. "Long term trends in non‐audit fees and audit quality: New evidence based on going concern opinions and financial restatements," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 65(2), pages 1532-1584, June.
    8. Sigurd Galaasen & Herman Kruse, 2025. "Spousal spillovers in the labor market: A structural assessment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 58, October.
    9. David Green, 2026. "The THIRD Way in Empirical Economics Research," RFBerlin Discussion Paper Series 26152, ROCKWOOL Foundation Berlin (RFBerlin).
    10. Alexandros Theloudis & Jorge Velilla & Pierre-André Chiappori & José Ignacio Giménez-Nadal & José Alberto Molina, 2025. "Commitment and the Dynamics of Household Labour Supply," The Economic Journal, Royal Economic Society, vol. 135(665), pages 354-386.
    11. Jeppe Druedahl, 2021. "A Guide on Solving Non-convex Consumption-Saving Models," Computational Economics, Springer;Society for Computational Economics, vol. 58(3), pages 747-775, October.
    12. Markku Maula & Wouter Stam, 2020. "Enhancing Rigor in Quantitative Entrepreneurship Research," Entrepreneurship Theory and Practice, , vol. 44(6), pages 1059-1090, November.
    13. Timothy C. Y. Chan & Rafid Mahmood & Ian Yihang Zhu, 2025. "Inverse Optimization: Theory and Applications," Operations Research, INFORMS, vol. 73(2), pages 1046-1074, March.
    14. Han, Xintong & Liu, Zimin & Wang, Tong, 2023. "Nonlinear pricing in multidimensional context: An empirical analysis of energy consumption," International Journal of Industrial Organization, Elsevier, vol. 91(C).
    15. Ai, Chunrong & Linton, Oliver & Zhang, Zheng, 2022. "Estimation and inference for the counterfactual distribution and quantile functions in continuous treatment models," Journal of Econometrics, Elsevier, vol. 228(1), pages 39-61.
    16. Kantarcı, Tunga & Been, Jim & van Soest, Arthur & van Vuuren, Daniël, 2025. "Partial retirement opportunities and the labor supply of older individuals," Labour Economics, Elsevier, vol. 96(C).
    17. Fikru, Mahelet G. & Canfield, Casey, 2022. "Demand for renewable energy via green electricity versus solar installation in Community Choice Aggregation," Renewable Energy, Elsevier, vol. 186(C), pages 769-779.
    18. Jiaming Mao & Jingzhi Xu, 2020. "Ensemble Learning with Statistical and Structural Models," Papers 2006.05308, arXiv.org.
    19. Dave Donaldson, 2022. "Blending Theory and Data: A Space Odyssey," Journal of Economic Perspectives, American Economic Association, vol. 36(3), pages 185-210, Summer.
    20. Desjardins, Denise & Dionne, Georges & Koné, N’Golo, 2022. "Reinsurance demand and liquidity creation: A search for bicausality," Journal of Empirical Finance, Elsevier, vol. 66(C), pages 137-154.
    21. Reimer, Matthew N. & Abbott, Joshua K. & Haynie, Alan C., 2022. "Structural behavioral models for rights-based fisheries," Resource and Energy Economics, Elsevier, vol. 68(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2607.21268. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.