IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2605.08071.html

Vibe Econometrics and the Analysis Contract

Author

Listed:
  • Lydia Ashton

    (University of Wisconsin-Madison)

Abstract

"Vibe coding" and "vibe analytics" have been framed as a democratization of technical capability. This paper argues that AI-assisted methodology more broadly, or what I call "vibe methodology," also democratizes the failure modes specific to each domain. When AI assists with methods whose validity depends on assumptions that cannot be verified from the output alone (a class I call "vibe inference"), the failure surface is structurally different: the output does not reliably signal invalidity, and when it does, recognizing the signal requires the expertise the workflow bypasses. I focus on "vibe econometrics," the subset of AI-assisted causal analysis where identification can be named faster than it can be audited. The claim of this paper is not that AI invents inferential failures that did not previously exist, but that it changes their incidence, observability, and persuasive force enough to create a practically distinct governance problem. This results in three failure modes: method-data mismatch, where AI bypasses expertise at execution; confidence laundering, where AI amplifies the credibility of formatted output; and invisible forking, which spans both. What is new is not the failure modes but AI's industrialization of their packaging. The barrier between naming a method and executing it has collapsed, and weak foundations, dressed as rigorous analysis, now reach audiences at a scale, speed, and polish that previously required expertise. I propose the Analysis Contract, a pre-commitment framework that adapts the logic of pre-analysis plans and the Causal Roadmap to the AI-assisted setting. The contract imposes three conditions before a causal claim is made: a method-data contract, a data audit, and a pre-commitment statement defining what would count as a disconfirming result. The framework generalizes across domains of vibe inference through domain-specific instantiation.

Suggested Citation

  • Lydia Ashton, 2026. "Vibe Econometrics and the Analysis Contract," Papers 2605.08071, arXiv.org.
  • Handle: RePEc:arx:papers:2605.08071
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2605.08071
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    2. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    3. Katherine Casey & Rachel Glennerster & Edward Miguel, 2012. "Reshaping Institutions: Evidence on Aid Impacts Using a Preanalysis Plan," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(4), pages 1755-1812.
    4. Marcus R. Munafò & Brian A. Nosek & Dorothy V. M. Bishop & Katherine S. Button & Christopher D. Chambers & Nathalie Percie du Sert & Uri Simonsohn & Eric-Jan Wagenmakers & Jennifer J. Ware & John P. A, 2017. "A manifesto for reproducible science," Nature Human Behaviour, Nature, vol. 1(1), pages 1-9, January.
    5. Ilia Shumailov & Zakhar Shumaylov & Yiren Zhao & Nicolas Papernot & Ross Anderson & Yarin Gal, 2024. "AI models collapse when trained on recursively generated data," Nature, Nature, vol. 631(8022), pages 755-759, July.
    6. Daron Acemoglu & Dingwen Kong & Asuman Ozdaglar, 2026. "AI, Human Cognition and Knowledge Collapse," NBER Working Papers 34910, National Bureau of Economic Research, Inc.
    7. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    8. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bas Scheer & Wiljan van den Berge & Maarten Goos & Alan Manning & Anna Salomons, 2022. "Alternative Work Arrangements and Worker Outcomes: Evidence from Payrolling," CPB Discussion Paper 435, CPB Netherlands Bureau for Economic Policy Analysis.
    2. Mac Clay, Pablo & Börner, Jan & Sellare, Jorge, 2023. "Institutional and macroeconomic stability mediate the effect of auctions on renewable energy capacity," Energy Policy, Elsevier, vol. 180(C).
    3. Nadja van 't Hoff & Giovanni Mellace & Seetha Menon, 2025. "Gender Differences in Healthcare Utilisation -- Evidence from Unexpected Adverse Health Shocks," Papers 2509.01310, arXiv.org.
    4. Stefan Bauernschuster & Michael Grimm & Cathy M. Hajo, 2023. "The Impact of Margaret Sanger’s Birth Control Clinics on Early 20th Century U.S. Fertility and Mortality," CESifo Working Paper Series 10421, CESifo.
    5. Art=uras Juodis & Martin Weidner, 2026. "Factor-Augmented Panel Regressions and Variance-Weighted Treatment Effects," Papers 2604.18078, arXiv.org.
    6. Cocco, Valentin & Chakir, Raja & Mouysset, Lauriane, 2025. "Guilty or scapegoat? Land consolidation and hedgerow decline," Journal of Environmental Economics and Management, Elsevier, vol. 133(C).
    7. Rik Chakraborti & Gavin Roberts, 2023. "How price-gouging regulation undermined COVID-19 mitigation: county-level evidence of unintended consequences," Public Choice, Springer, vol. 196(1), pages 51-83, July.
    8. Hahm, Dong Woo, 2026. "From curriculum to career: Early-career labor market effects of the Common Core," Economics of Education Review, Elsevier, vol. 110(C).
    9. Luo, Lianfa & Cheng, Zhiming & Ye, Qingqing & Cheng, Yanjun & Smyth, Russell & Yang, Zhiqing & Zhang, Le, 2024. "Nonmonetary awards and innovation: Evidence from winning China's Top Brand Contest," China Economic Review, Elsevier, vol. 86(C).
    10. Görg, Holger & Lehr, Jakob, 2024. "Short and medium-term effects of foreign acquisitions on manufacturing firms: Evidence from Germany," Open Access Publications from Kiel Institute for the World Economy 302104, Kiel Institute for the World Economy.
    11. Hashida, Yukiko & Dundas, Steven J., 2023. "The effects of a voluntary property buyout and acquisition program on coastal housing markets: Evidence from New York," Journal of Environmental Economics and Management, Elsevier, vol. 121(C).
    12. Maclean, J. Catherine & Pichler, Stefan & Ziebarth, Nicolas R., 2020. "Mandated Sick Pay: Coverage, Utilization, and Welfare Effects," IZA Discussion Papers 13132, IZA Network @ LISER.
    13. Mayberry, Anthony A., 2023. "Demilitarization and economic growth: Empirical evidence in support of a peace dividend," Journal of Comparative Economics, Elsevier, vol. 51(3), pages 960-988.
    14. Jaraitė, Jūratė & Kurtyka, Oliwia & Ollivier, Hélène, 2022. "Take a ride on the (not so) green side: How do CDM projects affect Indian manufacturing firms’ environmental performance?," Journal of Environmental Economics and Management, Elsevier, vol. 114(C).
    15. Guo, Naijia & Huang, Wei & Wang, Ruixin, 2025. "Public pensions and family dynamics: Eldercare, child investment, and son preference in rural China," Journal of Development Economics, Elsevier, vol. 172(C).
    16. William Casey Boland, 2025. "Accountability at the Expense of Equity? Investigating Intended and Unintended Consequences of Performance Based-Funding in Hispanic-Serving Institutions," Research in Higher Education, Springer;Association for Institutional Research, vol. 66(4), pages 1-35, June.
    17. Li, Daiyue & Jin, Yanhong & Cheng, Mingwang, 2024. "Unleashing the power of industrial robotics on firm productivity: Evidence from China," Journal of Economic Behavior & Organization, Elsevier, vol. 224(C), pages 500-520.
    18. Partha Deb & Anjelica Gangaram, 2024. "The effects of school shootings on risky behavior, health, and human capital," Journal of Population Economics, Springer;European Society for Population Economics, vol. 37(1), pages 1-28, March.
    19. Brehm, Johannes & Pestel, Nico & Schaffner, Sandra & Schmitz, Laura, 2025. "From Low Emission Zone to academic track: Environmental policy effects on educational achievement in elementary school," Journal of Environmental Economics and Management, Elsevier, vol. 132(C).
    20. Timothy K. M. Beatty & Joakim A. Weill, 2024. "Social Security and High-Frequency Labor Supply: Evidence from Uber Drivers," Finance and Economics Discussion Series 2024-079, Board of Governors of the Federal Reserve System (U.S.).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2605.08071. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.