IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2601.07573.html

A Model of Artificial Jagged Intelligence

Author

Listed:
  • Joshua Gans

Abstract

Generative AI systems often display highly uneven performance across tasks that appear ``nearby'': they can be excellent on one prompt and confidently wrong on another with only small changes in wording or context. We call this phenomenon Artificial Jagged Intelligence (AJI). This paper develops a tractable economic model of AJI that treats adoption as an information problem: users care about \emph{local} reliability, but typically observe only coarse, global quality signals. In a baseline one-dimensional landscape, truth is a rough Brownian process, and the model ``knows'' scattered points drawn from a Poisson process. The model interpolates optimally, and the local error is measured by posterior variance. We derive an adoption threshold for a blind user, show that experienced errors are amplified by the inspection paradox, and interpret scaling laws as denser coverage that improves average quality without eliminating jaggedness. We then study mastery and calibration: a calibrated user who can condition on local uncertainty enjoys positive expected value even in domains that fail the blind adoption test. Modelling mastery as learning a reliability map via Gaussian process regression yields a learning-rate bound driven by information gain, clarifying when discovering ``where the model works'' is slow. Finally, we study how scaling interacts with discoverability: when calibrated signals and user mastery accelerate the harvesting of scale improvements, and when opacity can make gains from scaling effectively invisible.

Suggested Citation

  • Joshua Gans, 2026. "A Model of Artificial Jagged Intelligence," Papers 2601.07573, arXiv.org.
  • Handle: RePEc:arx:papers:2601.07573
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2601.07573
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jovanovic, Boyan, 1982. "Selection and the Evolution of Industry," Econometrica, Econometric Society, vol. 50(3), pages 649-670, May.
    2. Nelson, Phillip, 1970. "Information and Consumer Behavior," Journal of Political Economy, University of Chicago Press, vol. 78(2), pages 311-329, March-Apr.
    3. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2025. "Generative AI at Work," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(2), pages 889-942.
    4. George A. Akerlof, 1970. "The Market for "Lemons": Quality Uncertainty and the Market Mechanism," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 84(3), pages 488-500.
    5. Steven Callander, 2011. "Searching and Learning by Trial and Error," American Economic Review, American Economic Association, vol. 101(6), pages 2277-2308, October.
    6. Christoph Carnehl & Johannes Schneider, 2025. "A Quest for Knowledge," Econometrica, Econometric Society, vol. 93(2), pages 623-659, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin Davies, 2024. "Estimating sample paths of Gauss-Markov processes from noisy data," Papers 2404.00784, arXiv.org.
    2. Marco Costanigro & Yuko Onozaka, 2020. "A Belief‐Preference Model of Choice for Experience and Credence Goods," Journal of Agricultural Economics, Wiley Blackwell, vol. 71(1), pages 70-95, February.
    3. Arai, Yoichi & Ichimura, Hidehiko & Kawaguchi, Daiji, 2015. "The educational upgrading of Japanese youth, 1982–2007: Are all Japanese youth ready for structural reforms?," Journal of the Japanese and International Economies, Elsevier, vol. 37(C), pages 100-126.
    4. Fabienne Chameroy & Jean-Louis Chandon, 2011. "Are All Labels Ethical? [Les labels sont-ils tous éthiques ?]," Post-Print hal-02092068, HAL.
    5. Bester, Helmut & Ouyang, Yaofu, 2018. "Optimal procurement of a credence good under limited liability," International Journal of Industrial Organization, Elsevier, vol. 61(C), pages 96-129.
    6. Cujean, Julien & Bustamante, Maria Cecilia & Frésard, Laurent, 2019. "Knowledge Cycles and Corporate Investment," CEPR Discussion Papers 14152, C.E.P.R. Discussion Papers.
    7. Charity, Nabwire Ephamia Juma, "undated". "Economic Analysis Of Consumers’ Awareness And Willingness To Pay For Geographical Indicators And Other Quality Attributes Of Honey In Kenya," Research Theses 265574, Collaborative Masters Program in Agricultural and Applied Economics.
    8. Haucap, Justus, 2017. "The rule of law and the emergence of market exchange: A new institutional economic perspective," DICE Discussion Papers 276, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    9. Judy E. Scott & Dawn G. Gregg & Jae Hoon Choi, 2015. "Lemon complaints: When online auctions go sour," Information Systems Frontiers, Springer, vol. 17(1), pages 177-191, February.
    10. Khim-Yong Goh & Cheng-Suang Heng & Zhijie Lin, 2013. "Social Media Brand Community and Consumer Behavior: Quantifying the Relative Impact of User- and Marketer-Generated Content," Information Systems Research, INFORMS, vol. 24(1), pages 88-107, March.
    11. Aleix Calveras & Juan‐José Ganuza, 2018. "Corporate social responsibility and product quality," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 27(4), pages 804-829, October.
    12. Sophie Bienenstock, 2016. "Consumer education: why the market doesn’t work," European Journal of Law and Economics, Springer, vol. 42(2), pages 237-262, October.
    13. Yi Qian & Qiang Gong & Yuxin Chen, 2015. "Untangling Searchable and Experiential Quality Responses to Counterfeits," Marketing Science, INFORMS, vol. 34(4), pages 522-538, July.
    14. Langinier Corinne & Babcock Bruce A., 2008. "Agricultural Production Clubs: Viability and Welfare Implications," Journal of Agricultural & Food Industrial Organization, De Gruyter, vol. 6(1), pages 1-31, December.
    15. Carlyle Farrell & Gervan Fearon, 2005. "Renting Goodwill in International Marketing Channels: An Analysis of Pricing Strategies and Bargaining Power," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 33(3), pages 285-296, September.
    16. James Hilger & Greg Rafert & Sofia Villas-Boas, 2011. "Expert Opinion and the Demand for Experience Goods: An Experimental Approach in the Retail Wine Market," The Review of Economics and Statistics, MIT Press, vol. 93(4), pages 1289-1296, November.
    17. Michela Ponzo & Vincenzo Scoppa, 2015. "Experts’ awards and economic success: evidence from an Italian literary prize," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 39(4), pages 341-367, November.
    18. Homburg, Christian & Klarmann, Martin & Schmitt, Jens, 2010. "Brand awareness in business markets: When is it related to firm performance?," International Journal of Research in Marketing, Elsevier, vol. 27(3), pages 201-212.
    19. Fredriksen, Kaja & Runst, Petrik & Bizer, Kilian, 2017. "Masterful Meisters? Voluntary Certification and Quality in the German Crafts Sector," ifh Working Papers 3 (2017), Volkswirtschaftliches Institut für Mittelstand und Handwerk an der Universität Göttingen (ifh), revised 2017.
    20. Giovanni Anania & Rosanna Nisticò, 2004. "Public Regulation as a Substitute for Trust in Quality Food Markets: What if the Trust Substitute cannot be Fully Trusted?," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 160(4), pages 681-701, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2601.07573. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.