IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2606.06253.html

When the Scaffold Stays On: AI, Practice Style, and Screening in Elite Skill Formation

Author

Listed:
  • Song Yao

Abstract

Generative AI raises short-term productivity by completing tasks learners would otherwise practice on their own. Whether this exchange erodes frontier skill depends on the mode of use: substitute-users let AI stand in for practice and fail to develop skills, while complement-users use AI to learn faster. The modes look alike in AI-aided output, so organizations screening on that output cannot tell them apart. We ask whether the AI-prohibited evaluation gates organizations already operate can separate the modes. In elite competitive programming, ICPC and IOI contests prohibit AI under in-person proctoring, with qualification-round entry, whereas Codeforces (CF) practice and contests are unproctored and open to all. From CF practice histories we build an AI-prompt signature consistent with AI usage, more first-attempt acceptances, fewer attempts and debugging retries. CF practice has shifted toward this signature across entry cohorts spanning two AI rollouts. On CF, a stronger signature predicts smaller rating gains for users with no ICPC-IOI affiliation, but not for those who qualified. Inside the AI-prohibited ICPC environment, AI-era entrants show no skill erosion, and shifts toward AI-style practice predict higher non-AI-aided scores. One screening mechanism fits both: where the modes mix, a stronger signature flags substitute-users; among those who qualified, a strengthening signature marks adoption of the complement mode. The message is constructive: AI-style practice is compatible with frontier skill; the erosion risk links to the substitute mode; and separating the modes is a design question for the exams organizations regularly administer, from medical and legal boards to professional certification.

Suggested Citation

  • Song Yao, 2026. "When the Scaffold Stays On: AI, Practice Style, and Screening in Elite Skill Formation," Papers 2606.06253, arXiv.org, revised Sep 2026.
  • Handle: RePEc:arx:papers:2606.06253
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2606.06253
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    2. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    3. Wanda J. Orlikowski, 2000. "Using Technology and Constituting Structures: A Practice Lens for Studying Technology in Organizations," Organization Science, INFORMS, vol. 11(4), pages 404-428, August.
    4. Carlos Cinelli & Chad Hazlett, 2020. "Making sense of sensitivity: extending omitted variable bias," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(1), pages 39-67, February.
    5. Emily Oster, 2019. "Unobservable Selection and Coefficient Stability: Theory and Evidence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 187-204, April.
    6. Michael Spence, 1973. "Job Market Signaling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 87(3), pages 355-374.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Song Yao, 2026. "Stranded Credentials: Keeping Online Reputation Systems Informative in the AI Era," Papers 2608.17111, arXiv.org, revised Sep 2026.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Song Yao, 2026. "Stranded Credentials: Keeping Online Reputation Systems Informative in the AI Era," Papers 2608.17111, arXiv.org, revised Sep 2026.
    2. Thomas Bolli & Katherine Caves & Maria Esther Oswald-Egg, 2021. "Valuable Experience: How University Internships Affect Graduates’ Income," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(8), pages 1198-1247, December.
    3. Johannes Abeler & Armin Falk & Fabian Kosse, 2025. "Malleability of Preferences for Honesty," The Economic Journal, Royal Economic Society, vol. 135(667), pages 982-998.
    4. Upasak Das & Rupayan Pal & Udayan Rathore & Bibhas Saha, 2023. "Rein in pandemic by pricing vaccine: Does social trust matter?," Indira Gandhi Institute of Development Research, Mumbai Working Papers 2023-008, Indira Gandhi Institute of Development Research, Mumbai, India.
    5. Holla,Alaka & Bendini,Maria Magdalena & Dinarte Diaz,Lelys Ileana & Trako,Iva, 2021. "Is Investment in Preprimary Education Too Low ? Lessons from (Quasi) ExperimentalEvidence across Countries," Policy Research Working Paper Series 9723, The World Bank.
    6. Bauchet, Jonathan & Chakravarty, Sugato & Hunter, Brian, 2018. "Separating the wheat from the chaff: Signaling in microfinance loans," World Development, Elsevier, vol. 106(C), pages 40-50.
    7. Indra de Soysa, 2022. "Economic freedom vs. egalitarianism: An empirical test of weak & strong sustainability, 1970–2017," Kyklos, Wiley Blackwell, vol. 75(2), pages 236-268, May.
    8. Linda Argote & Jerry Guo & Ki-Won Haan & Matthew R. Rosengart & Cindy Y. Teng & Jeremy M. Kahn, 2026. "Transactive Memory Systems and Hospital Trauma Team Performance: Shared Experience in Action Teams," Organization Science, INFORMS, vol. 37(1), pages 48-70, January.
    9. Yao Wang & Zhecong Zheng & Dawei Feng, 2025. "Historical Clans and Contemporary Human Capital," China & World Economy, Institute of World Economics and Politics, Chinese Academy of Social Sciences, vol. 33(3), pages 234-270, May.
    10. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    11. Samuel Berlinski & Michele Giannola & Michele Giannola, 2026. "Effective families or effective schools? Experimental evidence on fostering children’s numeracy," IFS Working Papers W26/36, Institute for Fiscal Studies.
    12. Tang, Lianzhou & Xu, Wenli, 2025. "Patronage and pollution," Journal of Environmental Economics and Management, Elsevier, vol. 130(C).
    13. Seyhakunthy Hun, 2026. "Privatization, sorting, and wage premium from Cambodia's higher education," Asian Economic Journal, East Asian Economic Association, vol. 40(1), pages 105-135, March.
    14. Sinha, Kompal & Magnani, Elisabetta & Zhu, Rong, 2026. "From entry to persistence: Socio-emotional skills and entrepreneurial profiles," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 121(C).
    15. Hille, Adrian & Schupp, Jürgen, 2015. "How Learning a Musical Instrument Affects the Development of Skills," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 44, pages 56-82.
    16. Rios, Vicente & Barba, Izaskun & Gianmoena, Lisa & Pascual, Pedro, 2024. "Clearing the smog ceiling: The impact of women’s political empowerment on air quality in European regions," European Journal of Political Economy, Elsevier, vol. 85(C).
    17. Jaeger, David, 2026. "Robustness? Range Tests for Equality and Equivalence Across Specifications," CEPR Discussion Papers 21802, Centre for Economic Policy Research.
    18. Gervas Huxley & Mike Peacey, 2014. "A Simple Model of Learning Styles," The Centre for Market and Public Organisation 14/322, The Centre for Market and Public Organisation, University of Bristol, UK.
    19. De Paola, Maria & Skatova, Ekaterina, 2024. "Non-cognitive skills and social isolation in late childhood: An investigation of their impact on school performance in Italy," Economics of Education Review, Elsevier, vol. 103(C).
    20. Pontus af Buren & Jurg Schweri, 2024. "Firms' training processes and their apprentices' education success," Economics of Education Working Paper Series 0225, University of Zurich, Department of Business Administration (IBW).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2606.06253. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.