IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2606.06253.html

When the Scaffold Stays On: AI, Practice Style, and Screening in Elite Skill Formation

Author

Listed:
  • Song Yao

Abstract

Generative AI raises short-term productivity by completing tasks that learners would otherwise practice on their own. Whether this exchange erodes frontier skill depends on the mode of use: substitute-users let AI stand in for deliberate practice and fail to develop skill, while complement-users use it to accelerate skill development. For institutions that train and certify talent, the design question is not whether to allow AI but how to govern the mode of its use. We ask whether AI-prohibited evaluation gates can separate the two modes. In elite competitive programming, the International Collegiate Programming Contest (ICPC) and the International Olympiad in Informatics (IOI) prohibit AI under in-person proctoring, with qualification-round entry, whereas Codeforces (CF) practice is unproctored and open to all. From CF submission histories we build an AI-prompt signature, more first-attempt acceptances, fewer attempts, fewer debugging retries, consistent with AI-assisted practice. CF practice has shifted toward this signature across entry cohorts spanning two AI rollouts. In CF contests, a stronger signature predicts smaller rating gains for users with no ICPC-IOI affiliation, but not for those who qualified. Inside the AI-prohibited ICPC environment, a shift toward AI-style practice predicts higher non-AI-aided scores for AI-era entrants. The same signature carries opposite signs across the two environments, exactly the pattern a type-separating gate predicts. The message is constructive: AI-style practice is compatible with frontier skill; the erosion risk links to the substitute mode; and that mode is separable by gates standard at credential boundaries, from medical and legal boards to professional certification.

Suggested Citation

  • Song Yao, 2026. "When the Scaffold Stays On: AI, Practice Style, and Screening in Elite Skill Formation," Papers 2606.06253, arXiv.org, revised Aug 2026.
  • Handle: RePEc:arx:papers:2606.06253
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2606.06253
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    2. Carlos Cinelli & Chad Hazlett, 2020. "Making sense of sensitivity: extending omitted variable bias," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(1), pages 39-67, February.
    3. Emily Oster, 2019. "Unobservable Selection and Coefficient Stability: Theory and Evidence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 187-204, April.
    4. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    5. Wanda J. Orlikowski, 2000. "Using Technology and Constituting Structures: A Practice Lens for Studying Technology in Organizations," Organization Science, INFORMS, vol. 11(4), pages 404-428, August.
    6. Michael Spence, 1973. "Job Market Signaling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 87(3), pages 355-374.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas Bolli & Katherine Caves & Maria Esther Oswald-Egg, 2021. "Valuable Experience: How University Internships Affect Graduates’ Income," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(8), pages 1198-1247, December.
    2. Johannes Abeler & Armin Falk & Fabian Kosse, 2025. "Malleability of Preferences for Honesty," The Economic Journal, Royal Economic Society, vol. 135(667), pages 982-998.
    3. Upasak Das & Rupayan Pal & Udayan Rathore & Bibhas Saha, 2023. "Rein in pandemic by pricing vaccine: Does social trust matter?," Indira Gandhi Institute of Development Research, Mumbai Working Papers 2023-008, Indira Gandhi Institute of Development Research, Mumbai, India.
    4. Holla,Alaka & Bendini,Maria Magdalena & Dinarte Diaz,Lelys Ileana & Trako,Iva, 2021. "Is Investment in Preprimary Education Too Low ? Lessons from (Quasi) ExperimentalEvidence across Countries," Policy Research Working Paper Series 9723, The World Bank.
    5. Bauchet, Jonathan & Chakravarty, Sugato & Hunter, Brian, 2018. "Separating the wheat from the chaff: Signaling in microfinance loans," World Development, Elsevier, vol. 106(C), pages 40-50.
    6. Indra de Soysa, 2022. "Economic freedom vs. egalitarianism: An empirical test of weak & strong sustainability, 1970–2017," Kyklos, Wiley Blackwell, vol. 75(2), pages 236-268, May.
    7. Linda Argote & Jerry Guo & Ki-Won Haan & Matthew R. Rosengart & Cindy Y. Teng & Jeremy M. Kahn, 2026. "Transactive Memory Systems and Hospital Trauma Team Performance: Shared Experience in Action Teams," Organization Science, INFORMS, vol. 37(1), pages 48-70, January.
    8. Yao Wang & Zhecong Zheng & Dawei Feng, 2025. "Historical Clans and Contemporary Human Capital," China & World Economy, Institute of World Economics and Politics, Chinese Academy of Social Sciences, vol. 33(3), pages 234-270, May.
    9. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    10. Berlinski, Samuel & Giannola, Michele & Toppeta, Alessandro, 2026. "Effective Families or Effective Schools? Experimental Evidence on Fostering Children’s Numeracy," SOFI Working Papers in Labour Economics 6/2026, Stockholm University, Swedish Institute for Social Research.
    11. Tang, Lianzhou & Xu, Wenli, 2025. "Patronage and pollution," Journal of Environmental Economics and Management, Elsevier, vol. 130(C).
    12. Seyhakunthy Hun, 2026. "Privatization, sorting, and wage premium from Cambodia's higher education," Asian Economic Journal, East Asian Economic Association, vol. 40(1), pages 105-135, March.
    13. Hille, Adrian & Schupp, Jürgen, 2015. "How Learning a Musical Instrument Affects the Development of Skills," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 44, pages 56-82.
    14. Rios, Vicente & Barba, Izaskun & Gianmoena, Lisa & Pascual, Pedro, 2024. "Clearing the smog ceiling: The impact of women’s political empowerment on air quality in European regions," European Journal of Political Economy, Elsevier, vol. 85(C).
    15. Gervas Huxley & Mike Peacey, 2014. "A Simple Model of Learning Styles," The Centre for Market and Public Organisation 14/322, The Centre for Market and Public Organisation, University of Bristol, UK.
    16. De Paola, Maria & Skatova, Ekaterina, 2024. "Non-cognitive skills and social isolation in late childhood: An investigation of their impact on school performance in Italy," Economics of Education Review, Elsevier, vol. 103(C).
    17. Pontus af Buren & Jurg Schweri, 2024. "Firms' training processes and their apprentices' education success," Economics of Education Working Paper Series 0225, University of Zurich, Department of Business Administration (IBW).
    18. Piza, Caio & Zwager, Astrid & Ruzzante, Matteo & Dantas, Rafael & Loureiro, Andre, 2024. "Teacher-led innovations to improve education outcomes: Experimental evidence from Brazil," Journal of Public Economics, Elsevier, vol. 234(C).
    19. Rodrigo Ceni & Maira Colacce & Gonzalo Salas, 2023. "Initial inequality, unequal development: Effects of family movements on child development," Documentos de Trabajo (working papers) 23-07, Instituto de Economía - IECON.
    20. Robert Kaestner & Cuiping Schiman, 2026. "Do preschool investments depreciate and fadeout or result in dynamic complementarities? An assessment using the Head Start Impact Study," Review of Economics of the Household, Springer, vol. 24(1), pages 61-97, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2606.06253. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.