IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2509.20634.html

Recidivism Prediction, Peer Effect Estimation, and Prediction-Powered Inference with LLM Text Measures

Author

Listed:
  • Shanjukta Nath
  • Jiwon Hong
  • Jae Ho Chang
  • Keith Warren
  • Subhadeep Paul

Abstract

We provide a new framework for estimating peer effects when outcomes are multivariate behavioral measures derived from written text using an LLM and the network formation is endogenous. We obtain LLM embeddings and zero shot classification of more than 200,000 written exchanges among residents of low-security correctional facilities. We find that LLM embeddings improve out-of-sample recidivism prediction by up to 30% over pre-entry covariates alone using LASSO and LoRA fine-tuning, showing that text representations capture meaningful signals. For peer effect estimation, we develop a novel instrumental variable estimator that accommodates multivariate outcomes, sparse networks, and multidimensional latent homophily. We show that this estimator is $\sqrt{N}$-consistent and asymptotically normal under sparsity conditions that relax dense-network assumptions prevalent in the peer effect literature. Limited human annotations are then combined with LLM zero-shot vectors in a new prediction-powered peer inference (PPPI) approach to obtain de-biased estimates and valid inference. Results reveal significant peer effects in the behavioral profiles.

Suggested Citation

  • Shanjukta Nath & Jiwon Hong & Jae Ho Chang & Keith Warren & Subhadeep Paul, 2025. "Recidivism Prediction, Peer Effect Estimation, and Prediction-Powered Inference with LLM Text Measures," Papers 2509.20634, arXiv.org, revised Sep 2026.
  • Handle: RePEc:arx:papers:2509.20634
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2509.20634
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yann Bramoullé & Habiba Djebbari & Bernard Fortin, 2020. "Peer Effects in Networks: A Survey," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 603-629, August.
    2. Logan M. Lee, 2023. "Halfway Home? Residential Housing and Reincarceration," American Economic Journal: Applied Economics, American Economic Association, vol. 15(3), pages 117-149, July.
    3. Zubin Jelveh & Bruce Kogut & Suresh Naidu, 2024. "Political Language in Economics," The Economic Journal, Royal Economic Society, vol. 134(662), pages 2439-2469.
    4. Paul Brehm & Martin Saavedra, 2025. "Vaccines and Verdicts: How Smallpox Court Decisions Affect Anti-Vaccine Discourse and Mortality," The Economic Journal, Royal Economic Society, vol. 135(668), pages 1229-1260.
    5. Elliott Ash & Daniel L Chen & Suresh Naidu, 2026. "Ideas Have Consequences: The Impact of Law and Economics on American Justice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 141(1), pages 845-887.
    6. Cody Tuttle, 2019. "Snapping Back: Food Stamp Bans and Criminal Recidivism," American Economic Journal: Economic Policy, American Economic Association, vol. 11(2), pages 301-327, May.
    7. Edward McFowland & Cosma Rohilla Shalizi, 2023. "Estimating Causal Peer Influence in Homophilous Social Networks by Inferring Latent Locations," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(541), pages 707-718, January.
    8. Patrick Rubin‐Delanchy & Joshua Cape & Minh Tang & Carey E. Priebe, 2022. "A statistical interpretation of spectral embedding: The generalised random dot product graph," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(4), pages 1446-1473, September.
    9. Paul Goldsmith-Pinkham & Guido W. Imbens, 2013. "Social Networks and the Identification of Peer Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(3), pages 253-264, July.
    10. Ida Johnsson & Hyungsik Roger Moon, 2021. "Estimation of Peer Effects in Endogenous Social Networks: Control Function Approach," The Review of Economics and Statistics, MIT Press, vol. 103(2), pages 328-345, May.
    11. Fangzheng Xie & Yanxun Xu, 2023. "Efficient Estimation for Random Dot Product Graphs via a One-Step Procedure," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(541), pages 651-664, January.
    12. Eric Auerbach, 2022. "Identification and Estimation of a Partially Linear Regression Model Using Network Data," Econometrica, Econometric Society, vol. 90(1), pages 347-365, January.
    13. Kevin T. Schnepel, 2018. "Good Jobs and Recidivism," Economic Journal, Royal Economic Society, vol. 128(608), pages 447-469.
    14. Quentin Lippmann, 2022. "Gender and lawmaking in times of quotas," Post-Print hal-04120482, HAL.
    15. Jennifer L. Doleac, 2023. "Encouraging Desistance from Crime," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 383-427, June.
    16. Roberto Galbiati & Aurélie Ouss & Arnaud Philippe, 2021. "Jobs, News and Reoffending after Incarceration [Examining the generality of the unemployment–crime association]," The Economic Journal, Royal Economic Society, vol. 131(633), pages 247-270.
    17. Kevin T. Schnepel, 2018. "Good Jobs and Recidivism," Economic Journal, Royal Economic Society, vol. 128(608), pages 447-469, February.
    18. Lippmann, Quentin, 2022. "Gender and lawmaking in times of quotas," Journal of Public Economics, Elsevier, vol. 207(C).
    19. Zhu, Xuening & Huang, Danyang & Pan, Rui & Wang, Hansheng, 2020. "Multivariate spatial autoregressive model for large scale social networks," Journal of Econometrics, Elsevier, vol. 215(2), pages 591-606.
    20. Bramoullé, Yann & Djebbari, Habiba & Fortin, Bernard, 2009. "Identification of peer effects through social networks," Journal of Econometrics, Elsevier, vol. 150(1), pages 41-55, May.
    21. Yukhnenko, Denis & Farouki, Leen & Fazel, Seena, 2023. "Criminal recidivism rates globally: A 6-year systematic review update," Journal of Criminal Justice, Elsevier, vol. 88(C).
    22. Ethan Cohen‐Cole & Xiaodong Liu & Yves Zenou, 2018. "Multivariate choices and identification of social interactions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(2), pages 165-178, March.
    23. J Cape & M Tang & C E Priebe, 2019. "Signal-plus-noise matrix models: eigenvector deviations and fluctuations," Biometrika, Biometrika Trust, vol. 106(1), pages 243-250.
    24. Crystal S. Yang, 2017. "Does Public Assistance Reduce Recidivism?," American Economic Review, American Economic Association, vol. 107(5), pages 551-555, May.
    25. Eleni Kalamara & Arthur Turrell & Chris Redl & George Kapetanios & Sujit Kapadia, 2022. "Making text count: Economic forecasting using newspaper text," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 896-919, August.
    26. Gloria Gennaro & Elliott Ash, 2022. "Emotion and Reason in Political Language," The Economic Journal, Royal Economic Society, vol. 132(643), pages 1037-1059.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tiziano Arduini & Edoardo Rainone, 2024. "Partial identification of treatment response under complementarity and substitutability," Temi di discussione (Economic working papers) 1473, Bank of Italy, Economic Research and International Relations Area.
    2. Duong Trinh & Santiago Montoya-Bland'on, 2026. "Heterogeneous Peer Effects with Endogenous Network Formation," Papers 2606.24850, arXiv.org.
    3. Jochmans, Koen, 2023. "Peer effects and endogenous social interactions," Journal of Econometrics, Elsevier, vol. 235(2), pages 1203-1214.
    4. Torsten Santavirta & Miguel Sarzosa, 2026. "Effects of disruptive peers in endogenous social networks," Quantitative Economics, Econometric Society, vol. 17(1), pages 92-134, January.
    5. Xin Gu & Haizheng Li & Zhongjian Lin & Xun Tang, 2025. "Peer effects with sample selection: an application in online job training," Empirical Economics, Springer, vol. 69(5), pages 2973-3000, November.
    6. Nicolas Debarsy & Julie Le Gallo, 2025. "Identification of Spatial Spillovers: Do's and Don'ts," Journal of Economic Surveys, Wiley Blackwell, vol. 39(5), pages 2152-2173, December.
    7. repec:hal:journl:hal-04549691 is not listed on IDEAS
    8. Diemer, Andreas, 2022. "Endogenous peer effects in diverse friendship networks: Evidence from Swedish classrooms," Economics of Education Review, Elsevier, vol. 89(C).
    9. Wu, Zhibin & Li, Yueyuan & Pedrycz, Witold, 2026. "Peer influence in social network: a review of identification, modeling and application," Journal of Business Research, Elsevier, vol. 203(C).
    10. Brice Romuald Gueyap Kounga, 2026. "Semiparametric Dynamic Logit Model with Endogenous Networks," Papers 2606.16230, arXiv.org, revised Oct 2026.
    11. Zenou, Yves, 2026. "Peer vs. Network Effects: Microfoundations, Identification, and Beyond," IZA Discussion Papers 18501, IZA Network @ LISER.
    12. Comola, Margherita & Dieye, Rokhaya & Fortin, Bernard, 2025. "Heterogeneous peer effects and gender-based interventions for teenage obesity," Journal of Health Economics, Elsevier, vol. 102(C).
    13. Alejandro Sanchez-Becerra, 2022. "The Network Propensity Score: Spillovers, Homophily, and Selection into Treatment," Papers 2209.14391, arXiv.org.
    14. Benjamin Monnery & Saïd Souam & Anna Montagutelli, 2021. "Economie du travail en prison : enjeux, résultats et recommandations," EconomiX Working Papers 2021-26, University of Paris Nanterre, EconomiX.
    15. Yann Bramoullé & Habiba Djebbari & Bernard Fortin, 2020. "Peer Effects in Networks: A Survey," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 603-629, August.
    16. William W. Wang & Ali Jadbabaie, 2025. "Weak Identification in Peer Effects Estimation," Papers 2508.04897, arXiv.org.
    17. Michel, Bastien & Hémet, Camille, 2026. "Custodial versus non-custodial sentences: Long-run evidence from an anticipated reform," Journal of Economic Behavior & Organization, Elsevier, vol. 248(C).
    18. Alejandra Agustina Martínez, 2023. "Raise your Voice! Activism and Peer Effects in Online Social Networks," Working Papers 277, Red Nacional de Investigadores en Economía (RedNIE).
    19. Eric Auerbach & Hongchang Guo & Max Tabord‐Meehan, 2026. "The local approach to causal inference under network interference," Quantitative Economics, Econometric Society, vol. 17(1), pages 173-199, January.
    20. Lan, Jing & Liu, Zhen, 2019. "Social network effect on income structure of SLCP participants: Evidence from Baitoutan Village, China," Forest Policy and Economics, Elsevier, vol. 106(C), pages 1-1.
    21. Wennberg, Karl & Norgren, Axel, 2021. "Models of Peer Effects in Education," Working Papers 21/3, Stockholm School of Economics, Center for Educational Leadership and Excellence.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2509.20634. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.