IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2511.14722.html

When AI Democratizes Exploitation: LLM-Assisted Strategic Manipulation of Fair Division Algorithms

Author

Listed:
  • Priyanka Verma
  • Balagopal Unnikrishnan

Abstract

Fair resource division algorithms, like those implemented in Spliddit platform, have traditionally been considered difficult for the end users to manipulate due to its complexities. This paper demonstrates how Large Language Models (LLMs) can dismantle these protective barriers by democratizing access to strategic expertise. Through empirical analysis of rent division scenarios on Spliddit algorithms, we show that users can obtain actionable manipulation strategies via simple conversational queries to AI assistants. We present four distinct manipulation scenarios: exclusionary collusion where majorities exploit minorities, defensive counterstrategies that backfire, benevolent subsidization of specific participants, and cost minimization coalitions. Our experiments reveal that LLMs can explain algorithmic mechanics, identify profitable deviations, and generate specific numerical inputs for coordinated preference misreporting--capabilities previously requiring deep technical knowledge. These findings extend algorithmic collective action theory from classification contexts to resource allocation scenarios, where coordinated preference manipulation replaces feature manipulation. The implications reach beyond rent division to any domain using algorithmic fairness mechanisms for resource division. While AI-enabled manipulation poses risks to system integrity, it also creates opportunities for preferential treatment of equity deserving groups. We argue that effective responses must combine algorithmic robustness, participatory design, and equitable access to AI capabilities, acknowledging that strategic sophistication is no longer a scarce resource.

Suggested Citation

  • Priyanka Verma & Balagopal Unnikrishnan, 2025. "When AI Democratizes Exploitation: LLM-Assisted Strategic Manipulation of Fair Division Algorithms," Papers 2511.14722, arXiv.org.
  • Handle: RePEc:arx:papers:2511.14722
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2511.14722
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philip Brookins & Jason DeBacker, 2024. "Playing games with GPT: What can we learn about a large language model from canonical strategic games?," Economics Bulletin, AccessEcon, vol. 44(1), pages 25-37.
    2. David Arnold & Will Dobbie & Crystal S Yang, 2018. "Racial Bias in Bail Decisions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(4), pages 1885-1932.
    3. Cecilia Rouse & Claudia Goldin, 2000. "Orchestrating Impartiality: The Impact of "Blind" Auditions on Female Musicians," American Economic Review, American Economic Association, vol. 90(4), pages 715-741, September.
    4. Martini, Giorgio, 2016. "Strategy-proof and fair assignment is wasteful," Games and Economic Behavior, Elsevier, vol. 98(C), pages 172-179.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nikoloz Kudashvili & Philipp Lergetporer, 2019. "Do Minorities Misrepresent Their Ethnicity to Avoid Discrimination?," CESifo Working Paper Series 7861, CESifo.
    2. Mark Hoekstra & CarlyWill Sloan, 2022. "Does Race Matter for Police Use of Force? Evidence from 911 Calls," American Economic Review, American Economic Association, vol. 112(3), pages 827-860, March.
    3. J. Aislinn Bohren & Alex Imas & Michael Rosenberg, 2019. "The Dynamics of Discrimination: Theory and Evidence," American Economic Review, American Economic Association, vol. 109(10), pages 3395-3436, October.
    4. Brendan O'Flaherty & Rajiv Sethi & Morgan Williams, 2024. "The nature, detection, and avoidance of harmful discrimination in criminal justice," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 43(1), pages 289-320, January.
    5. Kudashvili, Nikoloz & Lergetporer, Philipp, 2022. "Minorities’ strategic response to discrimination: Experimental evidence," Journal of Public Economics, Elsevier, vol. 208(C).
    6. Alison L. Booth, 2006. "The Glass Ceiling in Europe: Why Are Women Doing Badly in the Labour Market?," CEPR Discussion Papers 542, Centre for Economic Policy Research, Research School of Economics, Australian National University.
    7. Thomas Buser & Muriel Niederle & Hessel Oosterbeek, 2014. "Gender, Competitiveness, and Career Choices," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1409-1447.
    8. Saugato Datta & Vikram Pathania, 2016. "For whom does the phone (not) ring? Discrimination in the rental housing market in Delhi, India," WIDER Working Paper Series 055, World Institute for Development Economic Research (UNU-WIDER).
    9. Lorenzo Ductor & Sanjeev Goyal & Anja Prummer, 2018. "Gender & Collaboration," Working Papers 856, Queen Mary University of London, School of Economics and Finance.
    10. Bryson, Alex & Chevalier, Arnaud, 2015. "Is there a taste for racial discrimination amongst employers?," Labour Economics, Elsevier, vol. 34(C), pages 51-63.
    11. Kaiser, Lutz C., 2014. "The Gender-Career Estimation Gap," IZA Discussion Papers 8185, Institute of Labor Economics (IZA).
    12. Nobel Prize Committee, 2023. "Scientific Background to the Sveriges Riksbank Prize in Economic Sciences in Memory of Alfred Nobel 2023," Nobel Prize in Economics documents 2023-2, Nobel Prize Committee.
    13. Gabor Kertesi, 2004. "The Employment of the Roma - Evidence from Hungary," Budapest Working Papers on the Labour Market 0401, Institute of Economics, Centre for Economic and Regional Studies.
    14. Meurs, Dominique & Puhani, Patrick A., 2024. "Culture as a Hiring Criterion: Systemic Discrimination in a Procedurally Fair Hiring Process," Labour Economics, Elsevier, vol. 87(C).
    15. Sansone, Dario, 2019. "Pink work: Same-sex marriage, employment and discrimination," Journal of Public Economics, Elsevier, vol. 180(C).
    16. Nicole M Lindner & Alexander Graser & Brian A Nosek, 2014. "Age-Based Hiring Discrimination as a Function of Equity Norms and Self-Perceived Objectivity," PLOS ONE, Public Library of Science, vol. 9(1), pages 1-6, January.
    17. LaVoice, Jessica & Vamossy, Domonkos F., 2024. "Racial disparities in debt collection," Journal of Banking & Finance, Elsevier, vol. 164(C).
    18. Hinnerich, Björn Tyrefors & Höglin, Erik & Johannesson, Magnus, 2011. "Ethnic Discrimination in High School Grading: Evidence from a Field Experiment," SSE/EFI Working Paper Series in Economics and Finance 733, Stockholm School of Economics, revised 27 Jun 2011.
    19. Chen, Yiu Por (Vincent) & Zhang, Yuan, 2018. "A decomposition method on employment and wage discrimination and its application in urban China (2002–2013)," World Development, Elsevier, vol. 110(C), pages 1-12.
    20. Laura Hospido & Luc Laeven & Ana Lamo, 2022. "The Gender Promotion Gap: Evidence from Central Banking," The Review of Economics and Statistics, MIT Press, vol. 104(5), pages 981-996, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2511.14722. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.