IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2606.30085.html

Not-quite-human tastes: the stylized omnivorousness of LLM survey surrogates

Author

Listed:
  • Xiangyu Ma
  • Mengmi Zhang
  • Shannon Ang
  • Minne Chen

Abstract

Large-language models have proven to be remarkable if inconsistent parrots of public attitudes and opinions. The extent to which LLMs are able to produce reasonable approximations of cultural taste remains an open empirical question that becomes more urgent by the day, with market research companies already offering provisional `synthetic' survey panels and the contamination of standard survey data from LLM-generated responses. In this study, we build on past work on silicon sampling by extending considerations of its algorithmic fidelity and alignment to the domain of cultural consumption. We use large-language models from OpenAI, Anthropic, and DeepSeek to each produce 277,470 (30x9249) silicon surrogates of survey respondents from the Survey of Public Participation in the Arts (SPPA). We find these silicon surrogates' tastes to be highly stylized facsimiles of human tastes. (1) Silicon samples have a systematic postive-bias for liking, resulting in inflated ecological estimates of tastes. The individual-level bias of silicon samples are not well-explained by the WEIRD-bias often discussed in the literature. (2) The complex relationality in real taste structures is completely lost among silicon samples. (3) Finally, very little of the known cultural alignment between tastes and social space are preserved. Silicon samples attenuate age-taste associations, resurrect anachronistic class-taste associations, caricaturize gender- and race-taste associations.

Suggested Citation

  • Xiangyu Ma & Mengmi Zhang & Shannon Ang & Minne Chen, 2026. "Not-quite-human tastes: the stylized omnivorousness of LLM survey surrogates," Papers 2606.30085, arXiv.org.
  • Handle: RePEc:arx:papers:2606.30085
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2606.30085
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yuan Gao & Dokyun Lee & Gordon Burtch & Sina Fazelpour, 2024. "Take Caution in Using LLMs as Human Surrogates: Scylla Ex Machina," Papers 2410.19599, arXiv.org, revised Jan 2025.
    2. Jiancong Xiao & Ziniu Li & Xingyu Xie & Emily Getzen & Cong Fang & Qi Long & Weijie J. Su, 2025. "On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching Regularization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 120(552), pages 2154-2164, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alekseenko, Iuliia & Dagaev, Dmitry & Paklina, Sofiia & Parshakov, Petr, 2025. "Strategizing with AI: Insights from a beauty contest experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 240(C).
    2. Hongyu Chen & David Simchi-Levi & Ruoxuan Xiong, 2026. "Partial Identification under Missing Data Using Weak Shadow Variables from Pretrained Models," Papers 2602.16061, arXiv.org, revised Jun 2026.
    3. Wayne Gao & Sukjin Han & Annie Liang, 2026. "How Well Do LLMs Predict Human Behavior? A Measure of their Pretrained Knowledge," Papers 2601.12343, arXiv.org.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2606.30085. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.