IDEAS home Printed from https://ideas.repec.org/p/udt/wpgobi/wp_gob_2026_07.html

Same Model, Different Politics? How Language Shapes AI Ideology

Author

Listed:
  • Eduardo Levy Yeyati

  • César M. Ciappa

  • Milagros Onofri

Abstract

Recent work measures ideological positioning and drift in large language models (LLMs), but typically assumes that those measurements are invariant to the language of evaluation. This paper tests that assumption using the full Political Compass questionnaire in English and Spanish across three generations of OpenAI models, together with a benchmark comparison against recent Qwen and Mistral releases. Using matched item-level responses, we estimate within-model Spanish–English displacement and assess how language choice affects cross-model comparisons. We find that measured ideological coordinates remain in the same broad region across languages, but are not language-invariant. Spanish–English shifts differ in sign and magnitude across models and axes, and in several cases amount to a substantial share of the inter-model dispersion typically interpreted as ideological drift in English-only audits. The implication is methodological: ideological drift should not be treated as a language-invariant property of a model, but as a measurement outcome conditional on language choice and instrument design. Multilingual audits should therefore report language-specific placements and within-model cross-language displacement rather than extrapolating from English-only measurements.

Suggested Citation

  • Eduardo Levy Yeyati & César M. Ciappa & Milagros Onofri, 2026. "Same Model, Different Politics? How Language Shapes AI Ideology," School of Government Working Papers wp_gob_2026_07, Universidad Torcuato Di Tella.
  • Handle: RePEc:udt:wpgobi:wp_gob_2026_07
    as

    Download full text from publisher

    File URL: https://repositorio.utdt.edu/handle/20.500.13098/14285
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Motoki, Fabio Y.S. & Pinho Neto, Valdemar & Rangel, Victor, 2025. "Assessing political bias and value misalignment in generative artificial intelligence," Journal of Economic Behavior & Organization, Elsevier, vol. 234(C).
    2. Luca Rettenberger & Markus Reischl & Mark Schutera, 2025. "Assessing political bias in large language models," Journal of Computational Social Science, Springer, vol. 8(2), pages 1-17, May.
    3. Fabio Motoki & Valdemar Pinho Neto & Victor Rodrigues, 2024. "More human than human: measuring ChatGPT political bias," Public Choice, Springer, vol. 198(1), pages 3-23, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Leonardo Becchetti & Nazaria Solferino, 2026. "Political biases in chatgpt: insights from comparative analysis with human responses," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 43(1), pages 285-326, April.
    2. König, Pascal & Rone, Julia, 2025. "From tech wars to tech culture wars? “Value shaping” and “value signaling” in AI system design and governance," SocArXiv q4xep_v1, Center for Open Science.
    3. Louis Abraham & Charles Arnal & Antoine Marie, 2025. "Prompt selection matters: enhancing text annotations for social sciences with large language models," Journal of Computational Social Science, Springer, vol. 8(3), pages 1-20, August.
    4. Veda C. Storey & Wei Thoo Yue & J. Leon Zhao & Roman Lukyanenko, 2025. "Generative Artificial Intelligence: Evolving Technology, Growing Societal Impact, and Opportunities for Information Systems Research," Information Systems Frontiers, Springer, vol. 27(5), pages 2081-2102, October.
    5. George Gui & Seungwoo Kim, 2025. "Leveraging LLMs to Improve Experimental Design: A Generative Stratification Approach," Papers 2509.25709, arXiv.org.
    6. Rotaru George-Cristinel & Anagnoste Sorin & Oancea Vasile-Marian, 2024. "How Artificial Intelligence Can Influence Elections: Analyzing the Large Language Models (LLMs) Political Bias," Proceedings of the International Conference on Business Excellence, Sciendo, vol. 18(1), pages 1882-1891.
    7. Filippo Gusella & Eugenio Vicario, 2025. "Generative Agents and Expectations: Do LLMs Align with Heterogeneous Agent Models?," Working Papers - Economics wp2025_18.rdf, Universita' degli Studi di Firenze, Dipartimento di Scienze per l'Economia e l'Impresa.
    8. Olivier Toubia & George Z. Gui & Tianyi Peng & Daniel J. Merlau & Ang Li & Haozhe Chen, 2025. "Database Report: Twin-2K-500: A Data Set for Building Digital Twins of over 2,000 People Based on Their Answers to over 500 Questions," Marketing Science, INFORMS, vol. 44(6), pages 1446-1455, November.
    9. Antonina Rafikova & Anatoly Voronin, 2026. "ChatGPT as a research proxy: simulating human attitudes in social science research," Journal of Computational Social Science, Springer, vol. 9(1), pages 1-30, February.
    10. Sebastián Vallejo Vera & Hunter Driggers, 2025. "LLMs as annotators: the effect of party cues on labelling decisions by large language models," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-11, December.
    11. Blondeel, Eva & Everaert, Patricia & Opdecam, Evelien, 2025. "A practical guide to implementing ChatGPT as a secondary coder in qualitative research," International Journal of Accounting Information Systems, Elsevier, vol. 56(C).
    12. Motoki, Fabio Y.S. & Pinho Neto, Valdemar & Rangel, Victor, 2025. "Assessing political bias and value misalignment in generative artificial intelligence," Journal of Economic Behavior & Organization, Elsevier, vol. 234(C).
    13. Suhong Song & Zelong Liang & Wenna Zhao, 2026. "Modes of asking as switches: prompt-driven inconsistency in ChatGPT’s gender equality perspective outputs," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 13(1), pages 1-12, December.
    14. Yao Qu & Jue Wang, 2024. "Performance and biases of Large Language Models in public opinion simulation," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    15. Olivier Toubia & George Z. Gui & Tianyi Peng & Daniel J. Merlau & Ang Li & Haozhe Chen, 2025. "Twin-2K-500: A dataset for building digital twins of over 2,000 people based on their answers to over 500 questions," Papers 2505.17479, arXiv.org.
    16. Henry A. Thompson, 2025. "Some economics of artificial superintelligence," Papers 2511.06613, arXiv.org, revised Jun 2026.
    17. Yukihiro Hoshino & Ayato Kitadai & Nariaki Nishino, 2026. "Do Matching Mechanisms Work with LLM Agents?," Papers 2606.03030, arXiv.org.
    18. Ryota IWAMOTO & Takunori ISHIHARA & Takanori IDA, 2025. "Comparing Risk Preferences and Reference Dependence in Humans and AI: A Persona-Based Approach with Fine-Tuning「Revised in July 2026.」," Discussion papers e-25-006, Graduate School of Economics , Kyoto University.
    19. Tom Coupé, 2024. "Revealed Preferences: ChatGPT’s Opinion on Economic Issues and the Economics Profession," Working Papers in Economics 24/13, University of Canterbury, Department of Economics and Finance.
    20. Yingnan Yan & Tianming Liu & Yafeng Yin, 2025. "Valuing Time in Silicon: Can Large Language Models Replicate Human Value of Travel Time," Papers 2507.22244, arXiv.org, revised Dec 2025.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • D72 - Microeconomics - - Analysis of Collective Decision-Making - - - Political Processes: Rent-seeking, Lobbying, Elections, Legislatures, and Voting Behavior

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:udt:wpgobi:wp_gob_2026_07. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Fiorela Navarro Duymovich (email available below). General contact details of provider: https://edirc.repec.org/data/geutdar.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.