IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v234y2025ics0167268125000241.html
   My bibliography  Save this article

Assessing political bias and value misalignment in generative artificial intelligence

Author

Listed:
  • Motoki, Fabio Y.S.
  • Pinho Neto, Valdemar
  • Rangel, Victor

Abstract

Our analysis reveals a concerning misalignment of values between ChatGPT and the average American. We also show that ChatGPT displays political leanings when generating text and images, but the degree and direction of skew depend on the theme. Notably, ChatGPT repeatedly refused to generate content representing certain mainstream perspectives, citing concerns over misinformation and bias. As generative AI systems like ChatGPT become ubiquitous, such misalignment with societal norms poses risks of distorting public discourse. Without proper safeguards, these systems threaten to exacerbate societal divides and depart from principles that underpin free societies.

Suggested Citation

  • Motoki, Fabio Y.S. & Pinho Neto, Valdemar & Rangel, Victor, 2025. "Assessing political bias and value misalignment in generative artificial intelligence," Journal of Economic Behavior & Organization, Elsevier, vol. 234(C).
    • Handle: RePEc:eee:jeborg:v:234:y:2025:i:c:s0167268125000241
    DOI: 10.1016/j.jebo.2025.106904
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268125000241
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jebo.2025.106904?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Klockmann, Victor & von Schenk, Alicia & Villeval, Marie Claire, 2022. "Artificial intelligence, ethics, and intergenerational responsibility," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 284-317.
    2. Desmond Ang, 2023. "The Birth of a Nation: Media and Racial Hate," American Economic Review, American Economic Association, vol. 113(6), pages 1424-1460, June.
    3. Matthew Gentzkow & Edward L. Glaeser & Claudia Goldin, 2006. "The Rise of the Fourth Estate. How Newspapers Became Informative and Why It Mattered," NBER Chapters, in: Corruption and Reform: Lessons from America's Economic History, pages 187-230, National Bureau of Economic Research, Inc.
    4. Elena Esposito & Tiziano Rotesi & Alessandro Saia & Mathias Thoenig, 2023. "Reconciliation Narratives: The Birth of a Nation after the US Civil War," American Economic Review, American Economic Association, vol. 113(6), pages 1461-1504, June.
    5. Ryan C. Moore & Ross Dahlke & Jeffrey T. Hancock, 2023. "Exposure to untrustworthy websites in the 2020 US election," Nature Human Behaviour, Nature, vol. 7(7), pages 1096-1105, July.
    6. Lisa Messeri & M. J. Crockett, 2024. "Artificial intelligence and illusions of understanding in scientific research," Nature, Nature, vol. 627(8002), pages 49-58, March.
    7. Valerio Capraro & Roberto Di Paolo & Matjaz Perc & Veronica Pizziol, 2024. "Language-based game theory in the age of artificial intelligence," Papers 2403.08944, arXiv.org.
    8. Douglas Guilbeault & Solène Delecourt & Tasker Hull & Bhargav Srinivasa Desikan & Mark Chu & Ethan Nadler, 2024. "Online images amplify gender bias," Nature, Nature, vol. 626(8001), pages 1049-1055, February.
    9. Jeffrey, Karen, 2021. "Automation and the future of work: How rhetoric shapes the response in policy preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 192(C), pages 417-433.
    10. Arthur, W. Brian, 2023. "Economics in nouns and verbs," Journal of Economic Behavior & Organization, Elsevier, vol. 205(C), pages 638-647.
    11. Czarnitzki, Dirk & Fernández, Gastón P. & Rammer, Christian, 2023. "Artificial intelligence and firm-level productivity," Journal of Economic Behavior & Organization, Elsevier, vol. 211(C), pages 188-205.
    12. Eva A. M. van Dis & Johan Bollen & Willem Zuidema & Robert van Rooij & Claudi L. Bockting, 2023. "ChatGPT: five priorities for research," Nature, Nature, vol. 614(7947), pages 224-226, February.
    13. Taylor Webb & Keith J. Holyoak & Hongjing Lu, 2023. "Emergent analogical reasoning in large language models," Nature Human Behaviour, Nature, vol. 7(9), pages 1526-1541, September.
    14. Ashesh Rambachan & Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan, 2020. "An Economic Perspective on Algorithmic Fairness," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 91-95, May.
    15. Kevin Aslett & Zeve Sanderson & William Godel & Nathaniel Persily & Jonathan Nagler & Joshua A. Tucker, 2024. "Online searches to evaluate misinformation can increase its perceived veracity," Nature, Nature, vol. 625(7995), pages 548-556, January.
    16. Anton Korinek, 2023. "Generative AI for Economic Research: Use Cases and Implications for Economists," Journal of Economic Literature, American Economic Association, vol. 61(4), pages 1281-1317, December.
    17. Milena Djourelova, 2023. "Persuasion through Slanted Language: Evidence from the Media Coverage of Immigration," American Economic Review, American Economic Association, vol. 113(3), pages 800-835, March.
    18. Lambert, Karras J. & Fegley, Tate, 2023. "Economic Calculation in Light of Advances in Big Data and Artificial Intelligence," Journal of Economic Behavior & Organization, Elsevier, vol. 206(C), pages 243-250.
    19. Daron Acemoglu & Todd Lensman, 2024. "Regulating Transformative Technologies," American Economic Review: Insights, American Economic Association, vol. 6(3), pages 359-376, September.
    20. Fabio Motoki & Valdemar Pinho Neto & Victor Rodrigues, 2024. "More human than human: measuring ChatGPT political bias," Public Choice, Springer, vol. 198(1), pages 3-23, January.
    21. Margarita Leib & Nils Köbis & Rainer Michael Rilke & Marloes Hagens & Bernd Irlenbusch, 2024. "Corrupted by Algorithms? How AI-generated and Human-written Advice Shape (Dis)honesty," The Economic Journal, Royal Economic Society, vol. 134(658), pages 766-784.
    22. Damian J. Ruck & Luke J. Matthews & Thanos Kyritsis & Quentin D. Atkinson & R. Alexander Bentley, 2020. "The cultural foundations of modern democracies," Nature Human Behaviour, Nature, vol. 4(3), pages 265-269, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Beach, Brian & Hanlon, W. Walker, 2023. "Historical newspaper data: A researcher’s guide," Explorations in Economic History, Elsevier, vol. 90(C).
    2. Petach, Luke, 2024. "That Old Time Religion: Christianity and Black Economic Progress After Reconstruction," GLO Discussion Paper Series 1480, Global Labor Organization (GLO).
    3. Feyzollahi, Maryam & Rafizadeh, Nima, 2025. "The adoption of Large Language Models in economics research," Economics Letters, Elsevier, vol. 250(C).
    4. Andersen, Jens Peter & Degn, Lise & Fishberg, Rachel & Graversen, Ebbe K. & Horbach, Serge P.J.M. & Schmidt, Evanthia Kalpazidou & Schneider, Jesper W. & Sørensen, Mads P., 2025. "Generative Artificial Intelligence (GenAI) in the research process – A survey of researchers’ practices and perceptions," Technology in Society, Elsevier, vol. 81(C).
    5. Marioni, Larissa da Silva & Rincon-Aznar, Ana & Venturini, Francesco, 2024. "Productivity performance, distance to frontier and AI innovation: Firm-level evidence from Europe," Journal of Economic Behavior & Organization, Elsevier, vol. 228(C).
    6. Paola Cillo & Gaia Rubera, 2025. "Generative AI in innovation and marketing processes: A roadmap of research opportunities," Journal of the Academy of Marketing Science, Springer, vol. 53(3), pages 684-701, May.
    7. Taylor, Alexander N., 2025. "Monumental effects: Confederate monuments in the Post-Reconstruction South," Explorations in Economic History, Elsevier, vol. 95(C).
    8. Jian-Qiao Zhu & Haijiang Yan & Thomas L. Griffiths, 2024. "Language Models Trained to do Arithmetic Predict Human Risky and Intertemporal Choice," Papers 2405.19313, arXiv.org, revised May 2025.
    9. Andres Karjus, 2025. "Machine-assisted quantitizing designs: augmenting humanities and social sciences with artificial intelligence," Palgrave Communications, Palgrave Macmillan, vol. 12(1), pages 1-18, December.
    10. Tao Chen & Shuwen Pi & Qing Sophie Wang, 2025. "Artificial Intelligence and Corporate Investment Efficiency: Evidence from Chinese Listed Companies," Working Papers in Economics 25/05, University of Canterbury, Department of Economics and Finance.
    11. Ghio, Alessandro, 2024. "Democratizing academic research with Artificial Intelligence: The misleading case of language," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 98(C).
    12. Li, Qianwen & Qian, Tingyu & Wang, Hui & Sun, Chuanwang, 2025. "Exploring the value of green: The impact factors on China's second-hand green housing prices based on geographically weighted Lasso regressions," Pacific-Basin Finance Journal, Elsevier, vol. 90(C).
    13. Chen, Chen & Xue, Zhixin, 2025. "New-type infrastructure and corporate digital transformation: Evidence from a multimethod machine learning approach," Finance Research Letters, Elsevier, vol. 74(C).
    14. Florian Mudekereza, 2025. "Robust Social Planning," Papers 2504.07401, arXiv.org, revised Jun 2025.
    15. Zhou, Meng & Yang, Yanlong & Xiang, Shuwen, 2025. "Effect of community learning mechanism on cooperation in conflict societies," Chaos, Solitons & Fractals, Elsevier, vol. 192(C).
    16. Mühlemann, Samuel, 2024. "AI Adoption and Workplace Training," IZA Discussion Papers 17367, Institute of Labor Economics (IZA).
    17. Evangelos Katsamakas & Oleg V. Pavlov & Ryan Saklad, 2024. "Artificial intelligence and the transformation of higher education institutions," Papers 2402.08143, arXiv.org.
    18. Filipe R. Campante & Quoc-Anh Do, 2014. "Isolated Capital Cities, Accountability, and Corruption: Evidence from US States," American Economic Review, American Economic Association, vol. 104(8), pages 2456-2481, August.
    19. Erdsiek, Daniel & Rost, Vincent, 2022. "Datenbewirtschaftung in deutschen Unternehmen: Umfrageergebnisse zu Status-quo und mittelfristigem Ausblick," ZEW Expert Briefs 22-09, ZEW - Leibniz Centre for European Economic Research.
    20. Efraim Benmelech & Tobias J. Moskowitz, 2010. "The Political Economy of Financial Regulation: Evidence from U.S. State Usury Laws in the 19th Century," Journal of Finance, American Finance Association, vol. 65(3), pages 1029-1073, June.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C89 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • L86 - Industrial Organization - - Industry Studies: Services - - - Information and Internet Services; Computer Software
    • Z00 - Other Special Topics - - General - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:234:y:2025:i:c:s0167268125000241. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.