IDEAS home Printed from https://ideas.repec.org/p/aim/wpaimx/2433.html
   My bibliography  Save this paper

The Moral Mind(s) of Large Language Models

Author

Abstract

As large language models (LLMs) become integrated to decision-making across various sectors, a key question arises: do they exhibit an emergent "moral mind" - a consistent set of moral principles guiding their ethical judgments - and is this reasoning uniform or diverse across models? To investigate this, we presented about forty different models from the main providers with a large array of structured ethical scenarios, creating one of the largest datasets of its kind. Our rationality tests revealed that at least one model from each provider demonstrated behavior consistent with stable moral principles, effectively acting as approximately optimizing a utility function encoding ethical reasoning. We identified these utility functions and observed a notable clustering of models around neutral ethical stances. To investigate variability, we introduced a novel non-parametric permutation approach, revealing that the most rational models shared 59% to 76% of their ethical reasoning patterns. Despite this shared foundation, differences emerged: roughly half displayed greater moral adaptability, bridging diverse perspectives, while the remainder adhered to more rigid ethical structures.

Suggested Citation

  • Avner Seror, 2024. "The Moral Mind(s) of Large Language Models," AMSE Working Papers 2433, Aix-Marseille School of Economics, France.
  • Handle: RePEc:aim:wpaimx:2433
    as

    Download full text from publisher

    File URL: https://www.amse-aixmarseille.fr/sites/default/files/working_papers/wp_2024_-_nr_33.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Varian, Hal R, 1982. "The Nonparametric Approach to Demand Analysis," Econometrica, Econometric Society, vol. 50(4), pages 945-973, July.
    2. Federico Echenique & Sangmok Lee & Matthew Shum, 2011. "The Money Pump as a Measure of Revealed Preference Violations," Journal of Political Economy, University of Chicago Press, vol. 119(6), pages 1201-1223.
    3. Yoram Halevy & Dotan Persitz & Lanny Zrill, 2018. "Parametric Recoverability of Preferences," Journal of Political Economy, University of Chicago Press, vol. 126(4), pages 1558-1593.
    4. Varian, Hal R., 1990. "Goodness-of-fit in optimizing models," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 125-140.
    5. Heufer, Jan & Hjertstrand, Per, 2015. "Consistent subsets: Computationally feasible methods to compute the Houtman–Maks-index," Economics Letters, Elsevier, vol. 128(C), pages 87-89.
    6. Bart Smeulders & Laurens Cherchye & Bram De Rock & Frits C. R. Spieksma, 2013. "The Money Pump as a Measure of Revealed Preference Violations: A Comment," Journal of Political Economy, University of Chicago Press, vol. 121(6), pages 1248-1258.
    7. Thomas Demuynck & John Rehbeck, 2023. "Computing revealed preference goodness-of-fit measures with integer programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 76(4), pages 1175-1195, November.
    8. James Andreoni & John Miller, 2002. "Giving According to GARP: An Experimental Test of the Consistency of Preferences for Altruism," Econometrica, Econometric Society, vol. 70(2), pages 737-753, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Smeulders, Bart & Crama, Yves & Spieksma, Frits C.R., 2019. "Revealed preference theory: An algorithmic outlook," European Journal of Operational Research, Elsevier, vol. 272(3), pages 803-815.
    2. Andreas C Drichoutis & Rodolfo M Nayga, 2020. "Economic Rationality under Cognitive Load," The Economic Journal, Royal Economic Society, vol. 130(632), pages 2382-2409.
    3. Thomas Demuynck & John Rehbeck, 2023. "Computing revealed preference goodness-of-fit measures with integer programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 76(4), pages 1175-1195, November.
    4. Avner Seror, 2022. "The Priced Survey Methodology," Working Papers hal-03852682, HAL.
    5. Mir Adnan Mahmood & John Rehbeck, 2022. "Correcting for Random Budgets in Revealed Preference Experiments," Games, MDPI, vol. 13(2), pages 1-14, April.
    6. Jim Engle-Warnick & Natalia Mishagina, 2014. "Insensitivity to Prices in a Dictator Game," CIRANO Working Papers 2014s-19, CIRANO.
    7. Jan Heufer & Per Hjertstrand, 2015. "Homothetic Efficiency and Test Power: A Non-Parametric Approach," Tinbergen Institute Discussion Papers 15-064/I, Tinbergen Institute.
    8. Dziewulski, Paweł, 2020. "Just-noticeable difference as a behavioural foundation of the critical cost-efficiency index," Journal of Economic Theory, Elsevier, vol. 188(C).
    9. Dziewulski, Paweł & Lanier, Joshua & Quah, John K.-H., 2024. "Revealed preference and revealed preference cycles: A survey," Journal of Mathematical Economics, Elsevier, vol. 113(C).
    10. Pawel Dziewulski, 2018. "Just-noticeable difference as a behavioural foundation of the critical cost-efficiency," Economics Series Working Papers 848, University of Oxford, Department of Economics.
    11. Demuynck, Thomas & Hjertstrand, Per, 2019. "Samuelson's Approach to Revealed Preference Theory: Some Recent Advances," Working Paper Series 1274, Research Institute of Industrial Economics.
    12. Kohei Shiozawa, 2015. "Revealed Preference Test and Shortest Path Problem; Graph Theoretic Structure of the Rationalizability Test," Discussion Papers in Economics and Business 15-17-Rev.2, Osaka University, Graduate School of Economics, revised Aug 2016.
    13. Aluma Dembo & Shachar Kariv & Matthew Polisson & John Quah, 2021. "Ever since Allais," IFS Working Papers W21/15, Institute for Fiscal Studies.
    14. Pawe{l} Dziewulski & Joshua Lanier & John K. -H. Quah, 2024. "Revealed preference and revealed preference cycles: a survey," Papers 2405.08459, arXiv.org.
    15. E. Cettolin & P. S. Dalton & W. J. Kop & W. Zhang, 2020. "Cortisol meets GARP: the effect of stress on economic rationality," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 554-574, June.
    16. Dieter Saelens, 2022. "Unitary or collective households? A nonparametric rationality and separability test using detailed data on consumption expenditures and time use," Empirical Economics, Springer, vol. 62(2), pages 637-677, February.
    17. Heufer, Jan & Hjertstrand, Per, 2019. "Homothetic preferences revealed," Journal of Economic Behavior & Organization, Elsevier, vol. 157(C), pages 602-614.
    18. Hjertstrand, Per, 2019. "Power Against Random Expenditure Allocation for Revealed Preference Tests," Working Paper Series 1309, Research Institute of Industrial Economics, revised 30 Apr 2021.
    19. Sabrina Bruyneel & Laurens Cherchye & Sam Cosaert & Bram De Rock & Siegfried Dewitte, 2012. "Are the Smart Kids More Rational ?," Working Papers ECARES ECARES 2012-050, ULB -- Universite Libre de Bruxelles.
    20. Heufer, Jan, 2014. "Nonparametric comparative revealed risk aversion," Journal of Economic Theory, Elsevier, vol. 153(C), pages 569-616.

    More about this item

    Keywords

    Decision Theory; revealed preference; Rationality; artificial intelligence; LLM; PSM.;
    All these keywords.

    JEL classification:

    • D9 - Microeconomics - - Micro-Based Behavioral Economics
    • C9 - Mathematical and Quantitative Methods - - Design of Experiments
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aim:wpaimx:2433. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gregory Cornu (email available below). General contact details of provider: https://edirc.repec.org/data/amseafr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.