IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2312.11589.html
   My bibliography  Save this paper

Moral Uncertainty and the Problem of Fanaticism

Author

Listed:
  • Jazon Szabo
  • Jose Such
  • Natalia Criado
  • Sanjay Modgil

Abstract

While there is universal agreement that agents ought to act ethically, there is no agreement as to what constitutes ethical behaviour. To address this problem, recent philosophical approaches to `moral uncertainty' propose aggregation of multiple ethical theories to guide agent behaviour. However, one of the foundational proposals for aggregation - Maximising Expected Choiceworthiness (MEC) - has been criticised as being vulnerable to fanaticism; the problem of an ethical theory dominating agent behaviour despite low credence (confidence) in said theory. Fanaticism thus undermines the `democratic' motivation for accommodating multiple ethical perspectives. The problem of fanaticism has not yet been mathematically defined. Representing moral uncertainty as an instance of social welfare aggregation, this paper contributes to the field of moral uncertainty by 1) formalising the problem of fanaticism as a property of social welfare functionals and 2) providing non-fanatical alternatives to MEC, i.e. Highest k-trimmed Mean and Highest Median.

Suggested Citation

  • Jazon Szabo & Jose Such & Natalia Criado & Sanjay Modgil, 2023. "Moral Uncertainty and the Problem of Fanaticism," Papers 2312.11589, arXiv.org.
  • Handle: RePEc:arx:papers:2312.11589
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2312.11589
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Adrien Fabre, 2021. "Tie-breaking the highest median: alternatives to the majority judgment," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 56(1), pages 101-124, January.
    2. Hurley, W. J. & Lior, D. U., 2002. "Combining expert judgment: On the performance of trimmed mean vote aggregation procedures in the presence of strategic voting," European Journal of Operational Research, Elsevier, vol. 140(1), pages 142-147, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roland W. Scholz & Ralf Hansmann, 2007. "Combining Experts' Risk Judgments on Technology Performance of Phytoremediation: Self‐Confidence Ratings, Averaging Procedures, and Formative Consensus Building," Risk Analysis, John Wiley & Sons, vol. 27(1), pages 225-240, February.
    2. Patrick Afflerbach & Christopher Dun & Henner Gimpel & Dominik Parak & Johannes Seyfried, 2021. "A Simulation-Based Approach to Understanding the Wisdom of Crowds Phenomenon in Aggregating Expert Judgment," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 63(4), pages 329-348, August.
    3. Philippos Louis & Matías Núñez & Dimitrios Xefteris, 2019. "Trimming Extreme Opinions in Preference Aggregation," University of Cyprus Working Papers in Economics 12-2019, University of Cyprus Department of Economics.
    4. García-Lapresta, José Luis & Marques Pereira, Ricardo Alberto, 2022. "An extension of Majority Judgment to non-uniform qualitative scales," European Journal of Operational Research, Elsevier, vol. 301(2), pages 667-674.
    5. Nickel, Stefan & Velten, Sebastian, 2017. "Optimization problems with flexible objectives: A general modeling approach and applications," European Journal of Operational Research, Elsevier, vol. 258(1), pages 79-88.
    6. Louis, Philippos & Núñez, Matías & Xefteris, Dimitrios, 2023. "Trimming extreme reports in preference aggregation," Games and Economic Behavior, Elsevier, vol. 137(C), pages 116-151.
    7. Aubin, Jean-Baptiste & Gannaz, Irène & Leoni, Samuela & Rolland, Antoine, 2022. "Deepest voting: A new way of electing," Mathematical Social Sciences, Elsevier, vol. 116(C), pages 1-16.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2312.11589. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.