AI Sycophancy and Decisions

We examine whether sycophantic AI advice distorts decisions. Our experiment involves 1,500 participants in 30 decision environments spanning core domains in economics and the social sciences. Contrary to the vast majority of predictions in an expert survey we conduct, we find that AI advice depolarizes choices on average, moving participants away from their initial leanings. This depolarization arises despite the LLM being measurably sycophantic: it disproportionately offers considerations that support users’ initial leanings and uses agreeable and flattering language. Depolarization occurs across moral and non-moral, objective and subjective, strategic and non-strategic, and complex and simple tasks. Increasing sycophancy weakens depolarization, showing that sycophancy is behaviorally relevant, even if it is generally outweighed by the informativeness of AI advice. Finally, several results mitigate the concern that market forces will generate greater polarizing effects outside the experiment or in the future. On the supply side, our baseline AI’s level of sycophancy is typical of leading models, and these models are not becoming more sycophantic over time. On the demand side, participants do not prefer greater sycophancy, do not select into AI advice in tasks where it is more polarizing, and exhibit greater depolarizing effects when they are more frequent AI users outside the experiment.