IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp12738.html
   My bibliography  Save this paper

Who Said or What Said? Estimating Ideological Bias in Views Among Economists

Author

Listed:
  • Javdani, Mohsen

    (Simon Fraser University)

  • Chang, Ha-Joon

    (University of Cambridge)

Abstract

There exists a long-standing debate about the influence of ideology in economics. Surprisingly, however, there is no concrete empirical evidence to examine this critical issue. Using an online randomized controlled experiment involving 2425 economists in 19 countries, we examine the effect of ideological bias on views among economists. Participants were asked to evaluate statements from prominent economists on different topics, while source attribution for each statement was randomized without participants' knowledge. For each statement, participants either received a mainstream source, an ideologically different less-/non-mainstream source, or no source. We find that changing source attributions from mainstream to less-/non-mainstream, or removing them, significantly reduces economists' reported agreement with statements. This contradicts the image economists have of themselves, with 82% of participants reporting that in evaluating a statement one should only pay attention to its content. Using a framework of Bayesian updating we examine two competing hypotheses as potential explanations for these results: unbiased Bayesian updating versus ideologically-/authority-biased Bayesian updating. While we find no evidence in support of unbiased updating, our results are consistent with biased Bayesian updating. More specifically, we find that changing/removing sources (1) has no impact on economists' reported confidence with their evaluations; (2) similarly affects experts/non-experts in relevant areas; and (3) has substantially different impacts on economists with different political orientations. Finally, we find significant heterogeneity in our results by gender, country, PhD completion country, research area, and undergraduate major, with patterns consistent with the existence of ideological bias.

Suggested Citation

  • Javdani, Mohsen & Chang, Ha-Joon, 2019. "Who Said or What Said? Estimating Ideological Bias in Views Among Economists," IZA Discussion Papers 12738, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp12738
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp12738.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. George Stigler, 1959. "The Politics of Political Economists," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 73(4), pages 522-532.
    2. Robert H. Frank & Thomas Gilovich & Dennis T. Regan, 1993. "Does Studying Economics Inhibit Cooperation?," Journal of Economic Perspectives, American Economic Association, vol. 7(2), pages 159-171, Spring.
    3. James J. Heckman & Sidharth Moktan, 2020. "Publishing and promotion in economics - The tyranny of the Top Five," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 23-32, Centre for Economic Policy Research.
    4. Victor R. Fuchs, 2018. "Economics, Values, and Health Care Reform," World Scientific Book Chapters, in: Health Economics and Policy Selected Writings by Victor Fuchs, chapter 39, pages 497-531, World Scientific Publishing Co. Pte. Ltd..
    5. P. A. Riach & J. Rich, 2002. "Field Experiments of Discrimination in the Market Place," Economic Journal, Royal Economic Society, vol. 112(483), pages 480-518, November.
    6. John Kenneth Galbraith, 1989. "Ideology and Economic Reality," Challenge, Taylor & Francis Journals, vol. 32(6), pages 4-9, November.
    7. Alberto Abadie & Susan Athey & Guido W Imbens & Jeffrey M Wooldridge, 2023. "When Should You Adjust Standard Errors for Clustering?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 1-35.
    8. repec:hal:spmain:info:hdl:2441/67ft27s7u58ocangahl1jigu6p is not listed on IDEAS
    9. Matthew Gentzkow & Jesse M. Shapiro, 2006. "Media Bias and Reputation," Journal of Political Economy, University of Chicago Press, vol. 114(2), pages 280-316, April.
    10. Colander, David, 2003. "The Aging of an Economist," Journal of the History of Economic Thought, Cambridge University Press, vol. 25(2), pages 157-176, June.
    11. Charles S. Taber & Milton Lodge, 2006. "Motivated Skepticism in the Evaluation of Political Beliefs," American Journal of Political Science, John Wiley & Sons, vol. 50(3), pages 755-769, July.
    12. Avner Offer & Gabriel Söderberg, 2016. "The Nobel Factor: The Prize in Economics, Social Democracy, and the Market Turn," Economics Books, Princeton University Press, edition 1, number 10841.
    13. Victor R. Fuchs & Alan B. Krueger & James M. Poterba, 1998. "Economists' Views about Parameters, Values, and Policies: Survey Results in Labor and Public Economics," Journal of Economic Literature, American Economic Association, vol. 36(3), pages 1387-1425, September.
    14. Gilles Saint-Paul, 2018. "The Possibility of Ideological Bias in Structural Macroeconomic Models," American Economic Journal: Macroeconomics, American Economic Association, vol. 10(1), pages 216-241, January.
    15. Tommaso Colussi, 2018. "Social Ties in Academia: A Friend Is a Treasure," The Review of Economics and Statistics, MIT Press, vol. 100(1), pages 45-50, March.
    16. Sanjeev Goyal & Marco J. van der Leij & José Luis Moraga-Gonzalez, 2006. "Economics: An Emerging Small World," Journal of Political Economy, University of Chicago Press, vol. 114(2), pages 403-432, April.
    17. Zacharias Maniadis & Fabio Tufano, 2017. "The Research Reproducibility Crisis and Economics of Science," Economic Journal, Royal Economic Society, vol. 127(605), pages 200-208, October.
    18. Marion Fourcade & Etienne Ollion & Yann Algan, 2015. "The Superiority of Economists," Journal of Economic Perspectives, American Economic Association, vol. 29(1), pages 89-114, Winter.
    19. Franco Modigliani, 1977. "The monetarist controversy; or, should we forsake stabilization policies?," Economic Review, Federal Reserve Bank of San Francisco, issue Spr suppl, pages 27-46.
    20. Colussi, Tommaso, 2015. "Social Ties in Academia: A Friend is a Treasure," IZA Discussion Papers 9414, Institute of Labor Economics (IZA).
    21. Rivlin, Alice M, 1987. "Economics and the Political Process," American Economic Review, American Economic Association, vol. 77(1), pages 1-10, March.
    22. John P. A. Ioannidis & T. D. Stanley & Hristos Doucouliagos, 2017. "The Power of Bias in Economics Research," Economic Journal, Royal Economic Society, vol. 127(605), pages 236-265, October.
    23. Hendrik P. van Dalen, 2019. "Values of Economists Matter in the Art and Science of Economics," Kyklos, Wiley Blackwell, vol. 72(3), pages 472-499, August.
    24. Backhouse,Roger E., 2010. "The Puzzle of Modern Economics," Cambridge Books, Cambridge University Press, number 9780521825542.
    25. John List & Sally Sadoff & Mathis Wagner, 2011. "So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 439-457, November.
    26. Robert H. Frank & Thomas D. Gilovich & Dennis T. Regan, 1996. "Do Economists Make Bad Citizens?," Journal of Economic Perspectives, American Economic Association, vol. 10(1), pages 187-192, Winter.
    27. Paul Oyer, 2006. "Initial Labor Market Conditions and Long-Term Outcomes for Economists," Journal of Economic Perspectives, American Economic Association, vol. 20(3), pages 143-160, Summer.
    28. Zacharias Maniadis & Fabio Tufano & John A. List, 2017. "To Replicate or Not To Replicate? Exploring Reproducibility in Economics through the Lens of a Model and a Pilot Study," Economic Journal, Royal Economic Society, vol. 127(605), pages 209-235, October.
    29. Raymond Fisman & Maura O’Neill, 2009. "Gender Differences in Beliefs on the Returns to Effort: Evidence from the World Values Survey," Journal of Human Resources, University of Wisconsin Press, vol. 44(4).
    30. Zacharias Maniadis & Fabio Tufano & John A. List, 2014. "One Swallow Doesn't Make a Summer: New Evidence on Anchoring Effects," American Economic Review, American Economic Association, vol. 104(1), pages 277-290, January.
    31. Marion Fourcade & Etienne Ollion & Yann Algan, 2015. "The Superiority of Economists," Journal of Economic Perspectives, American Economic Association, vol. 29(1), pages 89-114, Winter.
    32. Ariel Rubinstein, 2006. "A Sceptic's Comment on the Study of Economics," Economic Journal, Royal Economic Society, vol. 116(510), pages 1-9, March.
    33. Currie, Janet & Lin, Wanchuan & Meng, Juanjuan, 2014. "Addressing antibiotic abuse in China: An experimental audit study," Journal of Development Economics, Elsevier, vol. 110(C), pages 39-51.
    34. Roger Gordon & Gordon B. Dahl, 2013. "Views among Economists: Professional Consensus or Point-Counterpoint?," American Economic Review, American Economic Association, vol. 103(3), pages 629-635, May.
    35. Sam Allgood & William Bosshardt & Wilbert van der Klaauw & Michael Watts, 2012. "Is Economics Coursework, or Majoring in Economics, Associated with Different Civic Behaviors?," The Journal of Economic Education, Taylor & Francis Journals, vol. 43(3), pages 248-268, July.
    36. Paul M. Romer, 2015. "Mathiness in the Theory of Economic Growth," American Economic Review, American Economic Association, vol. 105(5), pages 89-93, May.
    37. Harcourt,G. C., 1972. "Some Cambridge Controversies in the Theory of Capital," Cambridge Books, Cambridge University Press, number 9780521096720.
    38. David Colander, 2005. "The Making of an Economist Redux," Journal of Economic Perspectives, American Economic Association, vol. 19(1), pages 175-198, Winter.
    39. Colander, David & Klamer, Arjo, 1987. "The Making of an Economist," Journal of Economic Perspectives, American Economic Association, vol. 1(2), pages 95-111, Fall.
    40. Karl Beyer & Stephan Puehringer, 2019. "Divided we stand? Professional consensus and political conflict in academic economics," ICAE Working Papers 94, Johannes Kepler University, Institute for Comprehensive Analysis of the Economy.
    41. Thomas Mayer, 2001. "The role of ideology in disagreements among economists: a quantitative analysis," Journal of Economic Methodology, Taylor & Francis Journals, vol. 8(2), pages 253-273.
    42. Frankfurter, George M. & McGoun, Elton G., 1999. "Ideology and the theory of financial economics," Journal of Economic Behavior & Organization, Elsevier, vol. 39(2), pages 159-177, June.
    43. Marion Fourcade & Etienne Ollion & Yann Algan, 2015. "La superioridad de los economistas," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 17(33), pages 13-43, July-Dece.
    44. Herb Thompson, 1997. "Ignorance and Ideological Hegemony: A Critique of Neoclassical Economics," Journal of Interdisciplinary Economics, , vol. 8(4), pages 291-305, October.
    45. Enrico Moretti, 2011. "Social Learning and Peer Effects in Consumption: Evidence from Movie Sales," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(1), pages 356-393.
    46. Marko Terviö, 2011. "Divisions within Academia: Evidence from Faculty Hiring and Placement," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 1053-1062, August.
    47. Frey, Bruno S, et al, 1984. "Consensus and Dissension among Economists: An Empirical Inquiry," American Economic Review, American Economic Association, vol. 74(5), pages 986-994, December.
    48. Harcourt,G. C., 1972. "Some Cambridge Controversies in the Theory of Capital," Cambridge Books, Cambridge University Press, number 9780521096720.
    49. Frank, Bjorn & Schulze, Gunther G., 2000. "Does economics make citizens corrupt?," Journal of Economic Behavior & Organization, Elsevier, vol. 43(1), pages 101-113, September.
    50. Warren J. Samuels, 1992. "Ideology in Economics," Palgrave Macmillan Books, in: Essays on the Methodology and Discourse of Economics, chapter 11, pages 233-248, Palgrave Macmillan.
    51. Zacharias Maniadis & Fabio Tufano & John A. List, 2017. "To Replicate or Not To Replicate? Exploring Reproducibility in Economics through the Lens of a Model and a Pilot Study," Economic Journal, Royal Economic Society, vol. 127(605), pages 209-235, October.
    52. Marwell, Gerald & Ames, Ruth E., 1981. "Economists free ride, does anyone else? : Experiments on the provision of public goods, IV," Journal of Public Economics, Elsevier, vol. 15(3), pages 295-310, June.
    53. John R. Carter & Michael D. Irons, 1991. "Are Economists Different, and If So, Why?," Journal of Economic Perspectives, American Economic Association, vol. 5(2), pages 171-177, Spring.
    54. Backhouse,Roger E., 2010. "The Puzzle of Modern Economics," Cambridge Books, Cambridge University Press, number 9780521532617.
    55. Mark Horowitz & Robert Hughes, 2018. "Political Identity and Economists’ Perceptions of Capitalist Crises," Review of Radical Political Economics, Union for Radical Political Economics, vol. 50(1), pages 173-193, March.
    56. Warren J. Samuels, 1992. "Essays on the Methodology and Discourse of Economics," Palgrave Macmillan Books, Palgrave Macmillan, number 978-1-349-12371-1, December.
    57. Matthew Rabin & Joel L. Schrag, 1999. "First Impressions Matter: A Model of Confirmatory Bias," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 37-82.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Johanna Catherine Maclean & John Buckell, 2021. "Information and sin goods: Experimental evidence on cigarettes," Health Economics, John Wiley & Sons, Ltd., vol. 30(2), pages 289-310, February.
    2. Jakub Rybacki, 2019. "Are Central Banks' Research Teams Fragile Because of Groupthink?," KAE Working Papers 2019-045, Warsaw School of Economics, Collegium of Economic Analysis.
    3. Amandine Fillol & Esther Mcsween-Cadieux & Bruno Ventelou & Marie-Pier Larose & Ulrich Boris Nguemdjo Kanguem & Kadidiatou Kadio & Christian Dagenais & Valéry Ridde, 2022. "When the messenger is more important than the message: an experimental study of evidence use in francophone Africa [Quand le messager est plus important que le message: étude expérimentale en Afriq," Post-Print hal-03703117, HAL.
    4. Malte Dold & Tim Krieger, 2023. "The ideological use and abuse of Freiburg’s ordoliberalism," Public Choice, Springer, vol. 195(3), pages 341-361, June.
    5. Sami Diaf & Jörg Döpke & Ulrich Fritsche & Ida Rockenbach, 2020. "Sharks and minnows in a shoal of words: Measuring latent ideological positions of German economic research institutes based on text mining techniques," Macroeconomics and Finance Series 202001, University of Hamburg, Department of Socioeconomics.
    6. Asatryan, Zareh & Havlik, Annika & Heinemann, Friedrich & Nover, Justus, 2020. "Biases in fiscal multiplier estimates," European Journal of Political Economy, Elsevier, vol. 63(C).
    7. Jakub Rybacki, 2020. "Are Central Banks’ Research Teams Fragile Because of Groupthink in the Area of Monetary Policy? – Evidence on Inflation Targeting," Gospodarka Narodowa. The Polish Journal of Economics, Warsaw School of Economics, issue 4, pages 81-103.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohsen Javdani & Ha-Joon Chang, 2023. "Who said or what said? Estimating ideological bias in views among economists," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 47(2), pages 309-339.
    2. Karl Beyer & Stephan Puehringer, 2019. "Divided we stand? Professional consensus and political conflict in academic economics," ICAE Working Papers 94, Johannes Kepler University, Institute for Comprehensive Analysis of the Economy.
    3. Hendrik P. van Dalen, 2019. "Values of Economists Matter in the Art and Science of Economics," Kyklos, Wiley Blackwell, vol. 72(3), pages 472-499, August.
    4. Ruske, René & Suttner, Johannes, 2012. "Wie (un-)fair sind Ökonomen? Neue empirische Evidenz zur Marktbewertung und Rationalität," CIW Discussion Papers 03/2012, University of Münster, Center for Interdisciplinary Economics (CIW).
    5. Ruske René & Suttner Johannes, 2012. "Wie (un-)fair sind Ökonomen? – Neue empirische Evidenz zur Marktbewertung und Rationalität / How (un-)fair are economists? New empirical evidence on market valuation and rationality," ORDO. Jahrbuch für die Ordnung von Wirtschaft und Gesellschaft, De Gruyter, vol. 63(1), pages 179-194, January.
    6. Bruno S. Frey, 2021. "Backward‐oriented economics," Kyklos, Wiley Blackwell, vol. 74(2), pages 187-195, May.
    7. Matthias Aistleitner & Stephan Puehringer, 2023. "Biased Trade Narratives and Its Influence on Development Studies: A Multi-level Mixed-Method Approach," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 35(6), pages 1322-1346, December.
    8. Carlo D'Ippoliti, 2021. "“Many‐Citedness”: Citations Measure More Than Just Scientific Quality," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1271-1301, December.
    9. Kirchgassner, Gebhard, 2005. "(Why) are economists different?," European Journal of Political Economy, Elsevier, vol. 21(3), pages 543-562, September.
    10. René Ruske, 2015. "Does Economics Make Politicians Corrupt? Empirical Evidence from the United States Congress," Kyklos, Wiley Blackwell, vol. 68(2), pages 240-254, May.
    11. Lorenzo Ductor & Bauke Visser, 2023. "Concentration of power at the editorial boards of economics journals," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 189-238, April.
    12. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    13. Astri Drange Hole, 2013. "How do economists differ from others in distributive situations?," Nordic Journal of Political Economy, Nordic Journal of Political Economy, vol. 38, pages 1-4.
    14. Müller, Andrea & Haucap, Justus, 2014. "Why are Economists so Different? Nature, Nurture and Gender Effects in a Simple Trust Game," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100554, Verein für Socialpolitik / German Economic Association.
    15. Bruno S. Frey, 2000. "Was Bewirkt die Volkswirtschaftslehre?," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 1(1), pages 5-33, February.
    16. João Carlos Graça & João Carlos Lopes & Rita Gomes Correia, 2014. "Economics education: literacy or mind framing? Evidence from a survey on the social building of trust in Portugal," Working Papers Department of Economics 2014/20, ISEG - Lisbon School of Economics and Management, Department of Economics, Universidade de Lisboa.
    17. Brinja Meiseberg & Thomas Ehrmann & Aloys Prinz, 2017. "“Anything worth winning is worth cheating for”? Determinants of cheating behavior among business and theology students," Journal of Business Economics, Springer, vol. 87(8), pages 985-1016, November.
    18. Simon Niklas Hellmich, 2019. "Are People Trained in Economics “Different,†and if so, Why? A Literature Review," The American Economist, Sage Publications, vol. 64(2), pages 246-268, October.
    19. Niclas Berggren & Henrik Jordahl & Charlotta Stern, 2009. "The Political Opinions of Swedish Social Scientists," Finnish Economic Papers, Finnish Economic Association, vol. 22(2), pages 75-88, Autumn.
    20. Astri Drange Hole, 2008. "How do economists differ from others in distributive situations?," Labsi Experimental Economics Laboratory University of Siena 023, University of Siena.

    More about this item

    Keywords

    views among economists; Bayesian updating; authority bias; ideological bias; ideology;
    All these keywords.

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp12738. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.