IDEAS home Printed from https://ideas.repec.org/a/sae/crmide/v8y2021i1p22-35.html
   My bibliography  Save this article

Methodological Problems of Using Arabic-Language Twitter as a Gauge for Arab Attitudes Toward Politics and Society

Author

Listed:
  • Mujtaba Ali Isani

Abstract

Public opinion research in the Middle Eastern context has seen a proliferation of data research that aims to track changes in the state of Arab attitudes. Yet, it remains unclear what is being measured and how representative the data is. This article aims to address this question by reviewing the extent to which and how the existing literature has addressed the issues of representativeness of Twitter communities and the validity of opinion measures derived from sentiment analysis in the Middle Eastern context. While some studies aim no further than to gauge the dynamics of Twitter debates, many others seek to generalize the larger public opinion trends. This raises questions about how representative Twitter users are of the general public, how asymmetric social media use is, and how participation routines vary. Furthermore, to what extent can sentiment analysis translate individual tweets into meaningful measures of expressed opinion, and how sensitive are means of aggregating opinions from sentiment analysis to variation in terms of tone and amount of text within and across individuals? Following a comprehensive review of existing research in the context of the Middle East, this article also aims to derive a clearer understanding of how collective Twitter opinion relates to public opinion and make some suggestions of ways to design sampling and coding procedures, as well as validation exercises to address measurement bias and error.

Suggested Citation

  • Mujtaba Ali Isani, 2021. "Methodological Problems of Using Arabic-Language Twitter as a Gauge for Arab Attitudes Toward Politics and Society," Contemporary Review of the Middle East, , vol. 8(1), pages 22-35, March.
    • Handle: RePEc:sae:crmide:v:8:y:2021:i:1:p:22-35
    DOI: 10.1177/2347798920976283
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/2347798920976283
    Download Restriction: no
    File URL: https://libkey.io/10.1177/2347798920976283?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jean-Eric Aubert & Jean-Louis Reiffers, 2004. "Knowledge Economies in the Middle East and North Africa : Toward New Development Strategies," World Bank Publications - Books, The World Bank Group, number 15037, April.
    2. Joshua D. Kertzer & Thomas Zeitzoff, 2017. "A Bottom‐Up Theory of Public Opinion about Foreign Policy," American Journal of Political Science, John Wiley & Sons, vol. 61(3), pages 543-558, July.
    3. Alexandre Bovet & Hernán A. Makse, 2019. "Influence of fake news in Twitter during the 2016 US presidential election," Nature Communications, Nature, vol. 10(1), pages 1-14, December.
    4. Lucas, Christopher & Nielsen, Richard A. & Roberts, Margaret E. & Stewart, Brandon M. & Storer, Alex & Tingley, Dustin, 2015. "Computer-Assisted Text Analysis for Comparative Politics," Political Analysis, Cambridge University Press, vol. 23(2), pages 254-277, April.
    5. Daniel J. Hopkins & Gary King, 2010. "A Method of Automated Nonparametric Content Analysis for Social Science," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 229-247, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weifeng Zhong, 2016. "The candidates in their own words: A textual analysis of 2016 president primary debates," AEI Economic Perspectives, American Enterprise Institute, April.
    2. Sara Kahn-Nisser, 2019. "When the targets are members and donors: Analyzing inter-governmental organizations’ human rights shaming," The Review of International Organizations, Springer, vol. 14(3), pages 431-451, September.
    3. Sean D. Ehrlich & Christopher Gahagan, 2023. "The Multisided Threat to Free Trade: Protectionism and Fair Trade During Increasing Populism," Politics and Governance, Cogitatio Press, vol. 11(1), pages 223-236.
    4. repec:osf:osfxxx:pu2yv_v1 is not listed on IDEAS
    5. Ciprian-Octavian Truică & Elena-Simona Apostol, 2022. "MisRoBÆRTa: Transformers versus Misinformation," Mathematics, MDPI, vol. 10(4), pages 1-25, February.
    6. Kübler, Raoul V. & Manke, Kai & Pauwels, Koen, 2025. "I like, I share, I vote: Mapping the dynamic system of political marketing," Journal of Business Research, Elsevier, vol. 186(C).
    7. Uğur Baloğlu, 2021. "Trolls, Pressure and Agenda: The discursive fight on Twitter in Turkey," Media and Communication, Cogitatio Press, vol. 9(4), pages 39-51.
    8. Mohamed M. Mostafa, 2023. "A one-hundred-year structural topic modeling analysis of the knowledge structure of international management research," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(4), pages 3905-3935, August.
    9. Sinziana-Maria Rindasu & Ioan Dan Topor & Liliana Ionescu-Feleaga, 2023. "The Evolution of Management Accountants' Digital Skills in Industry 4.0: A Qualitative Approach," Oblik i finansi, Institute of Accounting and Finance, issue 1, pages 38-48, March.
    10. Prather, Lauren, 2024. "Ideology at the Water’s Edge: Explaining Variation in Public Support for Foreign Aid," World Development, Elsevier, vol. 176(C).
    11. Nwaibeh, E.A. & Chikwendu, C.R., 2023. "A deterministic model of the spread of scam rumor and its numerical simulations," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 207(C), pages 111-129.
    12. Dongshu Liu & Li Shao, 2024. "Nationalist propaganda and support for war in an authoritarian context: Evidence from China," Journal of Peace Research, Peace Research Institute Oslo, vol. 61(6), pages 985-1001, November.
    13. Pauwels, Koen & Aksehirli, Zeynep & Lackman, Andrew, 2016. "Like the ad or the brand? Marketing stimulates different electronic word-of-mouth content to drive online and offline performance," International Journal of Research in Marketing, Elsevier, vol. 33(3), pages 639-655.
    14. Rauh, Christian, 2018. "Validating a sentiment dictionary for German political language—a workbench note," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 15(4), pages 319-343.
    15. Andrea Sciandra & Alessio Surian & Livio Finos, 2021. "Supervised Machine Learning Methods to Disclose Action and Information in “U.N. 2030 Agenda” Social Media Data," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(2), pages 689-699, August.
    16. Ferrara, Federico M. & Masciandaro, Donato & Moschella, Manuela & Romelli, Davide, 2022. "Political voice on monetary policy: Evidence from the parliamentary hearings of the European Central Bank," European Journal of Political Economy, Elsevier, vol. 74(C).
    17. Matthew R DeVerna & Rachith Aiyappa & Diogo Pacheco & John Bryden & Filippo Menczer, 2024. "Identifying and characterizing superspreaders of low-credibility content on Twitter," PLOS ONE, Public Library of Science, vol. 19(5), pages 1-17, May.
    18. Xipeng Liu & Xinmiao Li, 2024. "Unbiased evaluation of ranking algorithms applied to the Chinese green patents citation network," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 2999-3021, June.
    19. Christopher D. Wirz & Michael A. Xenos & Dominique Brossard & Dietram Scheufele & Jennifer H. Chung & Luisa Massarani, 2018. "Rethinking Social Amplification of Risk: Social Media and Zika in Three Languages," Risk Analysis, John Wiley & Sons, vol. 38(12), pages 2599-2624, December.
    20. Dehler-Holland, Joris & Okoh, Marvin & Keles, Dogan, 2022. "Assessing technology legitimacy with topic models and sentiment analysis – The case of wind power in Germany," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    21. Weiss, Daniel & Nemeczek, Fabian, 2021. "A text-based monitoring tool for the legitimacy and guidance of technological innovation systems," Technology in Society, Elsevier, vol. 66(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:crmide:v:8:y:2021:i:1:p:22-35. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.