IDEAS home Printed from https://ideas.repec.org/a/eee/teinso/v67y2021ics0160791x21002633.html

Verifying online information: Development and validation of a self-report scale

Author

Listed:
  • Tifferet, Sigal

Abstract

Misinformation endangers democracy, science, and rational behavior. Verifying information and recognizing misinformation are critical skills, but there are few measures of these abilities. To help close this gap, we developed and validated the Verifying Online Information (VOI) self-report scale, which assesses individual differences in online information verification. Two study samples were collected through Amazon Mechanical Turk (N = 958). In Study 1, exploratory factor analysis suggested a 22-item scale (VOI-22; α = 0.95) with two underlying factors: direct and indirect verification of online information. In Study 2, the bifactor model was affirmed using confirmatory factor analysis. Convergent validity was demonstrated with the positive factor Need for Cognition, and discriminant validity was demonstrated with social desirability. Two abbreviated scales (with three and seven items) were also created and validated using genetic algorithms. VOI will allow researchers and educators to evaluate behaviors associated with verifying online information, making it a critical tool in the fight against misinformation.

Suggested Citation

  • Tifferet, Sigal, 2021. "Verifying online information: Development and validation of a self-report scale," Technology in Society, Elsevier, vol. 67(C).
    • Handle: RePEc:eee:teinso:v:67:y:2021:i:c:s0160791x21002633
    DOI: 10.1016/j.techsoc.2021.101788
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160791X21002633
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techsoc.2021.101788?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Paolacci, Gabriele & Chandler, Jesse & Ipeirotis, Panagiotis G., 2010. "Running experiments on Amazon Mechanical Turk," Judgment and Decision Making, Cambridge University Press, vol. 5(5), pages 411-419, August.
    2. Dietram A. Scheufele & Nicole M. Krause, 2019. "Science audiences, misinformation, and fake news," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 116(16), pages 7662-7669, April.
    3. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    4. Ulrich Schroeders & Oliver Wilhelm & Gabriel Olaru, 2016. "Meta-Heuristics in Short Scale Construction: Ant Colony Optimization and Genetic Algorithm," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-19, November.
    5. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," NBER Working Papers 23089, National Bureau of Economic Research, Inc.
    6. Matthew J C Crump & John V McDonnell & Todd M Gureckis, 2013. "Evaluating Amazon's Mechanical Turk as a Tool for Experimental Behavioral Research," PLOS ONE, Public Library of Science, vol. 8(3), pages 1-18, March.
    7. Apuke, Oberiri Destiny & Omar, Bahiyah, 2021. "The ethical challenges and issues of online journalism practice in Nigeria: What do professionals and academics think?," Technology in Society, Elsevier, vol. 67(C).
    8. Xijuan Zhang & Ramsha Noor & Victoria Savalei, 2016. "Examining the Effect of Reverse Worded Items on the Factor Structure of the Need for Cognition Scale," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-15, June.
    9. Gordon Pennycook & James Allan Cheyne & Nathaniel Barr & Derek J. Koehler & Jonathan A. Fugelsang, 2015. "On the reception and detection of pseudo-profound bullshit," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(6), pages 549-563, November.
    10. Berinsky, Adam J., 2017. "Rumors and Health Care Reform: Experiments in Political Misinformation," British Journal of Political Science, Cambridge University Press, vol. 47(2), pages 241-262, April.
    11. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 211-236, Spring.
    12. Gabriele Paolacci & Jesse Chandler & Panagiotis G. Ipeirotis, 2010. "Running experiments on Amazon Mechanical Turk," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 5(5), pages 411-419, August.
    13. Rosseel, Yves, 2012. "lavaan: An R Package for Structural Equation Modeling," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 48(i02).
    14. Ana I. Bento & Thuy Nguyen & Coady Wing & Felipe Lozano-Rojas & Yong-Yeol Ahn & Kosali Simon, 2020. "Evidence from internet search data shows information-seeking responses to news of local COVID-19 cases," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(21), pages 11220-11222, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dong, Qingxing & Xiong, Siyue & Zhang, Mengyi, 2024. "Remedial behavior for misinformation: A moderated mediation model of remedial attitude and perceived consequence severity," Technology in Society, Elsevier, vol. 77(C).
    2. Li, Yunjian & Song, Yixiao & Sun, Yanming & Zeng, Mingzhuo, 2024. "When do employees learn from artificial intelligence? The moderating effects of perceived enjoyment and task-related complexity," Technology in Society, Elsevier, vol. 77(C).
    3. Raj, Chahat & Meel, Priyanka, 2022. "People lie, actions Don't! Modeling infodemic proliferation predictors among social media users," Technology in Society, Elsevier, vol. 68(C).
    4. Shixiong Wang & Fangfang Su & Lu Ye & Yuan Jing, 2022. "Disinformation: A Bibliometric Review," IJERPH, MDPI, vol. 19(24), pages 1-21, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ronayne, David & Sgroi, Daniel & Tuckwell, Anthony, 2021. "Evaluating the sunk cost effect," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 318-327.
    2. Assenza, Tiziana, 2021. "The Ability to 'Distill the Truth'," TSE Working Papers 21-1280, Toulouse School of Economics (TSE), revised Mar 2022.
    3. Gandullia, Luca & Lezzi, Emanuela & Parciasepe, Paolo, 2020. "Replication with MTurk of the experimental design by Gangadharan, Grossman, Jones & Leister (2018): Charitable giving across donor types," Journal of Economic Psychology, Elsevier, vol. 78(C).
    4. Prissé, Benjamin & Jorrat, Diego, 2022. "Lab vs online experiments: No differences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    5. Giandomenico Domenico & Annamaria Tuan & Marco Visentin, 2021. "Linguistic drivers of misinformation diffusion on social media during the COVID-19 pandemic," Italian Journal of Marketing, Springer, vol. 2021(4), pages 351-369, December.
    6. Michael Thaler, 2021. "The Supply of Motivated Beliefs," Papers 2111.06062, arXiv.org, revised Sep 2023.
    7. Sven Gruener, 2024. "Determinants of Gullibility to Misinformation: A Study of Climate Change, COVID-19 and Artificial Intelligence," Journal of Interdisciplinary Economics, , vol. 36(1), pages 58-78, January.
    8. Buser, Thomas, 2024. "Adversarial Economic Preferences Predict Right-Wing Voting," IZA Discussion Papers 16711, Institute of Labor Economics (IZA).
    9. Henkens, Bieke & Verleye, Katrien & Larivière, Bart, 2021. "The smarter, the better?! Customer well-being, engagement, and perceptions in smart service systems," International Journal of Research in Marketing, Elsevier, vol. 38(2), pages 425-447.
    10. Tiziana Assenza & Alberto Cardaci & Stefanie Huber, 2024. "Fake News: Susceptibility, Awareness, and Solutions," ECONtribute Policy Brief Series 065, University of Bonn and University of Cologne, Germany.
    11. Schwaiger, Rene & Hueber, Laura, 2021. "Do MTurkers exhibit myopic loss aversion?," Economics Letters, Elsevier, vol. 209(C).
    12. Jiexun Li & Xiaohui Chang, 2023. "Combating Misinformation by Sharing the Truth: a Study on the Spread of Fact-Checks on Social Media," Information Systems Frontiers, Springer, vol. 25(4), pages 1479-1493, August.
    13. Palan, Stefan & Schitter, Christian, 2018. "Prolific.ac—A subject pool for online experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 17(C), pages 22-27.
    14. Van Borm, Hannah & Burn, Ian & Baert, Stijn, 2021. "What Does a Job Candidate's Age Signal to Employers?," Labour Economics, Elsevier, vol. 71(C).
    15. David G Rand & Gordon Kraft-Todd & June Gruber, 2015. "The Collective Benefits of Feeling Good and Letting Go: Positive Emotion and (dis)Inhibition Interact to Predict Cooperative Behavior," PLOS ONE, Public Library of Science, vol. 10(1), pages 1-12, January.
    16. Rene Schwaiger & Laura Hueber, 2021. "Do MTurkers Exhibit Myopic Loss Aversion?," Working Papers 2021-12, Faculty of Economics and Statistics, Universität Innsbruck.
    17. Ma-Kellams, Christine & Lerner, Jennifer S., 2016. "Trust Your Gut or Think Carefully? Examining Whether an Intuitive versus a Systematic Mode of Thought Produces Greater Empathic Accuracy," Working Paper Series 16-017, Harvard University, John F. Kennedy School of Government.
    18. Vicente Javier Clemente-Suárez & Eduardo Navarro-Jiménez & Juan Antonio Simón-Sanjurjo & Ana Isabel Beltran-Velasco & Carmen Cecilia Laborde-Cárdenas & Juan Camilo Benitez-Agudelo & Álvaro Bustamante-, 2022. "Mis–Dis Information in COVID-19 Health Crisis: A Narrative Review," IJERPH, MDPI, vol. 19(9), pages 1-24, April.
    19. Gruener, Sven, 2020. "Identifying and debunking environmental-related false news stories—An experimental study," SocArXiv zmx5p, Center for Open Science.
    20. Acar-Burkay, Sinem & Cristian, Daniela-Carmen, 2022. "Cognitive underpinnings of COVID-19 vaccine hesitancy," Social Science & Medicine, Elsevier, vol. 301(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:teinso:v:67:y:2021:i:c:s0160791x21002633. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/technology-in-society .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.