IDEAS home Printed from https://ideas.repec.org/a/eee/teinso/v78y2024ics0160791x24001994.html
   My bibliography  Save this article

Cognitive-affective maps (CAMs) as measurement tool – Elaboration of quantitative and qualitative test-retest reliability

Author

Listed:
  • Gros, Wilhelm
  • Reuter, Lisa
  • Sprich, Julia
  • Schuldzinski, Dennis
  • Fenn, Julius
  • Kiesel, Andrea

Abstract

Cognitive-Affective Mapping is a novel mind-map like technique enabling to visually represent existing belief systems or any declarative knowledge and can therefore be used in empirical social research. It can be applied broadly, for example to assess technology acceptance, and the obtained data can be analyzed with quantitative and/or qualitative approaches. Here, we aimed for the first time to assess the data quality of Cognitive-Affective Maps (CAMs). To assess whether the findings of CAM studies are due to measurement errors or due to a real effect, we aimed for a quantitative as well as qualitative test-retest reliability approach. Participants (62 in total) drew a CAM online on their cognitions, emotions and experiences regarding the topic "Universal Basic Income" twice with delays of the two measurement time points ranging from 7 to 24 days. Assuming that the evaluation of this topic is driven by values, a stable psychological measurement construct, we presume a high test-retest reliability. Pearson's Product-Moment-Correlations and Spearman's Rank Correlations of CAM parameters show quantitative test-retest reliabilities up to 0.78. Furthermore, two raters identified on average 52 % of repeated or at least semantically similar concepts drawn by the participants between the two measurement time points. Taken together, these findings are promising for a method with this amount of degrees of freedom.

Suggested Citation

  • Gros, Wilhelm & Reuter, Lisa & Sprich, Julia & Schuldzinski, Dennis & Fenn, Julius & Kiesel, Andrea, 2024. "Cognitive-affective maps (CAMs) as measurement tool – Elaboration of quantitative and qualitative test-retest reliability," Technology in Society, Elsevier, vol. 78(C).
    • Handle: RePEc:eee:teinso:v:78:y:2024:i:c:s0160791x24001994
    DOI: 10.1016/j.techsoc.2024.102651
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0160791X24001994
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.techsoc.2024.102651?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cousse, Julia & Trutnevyte, Evelina & Hahnel, Ulf J.J., 2021. "Tell me how you feel about geothermal energy: Affect as a revealing factor of the role of seismic risk on public acceptance," Energy Policy, Elsevier, vol. 158(C).
    2. Lee Soomi, 2018. "Attitudes Toward Universal Basic Income and Welfare State in Europe: A Research Note," Basic Income Studies, De Gruyter, vol. 13(1), pages 1-9, June.
    3. Lilach Sagiv & Sonia Roccas & Jan Cieciuch & Shalom H. Schwartz, 2017. "Personal values in human life," Nature Human Behaviour, Nature, vol. 1(9), pages 630-639, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Claudia Salceanu, 2019. "The Evolution of Human Values – A Comparative Study of Values in Adolescents and Emerging Adults," Postmodern Openings, Editura Lumen, Department of Economics, vol. 10(2), pages 74-83, June.
    2. Ana Carneiro & Hélder Fernando Pedrosa e Sousa & Maria Alzira Pimenta Dinis & Ângela Leite, 2021. "Human Values and Religion: Evidence from the European Social Survey," Social Sciences, MDPI, vol. 10(2), pages 1-18, February.
    3. Valentina Socci & Dalila Talevi & Paolo Stratta & Alessandro Rossi & Francesca Pacitti & Alessia Lucaselli & Eleonora Gregori & Eleonora Quarta & Rodolfo Rossi, 2021. "Personal values in mental disorders: an exploratory analysis," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-7, December.
    4. Julia Jastrzębska & Magdalena Błażek, 2022. "Questioning Gender and Sexual Identity in the Context of Self-Concept Clarity, Sense of Coherence and Value System," IJERPH, MDPI, vol. 19(17), pages 1-10, August.
    5. Rok Črešnar & Zlatko Nedelko, 2020. "Understanding Future Leaders: How Are Personal Values of Generations Y and Z Tailored to Leadership in Industry 4.0?," Sustainability, MDPI, vol. 12(11), pages 1-19, May.
    6. R.V., Rohit & R., Vipin Raj & Kiplangat, Dennis C. & R., Veena & Jose, Rajan & Pradeepkumar, A.P. & Kumar, K. Satheesh, 2023. "Tracing the evolution and charting the future of geothermal energy research and development," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
    7. Cinzia Daraio & Alessio Vaccari, 2019. "Sorting out Guidelines for the Good Evaluation of Research Practices," DIAG Technical Reports 2019-02, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    8. Phillips, L. Taylor & Kreps, Tamar A. & Chugh, Dolly, 2024. "Different ally motivations lead to different outcomes: How self-transcendence and self-enhancement values predict effectiveness of self-identified allies," Organizational Behavior and Human Decision Processes, Elsevier, vol. 182(C).
    9. Muhammad Atif & Muhammad Shafiq & Muhammad Farooq & Gohar Ayub & Mujeeb Hussain & Muhammad Waqas, 2022. "Evolution of basic human values orientations: An application of monitoring changes in cluster solutions," PLOS ONE, Public Library of Science, vol. 17(9), pages 1-14, September.
    10. Cinzia Daraio & Alessio Vaccari, 2019. "Sorting out Guidelines for a Good Evaluation of Research Practices.Towards the Assessment of Researcher’s Virtues," DIAG Technical Reports 2019-10, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    11. Susan L. Prescott & Alan C. Logan, 2018. "From Authoritarianism to Advocacy: Lifestyle-Driven, Socially-Transmitted Conditions Require a Transformation in Medical Training and Practice," Challenges, MDPI, vol. 9(1), pages 1-29, March.
    12. Jiaqi Yang & Geetha Mohan & Kensuke Fukushi, 2020. "An Analysis of the Factors Influencing Public Attitudes toward Implementing Basic Income (BI) from an Individual Perspective: A Case Study of Hokuriku Region, Japan," Societies, MDPI, vol. 10(3), pages 1-18, July.
    13. Janelle Knox‐Hayes & Shekhar Chandra & Jungwoo Chun, 2021. "The role of values in shaping sustainable development perspectives and outcomes: A case study of Iceland," Sustainable Development, John Wiley & Sons, Ltd., vol. 29(2), pages 363-377, March.
    14. Agnes Hofmeister-Tóth & Agnes Neulinger, 2022. "The Importance and Realization of Personal Values and Cognitive Age," Tržište/Market, Faculty of Economics and Business, University of Zagreb, vol. 34(1), pages 25-40.
    15. Eddie W. L. Cheng, 2022. "Revisiting the Concept of Values Taught in Education through Carroll’s Corporate Social Responsibility," Sustainability, MDPI, vol. 14(18), pages 1-14, September.
    16. Črešnar Rok & Jevšenak Senta, 2019. "The Millennials’ Effect: How Can Their Personal Values Shape the Future Business Environment of Industry 4.0?," Naše gospodarstvo/Our economy, Sciendo, vol. 65(1), pages 57-65, March.
    17. Huijts, Nicole M.A. & Contzen, Nadja & Roeser, Sabine, 2022. "Unequal means more unfair means more negative emotions? Ethical concerns and emotions about an unequal distribution of negative outcomes of a local energy project," Energy Policy, Elsevier, vol. 165(C).
    18. Sarah Williams & David F. Murphy, 2023. "Learning from Each Other: UK Global Businesses, SMEs, CSR and the Sustainable Development Goals (SDGs)," Sustainability, MDPI, vol. 15(5), pages 1-17, February.
    19. Sasse, Jan-Philipp & Trutnevyte, Evelina, 2023. "Cost-effective options and regional interdependencies of reaching a low-carbon European electricity system in 2035," Energy, Elsevier, vol. 282(C).
    20. Dabić, Marina & Maley, Jane F. & Črešnar, Rok & Nedelko, Zlatko, 2023. "Unappreciated channel of manufacturing productivity under industry 4.0: Leadership values and capabilities," Journal of Business Research, Elsevier, vol. 162(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:teinso:v:78:y:2024:i:c:s0160791x24001994. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/technology-in-society .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.