IDEAS home Printed from https://ideas.repec.org/a/spr/metron/v83y2025i1d10.1007_s40300-024-00276-5.html
   My bibliography  Save this article

Neither agree nor disagree: use and misuse of the neutral response category in Likert-type scales

Author

Listed:
  • Miloš Kankaraš

    (UNESCO Mahatma Gandhi Institute of Education for Peace and Sustainable Development (MGIEP))

  • Stefania Capecchi

    (University of Naples Federico II)

Abstract

The Likert-type scales are among the most widely implemented instruments in social sciences, nonetheless, it is not clear so far whether such scales should or should not employ a mid-point “neutral” response option. While a mid-point category might improve the psychometric properties of survey instruments when appropriately applied, it has been argued that respondents often tend to use it in several invalid ways. This study aims to examine how a neutral response modality may influence the scales’ psychometric properties. We conducted two types of survey experiments employing a between-subjects and a within-subjects design, comparing psychometric properties of twelve personality scales in both cases i.e., with and without the neutral response category. Our findings show that the scales presenting the neutral category allow to some extent for better psychometric characteristics, both in terms of their reliability and with respect to the proportion of accounted variance by the first factors. Results also suggest that most respondents seem to use the neutral category validly. However, there are also indications that a minority of respondents actually employ the neutral answer as an “escape” option, especially when asked socially sensitive questions.

Suggested Citation

  • Miloš Kankaraš & Stefania Capecchi, 2025. "Neither agree nor disagree: use and misuse of the neutral response category in Likert-type scales," METRON, Springer;Sapienza Università di Roma, vol. 83(1), pages 111-140, April.
  • Handle: RePEc:spr:metron:v:83:y:2025:i:1:d:10.1007_s40300-024-00276-5
    DOI: 10.1007/s40300-024-00276-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40300-024-00276-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s40300-024-00276-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Birk Diedenhofen & Jochen Musch, 2015. "cocor: A Comprehensive Solution for the Statistical Comparison of Correlations," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-12, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anthony Evans & Willem Sleegers & Žan Mlakar, 2020. "Individual differences in receptivity to scientific bullshit," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(3), pages 401-412, May.
    2. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    3. Kevin Handtke & Lisa Richter-Beuschel & Susanne Bögeholz, 2022. "Self-Efficacy Beliefs of Teaching ESD: A Theory-Driven Instrument and the Effectiveness of ESD in German Teacher Education," Sustainability, MDPI, vol. 14(11), pages 1-32, May.
    4. Audrey Helen Linden & Thomas V Pollet & Johannes Hönekopp, 2024. "Publication bias in psychology: A closer look at the correlation between sample size and effect size," PLOS ONE, Public Library of Science, vol. 19(2), pages 1-15, February.
    5. Joseph H. Paris & Catherine Pressimone Beckowski & Sara Fiorot, 2023. "Predicting Success: An Examination of the Predictive Validity of a Measure of Motivational-Developmental Dimensions in College Admissions," Research in Higher Education, Springer;Association for Institutional Research, vol. 64(8), pages 1191-1216, December.
    6. Les Sikos & Noortje J Venhuizen & Heiner Drenhaus & Matthew W Crocker, 2021. "Reevaluating pragmatic reasoning in language games," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-33, March.
    7. S. Adil Saribay & Onurcan Yilmaz & Gülay Gözde Körpe, 2020. "Does intuitive mindset influence belief in God? A registered replication of Shenhav, Rand and Greene (2012)," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(2), pages 193-202, March.
    8. Tessa Haesevoets & Alain Van Hiel & Kim Dierckx & Chris Reinders Folmer, 2020. "Do multiple-trial games better reflect prosocial behavior than single-trial games?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(3), pages 330-345, May.
    9. Huili Sun & Rongtao Jiang & Wei Dai & Alexander J. Dufford & Stephanie Noble & Marisa N. Spann & Shi Gu & Dustin Scheinost, 2023. "Network controllability of structural connectomes in the neonatal brain," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    10. Kasemaa Antek & Suviste Reelika, 2020. "Comparing Two Instruments of Transformational Leadership," Journal of Management and Business Administration. Central Europe, Sciendo, vol. 28(1), pages 2-31, March.
    11. Dang, Hai-Anh H & Pullinger, John & Serajuddin, Umar & Stacy, Brian, 2024. "Reviewing Assessment Tools for Measuring Country Statistical Capacity," IZA Discussion Papers 16745, Institute of Labor Economics (IZA).
    12. Krishna B. S. Swamy & Hsin-Yi Lee & Carmina Ladra & Chien-Fu Jeff Liu & Jung-Chi Chao & Yi-Yun Chen & Jun-Yi Leu, 2022. "Proteotoxicity caused by perturbed protein complexes underlies hybrid incompatibility in yeast," Nature Communications, Nature, vol. 13(1), pages 1-14, December.
    13. Diana R. Sanchez & Markus Langer, 2020. "Video Game Pursuit (VGPu) Scale Development: Designing and Validating a Scale With Implications for Game-Based Learning and Assessment," Simulation & Gaming, , vol. 51(1), pages 55-86, February.
    14. Röseler, Lukas & Bögler, Hannah L. & Koßmann, Lisa & Krueger, Sabine M. & Bickenbach, Sabrina L. C. & Bühler, Ricarda & della Guardia, Jasmin & Köppel, Lisa-Marie A. & Möhring, Jarl & Ponader, Susanne, 2024. "Need for Cognition, Cognitive Load, and Forewarning do not Moderate Anchoring Effects. A Replication Study of Epley & Gilovich (Journal of Behavioral Decision Making, 2005; Psychological Science, 2006," Journal of Comments and Replications in Economics (JCRE), ZBW - Leibniz Information Centre for Economics, vol. 3, pages 1-42.
    15. Tarana Nigam & Caspar M. Schwiedrzik, 2024. "Predictions enable top-down pattern separation in the macaque face-processing hierarchy," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    16. repec:cup:judgdm:v:14:y:2019:i:5:p:535-546 is not listed on IDEAS
    17. Weihua Guo & Jiayi Tan & Lei Wang & Colt A. Egelston & Diana L. Simons & Aaron Ochoa & Min Hui Lim & Lu Wang & Shawn Solomon & James Waisman & Christina H. Wei & Caroline Hoffmann & Joo Song & Daniel , 2024. "Tumor draining lymph nodes connected to cold triple-negative breast cancers are characterized by Th2-associated microenvironment," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    18. Francesco Saldarini & Mark Cropley, 2022. "Chronic Stress Is Associated with Reduced Mindful Acceptance Skills but Not with Mindful Attention Monitoring: A Cross-Sectional Study," IJERPH, MDPI, vol. 19(18), pages 1-16, September.
    19. Chang Li & Xiaohui Huang, 2022. "Differences in Visual Attraction between Historical Garden and Urban Park Walking Scenes," Land, MDPI, vol. 11(10), pages 1-16, October.
    20. Kathrin Leppek & Gun Woo Byeon & Wipapat Kladwang & Hannah K. Wayment-Steele & Craig H. Kerr & Adele F. Xu & Do Soon Kim & Ved V. Topkar & Christian Choe & Daphna Rothschild & Gerald C. Tiu & Roger We, 2022. "Combinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics," Nature Communications, Nature, vol. 13(1), pages 1-22, December.
    21. repec:cup:judgdm:v:15:y:2020:i:2:p:193-202 is not listed on IDEAS
    22. Alan E. Stewart & Harrison E. Chapman & Jackson B. L. Davis, 2023. "Anxiety and Worry about Six Categories of Climate Change Impacts," IJERPH, MDPI, vol. 21(1), pages 1-24, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:metron:v:83:y:2025:i:1:d:10.1007_s40300-024-00276-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.