IDEAS home Printed from https://ideas.repec.org/a/eee/ijrema/v38y2021i1p85-103.html
   My bibliography  Save this article

Extremity in horizontal and vertical Likert scale format responses. Some evidence on how visual distance between response categories influences extreme responding

Author

Listed:
  • Weijters, Bert
  • Millet, Kobe
  • Cabooter, Elke

Abstract

In four survey experiments we show that people generally answer more extremely to survey items presented in vertical versus horizontal Likert formats. Our findings suggest that this effect may be at least partly driven by differences in the visual range spanned by the response scale (i.e. the visual distance between endpoint response categories is larger in horizontal than in a vertical format). In addition, compared to traditional horizontal Likert data, vertical Likert data contain more variance, which is mainly non-substantive. As a result, data obtained with scale formats that have different distances between response categories (as is typically the case for vertical vs. horizontal formats) may lead to differences in measurement model parameter estimates like residual terms, and in some cases factor loadings and construct correlations. Based on these results, we provide recommendations on the use of response scale formats in online surveys, bearing in mind that several online survey tool providers promote the use of vertical Likert formats and even automatically change traditional horizontal formats of Likert-type items to vertical Likert formats when viewed on small screens (e.g., on mobile phones).

Suggested Citation

  • Weijters, Bert & Millet, Kobe & Cabooter, Elke, 2021. "Extremity in horizontal and vertical Likert scale format responses. Some evidence on how visual distance between response categories influences extreme responding," International Journal of Research in Marketing, Elsevier, vol. 38(1), pages 85-103.
    • Handle: RePEc:eee:ijrema:v:38:y:2021:i:1:p:85-103
    DOI: 10.1016/j.ijresmar.2020.04.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167811620300367
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijresmar.2020.04.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Weijters, Bert & Cabooter, Elke & Schillewaert, Niels, 2010. "The effect of rating scale format on response styles: The number of response categories and response category labels," International Journal of Research in Marketing, Elsevier, vol. 27(3), pages 236-247.
    2. Babin, Barry J & Darden, William R & Griffin, Mitch, 1994. "Work and/or Fun: Measuring Hedonic and Utilitarian Shopping Value," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 20(4), pages 644-656, March.
    3. Holbrook, Morris B, 1993. "Nostalgia and Consumption Preferences: Some Emerging Patterns of Consumer Tastes," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 20(2), pages 245-256, September.
    4. Richins, Marsha L, 1983. "An Analysis of Consumer Interaction Styles in the Marketplace," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 10(1), pages 73-82, June.
    5. Hans Baumgartner & Bert Weijters, 2017. "Measurement Models for Marketing Constructs," International Series in Operations Research & Management Science, in: Berend Wierenga & Ralf van der Lans (ed.), Handbook of Marketing Decision Models, edition 2, chapter 0, pages 259-295, Springer.
    6. Vera Toepoel & Corrie Vis & Marcel Das & Arthur van Soest, 2009. "Design of Web Questionnaires," Sociological Methods & Research, , vol. 37(3), pages 371-392, February.
    7. John Hulland & Hans Baumgartner & Keith Marion Smith, 2018. "Marketing survey research best practices: evidence and recommendations from a review of JAMS articles," Journal of the Academy of Marketing Science, Springer, vol. 46(1), pages 92-108, January.
    8. Bert Weijters & Maggie Geuens & Hans Baumgartner, 2013. "The Effect of Familiarity with the Response Category Labels on Item Response to Likert Scales," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 40(2), pages 368-381.
    9. Cabooter, Elke & Weijters, Bert & Geuens, Maggie & Vermeir, Iris, 2016. "Scale format effects on response option interpretation and use," Journal of Business Research, Elsevier, vol. 69(7), pages 2574-2584.
    10. Steenkamp, Jan-Benedict E M & Baumgartner, Hans, 1998. "Assessing Measurement Invariance in Cross-National Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 25(1), pages 78-90, June.
    11. Ahmed, Sadrudin A & Jackson, Douglas N, 1979. "Psychographics for Social Policy Decisions: Welfare Assistance," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 5(4), pages 229-239, March.
    12. Seymour, Daniel & Lessne, Greg, 1984. "Spousal Conflict Arousal: Scale Development," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 11(3), pages 810-821, December.
    13. Janiszewski, Chris & Silk, Tim & Cooke, Alan D J, 2003. "Different Scales for Different Frames: The Role of Subjective Scales and Experience in Explaining Attribute-Framing Effects," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 30(3), pages 311-325, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tiberius, Victor & Gojowy, Robin & Dabić, Marina, 2022. "Forecasting the future of robo advisory: A three-stage Delphi study on economic, technological, and societal implications," Technological Forecasting and Social Change, Elsevier, vol. 182(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weijters, Bert & Baumgartner, Hans & Geuens, Maggie, 2016. "The calibrated sigma method: An efficient remedy for between-group differences in response category use on Likert scales," International Journal of Research in Marketing, Elsevier, vol. 33(4), pages 944-960.
    2. Elke Cabooter & Bert Weijters & Alain Beuckelaer & Eldad Davidov, 2017. "Is extreme response style domain specific? Findings from two studies in four countries," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(6), pages 2605-2622, November.
    3. Piotr Cichocki & Piotr Jabkowski, 2023. "Response scale overstretch: linear stretching of response scales does not ensure cross-project equivalence in harmonised data," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(4), pages 3729-3745, August.
    4. Lloyd, Alison E. & Yip, Leslie S.C. & Luk, Sherriff T.K., 2011. "An examination of the differences in retail service evaluation between domestic and tourist shoppers in Hong Kong," Tourism Management, Elsevier, vol. 32(3), pages 520-533.
    5. Frank, Björn & Herbas-Torrico, Boris & Schvaneveldt, Shane J., 2021. "The AI-extended consumer: Technology, consumer, country differences in the formation of demand for AI-empowered consumer products," Technological Forecasting and Social Change, Elsevier, vol. 172(C).
    6. Zhou, Joyce Xin & Arnold, Mark J. & Pereira, Arun & Yu, Jun, 2010. "Chinese consumer decision-making styles: A comparison between the coastal and inland regions," Journal of Business Research, Elsevier, vol. 63(1), pages 45-51, January.
    7. Li, Jie & Huddleston, Patricia & Minahan, Stella, 2021. "International retail format transfer: A comparison study of Australian and U.S. warehouse club members," Journal of Retailing and Consumer Services, Elsevier, vol. 59(C).
    8. Cabooter, Elke & Weijters, Bert & Geuens, Maggie & Vermeir, Iris, 2016. "Scale format effects on response option interpretation and use," Journal of Business Research, Elsevier, vol. 69(7), pages 2574-2584.
    9. Jan-Benedict E. M. Steenkamp & Alberto Maydeu-Olivares, 2023. "Unrestricted factor analysis: A powerful alternative to confirmatory factor analysis," Journal of the Academy of Marketing Science, Springer, vol. 51(1), pages 86-113, January.
    10. Stokburger-Sauer, Nicola & Ratneshwar, S. & Sen, Sankar, 2012. "Drivers of consumer–brand identification," International Journal of Research in Marketing, Elsevier, vol. 29(4), pages 406-418.
    11. Paurav Shukla & Jaywant Singh & Madhumita Banerjee, 2015. "They are not all same: variations in Asian consumers’ value perceptions of luxury brands," Marketing Letters, Springer, vol. 26(3), pages 265-278, September.
    12. Tyrväinen, Olli & Karjaluoto, Heikki & Saarijärvi, Hannu, 2020. "Personalization and hedonic motivation in creating customer experiences and loyalty in omnichannel retail," Journal of Retailing and Consumer Services, Elsevier, vol. 57(C).
    13. Babin, Barry J. & Griffin, Mitch & Borges, Adilson & Boles, James S., 2013. "Negative emotions, value and relationships: Differences between women and men," Journal of Retailing and Consumer Services, Elsevier, vol. 20(5), pages 471-478.
    14. Ford, John B. & Merchant, Altaf & Bartier, Anne-Laure & Friedman, Mike, 2018. "The cross-cultural scale development process: The case of brand-evoked nostalgia in Belgium and the United States," Journal of Business Research, Elsevier, vol. 83(C), pages 19-29.
    15. Manfred Bruhn & Verena Schoenmüller & Daniela Schäfer & Simon Reumer, 2012. "Markenintimität (Brand Intimacy) von Konsumenten — Konzeptualisierung, Determinanten und Wirkungen, mit empirischen Befunden," Schmalenbach Journal of Business Research, Springer, vol. 64(6), pages 590-629, September.
    16. Klein, Jan F. & Falk, Tomas & Esch, Franz-Rudolf & Gloukhovtsev, Alexei, 2016. "Linking pop-up brand stores to brand experience and word of mouth: The case of luxury retail," Journal of Business Research, Elsevier, vol. 69(12), pages 5761-5767.
    17. Sasichakorn Wongsaichia & Phaninee Naruetharadhol & Johannes Schrank & Premchai Phoomsom & Kanjakhon Sirisoonthonkul & Vorrapol Paiyasen & Sedthawut Srichaingwang & Chavis Ketkaew, 2022. "Influences of Green Eating Behaviors Underlying the Extended Theory of Planned Behavior: A Study of Market Segmentation and Purchase Intention," Sustainability, MDPI, vol. 14(13), pages 1-20, July.
    18. Tellis, Gerard J. & Chandrasekaran, Deepa, 2010. "Extent and impact of response biases in cross-national survey research," International Journal of Research in Marketing, Elsevier, vol. 27(4), pages 329-341.
    19. de Rezende, Naia A. & de Medeiros, Denise D., 2022. "How rating scales influence responses’ reliability, extreme points, middle point and respondent’s preferences," Journal of Business Research, Elsevier, vol. 138(C), pages 266-274.
    20. Christina Kuehnl & Danijel Jozic & Christian Homburg, 2019. "Effective customer journey design: consumers’ conception, measurement, and consequences," Journal of the Academy of Marketing Science, Springer, vol. 47(3), pages 551-568, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijrema:v:38:y:2021:i:1:p:85-103. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-research-in-marketing/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.