IDEAS home Printed from https://ideas.repec.org/a/kap/mktlet/v29y2018i1d10.1007_s11002-018-9448-7.html
   My bibliography  Save this article

PLease do not answer if you are reading this: respondent attention in online panels

Author

Listed:
  • Leonard J. Paas

    (Massey University Albany)

  • Meike Morren

    (VU University Amsterdam)

Abstract

This paper reports on the relevance of attention checks for online panels, e.g., M-Turk, SurveyMonkey, SmartSurvey, QualTrics. In two SmartSurvey studies approximately one third of the respondents failed a check that instructed them to skip the question. Attention-enhancing tools reduce this to approximately one fifth. The failure rate is not affected by replacing multiple-item scales with single-item measures. We find that failing the attention check relates to other attention indicators and that decreased attention levels often apply across the length of the survey. In support of relevance, our empirical findings show respondent inattentiveness systematically biases survey responses.

Suggested Citation

  • Leonard J. Paas & Meike Morren, 2018. "PLease do not answer if you are reading this: respondent attention in online panels," Marketing Letters, Springer, vol. 29(1), pages 13-21, March.
    • Handle: RePEc:kap:mktlet:v:29:y:2018:i:1:d:10.1007_s11002-018-9448-7
    DOI: 10.1007/s11002-018-9448-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11002-018-9448-7
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11002-018-9448-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Raj Echambadi & James D. Hess, 2007. "Mean-Centering Does Not Alleviate Collinearity Problems in Moderated Multiple Regression Models," Marketing Science, INFORMS, vol. 26(3), pages 438-445, 05-06.
    2. Wagner Kamakura, 2015. "Measure twice and cut once: the carpenter’s rule still applies," Marketing Letters, Springer, vol. 26(3), pages 237-243, September.
    3. van Herk, H. & Poortinga, Y.H. & Verhallen, T.M.M., 2004. "Response styles in rating scales : Evidence of method bias in data from 6 EU countries," Other publications TiSEM c8befc7a-f2f4-44cf-b2fc-b, Tilburg University, School of Economics and Management.
    4. Michael Barone & Keith Lyle & Karen Winterich, 2015. "When deal depth doesn't matter: How handedness consistency influences consumer response to horizontal versus vertical price comparisons," Marketing Letters, Springer, vol. 26(2), pages 213-223, June.
    5. Holbrook, Morris B & Batra, Rajeev, 1987. "Assessing the Role of Emotions as Mediators of Consumer Responses to Advertising," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 14(3), pages 404-420, December.
    6. Emrich, Oliver & Verhoef, Peter C., 2015. "The impact of a homogenous versus a prototypical Web design on online retail patronage for multichannel providers," International Journal of Research in Marketing, Elsevier, vol. 32(4), pages 363-374.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Baier-Fuentes, Hugo & Andrade-Valbuena, Nelson A. & Huertas Gonzalez-Serrano, Maria & Gaviria-Marin, Magaly, 2023. "Bricolage as an effective tool for the survival of owner-managed SMEs during crises," Journal of Business Research, Elsevier, vol. 157(C).
    2. Carol Azab & Jonas Holmqvist, 2022. "Discrimination in Services: How Service Recovery Efforts Change with Customer Accent," Journal of Business Ethics, Springer, vol. 180(1), pages 355-372, September.
    3. Sam Fullerton & Tammy McCullough, 2023. "Using quality control checks to overcome pitfalls in the collection of primary data via online platforms," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(4), pages 602-612, December.
    4. Burdea, Valeria & Woon, Jonathan, 2022. "Online belief elicitation methods," Journal of Economic Psychology, Elsevier, vol. 90(C).
    5. Alessandro Gandolfo, 2021. "The Drawbacks of the Digital Transition of Marketing Research: Implications for Decision Makers and the Industry," International Journal of Marketing Studies, Canadian Center of Science and Education, vol. 13(3), pages 1-9, December.
    6. Kostyk, Alena & Zhou, Wenkai & Hyman, Michael R., 2019. "Using surveytainment to counter declining survey data quality," Journal of Business Research, Elsevier, vol. 95(C), pages 211-219.
    7. Ruixuan Jiang & Thomas Kohlmann & Todd A. Lee & Axel Mühlbacher & James Shaw & Surrey Walton & A. Simon Pickard, 2021. "Increasing respondent engagement in composite time trade-off tasks by imposing three minimum trade-offs to improve data quality," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 22(1), pages 17-33, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Denise Janssen & Leonard Paas, 2014. "Moderately thin advertising models are optimal, most of the time: Moderating the quadratic effect of model body size on ad attitude by fashion leadership," Marketing Letters, Springer, vol. 25(2), pages 167-177, June.
    2. Sergio Cesare Masin & Michele Vicovaro, 2023. "Sources of uncertainty in functional measurement methodology," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(2), pages 1185-1205, April.
    3. Neslin, Scott A., 2022. "The omnichannel continuum: Integrating online and offline channels along the customer journey," Journal of Retailing, Elsevier, vol. 98(1), pages 111-132.
    4. Garaus, Marion & Hudáková, Melánia, 2022. "The impact of the COVID-19 pandemic on tourists’ air travel intentions: The role of perceived health risk and trust in the airline," Journal of Air Transport Management, Elsevier, vol. 103(C).
    5. Jong-Woo Jun & Jun-Hyuk Cho & Ji-Hoon Lee, 2021. "Why Do Koreans Love Ethnic Players in the MLB? A Focus on Ethnic Identity and Player Identification," Sustainability, MDPI, vol. 13(23), pages 1-10, November.
    6. Schilling, Melissa A. & Green, Elad, 2011. "Recombinant search and breakthrough idea generation: An analysis of high impact papers in the social sciences," Research Policy, Elsevier, vol. 40(10), pages 1321-1331.
    7. Karoline Gamma & Robert Mai & Moritz Loock, 2020. "The Double-Edged Sword of Ethical Nudges: Does Inducing Hypocrisy Help or Hinder the Adoption of Pro-environmental Behaviors?," Journal of Business Ethics, Springer, vol. 161(2), pages 351-373, January.
    8. Septianto, Felix & Ye, Sheng & Northey, Gavin, 2021. "The effectiveness of advertising images in promoting experiential offerings: An emotional response approach," Journal of Business Research, Elsevier, vol. 122(C), pages 344-352.
    9. Wang, Jessie J. & Lalwani, Ashok K. & DelVecchio, Devon, 2022. "The Impact of Power Distance Belief on Consumers' Brand Preferences," International Journal of Research in Marketing, Elsevier, vol. 39(3), pages 804-823.
    10. Frauke Sander & Ulrich Föhl & Nadine Walter & Vera Demmer, 2021. "Green or social? An analysis of environmental and social sustainability advertising and its impact on brand personality, credibility and attitude," Journal of Brand Management, Palgrave Macmillan, vol. 28(4), pages 429-445, July.
    11. Muhammad Abdullah Khan & Usman Ghani & Sadia Aziz, 2019. "Impact of Islamic Religiosity on Consumers’ Attitudes towards Islamic and Conventional ways of Advertisements, Attitude towards Brands and Purchase Intentions," Business & Economic Review, Institute of Management Sciences, Peshawar, Pakistan, vol. 11(1), pages 1-30, March.
    12. Lee, Seunghwan & Kim, Yukyoum & Heere, Bob, 2018. "Sport team emotion: Conceptualization, scale development and validation," Sport Management Review, Elsevier, vol. 21(4), pages 363-376.
    13. Shir-Way Siew & Michael S. Minor & Reto Felix, 2018. "The influence of perceived strength of brand origin on willingness to pay more for luxury goods," Journal of Brand Management, Palgrave Macmillan, vol. 25(6), pages 591-605, November.
    14. Antioco, Michael & Coussement, Kristof & Fletcher-Chen, Chavi Chi-Yun & Prange, Christiane, 2023. "What's in a word? Adopting a linguistic-style analysis of western MNCs’ global press releases," Journal of World Business, Elsevier, vol. 58(2).
    15. Chaudhuri, Arjun & Ligas, Mark, 2009. "Consequences of Value in Retail Markets," Journal of Retailing, Elsevier, vol. 85(3), pages 406-419.
    16. Kristina Ročkutė & Inga Minelgaitė & Ligita Zailskaitė-Jakštė & Robertas Damaševičius, 2018. "Brand Awareness in the Context of Mistrust: The Case Study of an Employment Agency," Sustainability, MDPI, vol. 10(3), pages 1-13, March.
    17. María del Mar García‐De los Salmones & Andrea Perez, 2018. "Effectiveness of CSR Advertising: The Role of Reputation, Consumer Attributions, and Emotions," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 25(2), pages 194-208, March.
    18. Jing Zhang & Justin Tan & Poh Wong, 2015. "When does investment in political ties improve firm performance? The contingent effect of innovation activities," Asia Pacific Journal of Management, Springer, vol. 32(2), pages 363-387, June.
    19. Thaddeus Neururer & George Papadakis & Edward J. Riedl, 2016. "Tests of investor learning models using earnings innovations and implied volatilities," Review of Accounting Studies, Springer, vol. 21(2), pages 400-437, June.
    20. Shan, Minghui & Zhu, Zhenzhong & Song, Chunlei & Chen, Haipeng (Allan), 2023. "The effectiveness of advertising appeals: A culturally-derived power perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:mktlet:v:29:y:2018:i:1:d:10.1007_s11002-018-9448-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.