IDEAS home Printed from https://ideas.repec.org/a/eee/ijrema/v35y2018i2p258-269.html
   My bibliography  Save this article

Instructional Manipulation Checks: A longitudinal analysis with implications for MTurk

Author

Listed:
  • Paas, Leonard J.
  • Dolnicar, Sara
  • Karlsson, Logi

Abstract

Instructional Manipulation Checks (IMCs) assess respondent behavior by, for example, asking participants not to answer a trick question. We find IMCs can be used to detect problematic response behavior in longitudinal surveys. This is important because a Latent Class Analysis based on IMC-failure in the two reported studies reveals that between 9% and 12% of respondents can be labelled Inattentive Stayers at the first survey-wave and between 13% and 17% at the third wave. The tendency of Inattentive Stayers to remain in the panel is particularly relevant for online panel services such as MTurk, with workers participating in many surveys over longer time-periods. We find IMC-failure to be mitigated by a warning to respondents that their attention will be checked early in the survey, but not by repeated exposure to IMCs, or a timer leaving questions on the screen longer. Respondent personality also plays a role in IMC-failure, which implies persistency of undesirable respondent behavior.

Suggested Citation

  • Paas, Leonard J. & Dolnicar, Sara & Karlsson, Logi, 2018. "Instructional Manipulation Checks: A longitudinal analysis with implications for MTurk," International Journal of Research in Marketing, Elsevier, vol. 35(2), pages 258-269.
    • Handle: RePEc:eee:ijrema:v:35:y:2018:i:2:p:258-269
    DOI: 10.1016/j.ijresmar.2018.01.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S016781161830003X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijresmar.2018.01.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kock, Florian & Nørfelt, Astrid & Josiassen, Alexander & Assaf, A. George & Tsionas, Mike G., 2020. "Understanding the COVID-19 tourist psyche: The Evolutionary Tourism Paradigm," Annals of Tourism Research, Elsevier, vol. 85(C).
    2. Hu, Peng & Gong, Yeming & Lu, Yaobin & Ding, Amy Wenxuan, 2023. "Speaking vs. listening? Balance conversation attributes of voice assistants for better voice marketing," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 109-127.
    3. Xisi Yang & Anja Weber & Anna-Katharina Grimm, 2022. "The effects of green consumer empowerment in advertising on corporate evaluations and purchase intention: the case of organic food," Review of Managerial Science, Springer, vol. 16(6), pages 1877-1909, August.
    4. Kock, Florian & Josiassen, Alexander & Assaf, A. George, 2019. "The xenophobic tourist," Annals of Tourism Research, Elsevier, vol. 74(C), pages 155-166.
    5. Schönegger, Philipp & Verheyen, Steven, 2022. "Taking A Closer Look At The Bayesian Truth Serum: A Registered Report (Stage 2 Registered Report)," OSF Preprints 9zvqj, Center for Open Science.
    6. Ashish Varma & Adnan Khan, 2023. "Simons levers of control disentangled: A quasi-experiment into the competitiveness of hybrid firms," MANAGEMENT CONTROL, FrancoAngeli Editore, vol. 2023(2), pages 19-41.
    7. MacInnes, Sarah & Grün, Bettina & Dolnicar, Sara, 2022. "Habit drives sustainable tourist behaviour," Annals of Tourism Research, Elsevier, vol. 92(C).
    8. Leonhardt, James M. & Pezzuti, Todd & Namkoong, Jae-Eun, 2020. "We’re not so different: Collectivism increases perceived homophily, trust, and seeking user-generated product information," Journal of Business Research, Elsevier, vol. 112(C), pages 160-169.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijrema:v:35:y:2018:i:2:p:258-269. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-research-in-marketing/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.