IDEAS home Printed from https://ideas.repec.org/a/pal/jmarka/v9y2021i2d10.1057_s41270-021-00105-y.html
   My bibliography  Save this article

The impact of questionnaire length on the accuracy rate of online surveys

Author

Listed:
  • Takumi Kato

    (Saitama University)

  • Taro Miura

    (Intage Inc.)

Abstract

Online surveys have the advantages of affordability and speedy collection; however, there have been some concerns about their response quality. Previous studies have measured response quality using nonresponse rate and biased choice behavior. However, it is difficult to detect defective respondents who are randomly selected without careful consideration by using those indicators. Therefore, this study measured the accuracy rate as an index of response quality using a questionnaire with questions for which possible answers were provided. Questionnaire length was found to have a negative effect on response rate but no significant effect on the accuracy rate. In addition, considering the response device, surveys from smartphone users have a lower accuracy rate than surveys from personal computer users. Lastly, respondents who have a response rate faster than 10 seconds per question have a lower accuracy rate. It is important to understand the factors that affect response quality and to design surveys accordingly.

Suggested Citation

  • Takumi Kato & Taro Miura, 2021. "The impact of questionnaire length on the accuracy rate of online surveys," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(2), pages 83-98, June.
    • Handle: RePEc:pal:jmarka:v:9:y:2021:i:2:d:10.1057_s41270-021-00105-y
    DOI: 10.1057/s41270-021-00105-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41270-021-00105-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1057/s41270-021-00105-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Elisabeth Deutskens & Ko de Ruyter & Martin Wetzels & Paul Oosterveld, 2004. "Response Rate and Response Quality of Internet-Based Surveys: An Experimental Study," Marketing Letters, Springer, vol. 15(1), pages 21-36, February.
    2. Sauermann, Henry & Roach, Michael, 2013. "Increasing web survey response rates in innovation research: An experimental study of static and dynamic contact design features," Research Policy, Elsevier, vol. 42(1), pages 273-286.
    3. Kostyk, Alena & Zhou, Wenkai & Hyman, Michael R., 2019. "Using surveytainment to counter declining survey data quality," Journal of Business Research, Elsevier, vol. 95(C), pages 211-219.
    4. Pushkin Kachroo & Sheen Kachen, 2018. "Item placement for questionnaire design for optimal reliability," Journal of Marketing Analytics, Palgrave Macmillan, vol. 6(4), pages 120-126, December.
    5. Takumi Kato & Noriko Kishida & Takahiko Umeyama & Yuexian Jin & Kazuhiko Tsuda, 2020. "A random extraction method with high market representation for online surveys," International Journal of Business Innovation and Research, Inderscience Enterprises Ltd, vol. 22(4), pages 569-584.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rolf Becker, 2023. "Short- and long-term effects of reminders on panellists’ survey participation in a probability-based panel study with a sequential mixed-mode design," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(5), pages 4095-4119, October.
    2. Jian Han & Miaodan Fang & Shenglu Ye & Chuansheng Chen & Qun Wan & Xiuying Qian, 2019. "Using Decision Tree to Predict Response Rates of Consumer Satisfaction, Attitude, and Loyalty Surveys," Sustainability, MDPI, vol. 11(8), pages 1-13, April.
    3. Vecchio, Riccardo & Caso, Gerarda & Cembalo, Luigi & Borrello, Massimiliano, 2020. "Is respondents’ inattention in online surveys a major issue for research?," Economia agro-alimentare / Food Economy, Italian Society of Agri-food Economics/Società Italiana di Economia Agro-Alimentare (SIEA), vol. 22(1), March.
    4. Srinivasan, V. Seenu & Netzer, Oded, 2007. "Adaptive Self-Explication of Multi-attribute Preferences," Research Papers 1979, Stanford University, Graduate School of Business.
    5. Tatsushi Fukaya & Masayuki Suzuki & Ikumi Ozawa & Takumi Nakagoshi, 2022. "An Examination of Related Factors of Mathematical Pedagogical Content Knowledge in Elementary School Teachers: Focusing on Conceptions of Teaching and Learning and Test Utilization Strategy," SAGE Open, , vol. 12(4), pages 21582440221, October.
    6. Christoph Markmann & Alexander Spickermann & Heiko A. von der Gracht & Alexander Brem, 2021. "Improving the question formulation in Delphi‐like surveys: Analysis of the effects of abstract language and amount of information on response behavior," Futures & Foresight Science, John Wiley & Sons, vol. 3(1), March.
    7. Abrardi Laura & Grinza Elena & Manello Alessandro & Porta Flavio, 2022. "Work From Home Arrangements and Organizational Performance in Italian SMEs: Evidence from the COVID-19 Pandemic," Working papers 076, Department of Economics and Statistics (Dipartimento di Scienze Economico-Sociali e Matematico-Statistiche), University of Torino.
    8. Lusk, Jayson L., 2012. "The political ideology of food," Food Policy, Elsevier, vol. 37(5), pages 530-542.
    9. Vahid Sobhani & Mohammadjavad Rostamizadeh & Seyed Morteza Hosseini & Seyed Ebrahim Hashemi & Ignacio Refoyo Román & Daniel Mon-López, 2022. "Anthropometric, Physiological, and Psychological Variables That Determine the Elite Pistol Performance of Women," IJERPH, MDPI, vol. 19(3), pages 1-10, January.
    10. Barbara Ryan & Rachel King, 2020. "How ready is ready? Measuring physical preparedness for severe storms," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 104(1), pages 171-199, October.
    11. Yang Liu & Jan Hannig & Abhishek Pal Majumder, 2019. "Second-Order Probability Matching Priors for the Person Parameter in Unidimensional IRT Models," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 701-718, September.
    12. Elisabeth Deutskens & Ad Jong & Ko Ruyter & Martin Wetzels, 2006. "Comparing the generalizability of online and mail surveys in cross-national service quality research," Marketing Letters, Springer, vol. 17(2), pages 119-136, April.
    13. Giancarlo Condello & Laura Capranica & Mojca Doupona & Kinga Varga & Verena Burk, 2019. "Dual-career through the elite university student-athletes’ lenses: The international FISU-EAS survey," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-18, October.
    14. María del Mar Serrano-Arcos & Raquel Sánchez-Fernández & Juan Carlos Pérez-Mesa, 2021. "Analysis of Product-Country Image from Consumer’s Perspective: The Impact of Subjective Knowledge, Perceived Risk and Media Influence," Sustainability, MDPI, vol. 13(4), pages 1-25, February.
    15. Björn Hofman & Gerdien de Vries & Geerten van de Kaa, 2022. "Keeping Things as They Are: How Status Quo Biases and Traditions along with a Lack of Information Transparency in the Building Industry Slow Down the Adoption of Innovative Sustainable Technologies," Sustainability, MDPI, vol. 14(13), pages 1-20, July.
    16. Lafrenière, Darquise & Hurlimann, Thierry & Menuz, Vincent & Godard, Béatrice, 2014. "Evaluation of a cartoon-based knowledge dissemination intervention on scientific and ethical challenges raised by nutrigenomics/nutrigenetics research," Evaluation and Program Planning, Elsevier, vol. 46(C), pages 103-114.
    17. Bader, Benjamin & Berg, Nicola & Holtbrügge, Dirk, 2015. "Expatriate performance in terrorism-endangered countries: The role of family and organizational support," International Business Review, Elsevier, vol. 24(5), pages 849-860.
    18. Paula Stephan & Giuseppe Scellato & Chiara Franzoni, 2015. "International Competition for PhDs and Postdoctoral Scholars: What Does (and Does Not) Matter," Innovation Policy and the Economy, University of Chicago Press, vol. 15(1), pages 73-113.
    19. Ganguli, Ina & Gaulé, Patrick & Čugalj, Danijela Vuletić, 2022. "Chasing the academic dream: Biased beliefs and scientific labor markets," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 17-33.
    20. Wells, Victoria K. & Manika, Danae & Gregory-Smith, Diana & Taheri, Babak & McCowlen, Clair, 2015. "Heritage tourism, CSR and the role of employee environmental behaviour," Tourism Management, Elsevier, vol. 48(C), pages 399-413.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jmarka:v:9:y:2021:i:2:d:10.1057_s41270-021-00105-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.