IDEAS home Printed from https://ideas.repec.org/a/pal/jmarka/v9y2021i2d10.1057_s41270-021-00105-y.html
   My bibliography  Save this article

The impact of questionnaire length on the accuracy rate of online surveys

Author

Listed:
  • Takumi Kato

    (Saitama University)

  • Taro Miura

    (Intage Inc.)

Abstract

Online surveys have the advantages of affordability and speedy collection; however, there have been some concerns about their response quality. Previous studies have measured response quality using nonresponse rate and biased choice behavior. However, it is difficult to detect defective respondents who are randomly selected without careful consideration by using those indicators. Therefore, this study measured the accuracy rate as an index of response quality using a questionnaire with questions for which possible answers were provided. Questionnaire length was found to have a negative effect on response rate but no significant effect on the accuracy rate. In addition, considering the response device, surveys from smartphone users have a lower accuracy rate than surveys from personal computer users. Lastly, respondents who have a response rate faster than 10 seconds per question have a lower accuracy rate. It is important to understand the factors that affect response quality and to design surveys accordingly.

Suggested Citation

  • Takumi Kato & Taro Miura, 2021. "The impact of questionnaire length on the accuracy rate of online surveys," Journal of Marketing Analytics, Palgrave Macmillan, vol. 9(2), pages 83-98, June.
    • Handle: RePEc:pal:jmarka:v:9:y:2021:i:2:d:10.1057_s41270-021-00105-y
    DOI: 10.1057/s41270-021-00105-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41270-021-00105-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1057/s41270-021-00105-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sauermann, Henry & Roach, Michael, 2013. "Increasing web survey response rates in innovation research: An experimental study of static and dynamic contact design features," Research Policy, Elsevier, vol. 42(1), pages 273-286.
    2. Takumi Kato & Noriko Kishida & Takahiko Umeyama & Yuexian Jin & Kazuhiko Tsuda, 2020. "A random extraction method with high market representation for online surveys," International Journal of Business Innovation and Research, Inderscience Enterprises Ltd, vol. 22(4), pages 569-584.
    3. Elisabeth Deutskens & Ko de Ruyter & Martin Wetzels & Paul Oosterveld, 2004. "Response Rate and Response Quality of Internet-Based Surveys: An Experimental Study," Marketing Letters, Springer, vol. 15(1), pages 21-36, February.
    4. Kostyk, Alena & Zhou, Wenkai & Hyman, Michael R., 2019. "Using surveytainment to counter declining survey data quality," Journal of Business Research, Elsevier, vol. 95(C), pages 211-219.
    5. Pushkin Kachroo & Sheen Kachen, 2018. "Item placement for questionnaire design for optimal reliability," Journal of Marketing Analytics, Palgrave Macmillan, vol. 6(4), pages 120-126, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rolf Becker, 2023. "Short- and long-term effects of reminders on panellists’ survey participation in a probability-based panel study with a sequential mixed-mode design," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(5), pages 4095-4119, October.
    2. Jian Han & Miaodan Fang & Shenglu Ye & Chuansheng Chen & Qun Wan & Xiuying Qian, 2019. "Using Decision Tree to Predict Response Rates of Consumer Satisfaction, Attitude, and Loyalty Surveys," Sustainability, MDPI, vol. 11(8), pages 1-13, April.
    3. Tatsushi Fukaya & Masayuki Suzuki & Ikumi Ozawa & Takumi Nakagoshi, 2022. "An Examination of Related Factors of Mathematical Pedagogical Content Knowledge in Elementary School Teachers: Focusing on Conceptions of Teaching and Learning and Test Utilization Strategy," SAGE Open, , vol. 12(4), pages 21582440221, October.
    4. Maikel Schwerdtfeger & Ruben L. Bach, 2024. "How does broadband supply affect participation in panel surveys?: Using geospatial broadband data at the district level to analyze mode choice and panel attrition," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(6), pages 5805-5828, December.
    5. Christoph Markmann & Alexander Spickermann & Heiko A. von der Gracht & Alexander Brem, 2021. "Improving the question formulation in Delphi‐like surveys: Analysis of the effects of abstract language and amount of information on response behavior," Futures & Foresight Science, John Wiley & Sons, vol. 3(1), March.
    6. Vahid Sobhani & Mohammadjavad Rostamizadeh & Seyed Morteza Hosseini & Seyed Ebrahim Hashemi & Ignacio Refoyo Román & Daniel Mon-López, 2022. "Anthropometric, Physiological, and Psychological Variables That Determine the Elite Pistol Performance of Women," IJERPH, MDPI, vol. 19(3), pages 1-10, January.
    7. Giulia Mascarello & Anna Pinto & Stefania Crovato & Barbara Tiozzo Pezzoli & Marco Pietropaoli & Michela Bertola & Franco Mutinelli & Giovanni Formato, 2024. "Consumers’ Perceptions and Behaviors Regarding Honey Purchases and Expectations on Traceability and Sustainability in Italy," Sustainability, MDPI, vol. 16(20), pages 1-17, October.
    8. Giancarlo Condello & Laura Capranica & Mojca Doupona & Kinga Varga & Verena Burk, 2019. "Dual-career through the elite university student-athletes’ lenses: The international FISU-EAS survey," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-18, October.
    9. Bader, Benjamin & Berg, Nicola & Holtbrügge, Dirk, 2015. "Expatriate performance in terrorism-endangered countries: The role of family and organizational support," International Business Review, Elsevier, vol. 24(5), pages 849-860.
    10. Olivier Toubia & Eric Johnson & Theodoros Evgeniou & Philippe Delquié, 2013. "Dynamic Experiments for Estimating Preferences: An Adaptive Method of Eliciting Time and Risk Parameters," Management Science, INFORMS, vol. 59(3), pages 613-640, June.
    11. repec:eee:respol:v:48:y:2019:i:8:p:- is not listed on IDEAS
    12. Philip X Fuchs & Mojca Doupona & Kinga Varga & Marta Bon & Cristina Cortis & Andrea Fusco & Loriana Castellani & Niko Niemisalo & Heikki Hannola & Patrice Giron & Jörg Förster & Laura Capranica & Herb, 2021. "Multi-national perceptions on challenges, opportunities, and support structures for Dual Career migrations in European student-athletes," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-18, June.
    13. Balk, B.M. & de Koster, M.B.M. & Kaps, C. & Zofío, J.L., 2017. "An Evaluation of Cross-Efficiency Methods, Applied to Measuring Warehouse Performance," ERIM Report Series Research in Management ERS-2017-015-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    14. Elena-Loreni Baciu & Delia Vîrgă & Theofild-Andrei Lazăr & Delia Gligor & Cecilia-Nicoleta Jurcuț, 2020. "The Association between Entrepreneurial Perceived Behavioral Control, Personality, Empathy, and Assertiveness in a Romanian Sample of Nascent Entrepreneurs," Sustainability, MDPI, vol. 12(24), pages 1-16, December.
    15. Heider, Raphael & Moeller, Sabine, 2012. "Outlet patronage in on-the-go consumption: An analysis of patronage preference drivers for convenience outlets versus traditional retail outlets," Journal of Retailing and Consumer Services, Elsevier, vol. 19(3), pages 313-324.
    16. Bürgel, Tobias R. & Hiebl, Martin R.W. & Pielsticker, David I., 2023. "Digitalization and entrepreneurial firms' resilience to pandemic crises: Evidence from COVID-19 and the German Mittelstand," Technological Forecasting and Social Change, Elsevier, vol. 186(PA).
    17. Harrigan, Paul & Soutar, Geoff & Choudhury, Musfiq Mannan & Lowe, Michelle, 2015. "Modelling CRM in a social media age," Australasian marketing journal, Elsevier, vol. 23(1), pages 27-37.
    18. Eric Joseph van Holm & Heyjie Jung & Eric W. Welch, 2021. "The impacts of foreignness and cultural distance on commercialization of patents," The Journal of Technology Transfer, Springer, vol. 46(1), pages 29-61, February.
    19. Alho, Eeva, 2015. "The effect of social bonding and identity on the decision to invest in food production," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 59(C), pages 47-55.
    20. Francisco Liñán & Inmaculada Jaén & Domingo Martín, 2022. "Does entrepreneurship fit her? Women entrepreneurs, gender-role orientation, and entrepreneurial culture," Small Business Economics, Springer, vol. 58(2), pages 1051-1071, February.
    21. Gartner, Johannes & Fink, Matthias & Maresch, Daniela, 2022. "The Role of Fear of Missing Out and Experience in the Formation of SME Decision Makers’ Intentions to Adopt New Manufacturing Technologies," Technological Forecasting and Social Change, Elsevier, vol. 180(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jmarka:v:9:y:2021:i:2:d:10.1057_s41270-021-00105-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.