IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v56y2022i4d10.1007_s11135-021-01237-0.html
   My bibliography  Save this article

College students’ and Mechanical Turk workers’ environmental factors while completing online surveys

Author

Listed:
  • Arne Weigold

    (Kent State University at Geauga)

  • Ingrid K. Weigold

    (The University of Akron)

  • Migyeong Jang

    (The University of Akron)

  • Emily M. Thornton

    (The University of Akron)

Abstract

Few studies have investigated the environmental factors of participants completing online self-report surveys, such as the presence of others and engagement in multitasking. The current study examined the environmental factors of 1023 participants drawn from two popular convenience populations—college students (n = 512) and Mechanical Turk workers (n = 511). All participants completed online measures of computer self-efficacy, the five-factor model of personality, and social desirability, as well as a questionnaire about their environment and activities when completing the measures. The two samples differed in terms of environmental factors, with college students significantly more likely to report: (1) being in a location other than their place of residence, (2) interacting with others, (3) being interrupted, (4) engaging in multitasking, (5) being under the influence of alcohol or other substances, and (6) completing the study using a laptop computer. The presence of others interacted with sample to predict personality and social desirability scores. Additionally, both presence of others and engaging in multitasking predicted longer completion time.

Suggested Citation

  • Arne Weigold & Ingrid K. Weigold & Migyeong Jang & Emily M. Thornton, 2022. "College students’ and Mechanical Turk workers’ environmental factors while completing online surveys," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(4), pages 2589-2612, August.
    • Handle: RePEc:spr:qualqt:v:56:y:2022:i:4:d:10.1007_s11135-021-01237-0
    DOI: 10.1007/s11135-021-01237-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-021-01237-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-021-01237-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anthony Miyazaki & Kimberly Taylor, 2008. "Researcher Interaction Biases and Business Ethics Research: Respondent Reactions to Researcher Characteristics," Journal of Business Ethics, Springer, vol. 81(4), pages 779-795, September.
    2. Peterson, Robert A. & Merunka, Dwight R., 2014. "Convenience samples of college students and research reproducibility," Journal of Business Research, Elsevier, vol. 67(5), pages 1035-1041.
    3. Anna DeCastellarnau, 2018. "A classification of response scale characteristics that affect data quality: a literature review," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(4), pages 1523-1559, July.
    4. Claire M. Hart & Timothy D. Ritchie & Erica G. Hepper & Jochen E. Gebauer, 2015. "The Balanced Inventory of Desirable Responding Short Form (BIDR-16)," SAGE Open, , vol. 5(4), pages 21582440156, December.
    5. Berinsky, Adam J. & Huber, Gregory A. & Lenz, Gabriel S., 2012. "Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk," Political Analysis, Cambridge University Press, vol. 20(3), pages 351-368, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Logan S. Casey & Jesse Chandler & Adam Seth Levine & Andrew Proctor & Dara Z. Strolovitch, 2017. "Intertemporal Differences Among MTurk Workers: Time-Based Sample Variations and Implications for Online Data Collection," SAGE Open, , vol. 7(2), pages 21582440177, June.
    2. Pan, Jing Yu & Liu, Dahai, 2022. "Mask-wearing intentions on airplanes during COVID-19 – Application of theory of planned behavior model," Transport Policy, Elsevier, vol. 119(C), pages 32-44.
    3. Michele Cantarella & Chiara Strozzi, 2021. "Workers in the crowd: the labor market impact of the online platform economy [An evaluation of instrumental variable strategies for estimating the effects of catholic schooling]," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 30(6), pages 1429-1458.
    4. Robbett, Andrea & Matthews, Peter Hans, 2018. "Partisan bias and expressive voting," Journal of Public Economics, Elsevier, vol. 157(C), pages 107-120.
    5. Niculaescu, Corina E. & Sangiorgi, Ivan & Bell, Adrian R., 2023. "Does personal experience with COVID-19 impact investment decisions? Evidence from a survey of US retail investors," International Review of Financial Analysis, Elsevier, vol. 88(C).
    6. Cristina Robledo-Ardila & Juan Pablo Román-Calderón, 2022. "Potential: in search for meaning, theory and avenues for future research a systematic review," Management Review Quarterly, Springer, vol. 72(1), pages 149-186, February.
    7. S. Brent Jackson & Kathryn T. Stevenson & Lincoln R. Larson & M. Nils Peterson & Erin Seekamp, 2021. "Outdoor Activity Participation Improves Adolescents’ Mental Health and Well-Being during the COVID-19 Pandemic," IJERPH, MDPI, vol. 18(5), pages 1-18, March.
    8. Jon Roozenbeek & Stefan M. Herzog & Michael Geers & Ralf Kurvers & Mubashir Sultan & Sander van der Linden, 2022. "Susceptibility to misinformation is consistent across question framings and response modes and better explained by myside bias and partisanship than analytical thinking," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 17(3), pages 547-573, May.
    9. Park, JungKun & Ahn, Jiseon & Thavisay, Toulany & Ren, Tianbao, 2019. "Examining the role of anxiety and social influence in multi-benefits of mobile payment service," Journal of Retailing and Consumer Services, Elsevier, vol. 47(C), pages 140-149.
    10. Chunhao Wei & Han Chen & Yee Ming Lee, 2022. "COVID-19 preventive measures and restaurant customers’ intention to dine out: the role of brand trust and perceived risk," Service Business, Springer;Pan-Pacific Business Association, vol. 16(3), pages 581-600, September.
    11. Masha Shunko & Julie Niederhoff & Yaroslav Rosokha, 2018. "Humans Are Not Machines: The Behavioral Impact of Queueing Design on Service Time," Management Science, INFORMS, vol. 64(1), pages 453-473, January.
    12. Elizabeth Sheedy & Patrick Garcia & Denise Jepsen, 2021. "The Role of Risk Climate and Ethical Self-interest Climate in Predicting Unethical Pro-organisational Behaviour," Journal of Business Ethics, Springer, vol. 173(2), pages 281-300, October.
    13. Brodeur, Abel & Cook, Nikolai & Heyes, Anthony, 2022. "We Need to Talk about Mechanical Turk: What 22,989 Hypothesis Tests Tell Us about Publication Bias and p-Hacking in Online Experiments," IZA Discussion Papers 15478, Institute of Labor Economics (IZA).
    14. Lude, Maximilian & Prügl, Reinhard, 2021. "Experimental studies in family business research," Journal of Family Business Strategy, Elsevier, vol. 12(1).
    15. Mattozzi, Andrea & Snowberg, Erik, 2018. "The right type of legislator: A theory of taxation and representation," Journal of Public Economics, Elsevier, vol. 159(C), pages 54-65.
    16. Jasper Grashuis & Theodoros Skevas & Michelle S. Segovia, 2020. "Grocery Shopping Preferences during the COVID-19 Pandemic," Sustainability, MDPI, vol. 12(13), pages 1-10, July.
    17. Mohammad Nurul Alam & Osarodion Ogiemwonyi & Ibrahim. E. Hago & Noor Azlinna Azizan & Fariza Hashim & Md Sazzad Hossain, 2023. "Understanding Consumer Environmental Ethics and the Willingness to Use Green Products," SAGE Open, , vol. 13(1), pages 21582440221, January.
    18. Jeanette A.M.J. Deetlefs & Mathew Chylinski & Andreas Ortmann, 2015. "MTurk ‘Unscrubbed’: Exploring the good, the ‘Super’, and the unreliable on Amazon’s Mechanical Turk," Discussion Papers 2015-20, School of Economics, The University of New South Wales.
    19. Mireia Ercilla-Montserrat & David Sanjuan-Delmás & Esther Sanyé-Mengual & Laura Calvet-Mir & Karla Banderas & Joan Rieradevall & Xavier Gabarrell, 2019. "Analysis of the consumer’s perception of urban food products from a soilless system in rooftop greenhouses: a case study from the Mediterranean area of Barcelona (Spain)," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 36(3), pages 375-393, September.
    20. Jun Zhang & Joon Soo Lim, 2021. "Mitigating negative spillover effects in a product-harm crisis: strategies for market leaders versus market challengers," Journal of Brand Management, Palgrave Macmillan, vol. 28(1), pages 77-98, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:56:y:2022:i:4:d:10.1007_s11135-021-01237-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.