IDEAS home Printed from https://ideas.repec.org/a/cup/pscirm/v8y2020i2p232-250_3.html
   My bibliography  Save this article

Recruiting large online samples in the United States and India: Facebook, Mechanical Turk, and Qualtrics

Author

Listed:
  • Boas, Taylor C.
  • Christenson, Dino P.
  • Glick, David M.

Abstract

This article examines online recruitment via Facebook, Mechanical Turk (MTurk), and Qualtrics panels in India and the United States. It compares over 7300 respondents—1000 or more from each source and country—to nationally representative benchmarks in terms of demographics, political attitudes and knowledge, cooperation, and experimental replication. In the United States, MTurk offers the cheapest and fastest recruitment, Qualtrics is most demographically and politically representative, and Facebook facilitates targeted sampling. The India samples look much less like the population, though Facebook offers broad geographical coverage. We find online convenience samples often provide valid inferences into how partisanship moderates treatment effects. Yet they are typically unrepresentative on such political variables, which has implications for the external validity of sample average treatment effects.

Suggested Citation

  • Boas, Taylor C. & Christenson, Dino P. & Glick, David M., 2020. "Recruiting large online samples in the United States and India: Facebook, Mechanical Turk, and Qualtrics," Political Science Research and Methods, Cambridge University Press, vol. 8(2), pages 232-250, April.
    • Handle: RePEc:cup:pscirm:v:8:y:2020:i:2:p:232-250_3
    as

    Download full text from publisher

    File URL: https://www.cambridge.org/core/product/identifier/S2049847018000286/type/journal_article
    File Function: link to article abstract page
    Download Restriction: no
    ---><---

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Barton, Jared & Pan, Xiaofei, 2022. "Movin’ on up? A survey experiment on mobility enhancing policies," European Journal of Political Economy, Elsevier, vol. 74(C).
    2. S. Brent Jackson & Kathryn T. Stevenson & Lincoln R. Larson & M. Nils Peterson & Erin Seekamp, 2021. "Outdoor Activity Participation Improves Adolescents’ Mental Health and Well-Being during the COVID-19 Pandemic," IJERPH, MDPI, vol. 18(5), pages 1-18, March.
    3. Ji Yun Lee & Fangjiao Ma & Yue Li, 2022. "Understanding homeowner proactive actions for managing wildfire risks," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 114(2), pages 1525-1547, November.
    4. Beknazar-Yuzbashev, George & Stalinski, Mateusz, 2022. "Do social media ads matter for political behavior? A field experiment," Journal of Public Economics, Elsevier, vol. 214(C).
    5. Acacia R. Lopez & Danielle K. Nadorff & Delaney Peters, 2023. "The Twelve Ds: An Update to Edwards and Benson’s Reasons for Non-Parental Caregiving," IJERPH, MDPI, vol. 20(9), pages 1-14, April.
    6. Robert Kubinec & Haillie Na‐Kyung Lee & Andrey Tomashevskiy, 2021. "Politically connected companies are less likely to shutdown due to COVID‐19 restrictions," Social Science Quarterly, Southwestern Social Science Association, vol. 102(5), pages 2155-2169, September.
    7. Bogliacino, Francesco & Mantilla, César & Niño, Daniel, 2023. "Economic incentives and political inequality in the management of environmental public goods," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 104(C).
    8. Pankaj Tiwari, 2023. "Influence of Millennials’ eco-literacy and biospheric values on green purchases: the mediating effect of attitude," Public Organization Review, Springer, vol. 23(3), pages 1195-1212, September.
    9. Hannah Casey & Deirdre Desmond & Laura Coffey, 2023. "Professional and Family Carers’ Perspectives on the COVID-19 Pandemic and Its Impact on Supported Decision-Making with Adults with Intellectual Disabilities: A Qualitative Online Survey," Disabilities, MDPI, vol. 3(2), pages 1-11, April.
    10. Roselyn J. Lee-Won & Inyoung Jang & Hyun-Suk Kim & Sung-Gwan Park, 2022. "The Relationship between Future Anxiety Due to COVID-19 and Vigilance: The Role of Message Fatigue and Autonomy Satisfaction," IJERPH, MDPI, vol. 19(3), pages 1-16, January.
    11. Park, Keunhyun & Chamberlain, Brent & Song, Ziqi & Nasr Esfahani, Hossein & Sheen, Jeff & Larsen, Teresa & Long Novack, Valerie & Licon, Carlos & Christensen, Keith, 2022. "A double jeopardy: COVID-19 impacts on the travel behavior and community living of people with disabilities," Transportation Research Part A: Policy and Practice, Elsevier, vol. 156(C), pages 24-35.
    12. Huichuan Xia, 2023. "What scholars and IRBs talk when they talk about the Belmont principles in crowd work‐based research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(1), pages 67-80, January.
    13. Marissa L. Varade & Francis Choi & Brian Helmuth & Steven Scyphers, 2022. "Catching versus Counting: Comparing the Pro-Environmental Attitudes, Behaviors, and Climate Concerns of Recreational Fishers and Citizen Scientists," Sustainability, MDPI, vol. 15(1), pages 1-19, December.
    14. Michael Kumove, 2022. "Does Language Foster Reconciliation? Evidence From the Former Yugoslavia," Journal of Conflict Resolution, Peace Science Society (International), vol. 66(4-5), pages 783-808, May.
    15. Benjamin W Nelson & Adam Pettitt & Jessica E Flannery & Nicholas B Allen, 2020. "Rapid assessment of psychological and epidemiological correlates of COVID-19 concern, financial strain, and health-related behavior change in a large online sample," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-16, November.
    16. Matthew H. Goldberg & Abel Gustafson & Matthew T. Ballew & Seth A. Rosenthal & Matthew J. Cutler & Anthony Leiserowitz, 2020. "Predictors of global warming risk perceptions among Latino and non-Latino White Americans," Climatic Change, Springer, vol. 162(3), pages 1555-1574, October.
    17. Gordon Pennycook & David G. Rand, 2022. "Accuracy prompts are a replicable and generalizable approach for reducing the spread of misinformation," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    18. Sean F. Ellis & Olesya M. Savchenko & Kent D. Messer, 2022. "Mitigating stigma associated with recycled water," American Journal of Agricultural Economics, John Wiley & Sons, vol. 104(3), pages 1077-1099, May.
    19. S. Brent Jackson & Kathryn T. Stevenson & Lincoln R. Larson & M. Nils Peterson & Erin Seekamp, 2021. "Connection to Nature Boosts Adolescents’ Mental Well-Being during the COVID-19 Pandemic," Sustainability, MDPI, vol. 13(21), pages 1-24, November.
    20. Buccieri, Dominic & Park, JiEun, 2022. "Entrepreneurial marketing and reconfiguration towards post-entry performance: Moderating effects of market dynamism and entry mode," Journal of Business Research, Elsevier, vol. 148(C), pages 89-100.
    21. Buccieri, Dominic & Javalgi, Raj G. & Cavusgil, Erin, 2023. "Role of opportunity creation between reconfiguration and innovation: Insights from emerging market international new ventures," International Business Review, Elsevier, vol. 32(4).
    22. Kaitlynn Sandstrom‐Mistry & Frank Lupi & Hyunjung Kim & Joseph A. Herriges, 2023. "Comparing water quality valuation across probability and non‐probability samples," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 45(2), pages 744-761, June.
    23. Yanmengqian Zhou & Erina L. MacGeorge & Jessica Gall Myrick, 2020. "Mental Health and Its Predictors during the Early Months of the COVID-19 Pandemic Experience in the United States," IJERPH, MDPI, vol. 17(17), pages 1-19, August.
    24. Lisa M. Fucito & Krysten W. Bold & Sydney Cannon & Alison Serrantino & Rebecca Marrero & Stephanie S. O’Malley, 2022. "Cigarette Smoking in Response to COVID-19: Examining Co-Morbid Medical Conditions and Risk Perceptions," IJERPH, MDPI, vol. 19(14), pages 1-12, July.
    25. Nirmal Acharya & Anne-Marie Sassenberg & Jeffrey Soar, 2023. "The Role of Cognitive Absorption in Recommender System Reuse," Sustainability, MDPI, vol. 15(5), pages 1-23, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cup:pscirm:v:8:y:2020:i:2:p:232-250_3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kirk Stebbing (email available below). General contact details of provider: https://www.cambridge.org/ram .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.