Comparing the Similarity of Responses Received from Studies in Amazon’s Mechanical Turk to Studies Conducted Online and with Direct Recruitment
Author
Abstract
Suggested Citation
DOI: 10.1371/journal.pone.0121595
Download full text from publisher
References listed on IDEAS
- John Horton & David Rand & Richard Zeckhauser, 2011.
"The online laboratory: conducting experiments in a real labor market,"
Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
- John J. Horton & David G. Rand & Richard J. Zeckhauser, 2010. "The Online Laboratory: Conducting Experiments in a Real Labor Market," NBER Working Papers 15961, National Bureau of Economic Research, Inc.
- Horton, John Joseph & Rand, David Gertler & Zeckhauser, Richard Jay, 2010. "The Online Laboratory: Conducting Experiments in a Real Labor Market," Scholarly Articles 4448876, Harvard Kennedy School of Government.
- Horton, John J. & Rand, David G. & Zeckhauser, Richard, 2010. "The Online Laboratory: Conducting Experiments in a Real Labor Market," Working Paper Series rwp10-017, Harvard University, John F. Kennedy School of Government.
- Gabriele Paolacci & Jesse Chandler & Panagiotis G. Ipeirotis, 2010. "Running experiments on Amazon Mechanical Turk," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 5(5), pages 411-419, August.
- repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
- Rajagopal, 2014.
"The Human Factors,"
Palgrave Macmillan Books, in: Architecting Enterprise, chapter 9, pages 225-249,
Palgrave Macmillan.
- Rajagopal, 2013. "The Human Factors," Palgrave Macmillan Books, in: Managing Social Media and Consumerism, chapter 9, pages 173-194, Palgrave Macmillan.
- David J. Spiegelhalter & Nicola G. Best & Bradley P. Carlin & Angelika Van Der Linde, 2002. "Bayesian measures of model complexity and fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(4), pages 583-639, October.
- Alan Agresti & David B. Hitchcock, 2005. "Bayesian inference for categorical data analysis," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 14(3), pages 297-330, December.
- Paolacci, Gabriele & Chandler, Jesse & Ipeirotis, Panagiotis G., 2010. "Running experiments on Amazon Mechanical Turk," Judgment and Decision Making, Cambridge University Press, vol. 5(5), pages 411-419, August.
- Berinsky, Adam J. & Huber, Gregory A. & Lenz, Gabriel S., 2012. "Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk," Political Analysis, Cambridge University Press, vol. 20(3), pages 351-368, July.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Scott, Carol F. & Bay-Cheng, Laina Y. & Nochajski, Thomas H. & Lorraine Collins, R., 2024. "Emerging adults’ social media engagement & alcohol misuse: A multidimensional, person-centered analysis of risk," Children and Youth Services Review, Elsevier, vol. 159(C).
- Oliver Hahl & Jaekyung Ha, 2020. "Committed Diversification: Why Authenticity Insulates Against Penalties for Diversification," Organization Science, INFORMS, vol. 31(1), pages 1-22, January.
- repec:cup:judgdm:v:10:y:2015:i:6:p:538-548 is not listed on IDEAS
- Laura Biziou-van-Pol & Jana Haenen & Arianna Novaro & Andrés Occhipinti & Valerio Capraro, 2015. "Does telling white lies signal pro-social preferences?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(6), pages 538-548, November.
- Collin Weigel & Laura A. Paul & Paul J. Ferraro & Kent D. Messer, 2021. "Challenges in Recruiting U.S. Farmers for Policy‐Relevant Economic Field Experiments," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(2), pages 556-572, June.
- Young Kim & Hyojung Park, 2017. "Is there Still a PR Problem Online? Exploring the Effects of Different Sources and Crisis Response Strategies in Online Crisis Communication Via Social Media," Corporate Reputation Review, Palgrave Macmillan, vol. 20(1), pages 76-104, February.
- Tasci, Asli D.A., 2018. "Testing the cross-brand and cross-market validity of a consumer-based brand equity (CBBE) model for destination brands," Tourism Management, Elsevier, vol. 65(C), pages 143-159.
- Debra A. Hoffmann & Jenna M. Marx & Jacob M. Burmeister & Dara R. Musher-Eizenman, 2018. "Friday Night Is Pizza Night: A Comparison of Children’s Dietary Intake and Maternal Perceptions and Feeding Goals on Weekdays and Weekends," IJERPH, MDPI, vol. 15(4), pages 1-12, April.
- Alessandra Casella & Luis Sanchez, 2019.
"Storable Votes and Quadratic Voting. An Experiment on Four California Propositions,"
NBER Working Papers
25510, National Bureau of Economic Research, Inc.
- Casella, Alessandra & Sanchez, Luis, 2019. "Storable Votes and Quadratic Voting. An Experiment on Four California Propositions," CEPR Discussion Papers 13479, C.E.P.R. Discussion Papers.
- Hongsha Wang & Qihui Chen & Bhagyashree Katare, 2023. "Nudging Chinese consumers to embrace sustainable milk consumption: How should information be provided?," Agribusiness, John Wiley & Sons, Ltd., vol. 39(S1), pages 1512-1534, December.
- Oliver Hahl, 2016. "Turning Back the Clock in Baseball: The Increased Prominence of Extrinsic Rewards and Demand for Authenticity," Organization Science, INFORMS, vol. 27(4), pages 929-953, August.
- Kamryn S. Morris & Eleanor K. Seaton & Masumi Iida & Sarah Lindstrom Johnson, 2020. "Racial Discrimination Stress, School Belonging, and School Racial Composition on Academic Attitudes and Beliefs among Black Youth," Social Sciences, MDPI, vol. 9(11), pages 1-20, October.
- Ksenia Koroleva & Jasminko Novak, 2020. "How to Engage with Sustainability Issues We Rarely Experience? A Gamification Model for Collective Awareness Platforms in Water-Related Sustainability," Sustainability, MDPI, vol. 12(2), pages 1-24, January.
- Feenstra, Sanne & Jordan, Jennifer & Walter, Frank & Stoker, Janka I., 2020. "Antecedents of leaders' power sharing: The roles of power instability and distrust," Organizational Behavior and Human Decision Processes, Elsevier, vol. 157(C), pages 115-128.
- Paul Delfabbro & Neophytos Georgiou & Catia Malvaso & Daniel King, 2020. "Is Self-Reported Propensity for Everyday Illusions of Control Higher in Gamblers and Is It Associated With Gambling-Specific Erroneous Beliefs?," SAGE Open, , vol. 10(1), pages 21582440198, January.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Gandullia, Luca & Lezzi, Emanuela & Parciasepe, Paolo, 2020. "Replication with MTurk of the experimental design by Gangadharan, Grossman, Jones & Leister (2018): Charitable giving across donor types," Journal of Economic Psychology, Elsevier, vol. 78(C).
- Cantarella, Michele & Strozzi, Chiara, 2019. "Workers in the Crowd: The Labour Market Impact of the Online Platform Economy," IZA Discussion Papers 12327, Institute of Labor Economics (IZA).
- Azzam, Tarek & Harman, Elena, 2016. "Crowdsourcing for quantifying transcripts: An exploratory study," Evaluation and Program Planning, Elsevier, vol. 54(C), pages 63-73.
- Prissé, Benjamin & Jorrat, Diego, 2022.
"Lab vs online experiments: No differences,"
Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
- Benjamin Prissé & Diego Jorrat, 2022. "Lab vs online experiments: no differences," Working Papers 137, Red Nacional de Investigadores en Economía (RedNIE).
- Valerio Capraro & Hélène Barcelo, 2021. "Punishing defectors and rewarding cooperators: Do people discriminate between genders?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(1), pages 19-32, September.
- Lefgren, Lars J. & Sims, David P. & Stoddard, Olga B., 2016. "Effort, luck, and voting for redistribution," Journal of Public Economics, Elsevier, vol. 143(C), pages 89-97.
- Tim Straub & Henner Gimpel & Florian Teschner & Christof Weinhardt, 2015. "How (not) to Incent Crowd Workers," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 57(3), pages 167-179, June.
- Chandler, Dana & Kapelner, Adam, 2013. "Breaking monotony with meaning: Motivation in crowdsourcing markets," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 123-133.
- Harman, Elena & Azzam, Tarek, 2018. "Incorporating public values into evaluative criteria: Using crowdsourcing to identify criteria and standards," Evaluation and Program Planning, Elsevier, vol. 71(C), pages 68-82.
- Michele Cantarella & Chiara Strozzi, 2018. "Labour market effects of crowdwork in US and EU: an empirical investigation," Department of Economics 0139, University of Modena and Reggio E., Faculty of Economics "Marco Biagi".
- Binder, Carola Conces, 2022. "Time-of-day and day-of-week variations in Amazon Mechanical Turk survey responses," Journal of Macroeconomics, Elsevier, vol. 71(C).
- Anthony C. Bucaro & Kevin E. Jackson & Jeremy B. Lill, 2020. "The Influence of Corporate Social Responsibility Measures on Investors' Judgments When Integrated in a Financial Report Versus Presented in a Separate Report," Contemporary Accounting Research, John Wiley & Sons, vol. 37(2), pages 665-695, June.
- Brañas-Garza, Pablo & Capraro, Valerio & Rascón-Ramírez, Ericka, 2018.
"Gender differences in altruism on Mechanical Turk: Expectations and actual behaviour,"
Economics Letters, Elsevier, vol. 170(C), pages 19-23.
- Pablo Brañas-Garza & Valerio Capraro & Ericka Rascón Ramírez, 2018. "Gender differences in altruism on Mechanical Turk: Expectations and actual behaviour," SEET Working Papers 2018-02, BELIS, Istanbul Bilgi University.
- Brañas-Garza, Pablo & Capraro, Valerio & Rascon-Ramirez, Ericka, 2018. "Gender differences in altruism on mechanical turk: Expectations and actual behaviour," MPRA Paper 86238, University Library of Munich, Germany.
- Fehr, Dietmar & Vollmann, Martin, 2020.
"Misperceiving Economic Success: Experimental Evidence on Meritocratic Beliefs and Inequality Acceptance,"
Working Papers
0695, University of Heidelberg, Department of Economics.
- Dietmar Fehr & Martin Vollmann, 2022. "Misperceiving Economic Success: Experimental Evidence on Meritocratic Beliefs and Inequality Acceptance," CESifo Working Paper Series 9983, CESifo.
- Atalay, Kadir & Bakhtiar, Fayzan & Cheung, Stephen & Slonim, Robert, 2014.
"Savings and prize-linked savings accounts,"
Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 86-106.
- Atalay, Kadir & Bakhtiar, Fayzan & Cheung, Stephen L. & Slonim, Robert, 2012. "Savings and Prize-Linked Savings Accounts," IZA Discussion Papers 6927, Institute of Labor Economics (IZA).
- Atalay, Kadir & Bakhtiar, Fayzan & Cheung, Stephen L. & Slonim, Robert, 2013. "Savings and Prize-Linked Savings Accounts," Working Papers 2013-12, University of Sydney, School of Economics.
- Joseph A. Johnson & Jochen Theis & Adam Vitalis & Donald Young, 2020. "The Influence of Firms' Emissions Management Strategy Disclosures on Investors' Valuation Judgments†," Contemporary Accounting Research, John Wiley & Sons, vol. 37(2), pages 642-664, June.
- David Johnson & John Barry Ryan, 2020.
"Amazon Mechanical Turk workers can provide consistent and economically meaningful data,"
Southern Economic Journal, John Wiley & Sons, vol. 87(1), pages 369-385, July.
- Johnson, David & Ryan, John, 2018. "Amazon Mechanical Turk Workers Can Provide Consistent and Economically Meaningful Data," MPRA Paper 88450, University Library of Munich, Germany.
- Maier, Michael F. & Viete, Steffen & Ody, Margard, 2017. "Plattformbasierte Erwerbsarbeit: Stand der empirischen Forschung," IZA Research Reports 81, Institute of Labor Economics (IZA).
- Burdea, Valeria & Woon, Jonathan, 2022.
"Online belief elicitation methods,"
Journal of Economic Psychology, Elsevier, vol. 90(C).
- Valeria Burdea & Jonathan Woon, 2021. "Online Belief Elicitation Methods," CESifo Working Paper Series 8823, CESifo.
- Mourelatos, Evangelos, 2021. "Personality and Ethics on Online Labor Markets: How mood influences ethical perceptions," EconStor Preprints 244735, ZBW - Leibniz Information Centre for Economics.
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0121595. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.