Running experiments on Amazon Mechanical Turk
AbstractAlthough Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic data about the Mechanical Turk subject population, reviewing the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and comparing the magnitude of effects obtained using Mechanical Turk and traditional subject pools. We further discuss some additional benefits such as the possibility of longitudinal, cross cultural and prescreening designs, and offer some advice on how to best manage a common subject pool.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Society for Judgment and Decision Making in its journal Judgment and Decision Making.
Volume (Year): 5 (2010)
Issue (Month): 5 (August)
Contact details of provider:
experimentation; online research;
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Aguinis, Herman & Lawal, Sola O., 2012. "Conducting field experiments using eLancing's natural environment," Journal of Business Venturing, Elsevier, vol. 27(4), pages 493-505.
- Wieland, Alice & Sarin, Rakesh, 2012. "Domain specificity of sex differences in competition," Journal of Economic Behavior & Organization, Elsevier, vol. 83(1), pages 151-157.
- David Cooper & David Johnson, 2013. "Ambiguity in Performance Pay: An Online Experiment," Working Papers 2013-27, Department of Economics, University of Calgary, revised 14 Nov 2013.
- Michael Boyer O'leary & Anca Metiu & Jeanne M. Wilson, 2011. "Beyond Being There: The Symbolic Role of Communication and Identification in the Emergence of Perceived Proximity in Geographically Dispersed Work," Post-Print hal-00661000, HAL.
- Polman, Evan, 2012. "Self–other decision making and loss aversion," Organizational Behavior and Human Decision Processes, Elsevier, vol. 119(2), pages 141-150.
- Boyer O’Leary, Michael & Wilson, Jeanne M. & Metiu, Anca, 2011. "Beyond Being There: The Symbolic Role of Communication and Identification in the Emergence of Perceived Proximity in Geographically Dispersed Work," ESSEC Working Papers WP1112, ESSEC Research Center, ESSEC Business School.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jonathan Baron).
If references are entirely missing, you can add them using this form.