IDEAS home Printed from https://ideas.repec.org/p/mpr/mprres/f97b669c7b3e4c2ab95c9f8051d18af6.html
   My bibliography  Save this paper

The Average Laboratory Samples a Population of 7,300 Amazon Mechanical Turk Workers

Author

Listed:
  • Neil Stewart
  • Christoph Ungemach
  • Adam J. L. Harris
  • Daniel M. Bartels
  • Ben R. Newell
  • Gabriele Paolacci
  • Jesse Chandler

Abstract

Using capture-recapture analysis (a tool used by ecologists to estimate the size of hard to observe populations) we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers.

Suggested Citation

  • Neil Stewart & Christoph Ungemach & Adam J. L. Harris & Daniel M. Bartels & Ben R. Newell & Gabriele Paolacci & Jesse Chandler, "undated". "The Average Laboratory Samples a Population of 7,300 Amazon Mechanical Turk Workers," Mathematica Policy Research Reports f97b669c7b3e4c2ab95c9f805, Mathematica Policy Research.
    • Handle: RePEc:mpr:mprres:f97b669c7b3e4c2ab95c9f8051d18af6
    as

    Download full text from publisher

    File URL: http://journal.sjdm.org/14/14725/jdm14725.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
    2. David G. Rand & Alexander Peysakhovich & Gordon T. Kraft-Todd & George E. Newman & Owen Wurzbacher & Martin A. Nowak & Joshua D. Greene, 2014. "Social heuristics shape intuitive cooperation," Nature Communications, Nature, vol. 5(1), pages 1-12, May.
    3. Baillargeon, Sophie & Rivest, Louis-Paul, 2007. "Rcapture: Loglinear Models for Capture-Recapture in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 19(i05).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Neil Stewart & Christoph Ungemach & Adam J. L. Harris & Daniel M. Bartels & Ben R. Newell & Gabriele Paolacci & Jesse Chandler, 2015. "The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(5), pages 479-491, September.
    2. repec:cup:judgdm:v:10:y:2015:i:5:p:479-491 is not listed on IDEAS
    3. Alós-Ferrer, Carlos & Garagnani, Michele, 2020. "The cognitive foundations of cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 71-85.
    4. Christian Hilbe & Moshe Hoffman & Martin A. Nowak, 2015. "Cooperate without Looking in a Non-Repeated Game," Games, MDPI, vol. 6(4), pages 1-15, September.
    5. Jacob W. Crandall & Mayada Oudah & Tennom & Fatimah Ishowo-Oloko & Sherief Abdallah & Jean-François Bonnefon & Manuel Cebrian & Azim Shariff & Michael A. Goodrich & Iyad Rahwan, 2018. "Cooperating with machines," Nature Communications, Nature, vol. 9(1), pages 1-12, December.
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," TSE Working Papers 17-806, Toulouse School of Economics (TSE).
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," IAST Working Papers 17-68, Institute for Advanced Study in Toulouse (IAST).
      • Jacob Crandall & Mayada Oudah & Fatimah Ishowo-Oloko Tennom & Fatimah Ishowo-Oloko & Sherief Abdallah & Jean-François Bonnefon & Manuel Cebrian & Azim Shariff & Michael Goodrich & Iyad Rahwan, 2018. "Cooperating with machines," Post-Print hal-01897802, HAL.
    6. Wu, Yu’e & Zhang, Zhipeng & Yang, Guoli & Liu, Haixin & Zhang, Qingfeng, 2022. "Evolution of cooperation driven by diversity on a double-layer square lattice," Chaos, Solitons & Fractals, Elsevier, vol. 162(C).
    7. Christoph Engel & Paul A. M. Van Lange, 2021. "Social mindfulness is normative when costs are low, but rapidly declines with increases in costs," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 16(2), pages 290-322, March.
    8. Amanda Kvarven & Eirik Strømland & Conny Wollbrant & David Andersson & Magnus Johannesson & Gustav Tinghög & Daniel Västfjäll & Kristian Ove R. Myrseth, 2020. "The intuitive cooperation hypothesis revisited: a meta-analytic examination of effect size and between-study heterogeneity," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 6(1), pages 26-42, June.
    9. Anna Louisa Merkel & Johannes Lohse, 2019. "Is fairness intuitive? An experiment accounting for subjective utility differences under time pressure," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 24-50, March.
    10. Jeanette A.M.J. Deetlefs & Mathew Chylinski & Andreas Ortmann, 2015. "MTurk ‘Unscrubbed’: Exploring the good, the ‘Super’, and the unreliable on Amazon’s Mechanical Turk," Discussion Papers 2015-20, School of Economics, The University of New South Wales.
    11. Eamonn Ferguson & John Maltby & Peter A Bibby & Claire Lawrence, 2014. "Fast to Forgive, Slow to Retaliate: Intuitive Responses in the Ultimatum Game Depend on the Degree of Unfairness," PLOS ONE, Public Library of Science, vol. 9(5), pages 1-8, May.
    12. Fabio Galeotti & Valeria Maggian & Marie Claire Villeval, 2021. "Fraud Deterrence Institutions Reduce Intrinsic Honesty," The Economic Journal, Royal Economic Society, vol. 131(638), pages 2508-2528.
    13. Myrseth, Kristian Ove R. & Wollbrant, Conny E., 2017. "Cognitive foundations of cooperation revisited: Commentary on Rand et al. (2012, 2014)," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 69(C), pages 133-138.
    14. Martin G. Kocher & Peter Martinsson & Kristian Ove R. Myrseth & Conny E. Wollbrant, 2017. "Strong, bold, and kind: self-control and cooperation in social dilemmas," Experimental Economics, Springer;Economic Science Association, vol. 20(1), pages 44-69, March.
    15. repec:cup:judgdm:v:16:y:2021:i:2:p:290-322 is not listed on IDEAS
    16. Wladislaw Mill & Cornelius Schneider, 2023. "The Bright Side of Tax Evasion," CESifo Working Paper Series 10615, CESifo.
    17. Donald T McKnight & Day B Ligon, 2017. "Correcting for unequal catchability in sex ratio and population size estimates," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-13, August.
    18. Recalde, María P. & Riedl, Arno & Vesterlund, Lise, 2018. "Error-prone inference from response time: The case of intuitive generosity in public-good games," Journal of Public Economics, Elsevier, vol. 160(C), pages 132-147.
    19. Lohse, Tim & Simon, Sven A. & Konrad, Kai A., 2018. "Deception under time pressure: Conscious decision or a problem of awareness?," Journal of Economic Behavior & Organization, Elsevier, vol. 146(C), pages 31-42.
    20. Mirko Duradoni & Stefania Collodi & Serena Coppolino Perfumi & Andrea Guazzini, 2021. "Reviewing Stranger on the Internet: The Role of Identifiability through “Reputation” in Online Decision Making," Future Internet, MDPI, vol. 13(5), pages 1-12, April.
    21. Anna Conte & M. Vittoria Levati & Natalia Montinari, 2019. "Experience in public goods experiments," Theory and Decision, Springer, vol. 86(1), pages 65-93, February.
    22. Farcomeni, Alessio & Dotto, Francesco, 2021. "A correction to make Chao estimator conservative when the number of sampling occasions is finite," Statistics & Probability Letters, Elsevier, vol. 176(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mpr:mprres:f97b669c7b3e4c2ab95c9f8051d18af6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joanne Pfleiderer or Cindy George (email available below). General contact details of provider: https://edirc.repec.org/data/mathius.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.