IDEAS home Printed from https://ideas.repec.org/p/mpr/mprres/f97b669c7b3e4c2ab95c9f8051d18af6.html

The Average Laboratory Samples a Population of 7,300 Amazon Mechanical Turk Workers

Author

Listed:
  • Neil Stewart
  • Christoph Ungemach
  • Adam J. L. Harris
  • Daniel M. Bartels
  • Ben R. Newell
  • Gabriele Paolacci
  • Jesse Chandler

Abstract

Using capture-recapture analysis (a tool used by ecologists to estimate the size of hard to observe populations) we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers.

Suggested Citation

  • Neil Stewart & Christoph Ungemach & Adam J. L. Harris & Daniel M. Bartels & Ben R. Newell & Gabriele Paolacci & Jesse Chandler, "undated". "The Average Laboratory Samples a Population of 7,300 Amazon Mechanical Turk Workers," Mathematica Policy Research Reports f97b669c7b3e4c2ab95c9f805, Mathematica Policy Research.
    • Handle: RePEc:mpr:mprres:f97b669c7b3e4c2ab95c9f8051d18af6
    as

    Download full text from publisher

    File URL: http://journal.sjdm.org/14/14725/jdm14725.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gabriele Paolacci & Jesse Chandler & Panagiotis G. Ipeirotis, 2010. "Running experiments on Amazon Mechanical Turk," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 5(5), pages 411-419, August.
    2. David G. Rand & Alexander Peysakhovich & Gordon T. Kraft-Todd & George E. Newman & Owen Wurzbacher & Martin A. Nowak & Joshua D. Greene, 2014. "Social heuristics shape intuitive cooperation," Nature Communications, Nature, vol. 5(1), pages 1-12, May.
    3. Baillargeon, Sophie & Rivest, Louis-Paul, 2007. "Rcapture: Loglinear Models for Capture-Recapture in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 19(i05).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Neil Stewart & Christoph Ungemach & Adam J. L. Harris & Daniel M. Bartels & Ben R. Newell & Gabriele Paolacci & Jesse Chandler, 2015. "The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(5), pages 479-491, September.
    2. Wladislaw Mill & Cornelius Schneider, 2023. "The Bright Side of Tax Evasion," CESifo Working Paper Series 10615, CESifo.
    3. Johannes Lohse & Timo Goeschl & Johannes H. Diederich, 2017. "Giving is a Question of Time: Response Times and Contributions to an Environmental Public Good," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 67(3), pages 455-477, July.
    4. Brunner, Fabian & Gamm, Fabian & Mill, Wladislaw, 2023. "MyPortfolio: The IKEA effect in financial investment decisions," Journal of Banking & Finance, Elsevier, vol. 154(C).
    5. Antonio A. Arechar & Simon Gächter & Lucas Molleman, 2018. "Conducting interactive experiments online," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 99-131, March.
    6. Wladislaw Mill & John Morgan, 2022. "The cost of a divided America: an experimental study into destructive behavior," Experimental Economics, Springer;Economic Science Association, vol. 25(3), pages 974-1001, June.
    7. David G Rand & Gordon Kraft-Todd & June Gruber, 2015. "The Collective Benefits of Feeling Good and Letting Go: Positive Emotion and (dis)Inhibition Interact to Predict Cooperative Behavior," PLOS ONE, Public Library of Science, vol. 10(1), pages 1-12, January.
    8. Wladislaw Mill & Jonathan Staebler, 2023. "Spite in Litigation," CRC TR 224 Discussion Paper Series crctr224_2023_401, University of Bonn and University of Mannheim, Germany.
    9. Antonio A. Arechar & Gordon T. Kraft-Todd & David G. Rand, 2017. "Turking overtime: how participant characteristics and behavior vary over time and day on Amazon Mechanical Turk," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 3(1), pages 1-11, July.
    10. Capraro, Valerio & Schulz, Jonathan & Rand, David G., 2019. "Time pressure and honesty in a deception game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 79(C), pages 93-99.
    11. Capraro, Valerio & Kuilder, Jotte, 2016. "To know or not to know? Looking at payoffs signals selfish behavior, but it does not actually mean so," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 65(C), pages 79-84.
    12. Jeremy Cone & David G Rand, 2014. "Time Pressure Increases Cooperation in Competitively Framed Social Dilemmas," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-13, December.
    13. Hoeft, Leonard & Kurschilgen, Michael & Mill, Wladislaw, 2025. "Norms as obligations," International Review of Law and Economics, Elsevier, vol. 81(C).
    14. Yamada, Katsunori & Sato, Masayuki, 2013. "Another avenue for anatomy of income comparisons: Evidence from hypothetical choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 35-57.
    15. Kenneth D. Nguyen & Heather Rosoff & Richard S. John, 2017. "Valuing Equal Protection in Aviation Security Screening," Risk Analysis, John Wiley & Sons, vol. 37(12), pages 2405-2419, December.
    16. Varun Dutt & Cleotilde Gonzalez, 2013. "Enabling Eco-Friendly Choices by Relying on the Proportional-Thinking Heuristic," Sustainability, MDPI, vol. 5(1), pages 1-15, January.
    17. Sweldens, Steven & Puntoni, Stefano & Paolacci, Gabriele & Vissers, Maarten, 2014. "The bias in the bias: Comparative optimism as a function of event social undesirability," Organizational Behavior and Human Decision Processes, Elsevier, vol. 124(2), pages 229-244.
    18. Christian Hilbe & Moshe Hoffman & Martin A. Nowak, 2015. "Cooperate without Looking in a Non-Repeated Game," Games, MDPI, vol. 6(4), pages 1-15, September.
    19. S. Venus Jin & Aziz Muqaddam, 2019. "Product placement 2.0: “Do Brands Need Influencers, or Do Influencers Need Brands?”," Journal of Brand Management, Palgrave Macmillan, vol. 26(5), pages 522-537, September.
    20. Hopkins, Caroline & Hyde, Timothy, 2026. "HKC04 - How do risk perceptions change with new information? Evidence from a survey of flood-prone counties," Oberlin College Kasper Economics and Business Working Papers Series 2601, Oberlin College, Department of Economics.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mpr:mprres:f97b669c7b3e4c2ab95c9f8051d18af6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joanne Pfleiderer or Cindy George The email address of this maintainer does not seem to be valid anymore. Please ask Cindy George to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/mathius.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.