IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0207219.html
   My bibliography  Save this article

Citizen Social Lab: A digital platform for human behavior experimentation within a citizen science framework

Author

Listed:
  • Julián Vicens
  • Josep Perelló
  • Jordi Duch

Abstract

Cooperation is one of the behavioral traits that define human beings, however we are still trying to understand why humans cooperate. Behavioral experiments have been largely conducted to shed light into the mechanisms behind cooperation—and other behavioral traits. However, most of these experiments have been conducted in laboratories with highly controlled experimental protocols but with limitations in terms of subject pool or decisions’ context, which limits the reproducibility and the generalization of the results obtained. In an attempt to overcome these limitations, some experimental approaches have moved human behavior experimentation from laboratories to public spaces, where behaviors occur naturally, and have opened the participation to the general public within the citizen science framework. Given the open nature of these environments, it is critical to establish the appropriate data collection protocols to maintain the same data quality that one can obtain in the laboratories. In this article we introduce Citizen Social Lab, a software platform designed to be used in the wild using citizen science practices. The platform allows researchers to collect data in a more realistic context while maintaining the scientific rigor, and it is structured in a modular and scalable way so it can also be easily adapted for online or brick-and-mortar experimental laboratories. Following citizen science guidelines, the platform is designed to motivate a more general population into participation, but also to promote engaging and learning of the scientific research process. We also review the main results of the experiments performed using the platform up to now, and the set of games that each experiment includes. Finally, we evaluate some properties of the platform, such as the heterogeneity of the samples of the experiments, the satisfaction level of participants, or the technical parameters that demonstrate the robustness of the platform and the quality of the data collected.

Suggested Citation

  • Julián Vicens & Josep Perelló & Jordi Duch, 2018. "Citizen Social Lab: A digital platform for human behavior experimentation within a citizen science framework," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-20, December.
  • Handle: RePEc:plo:pone00:0207219
    DOI: 10.1371/journal.pone.0207219
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0207219
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0207219&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0207219?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Antonio M. Espin & Francisco Reyes-Pereira & Luis F. Ciria, 2017. "Organizations should know their people: A behavioral economics approach," Journal of Behavioral Economics for Policy, Society for the Advancement of Behavioral Economics (SABE), vol. 1(S), pages 41-48, November.
    2. Ernst Fehr & John A. List, 2004. "The Hidden Costs and Returns of Incentives-Trust and Trustworthiness Among CEOs," Journal of the European Economic Association, MIT Press, vol. 2(5), pages 743-771, September.
    3. Steven Levitt & John List, 2008. "Homo economicus evolves," Artefactual Field Experiments 00095, The Field Experiments Website.
    4. Forsythe Robert & Horowitz Joel L. & Savin N. E. & Sefton Martin, 1994. "Fairness in Simple Bargaining Experiments," Games and Economic Behavior, Elsevier, vol. 6(3), pages 347-369, May.
    5. repec:feb:artefa:0089 is not listed on IDEAS
    6. repec:feb:framed:0077 is not listed on IDEAS
    7. Steven D. Levitt & John A. List, 2007. "Viewpoint: On the generalizability of lab behaviour to the field," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 40(2), pages 347-370, May.
    8. Neil Stewart & Jesse Chandler & Gabriele Paolacci, "undated". "Crowdsourcing Samples in Cognitive Science," Mathematica Policy Research Reports c63e922cf7554604a919e1f18, Mathematica Policy Research.
    9. List, John A., 2009. "An introduction to field experiments in economics," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 439-442, June.
    10. Armin Falk & Stephan Meier & Christian Zehnder, 2013. "Do Lab Experiments Misrepresent Social Preferences? The Case Of Self-Selected Student Samples," Journal of the European Economic Association, European Economic Association, vol. 11(4), pages 839-852, August.
    11. repec:feb:artefa:0095 is not listed on IDEAS
    12. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    13. Trisha Gura, 2013. "Citizen science: Amateur experts," Nature, Nature, vol. 496(7444), pages 259-261, April.
    14. Mario Gutiérrez-Roig & Carlota Segura & Jordi Duch & Josep Perelló, 2016. "Market Imitation and Win-Stay Lose-Shift Strategies Emerge as Unintended Patterns in Market Direction Guesses," PLOS ONE, Public Library of Science, vol. 11(8), pages 1-19, August.
    15. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    16. Chen, Daniel L. & Schonger, Martin & Wickens, Chris, 2016. "oTree—An open-source platform for laboratory, online, and field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 9(C), pages 88-97.
    17. Ernst Fehr & Urs Fischbacher, "undated". "Third Party Punishment and Social Norms," IEW - Working Papers 106, Institute for Empirical Research in Economics - University of Zurich.
    18. repec:feb:natura:0056 is not listed on IDEAS
    19. Jeffrey Carpenter & Cristina Connolly & Caitlin Myers, 2008. "Altruistic behavior in a representative dictator experiment," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 282-298, September.
    20. Mario Guti'errez-Roig & Carlota Segura & Jordi Duch & Josep Perell'o, 2016. "Market Imitation and Win-Stay Lose-Shift strategies emerge as unintended patterns in market direction guesses," Papers 1604.01557, arXiv.org.
    21. Marcus R. Munafò & Brian A. Nosek & Dorothy V. M. Bishop & Katherine S. Button & Christopher D. Chambers & Nathalie Percie du Sert & Uri Simonsohn & Eric-Jan Wagenmakers & Jennifer J. Ware & John P. A, 2017. "A manifesto for reproducible science," Nature Human Behaviour, Nature, vol. 1(1), pages 1-9, January.
    22. Hirokazu Shirado & Nicholas A. Christakis, 2017. "Locally noisy autonomous agents improve global human coordination in network experiments," Nature, Nature, vol. 545(7654), pages 370-374, May.
    23. Robert M. Bond & Christopher J. Fariss & Jason J. Jones & Adam D. I. Kramer & Cameron Marlow & Jaime E. Settle & James H. Fowler, 2012. "A 61-million-person experiment in social influence and political mobilization," Nature, Nature, vol. 489(7415), pages 295-298, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Isabelle Bonhoure & Anna Cigarini & Julián Vicens & Bàrbara Mitats & Josep Perelló, 2023. "Reformulating computational social science with citizen social science: the case of a community-based mental health care research," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-14, December.
    2. Loreta Tauginienė & Eglė Butkevičienė & Katrin Vohland & Barbara Heinisch & Maria Daskolia & Monika Suškevičs & Manuel Portela & Bálint Balázs & Baiba Prūse, 2020. "Citizen science in the social sciences and humanities: the power of interdisciplinarity," Palgrave Communications, Palgrave Macmillan, vol. 6(1), pages 1-11, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    2. Blair Cleave & Nikos Nikiforakis & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 372-382, September.
    3. Cleave, Blair L. & Nikiforakis, Nikos & Slonim, Robert, 2010. "Is There Selection Bias in Laboratory Experiments?," Working Papers 2010-01, University of Sydney, School of Economics.
    4. Barmettler, Franziska & Fehr, Ernst & Zehnder, Christian, 2012. "Big experimenter is watching you! Anonymity and prosocial behavior in the laboratory," Games and Economic Behavior, Elsevier, vol. 75(1), pages 17-34.
    5. Naef, Michael & Schupp, Jürgen, 2009. "Measuring Trust: Experiments and Surveys in Contrast and Combination," IZA Discussion Papers 4087, Institute of Labor Economics (IZA).
    6. Chikwalila, Eric & Willinger, Marc & Farolfi, Stefano & Mungatana, Eric & Jourdain, Damien, 2023. "The impact of a scholarship programme on social capital formation among university students: An economic experiment at the University of Pretoria, South Africa," African Journal of Agricultural and Resource Economics, African Association of Agricultural Economists, vol. 18(1), April.
    7. Omar Al-Ubaydli & John List, 2013. "On the Generalizability of Experimental Results in Economics: With A Response To Camerer," Artefactual Field Experiments j0001, The Field Experiments Website.
    8. Ahrens, Steffen & Bosch-Rosa, Ciril, 2023. "Motivated beliefs, social preferences, and limited liability in financial decision-Making," Journal of Banking & Finance, Elsevier, vol. 154(C).
    9. Filippos Exadaktylos & Antonio M. Espin & Pablo Branas-Garza, 2012. "Experimental Subjects are Not Different," Working Papers 12-11, Chapman University, Economic Science Institute.
    10. Alves, Guillermo & Blanchard, Pablo & Burdin, Gabriel & Chávez, Mariana & Dean, Andrés, 2022. "Like principal, like agent? Managerial preferences in employee-owned firms," Journal of Institutional Economics, Cambridge University Press, vol. 18(6), pages 877-899, December.
    11. Erik O. Kimbrough & Alexander Vostroknutov, 2016. "Norms Make Preferences Social," Journal of the European Economic Association, European Economic Association, vol. 14(3), pages 608-638, June.
    12. Frigau, Luca & Medda, Tiziana & Pelligra, Vittorio, 2019. "From the field to the lab. An experiment on the representativeness of standard laboratory subjects," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 78(C), pages 160-169.
    13. Falk, Armin & Zehnder, Christian & Meier, Stephan, 2010. "Did We Overestimate the Role of Social Preferences? The Case of Self-Selected Student Samples," CEPR Discussion Papers 8019, C.E.P.R. Discussion Papers.
    14. Sven Grüner & Mira Lehberger & Norbert Hirschauer & Oliver Mußhoff, 2022. "How (un)informative are experiments with students for other social groups? A study of agricultural students and farmers," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(3), pages 471-504, July.
    15. Omar Al-Ubaydli & John A. List, 2013. "On the Generalizability of Experimental Results in Economics: With a Response to Commentors," CESifo Working Paper Series 4543, CESifo.
    16. Jan Stoop, 2014. "From the lab to the field: envelopes, dictators and manners," Experimental Economics, Springer;Economic Science Association, vol. 17(2), pages 304-313, June.
    17. Hoffman, Mitchell & Morgan, John, 2015. "Who's naughty? Who's nice? Experiments on whether pro-social workers are selected out of cutthroat business environments," Journal of Economic Behavior & Organization, Elsevier, vol. 109(C), pages 173-187.
    18. John Rand & Paula Castro Rodriguez & Finn Tarp & Neda Trifković, 2019. "Key behavioural characteristics of small-business owners: A lab-in-the-field experiment in Myanmar," WIDER Working Paper Series wp-2019-79, World Institute for Development Economic Research (UNU-WIDER).
    19. Fehr, Ernst & Schmidt, Klaus M., 2005. "The Economics of Fairness, Reciprocity and Altruism – Experimental Evidence and New Theories," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 66, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
    20. Weimann Joachim, 2015. "Die Rolle von Verhaltensökonomik und experimenteller Forschung in Wirtschaftswissenschaft und Politikberatung," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 16(3), pages 231-252, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0207219. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.