IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v106y2023ics2214804323000745.html
   My bibliography  Save this article

The adventure of running experiments with teenagers

Author

Listed:
  • Alfonso, Antonio
  • Brañas-Garza, Pablo
  • Jorrat, Diego
  • Lomas, Pablo
  • Prissé, Benjamin
  • Vasco, Mónica
  • Vázquez-De Francisco, María J.

Abstract

Economists are increasingly interested in how to conduct experiments with teenagers. This paper evaluates whether different methodological factors impact the answers of teenagers to standard experimental tasks on measuring time preferences, risk preferences and cognitive abilities, among others. Results show: (i) the recruitment process matters. When the school includes the experiment as an institutional activity, the dropout rate is observed to be significantly reduced; (ii) hypothetical payments elicit similar results to monetary payments; (iii) adding visual elements to the experiment’s interface improves the quality of answers; and iv) although the type of device has no effect on the results, who administers the experiment does have an effect. We conclude by giving three suggestions to researchers interested in conducting experiments with teenagers: first, run the experiment as a school-programmed activity; second, the use of actual payments is not necessary, which increases the cost and complicates the recruitment; and third, integrate visual components to the task.

Suggested Citation

  • Alfonso, Antonio & Brañas-Garza, Pablo & Jorrat, Diego & Lomas, Pablo & Prissé, Benjamin & Vasco, Mónica & Vázquez-De Francisco, María J., 2023. "The adventure of running experiments with teenagers," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 106(C).
  • Handle: RePEc:eee:soceco:v:106:y:2023:i:c:s2214804323000745
    DOI: 10.1016/j.socec.2023.102048
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214804323000745
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.socec.2023.102048?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Brañas-Garza, Pablo & Estepa-Mohedano, Lorenzo & Jorrat, Diego & Orozco, Victor & Rascón-Ramírez, Ericka, 2021. "To pay or not to pay: Measuring risk preferences in lab and field," Judgment and Decision Making, Cambridge University Press, vol. 16(5), pages 1290-1313, September.
    2. Andreoni, James & Kuhn, Michael A. & List, John A. & Samek, Anya & Sokal, Kevin & Sprenger, Charles, 2019. "Toward an understanding of the development of time preferences: Evidence from field experiments," Journal of Public Economics, Elsevier, vol. 177(C), pages 1-1.
    3. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    4. Matthias Sutter & Martin G. Kocher & Daniela Glätzle-Rützler & Stefan T. Trautmann, 2013. "Impatience and Uncertainty: Experimental Decisions Predict Adolescents' Field Behavior," American Economic Review, American Economic Association, vol. 103(1), pages 510-531, February.
    5. Alberto Abadie & Guido W. Imbens, 2016. "Matching on the Estimated Propensity Score," Econometrica, Econometric Society, vol. 84, pages 781-807, March.
    6. Jørgensen, Lotte Kofoed & Piovesan, Marco & Willadsen, Helene, 2022. "Gender differences in competitiveness: Friends matter," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 101(C).
    7. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    8. repec:cup:judgdm:v:11:y:2016:i:1:p:99-113 is not listed on IDEAS
    9. Andreoni, James & Di Girolamo, Amalia & List, John A. & Mackevicius, Claire & Samek, Anya, 2020. "Risk preferences of children and adolescents in relation to gender, cognitive skills, soft skills, and executive functions," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 729-742.
    10. James Andreoni & Charles Sprenger, 2012. "Risk Preferences Are Not Time Preferences," American Economic Review, American Economic Association, vol. 102(7), pages 3357-3376, December.
    11. Stoklosa, Michal & Shuval, Kerem & Drope, Jeffrey & Tchernis, Rusty & Pachucki, Mark & Yaroch, Amy & Harding, Matthew, 2018. "The intergenerational transmission of obesity: The role of time preferences and self-control," Economics & Human Biology, Elsevier, vol. 28(C), pages 92-106.
    12. Castillo, Marco & Jordan, Jeffrey L. & Petrie, Ragan, 2018. "Children’s rationality, risk attitudes and field behavior," European Economic Review, Elsevier, vol. 102(C), pages 62-81.
    13. Samek, Anya & Gray, Andre & Datar, Ashlesha & Nicosia, Nancy, 2021. "Adolescent time and risk preferences: Measurement, determinants and field consequences," Journal of Economic Behavior & Organization, Elsevier, vol. 184(C), pages 460-488.
    14. Castillo, Marco & Ferraro, Paul J. & Jordan, Jeffrey L. & Petrie, Ragan, 2011. "The today and tomorrow of kids: Time preferences and educational outcomes of children," Journal of Public Economics, Elsevier, vol. 95(11), pages 1377-1385.
    15. Melanie Lührmann & Marta Serra-Garcia & Joachim Winter, 2018. "The Impact of Financial Education on Adolescents' Intertemporal Choices," American Economic Journal: Economic Policy, American Economic Association, vol. 10(3), pages 309-332, August.
    16. Mograbi, Eli, 2022. "Decision-makers are more impulsive on smartphones than on computers," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    17. Christopher Chabris & David Laibson & Carrie Morris & Jonathon Schuldt & Dmitry Taubinsky, 2008. "Individual laboratory-measured discount rates predict field behavior," Journal of Risk and Uncertainty, Springer, vol. 37(2), pages 237-269, December.
    18. Prissé, Benjamin & Jorrat, Diego, 2022. "Lab vs online experiments: No differences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    19. Jorrat, Diego, 2021. "Recruiting experimental subjects using WhatsApp," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    20. Adeline Delavande & Hans-Peter Kohler, 2009. "Subjective expectations in the context of HIV/AIDS in Malawi," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 20(31), pages 817-875.
    21. Tymula, Agnieszka, 2019. "An experimental study of adolescent behavior under peer observation: Adolescents are more impatient and inconsistent, not more risk-taking, when observed by peers," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 735-750.
    22. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    23. Horn, Dániel & Kiss, Hubert János & Lénárd, Tünde, 2022. "Gender differences in preferences of adolescents: Evidence from a large-scale classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 478-522.
    24. Sule Alan & Seda Ertac, 2018. "Fostering Patience in the Classroom: Results from Randomized Educational Intervention," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 1865-1911.
    25. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    26. Catherine Eckel & Philip Grossman & Cathleen Johnson & Angela Oliveira & Christian Rojas & Rick Wilson, 2012. "School environment and risk preferences: Experimental evidence," Journal of Risk and Uncertainty, Springer, vol. 45(3), pages 265-292, December.
    27. repec:cup:judgdm:v:16:y:2021:i:5:p:1290-1313 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. No title
      by maximorossi in NEP-LTV blog on 2023-02-27 18:50:57

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pablo Brañas-Garza & Diego Jorrat & Antonio M. Espín & Angel Sánchez, 2023. "Paid and hypothetical time preferences are the same: lab, field and online evidence," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 412-434, April.
    2. Backes-Gellner, Uschi & Herz, Holger & Kosfeld, Michael & Oswald, Yvonne, 2021. "Do preferences and biases predict life outcomes? Evidence from education and labor market entry decisions," European Economic Review, Elsevier, vol. 134(C).
    3. Islam, Asad & Lee, Wang-Sheng & Nicholas, Aaron, 2021. "The Effects of Chess Instruction on Academic and Non-cognitive Outcomes: Field Experimental Evidence from a Developing Country," Journal of Development Economics, Elsevier, vol. 150(C).
    4. Samek, Anya & Gray, Andre & Datar, Ashlesha & Nicosia, Nancy, 2021. "Adolescent time and risk preferences: Measurement, determinants and field consequences," Journal of Economic Behavior & Organization, Elsevier, vol. 184(C), pages 460-488.
    5. Datar, Ashlesha & Nicosia, Nancy & Samek, Anya, 2023. "Heterogeneity in place effects on health: The case of time preferences and adolescent obesity," Economics & Human Biology, Elsevier, vol. 49(C).
    6. Horn, Dániel & Kiss, Hubert János & Lénárd, Tünde, 2022. "Gender differences in preferences of adolescents: Evidence from a large-scale classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 478-522.
    7. Sutter, Matthias & Zoller, Claudia & Glätzle-Rützler, Daniela, 2019. "Economic behavior of children and adolescents – A first survey of experimental economics results," European Economic Review, Elsevier, vol. 111(C), pages 98-121.
    8. Marco Castillo & John A. List & Ragan Petrie & Anya Samek, 2020. "Detecting Drivers of Behavior at an Early Age: Evidence from a Longitudinal Field Experiment," NBER Working Papers 28288, National Bureau of Economic Research, Inc.
    9. Andreoni, James & Di Girolamo, Amalia & List, John A. & Mackevicius, Claire & Samek, Anya, 2020. "Risk preferences of children and adolescents in relation to gender, cognitive skills, soft skills, and executive functions," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 729-742.
    10. Angerer, Silvia & Bolvashenkova, Jana & Glätzle-Rützler, Daniela & Lergetporer, Philipp & Sutter, Matthias, 2021. "Children's Patience and School-Track Choices Several Years Later: Linking Experimental and Field Data," IZA Discussion Papers 14401, Institute of Labor Economics (IZA).
    11. Angerer, Silvia & Bolvashenkova, Jana & Glätzle-Rützler, Daniela & Lergetporer, Philipp & Sutter, Matthias, 2023. "Children’s patience and school-track choices several years later: Linking experimental and field data," Journal of Public Economics, Elsevier, vol. 220(C).
    12. Sutter, Matthias & Angerer, Silvia & Glätzle-Rützler, Daniela & Lergetporer, Philipp, 2018. "Language group differences in time preferences: Evidence from primary school children in a bilingual city," European Economic Review, Elsevier, vol. 106(C), pages 21-34.
    13. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
    14. Matthias Sutter & Michael Weyland & Anna Untertrifaller & Manuel Froitzheim & Sebastian O. Schneider, 2020. "Financial literacy, risk and time preferences – Results from a randomized educational intervention," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2023_03, Max Planck Institute for Research on Collective Goods.
    15. Matthias Sutter & Michael Weyland & Anna Untertrifaller & Manuel Froitzheim, 2020. "Financial Literacy, Risk and Time Preferences - Results from a Randomized Educational Intervention," CESifo Working Paper Series 8489, CESifo.
    16. Matthias Sutter & Michael Weyland & Anna Untertrifaller & Manuel Froitzheim & Sebastian O. Schneider, 2023. "Financial Literacy, Experimental Preference Measures and Field Behavior – A Randomized Educational Intervention," ECONtribute Discussion Papers Series 229, University of Bonn and University of Cologne, Germany.
    17. Andreoni, James & Kuhn, Michael A. & List, John A. & Samek, Anya & Sokal, Kevin & Sprenger, Charles, 2019. "Toward an understanding of the development of time preferences: Evidence from field experiments," Journal of Public Economics, Elsevier, vol. 177(C), pages 1-1.
    18. Chiara Pastore & Stefanie Schurer & Agnieszka Tymula & Nicholas Fuller & Ian Caterson, 2023. "Economic preferences and obesity: Evidence from a clinical lab‐in‐field study," Health Economics, John Wiley & Sons, Ltd., vol. 32(9), pages 2147-2167, September.
    19. Daniel Horn & Hubert Janos Kiss, 2018. "Which preferences associate with school performance?—Lessons from an exploratory study with university students," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-32, February.
    20. Jindrich Matousek & Tomas Havranek & Zuzana Irsova, 2022. "Individual discount rates: a meta-analysis of experimental evidence," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 318-358, February.

    More about this item

    Keywords

    Developmental decision-making; Field experiments; Economic preferences; Teenagers;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:106:y:2023:i:c:s2214804323000745. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.