IDEAS home Printed from https://ideas.repec.org/p/hhs/stavef/2023_002.html
   My bibliography  Save this paper

A Guide to Conducting School Experiments: Expert Insights and Best Practices for Effective Implementation

Author

Listed:
  • Grosch, Kerstin

    (VU Vienna)

  • Haeckl, Simone

    (University of Stavanger)

  • Rau, Holger

    (University of Duisburg-Essen)

  • Preuss, Paul

    (University of Gottingen)

Abstract

This guide provides a comprehensive overview of the distinct characteristics of school experi- ments conducted with children in preschools and schools. We investigate and describe the essential considerations involved in designing and implementing such experiments, drawing insights from a survey conducted with senior researchers. Moreover, the guide summarizes nine key lessons learned from the experiences of these researchers. The paper also presents the opinions of inexperienced researchers in school experiments (juniors) on crucial aspects of successful school experiments, which differ from the opinions of the experienced senior researchers. As a result, this guide serves as a valuable resource for junior researchers embarking on their initial school experiments. By promoting the adoption of best practices endorsed by senior researchers, it strengthens the validity and reliability of school experiments.

Suggested Citation

  • Grosch, Kerstin & Haeckl, Simone & Rau, Holger & Preuss, Paul, 2023. "A Guide to Conducting School Experiments: Expert Insights and Best Practices for Effective Implementation," UiS Working Papers in Economics and Finance 2023/2, University of Stavanger.
    • Handle: RePEc:hhs:stavef:2023_002
    as

    Download full text from publisher

    File URL: https://ba-odegaard.no/uis_wps_econ_fin/uis_wps_2023_02_grosch_haeckl_rau_preus.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sutter, Matthias & Yilmaz, Levent & Oberauer, Manuela, 2015. "Delay of gratification and the role of defaults—An experiment with kindergarten children," Economics Letters, Elsevier, vol. 137(C), pages 21-24.
    2. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    3. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
    4. Gary Charness & Anya Samek & Jeroen Ven, 2022. "What is considered deception in experimental economics?," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 385-412, April.
    5. Harbaugh, William T & Krause, Kate, 2000. "Children's Altruism in Public Good and Dictator Experiments," Economic Inquiry, Western Economic Association International, vol. 38(1), pages 95-109, January.
    6. Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
    7. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    8. Cass R. Sunstein & Richard H. Thaler, 2003. "Libertarian paternalism is not an oxymoron," Conference Series ; [Proceedings], Federal Reserve Bank of Boston, vol. 48(Jun).
    9. repec:feb:artefa:0106 is not listed on IDEAS
    10. Bettinger, Eric & Ludvigsen, Sten & Rege, Mari & Solli, Ingeborg F. & Yeager, David, 2018. "Increasing perseverance in math: Evidence from a field experiment in Norway," Journal of Economic Behavior & Organization, Elsevier, vol. 146(C), pages 1-15.
    11. Sutter, Matthias & Zoller, Claudia & Glätzle-Rützler, Daniela, 2019. "Economic behavior of children and adolescents – A first survey of experimental economics results," European Economic Review, Elsevier, vol. 111(C), pages 98-121.
    12. Ronald E. Dahl & Nicholas B. Allen & Linda Wilbrecht & Ahna Ballonoff Suleiman, 2018. "Importance of investing in adolescence from a developmental science perspective," Nature, Nature, vol. 554(7693), pages 441-450, February.
    13. Hermes, Henning & Hett, Florian & Mechtel, Mario & Schmidt, Felix & Schunk, Daniel & Wagner, Valentin, 2020. "Do children cooperate conditionally? Adapting the strategy method for first-graders," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 638-652.
    14. Rachel Glennerster & Kudzai Takavarasha, 2013. "Running Randomized Evaluations: A Practical Guide," Economics Books, Princeton University Press, edition 1, number 10085.
    15. John List, 2008. "Informed consent in social science," Artefactual Field Experiments 00086, The Field Experiments Website.
    16. Charness, Gary & List, John A. & Rustichini, Aldo & Samek, Anya & Van De Ven, Jeroen, 2019. "Theory of mind among disadvantaged children: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 174-194.
    17. Gummerum, Michaela & Hanoch, Yaniv & Keller, Monika & Parsons, Katie & Hummel, Alegra, 2010. "Preschoolers' allocations in the dictator game: The role of moral emotions," Journal of Economic Psychology, Elsevier, vol. 31(1), pages 25-34, February.
    18. John A. List, 2011. "Why Economists Should Conduct Field Experiments and 14 Tips for Pulling One Off," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 3-16, Summer.
    19. Matthias Sutter & Daniela Glätzle-Rützler, 2015. "Gender Differences in the Willingness to Compete Emerge Early in Life and Persist," Management Science, INFORMS, vol. 61(10), pages 2339-23354, October.
    20. Rubinstein, Ariel, 2001. "A theorist's view of experiments," European Economic Review, Elsevier, vol. 45(4-6), pages 615-628, May.
    21. Richard H. Thaler & Cass R. Sunstein, 2023. "Libertarian paternalism," Chapters, in: Cass R. Sunstein & Lucia A. Reisch (ed.), Research Handbook on Nudges and Society, chapter 1, pages 10-16, Edward Elgar Publishing.
    22. Uri Gneezy & Aldo Rustichini, 2004. "Gender and Competition at a Young Age," American Economic Review, American Economic Association, vol. 94(2), pages 377-381, May.
    23. Omar Al-Ubaydli & John A. List & Dana L. Suskind, 2017. "What Can We Learn from Experiments? Understanding the Threats to the Scalability of Experimental Results," American Economic Review, American Economic Association, vol. 107(5), pages 282-286, May.
    24. Fehr, Ernst & Glätzle-Rützler, Daniela & Sutter, Matthias, 2013. "The development of egalitarianism, altruism, spite and parochialism in childhood and adolescence," European Economic Review, Elsevier, vol. 64(C), pages 369-383.
    25. Voslinsky, Alisa & Azar, Ofer H., 2021. "Incentives in experimental economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 93(C).
    26. Kerstin Grosch & Simone Haeckl & Martin G. Kocher, 2022. "Closing the Gender STEM Gap - A Large-Scale Randomized-Controlled Trial in Elementary Schools," CESifo Working Paper Series 9907, CESifo.
    27. Hausman, Daniel M & McPherson, Michael S, 1993. "Taking Ethics Seriously: Economics and Contemporary Moral Philosophy," Journal of Economic Literature, American Economic Association, vol. 31(2), pages 671-731, June.
    28. Alan, Sule & Baydar, Nazli & Boneva, Teodora & Crossley, Thomas F. & Ertac, Seda, 2017. "Transmission of risk preferences from mothers to daughters," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 60-77.
    29. repec:feb:artefa:0110 is not listed on IDEAS
    30. Kaplan, Lennart & Kuhnt, Jana & Steinert, Janina I., 2020. "Do no harm? Field research in the Global South: Ethical challenges faced by research staff," World Development, Elsevier, vol. 127(C).
    31. repec:mpr:mprres:5863 is not listed on IDEAS
    32. Alexander Cappelen & John List & Anya Samek & Bertil Tungodden, 2020. "The Effect of Early-Childhood Education on Social Preferences," Journal of Political Economy, University of Chicago Press, vol. 128(7), pages 2739-2758.
    33. Sule Alan & Ceren Baysan & Mert Gumren & Elif Kubilay, 2021. "Building Social Cohesion in Ethnically Mixed Schools: An Intervention on Perspective Taking," The Quarterly Journal of Economics, Oxford University Press, vol. 136(4), pages 2147-2194.
    34. Martin Dufwenberg & Glenn Harrison, 2008. "Peter Bohm: Father of field experiments," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 213-220, September.
    35. Grosch, Kerstin & Häckl, Simone & Kocher, Martin G., 2022. "Closing the gender STEM gap," Department of Economics Working Paper Series 329, WU Vienna University of Economics and Business.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hermes, Henning & Hett, Florian & Mechtel, Mario & Schmidt, Felix & Schunk, Daniel & Wagner, Valentin, 2020. "Do children cooperate conditionally? Adapting the strategy method for first-graders," Journal of Economic Behavior & Organization, Elsevier, vol. 179(C), pages 638-652.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sutter, Matthias & Zoller, Claudia & Glätzle-Rützler, Daniela, 2019. "Economic behavior of children and adolescents – A first survey of experimental economics results," European Economic Review, Elsevier, vol. 111(C), pages 98-121.
    2. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
    3. Horn, Dániel & Kiss, Hubert János & Lénárd, Tünde, 2022. "Gender differences in preferences of adolescents: Evidence from a large-scale classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 478-522.
    4. Kerstin Grosch & Simone Haeckl & Martin G. Kocher, 2022. "Closing the Gender STEM Gap - A Large-Scale Randomized-Controlled Trial in Elementary Schools," CESifo Working Paper Series 9907, CESifo.
    5. Grosch, Kerstin & Häckl, Simone & Kocher, Martin G., 2022. "Closing the gender STEM gap," Department of Economics Working Paper Series 329, WU Vienna University of Economics and Business.
    6. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    7. Falk, Armin & Kosse, Fabian & Schildberg-Hörisch, Hannah & Zimmermann, Florian, 2023. "Self-assessment: The role of the social environment," Journal of Public Economics, Elsevier, vol. 223(C).
    8. Etienne Dagorn & David Masclet & Thierry Penard, 2022. "The Behavioral Determinants of School Achievement: A Lab in the Field Experiment in Middle School," Economics Working Paper Archive (University of Rennes 1 & University of Caen) 2022-05, Center for Research in Economics and Management (CREM), University of Rennes 1, University of Caen and CNRS.
    9. Silvia Angerer & E. Glenn Dutcher & Daniela Glätzle-Rützler & Philipp Lergetporer & Matthias Sutter, 2021. "The Formation of Risk Preferences Through Small-Scale Events," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2021_16, Max Planck Institute for Research on Collective Goods.
    10. Zhou, Yexin & Chen, Siwei & Chen, Yefeng & Vollan, Björn, 2022. "Does parental migration impede the development of the cooperative preferences in their left-behind children? Evidence from a large-scale field experiment in China," China Economic Review, Elsevier, vol. 74(C).
    11. Johannes Abeler & Armin Falk & Fabian Kosse, 2021. "Malleability of Preferences for Honesty," CESifo Working Paper Series 9033, CESifo.
    12. Laura Breitkopf & Shyamal Chowdhury & Shambhavi Priyam & Hannah Schildberg-Hörisch & Matthias Sutter, 2024. "Do economic preferences of children predict behavior?," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2024_09, Max Planck Institute for Research on Collective Goods.
    13. Abeler, Johannes & Falk, Armin & Kosse, Fabian, 2021. "Malleability of Preferences for Honesty," Rationality and Competition Discussion Paper Series 296, CRC TRR 190 Rationality and Competition.
    14. Sutter, Matthias & Untertrifaller, Anna, 2020. "Children's heterogeneity in cooperation and parental background: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 171(C), pages 286-296.
    15. Cavatorta, Elisa & Zizzo, Daniel John & Daoud, Yousef, 2023. "Conflict and reciprocity: A study with Palestinian youths," Journal of Development Economics, Elsevier, vol. 160(C).
    16. Jaime, Marcela & Salazar, César & Alpizar, Francisco & Carlsson, Fredrik, 2023. "Can school environmental education programs make children and parents more pro-environmental?," Journal of Development Economics, Elsevier, vol. 161(C).
    17. Zvonimir Bašić & Parampreet C. Bindra & Daniela Glätzle-Rützler & Angelo Romano & Matthias Sutter & Claudia Zoller, 2021. "The Roots of Cooperation," ECONtribute Discussion Papers Series 097, University of Bonn and University of Cologne, Germany.
    18. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    19. Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
    20. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials [Microcredit impacts: Evidence from a randomized microcredit program placement experiment by Compartamos Banco]," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.

    More about this item

    Keywords

    school experiments; guide; internal validity; survey;
    All these keywords.

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • I20 - Health, Education, and Welfare - - Education - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:stavef:2023_002. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bernt Arne Odegaard (email available below). General contact details of provider: https://edirc.repec.org/data/iouisno.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.