IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/20953.html
   My bibliography  Save this paper

Who Is Coming to the Artefactual Field Experiment? Participation Bias among Chinese Rural Migrants

Author

Listed:
  • Paul Frijters
  • Tao Sherry Kong
  • Elaine M. Liu

Abstract

In this paper, we compare participants in an artefactual field experiment in urban China with the survey population of migrants from which they were recruited. The experimental participants were more educated, more likely to lend money to friends, and worked fewer hours than the general population. They differ significantly from non-participants in terms of regression coefficients, such as the effects of wealth and marital status on the probability of being self-employed and distance migrated. We thus find that there was selection into our experiments on the basis of both observable characteristics and on unobserved differences in behavioral relations.

Suggested Citation

  • Paul Frijters & Tao Sherry Kong & Elaine M. Liu, 2015. "Who Is Coming to the Artefactual Field Experiment? Participation Bias among Chinese Rural Migrants," NBER Working Papers 20953, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:20953
    Note: DEV
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w20953.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    2. Matthias Benz & Stephan Meier, 2008. "Do people behave in experiments as in the field?—evidence from donations," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 268-281, September.
    3. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    4. Juan Camilo Cardenas & Jeffrey Carpenter, 2008. "Behavioural Development Economics: Lessons from Field Labs in the Developing World," Journal of Development Studies, Taylor & Francis Journals, vol. 44(3), pages 311-338.
    5. Edward C. Norton & Hua Wang & Chunrong Ai, 2004. "Computing interaction effects and standard errors in logit and probit models," Stata Journal, StataCorp LP, vol. 4(2), pages 154-167, June.
    6. Blair Cleave & Nikos Nikiforakis & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 372-382, September.
    7. Angus S. Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," NBER Working Papers 14690, National Bureau of Economic Research, Inc.
    8. Roe, Brian E. & Haab, Timothy C. & Beversdorf, David Q. & Gu, Howard H. & Tilley, Michael R., 2009. "Risk-attitude selection bias in subject pools for experiments involving neuroimaging and blood samples," Journal of Economic Psychology, Elsevier, vol. 30(2), pages 181-189, April.
    9. Nava Ashraf & Dean Karlan & Wesley Yin, 2006. "Tying Odysseus to the Mast: Evidence From a Commitment Savings Product in the Philippines," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 121(2), pages 635-672.
    10. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    11. Utteeyo Dasgupta & Subha Mani, 2013. "Only Mine or All Ours: An Artefactual Field Experiment on Procedural Altruism," Fordham Economics Discussion Paper Series dp2013-01, Fordham University, Department of Economics.
    12. Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012. "Experts in experiments," Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
    13. Zingales, Luigi & Sapienza, Paola & Baran, Nicole M., 2010. "Can we infer social preferences from the lab? Evidence from the trust game," CEPR Discussion Papers 7634, C.E.P.R. Discussion Papers.
    14. Jeffrey Carpenter & Cristina Connolly & Caitlin Myers, 2008. "Altruistic behavior in a representative dictator experiment," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 282-298, September.
    15. Carpenter, Jeffrey & Verhoogen, Eric & Burks, Stephen, 2005. "The effect of stakes in distribution experiments," Economics Letters, Elsevier, vol. 86(3), pages 393-398, March.
    16. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009 is not listed on IDEAS
    17. Robert B. Barsky & F. Thomas Juster & Miles S. Kimball & Matthew D. Shapiro, 1997. "Preference Parameters and Behavioral Heterogeneity: An Experimental Approach in the Health and Retirement Study," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 537-579.
    18. Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009. "Risk attitudes, randomization to treatment, and self-selection into experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
    19. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten Igel & Rutström, E. Elisabet, 2010. "Preference heterogeneity in experiments: Comparing the field and laboratory," Journal of Economic Behavior & Organization, Elsevier, vol. 73(2), pages 209-224, February.
    20. Peterson, Robert A, 2001. "On the Use of College Students in Social Science Research: Insights from a Second-Order Meta-analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(3), pages 450-461, December.
    21. Laura Schechter, 2007. "Theft, Gift-Giving, and Trustworthiness: Honesty Is Its Own Reward in Rural Paraguay," American Economic Review, American Economic Association, vol. 97(5), pages 1560-1582, December.
    22. Jon Anderson & Stephen Burks & Jeffrey Carpenter & Lorenz Götte & Karsten Maurer & Daniele Nosenzo & Ruth Potter & Kim Rocha & Aldo Rustichini, 2013. "Self-selection and variations in the laboratory measurement of other-regarding preferences across subject pools: evidence from one college student and two adult samples," Experimental Economics, Springer;Economic Science Association, vol. 16(2), pages 170-189, June.
    23. repec:pri:rpdevs:instruments_of_development is not listed on IDEAS
    24. Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2007. "Estimating Risk Attitudes in Denmark: A Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 109(2), pages 341-368, June.
    25. repec:feb:artefa:00073 is not listed on IDEAS
    26. Edward P. Lazear & Ulrike Malmendier & Roberto A. Weber, 2012. "Sorting in Experiments with Application to Social Preferences," American Economic Journal: Applied Economics, American Economic Association, vol. 4(1), pages 136-163, January.
    27. Xin Meng & Chris Manning & Li Shi & Tadjuddin Nur Effendi (ed.), 2010. "The Great Migration," Books, Edward Elgar Publishing, number 13619.
    28. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009.pdf is not listed on IDEAS
    29. Armin Falk & Stephan Meier & Christian Zehnder, 2013. "Do Lab Experiments Misrepresent Social Preferences? The Case Of Self-Selected Student Samples," Journal of the European Economic Association, European Economic Association, vol. 11(4), pages 839-852, August.
    30. Carpenter, Jeffrey P. & Daniere, Amrita G. & Takahashi, Lois M., 2004. "Cooperation, trust, and social capital in Southeast Asian urban slums," Journal of Economic Behavior & Organization, Elsevier, vol. 55(4), pages 533-551, December.
    31. Dan Lovallo & Colin Camerer, 1999. "Overconfidence and Excess Entry: An Experimental Approach," American Economic Review, American Economic Association, vol. 89(1), pages 306-318, March.
    32. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2013. "Opting-in: Participation bias in economic experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 43-70.
    33. repec:pri:rpdevs:instruments_of_development.pdf is not listed on IDEAS
    34. Donkers, Bas & Melenberg, Bertrand & Van Soest, Arthur, 2001. "Estimating Risk Attitudes Using Lotteries: A Large Sample Approach," Journal of Risk and Uncertainty, Springer, vol. 22(2), pages 165-195, March.
    35. Elaine M. Liu, 2013. "Time to Change What to Sow: Risk Preferences and Technology Adoption Decisions of Cotton Farmers in China," The Review of Economics and Statistics, MIT Press, vol. 95(4), pages 1386-1403, October.
    36. Michal Krawczyk, 2011. "What brings your subjects to the lab? A field experiment," Natural Field Experiments 00694, The Field Experiments Website.
    37. Uwe Dulleck & Jonas Fooken & Yumei He, 2012. "Public Policy and Individual Labor Market Discrimination: An Artefactual Field Experiment in China," QuBE Working Papers 002, QUT Business School.
    38. Michèle Belot & Raymond Duch & Luis Miller, 2010. "Who should be called to the lab? A comprehensive comparison of students and non-students in classic experimental games," Discussion Papers 2010001, University of Oxford, Nuffield College.
    39. Michal Krawczyk, 2011. "What brings your subjects to the lab? A field experiment," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 482-489, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Belot, Michèle & James, Jonathan, 2016. "Partner selection into policy relevant field experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 123(C), pages 31-56.
    2. Romero, Christina & Wollni, Meike, 2015. "The effect of opportunistic behavior on trust: An experimental approach," GlobalFood Discussion Papers 206382, Georg-August-Universitaet Goettingen, GlobalFood, Department of Agricultural Economics and Rural Development.
    3. Markussen, Thomas & Sharma, Smriti & Singhal, Saurabh & Tarp, Finn, 2021. "Inequality, institutions and cooperation," European Economic Review, Elsevier, vol. 138(C).
    4. Alex Eble & Peter Boone & Diana Elbourne, 2017. "On Minimizing the Risk of Bias in Randomized Controlled Trials in Economics," The World Bank Economic Review, World Bank, vol. 31(3), pages 687-707.
    5. Hao, Li & Houser, Daniel & Mao, Lei & Villeval, Marie Claire, 2016. "Migrations, risks, and uncertainty: A field experiment in China," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PA), pages 126-140.
    6. Laurent Denant-Boemont & Matthieu Leprince & Matthieu Pourieux, 2019. "Distributive Preferences of Public Representatives: A Field-in-the-Lab Experiment," Economics Working Paper from Condorcet Center for political Economy at CREM-CNRS 2019-05-ccr, Condorcet Center for political Economy.
    7. Uri Gneezy & Alex Imas, 2016. "Lab in the Field: Measuring Preferences in the Wild," CESifo Working Paper Series 5953, CESifo.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    2. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2013. "Opting-in: Participation bias in economic experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 43-70.
    3. Johannes Abeler & Daniele Nosenzo, 2015. "Self-selection into laboratory experiments: pro-social motives versus monetary incentives," Experimental Economics, Springer;Economic Science Association, vol. 18(2), pages 195-214, June.
    4. Jonathan Schulz & Uwe Sunde & Petra Thiemann & Christian Thoeni, 2019. "Selection into Experiments: Evidence from a Population of Students," Discussion Papers 2019-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    5. Thiemann, Petra & Schulz, Jonathan & Sunde, Uwe & Thöni, Christian, 2022. "Selection into experiments: New evidence on the role of preferences, cognition, and recruitment protocols," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    6. Stephen V. Burks & Daniele Nosenzo & Jon Anderson & Matthew Bombyk & Derek Ganzhorn & Lorenz Goette & Aldo Rustichini, 2015. "Lab Measures of Other-Regarding Preferences Can Predict Some Related on-the-Job Behavior: Evidence from a Large Scale Field Experiment," Discussion Papers 2015-21, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    7. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute of Labor Economics (IZA).
    8. Mongoljin Batsaikhan, 2017. "Trust, Trustworthiness, And Business Success: Lab And Field Findings From Entrepreneurs," Economic Inquiry, Western Economic Association International, vol. 55(1), pages 368-382, January.
    9. Abeler, Johannes & Nosenzo, Daniele, 2013. "Self-Selection into Economics Experiments Is Driven by Monetary Rewards," IZA Discussion Papers 7374, Institute of Labor Economics (IZA).
    10. Cleave, Blair L. & Nikiforakis, Nikos & Slonim, Robert, 2010. "Is There Selection Bias in Laboratory Experiments?," Working Papers 2010-01, University of Sydney, School of Economics.
    11. Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012. "Experts in experiments," Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
    12. Blair Cleave & Nikos Nikiforakis & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 372-382, September.
    13. Jon Anderson & Stephen Burks & Jeffrey Carpenter & Lorenz Götte & Karsten Maurer & Daniele Nosenzo & Ruth Potter & Kim Rocha & Aldo Rustichini, 2013. "Self-selection and variations in the laboratory measurement of other-regarding preferences across subject pools: evidence from one college student and two adult samples," Experimental Economics, Springer;Economic Science Association, vol. 16(2), pages 170-189, June.
    14. Thomas Epper & Julien Senn & Ernst Fehr, 2023. "Social preferences across subject pools: students vs. general population," ECON - Working Papers 435, Department of Economics - University of Zurich, revised Jan 2024.
    15. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    16. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    17. Antonio A. Arechar & Simon Gächter & Lucas Molleman, 2018. "Conducting interactive experiments online," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 99-131, March.
    18. Hakan J. Holm & Sonja Opper & Victor Nee, 2013. "Entrepreneurs Under Uncertainty: An Economic Experiment in China," Management Science, INFORMS, vol. 59(7), pages 1671-1687, July.
    19. Schmidt, Robert & Schwieren, Christiane & Sproten, Alec N., 2020. "Norms in the lab: Inexperienced versus experienced participants," Journal of Economic Behavior & Organization, Elsevier, vol. 173(C), pages 239-255.
    20. Jasper Knockaert & Stefanie Peer & Erik Verhoef, 2016. "Identification of self-selection biases in field experiments using stated preference experiments," Natural Field Experiments 00568, The Field Experiments Website.

    More about this item

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:20953. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.