IDEAS home Printed from https://ideas.repec.org/p/dpr/wpaper/1160.html
   My bibliography  Save this paper

Comparing behavior between a large sample of smart students and a representative sample of Japanese adults

Author

Listed:
  • Nobuyuki Hanaki
  • Keigo Inukai
  • Takehito Masuda
  • Yuta Shimodaira

Abstract

We address a concern about the external validity, in particular, the representativeness of the sampled population, of an experiment conducted with university students. We do so by conducting large-scale (partly) incentivized online surveys of students at a Japanese university and of a sample of Japanese adults to measure individual characteristics such as cognitive ability, mentalizing skills, preferences for risk and distribution, and personality traits. While significant differences between these two samples are observed in many of these characteristics, the correlational structures among these characteristics are very similar in the two samples.

Suggested Citation

  • Nobuyuki Hanaki & Keigo Inukai & Takehito Masuda & Yuta Shimodaira, 2022. "Comparing behavior between a large sample of smart students and a representative sample of Japanese adults," ISER Discussion Paper 1160, Institute of Social and Economic Research, Osaka University.
    • Handle: RePEc:dpr:wpaper:1160
    as

    Download full text from publisher

    File URL: https://www.iser.osaka-u.ac.jp/library/dp/2022/DP1160.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Eizo Akiyama & Nobuyuki Hanaki & Ryuichiro Ishikawa, 2017. "It is Not Just Confusion! Strategic Uncertainty in An Experimental Asset Market," Economic Journal, Royal Economic Society, vol. 127(605), pages 563-580, October.
    2. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde, 2010. "Are Risk Aversion and Impatience Related to Cognitive Ability?," American Economic Review, American Economic Association, vol. 100(3), pages 1238-1260, June.
    3. Nobuyuki Hanaki & Nicolas Jacquemet & Stéphane Luchini & Adam Zylbersztejn, 2016. "Cognitive ability and the effect of strategic uncertainty," Theory and Decision, Springer, vol. 81(1), pages 101-121, June.
    4. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    5. James Andreoni & Lise Vesterlund, 2001. "Which is the Fair Sex? Gender Differences in Altruism," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 293-312.
    6. Alison L. Booth & Patrick Nolen, 2012. "Gender differences in risk behaviour: does nurture matter?," Economic Journal, Royal Economic Society, vol. 122(558), pages 56-78, February.
    7. Charles N. Noussair & Stefan T. Trautmann & Gijs van de Kuilen, 2014. "Higher Order Risk Attitudes, Demographics, and Financial Decisions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(1), pages 325-355.
    8. Kamas, Linda & Preston, Anne, 2015. "Can social preferences explain gender differences in economic behavior?," Journal of Economic Behavior & Organization, Elsevier, vol. 116(C), pages 525-539.
    9. Takehito Masuda & Eungik Lee, 2019. "Higher order risk attitudes and prevention under different timings of loss," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 197-215, March.
    10. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    11. David Gill & Victoria Prowse, 2016. "Cognitive Ability, Character Skills, and Learning to Play Equilibrium: A Level-k Analysis," Journal of Political Economy, University of Chicago Press, vol. 124(6), pages 1619-1676.
    12. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(2), pages 1-47, April.
    13. Uri Gneezy & Alex Imas & John List, 2015. "Estimating Individual Ambiguity Aversion: A Simple Approach," Artefactual Field Experiments 00588, The Field Experiments Website.
    14. Nobuyuki Hanaki, 2020. "Cognitive ability and observed behavior in laboratory experiments: implications for macroeconomic theory," The Japanese Economic Review, Springer, vol. 71(3), pages 355-378, July.
    15. Armin Falk & Anke Becker & Thomas Dohmen & David Huffman & Uwe Sunde, 2023. "The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences," Management Science, INFORMS, vol. 69(4), pages 1935-1950, April.
    16. Burnham, Terence C. & Cesarini, David & Johannesson, Magnus & Lichtenstein, Paul & Wallace, Björn, 2009. "Higher cognitive ability is associated with lower entries in a p-beauty contest," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 171-175, October.
    17. Antonio Filippin, 2022. "Gender differences in risk attitudes," IZA World of Labor, Institute of Labor Economics (IZA), pages 100-100, October.
    18. Dufwenberg, Martin & Sundaram, Ramya & Butler, David J., 2010. "Epiphany in the Game of 21," Journal of Economic Behavior & Organization, Elsevier, vol. 75(2), pages 132-143, August.
    19. Balafoutas, Loukas & Kerschbamer, Rudolf & Sutter, Matthias, 2012. "Distributional preferences and competitive behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 83(1), pages 125-135.
    20. Eugenio Proto & Aldo Rustichini & Andis Sofianos, 2019. "Intelligence, Personality, and Gains from Cooperation in Repeated Interactions," Journal of Political Economy, University of Chicago Press, vol. 127(3), pages 1351-1390.
    21. Charness, Gary & Gneezy, Uri, 2012. "Strong Evidence for Gender Differences in Risk Taking," Journal of Economic Behavior & Organization, Elsevier, vol. 83(1), pages 50-58.
    22. Ben Gillen & Erik Snowberg & Leeat Yariv, 2019. "Experimenting with Measurement Error: Techniques with Applications to the Caltech Cohort Study," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1826-1863.
    23. Carpenter, Jeffrey & Graham, Michael & Wolf, Jesse, 2013. "Cognitive ability and strategic sophistication," Games and Economic Behavior, Elsevier, vol. 80(C), pages 115-130.
    24. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    25. Smith, Vernon L & Suchanek, Gerry L & Williams, Arlington W, 1988. "Bubbles, Crashes, and Endogenous Expectations in Experimental Spot Asset Markets," Econometrica, Econometric Society, vol. 56(5), pages 1119-1151, September.
    26. Simon Gaechter & Benedikt Herrmann & Christian Thoeni, 2010. "Culture and Cooperation," Discussion Papers 2010-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    27. Gneezy, Uri & Rustichini, Aldo & Vostroknutov, Alexander, 2010. "Experience and insight in the Race game," Journal of Economic Behavior & Organization, Elsevier, vol. 75(2), pages 144-155, August.
    28. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    29. Daniel J. Benjamin & Sebastian A. Brown & Jesse M. Shapiro, 2013. "Who Is ‘Behavioral’? Cognitive Ability And Anomalous Preferences," Journal of the European Economic Association, European Economic Association, vol. 11(6), pages 1231-1255, December.
    30. Kobberling, Veronika & Wakker, Peter P., 2005. "An index of loss aversion," Journal of Economic Theory, Elsevier, vol. 122(1), pages 119-131, May.
    31. Erik Snowberg & Leeat Yariv, 2021. "Testing the Waters: Behavior across Participant Pools," American Economic Review, American Economic Association, vol. 111(2), pages 687-719, February.
    32. Crosetto, Paolo & Weisel, Ori & Winter, Fabian, 2019. "A flexible z-Tree and oTree implementation of the Social Value Orientation Slider Measure," Journal of Behavioral and Experimental Finance, Elsevier, vol. 23(C), pages 46-53.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nobuyuki Hanaki & Takayuki Hoshino & Kohei Kubota & Fabrice Murtin & Masao Ogaki & Fumio Ohtake & Naoko Okuyama, 2022. "Comparing data gathered in an online and a laboratory experiment using the Trustlab platform," ISER Discussion Paper 1168, Institute of Social and Economic Research, Osaka University.
    2. Shigehiro Serizawa & Natsumi Shimada & Tiffany Tsz Kwan Tse, 2024. "Toward an Understanding of Insincere Bidding in a Vickrey Auction Experiment," ISER Discussion Paper 1229, Institute of Social and Economic Research, Osaka University.
    3. Nobuyuki Hanaki & Yutaka Kayaba & Jun Maekawa & Hitoshi Matsushima, 2021. "Two Experiments on Trading Information Goods in a Network," ISER Discussion Paper 1151r, Institute of Social and Economic Research, Osaka University, revised Oct 2023.
    4. Nobuyuki Hanaki & Takahiro Hoshino & Kohei Kubota & Fabrice Murtin & Masao Ogaki & Fumio Ohtake & Naoko Okuyama, 2022. "Comparing data gathered in an online and a laboratory experiment using the Trustlab platform," ISER Discussion Paper 1168r, Institute of Social and Economic Research, Osaka University, revised Jun 2022.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nobuyuki Hanaki & Keigo Inukai & Takehito Masuda & Yuta Shimodaira, 2021. "Participants’ Characteristics at ISER-Lab in 2020," ISER Discussion Paper 1141, Institute of Social and Economic Research, Osaka University.
    2. Nobuyuki Hanaki & Eizo Akiyama & Yukihiko Funaki & Ryuichiro Ishikawa, 2017. "Diversity in Cognitive Ability Enlarges Mispricing in Experimental Asset Markets," GREDEG Working Papers 2017-08, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    3. Nobuyuki Hanaki, 2020. "Cognitive ability and observed behavior in laboratory experiments: implications for macroeconomic theory," The Japanese Economic Review, Springer, vol. 71(3), pages 355-378, July.
    4. Grandjean, Gilles & Lefebvre, Mathieu & Mantovani, Marco, 2022. "Preferences and strategic behavior in public goods games," Journal of Economic Behavior & Organization, Elsevier, vol. 195(C), pages 171-185.
    5. Perodaud, Maxime & Hanaki, Nobuyuki & Yamada, Takashi, 2022. "An experimental analysis of gender discrimination in a credence goods market," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    6. Butler, David & Cheung, Stephen L., 2018. "Mind, Body, Bubble! Psychological and Biophysical Dimensions of Behavior in Experimental Asset Markets," IZA Discussion Papers 11563, Institute of Labor Economics (IZA).
    7. Allred, Sarah & Duffy, Sean & Smith, John, 2016. "Cognitive load and strategic sophistication," Journal of Economic Behavior & Organization, Elsevier, vol. 125(C), pages 162-178.
    8. Dietmar Fehr & Steffen Huck, 2016. "Who knows it is a game? On strategic awareness and cognitive ability," Experimental Economics, Springer;Economic Science Association, vol. 19(4), pages 713-726, December.
    9. Ji Yong Lee & Rodolfo M. Nayga & Cary Deck & Andreas C. Drichoutis, 2020. "Cognitive Ability and Bidding Behavior in Second Price Auctions: An Experimental Study," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(5), pages 1494-1510, October.
    10. Bayer, R.-C. & Renou, Ludovic, 2016. "Logical abilities and behavior in strategic-form games," Journal of Economic Psychology, Elsevier, vol. 56(C), pages 39-59.
    11. Lee, Ji Yong & Nayga, Rodolfo M. & Deck, Cary & Drichoutis, Andreas, 2017. "Cognitive Ability and Bidding Behavior in Experimental Auction," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258347, Agricultural and Applied Economics Association.
    12. Kiss, H.J. & Rodriguez-Lara, I. & Rosa-García, A., 2016. "Think twice before running! Bank runs and cognitive abilities," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 12-19.
    13. Sheen S. Levine & Mark Bernard & Rosemarie Nagel, 2018. "Strategic intelligence: The cognitive capability to anticipate competitor behaviour," Strategic Management Journal, Wiley Blackwell, vol. 39(2), pages 527-527, February.
    14. Victor Stango & Jonathan Zinman, 2019. "We Are All Behavioral, More or Less: Measuring and Using Consumer-Level Behavioral Sufficient Statistics," Working Papers 19-14, Federal Reserve Bank of Philadelphia.
    15. Kiss, Hubert J. & Kóczy, László Á. & Pintér, Ágnes & Sziklai, Balázs R., 2022. "Does risk sorting explain overpricing in experimental asset markets?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 99(C).
    16. Hubert J. Kiss & Laszlo A. Koczy & Agnes Pinter & Balazs R. Sziklai, 2019. "Does risk sorting explain bubbles?," CERS-IE WORKING PAPERS 1905, Institute of Economics, Centre for Economic and Regional Studies.
    17. Nobuyuki Hanaki & Eizo Akiyama & Yukihiko Funaki & Ryuichiro Ishikawa, 2015. "Diversity in Cognitive Ability Enlarges Mispricing," GREDEG Working Papers 2015-29, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    18. Ciril Bosch-Rosa & Thomas Meissner & Antoni Bosch-Domènech, 2018. "Cognitive bubbles," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 132-153, March.
    19. Nobuyuki Hanaki & Nicolas Jacquemet & Stéphane Luchini & Adam Zylbersztejn, 2016. "Cognitive ability and the effect of strategic uncertainty," Theory and Decision, Springer, vol. 81(1), pages 101-121, June.
    20. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David Huffman & Uwe Sunde, 2018. "Global Evidence on Economic Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(4), pages 1645-1692.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dpr:wpaper:1160. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Librarian (email available below). General contact details of provider: https://edirc.repec.org/data/isosujp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.