IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_10360.html
   My bibliography  Save this paper

Happy Times: Measuring Happiness Using Response Times

Author

Listed:
  • Shuo Liu
  • Nick Netzer

Abstract

Surveys that measure subjective states like happiness or preferences often generate discrete ordinal data. Ordered response models, which are commonly used to analyze such data, suffer from a fundamental identification problem. Their conclusions depend on unjustified assumptions about the distribution of a latent variable. In this paper, we propose using survey response times to solve that problem. Response times contain information about the distribution of the latent variable even among subjects who give the same survey response, through a chronometric effect. Using an online survey, we test and verify the existence of the chronometric effect. We then provide theoretical conditions under which group differences in happiness or other variables are detectable based on response time data without making distributional assumptions. In our survey, we find evidence supporting the assumptions of traditional ordered response models for some common survey questions but not for others.

Suggested Citation

  • Shuo Liu & Nick Netzer, 2023. "Happy Times: Measuring Happiness Using Response Times," CESifo Working Paper Series 10360, CESifo.
  • Handle: RePEc:ces:ceswps:_10360
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp10360.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bryan Boulier & Robert Goldfarb, 1998. "On the use and nonuse of surveys in economics," Journal of Economic Methodology, Taylor & Francis Journals, vol. 5(1), pages 1-21.
    2. Oswald, Andrew J., 2008. "On the curvature of the reporting function from objective reality to subjective feelings," Economics Letters, Elsevier, vol. 100(3), pages 369-372, September.
    3. Clithero, John A., 2018. "Improving out-of-sample predictions using response times and a model of the decision process," Journal of Economic Behavior & Organization, Elsevier, vol. 148(C), pages 344-375.
    4. Stefano DellaVigna & Devin Pope, 2018. "What Motivates Effort? Evidence and Expert Forecasts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 1029-1069.
    5. Chen, Le-Yu & Oparina, Ekaterina & Powdthavee, Nattavudh & Srisuma, Sorawoot, 2022. "Robust Ranking of Happiness Outcomes: A Median Regression Perspective," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 672-686.
    6. Schröder, Carsten & Yitzhaki, Shlomo, 2017. "Revisiting the evidence for cardinal treatment of ordinal variables," European Economic Review, Elsevier, vol. 92(C), pages 337-358.
    7. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David Huffman & Uwe Sunde, 2018. "Global Evidence on Economic Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(4), pages 1645-1692.
    8. Ilyana Kuziemko & Michael I. Norton & Emmanuel Saez & Stefanie Stantcheva, 2015. "How Elastic Are Preferences for Redistribution? Evidence from Randomized Survey Experiments," American Economic Review, American Economic Association, vol. 105(4), pages 1478-1508, April.
    9. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: A Study of Response Times," Economic Journal, Royal Economic Society, vol. 117(523), pages 1243-1259, October.
    10. David M Kaplan & Wei Zhao, 2023. "Comparing latent inequality with ordinal data," The Econometrics Journal, Royal Economic Society, vol. 26(2), pages 189-214.
    11. Carlos Alós-Ferrer & Ernst Fehr & Nick Netzer, 2021. "Time Will Tell: Recovering Preferences When Choices Are Noisy," Journal of Political Economy, University of Chicago Press, vol. 129(6), pages 1828-1877.
    12. Kaiser, Caspar & Vendrik, Maarten C.M., 2020. "How threatening are transformations of happiness scales to subjective wellbeing research?," Research Memorandum 032, Maastricht University, Graduate School of Business and Economics (GSBE).
    13. Stefan Boes & Rainer Winkelmann, 2006. "Ordered Response Models," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 12, pages 167-181, Springer.
    14. Raphael Studer & Rainer Winkelmann, 2014. "Reported Happiness, Fast and Slow," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(3), pages 1055-1067, July.
    15. Betsey Stevenson & Justin Wolfers, 2008. "Economic Growth and Subjective Well-Being: Reassessing the Easterlin Paradox," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 39(1 (Spring), pages 1-102.
    16. James Andreoni & Charles Sprenger, 2012. "Risk Preferences Are Not Time Preferences," American Economic Review, American Economic Association, vol. 102(7), pages 3357-3376, December.
    17. Timothy N. Bond & Kevin Lang, 2019. "The Sad Truth about Happiness Scales," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1629-1640.
    18. Timothy N. Bond & Kevin Lang, 2013. "The Evolution of the Black-White Test Score Gap in Grades K–3: The Fragility of Results," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1468-1479, December.
    19. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    20. Chen, Le-Yu & Oparina, Ekaterina & Powdthavee, Nattavudh & Srisuma, Sorawoot, 2019. "Have Econometric Analyses of Happiness Data Been Futile? A Simple Truth about Happiness Scales," IZA Discussion Papers 12152, Institute of Labor Economics (IZA).
    21. Avoyan, Ala & Schotter, Andrew, 2020. "Attention in games: An experimental study," European Economic Review, Elsevier, vol. 124(C).
    22. Peter Moffatt, 2005. "Stochastic Choice and the Allocation of Cognitive Effort," Experimental Economics, Springer;Economic Science Association, vol. 8(4), pages 369-388, December.
    23. Hess, Stephane & Stathopoulos, Amanda, 2013. "Linking response quality to survey engagement: A combined random scale and latent variable approach," Journal of choice modelling, Elsevier, vol. 7(C), pages 1-12.
    24. repec:cup:judgdm:v:14:y:2019:i:4:p:381-394 is not listed on IDEAS
    25. G. Hanoch & H. Levy, 1969. "The Efficiency Analysis of Choices Involving Risk," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 36(3), pages 335-346.
    26. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    27. Rafael Di Tella & Robert MacCulloch, 2006. "Some Uses of Happiness Data in Economics," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 25-46, Winter.
    28. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David B. Huffman & Uwe Sunde, 2017. "Global Evidence on Economic Preferences," NBER Working Papers 23943, National Bureau of Economic Research, Inc.
    29. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    30. Anja Achtziger & Carlos Alós-Ferrer, 2014. "Fast or Rational? A Response-Times Study of Bayesian Updating," Management Science, INFORMS, vol. 60(4), pages 923-938, April.
    31. Easterlin, Richard A., 1974. "Does Economic Growth Improve the Human Lot? Some Empirical Evidence," MPRA Paper 111773, University Library of Munich, Germany.
    32. Joseph K. Goodman & Gabriele Paolacci, 2017. "Crowdsourcing Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(1), pages 196-210.
    33. Ariel Rubinstein, 2016. "A Typology of Players: Between Instinctive and Contemplative," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(2), pages 859-890.
    34. repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
    35. Christopher F. Chabris & David Laibson & Carrie L. Morris & Jonathon P. Schuldt & Dmitry Taubinsky, 2009. "The Allocation of Time in Decision-Making," Journal of the European Economic Association, MIT Press, vol. 7(2-3), pages 628-637, 04-05.
    36. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: Response Times Study," Levine's Bibliography 321307000000001011, UCLA Department of Economics.
    37. Clithero, John A., 2018. "Response times in economics: Looking through the lens of sequential sampling models," Journal of Economic Psychology, Elsevier, vol. 69(C), pages 61-86.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Daniel J. Benjamin & Kristen Cooper & Ori Heffetz & Miles S. Kimball, 2023. "From Happiness Data to Economic Conclusions," NBER Working Papers 31727, National Bureau of Economic Research, Inc.
    2. Francesco Berlingieri & Matija Kovacic, 2023. "Health and relationship quality of the LGBTQIA+ population in Europe," Working Papers 2023: 29, Department of Economics, University of Venice "Ca' Foscari".

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    2. Nicholas Gunby & Tom Coupé, 2023. "Weather-Related Home Damage and Subjective Well-Being," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 84(2), pages 409-438, February.
    3. Clithero, John A., 2018. "Response times in economics: Looking through the lens of sequential sampling models," Journal of Economic Psychology, Elsevier, vol. 69(C), pages 61-86.
    4. Carlos Alós-Ferrer & Ernst Fehr & Nick Netzer, 2021. "Time Will Tell: Recovering Preferences When Choices Are Noisy," Journal of Political Economy, University of Chicago Press, vol. 129(6), pages 1828-1877.
    5. Jeffrey R. Bloem & Andrew J. Oswald, 2022. "The Analysis of Human Feelings: A Practical Suggestion for a Robustness Test," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 68(3), pages 689-710, September.
    6. Carlos Alós-Ferrer & Michele Garagnani, 2022. "Strength of preference and decisions under risk," Journal of Risk and Uncertainty, Springer, vol. 64(3), pages 309-329, June.
    7. Marcus Klemm, 2022. "Well-being Changes from Year to Year: A Comparison of Current, Remembered and Predicted Life Satisfaction," Journal of Happiness Studies, Springer, vol. 23(4), pages 1669-1681, April.
    8. Ekaterina Oparina & Sorawoot Srisuma, 2022. "Analyzing Subjective Well-Being Data with Misclassification," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(2), pages 730-743, April.
    9. Konrad Grabiszewski & Alex Horenstein, 2022. "Profiling dynamic decision-makers," PLOS ONE, Public Library of Science, vol. 17(4), pages 1-22, April.
    10. Cary Frydman & Ian Krajbich, 2022. "Using Response Times to Infer Others’ Private Information: An Application to Information Cascades," Management Science, INFORMS, vol. 68(4), pages 2970-2986, April.
    11. O'Connor, Kelsey J., 2022. "Measuring Progress," IZA Policy Papers 194, Institute of Labor Economics (IZA).
    12. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    13. Ferreira, Susana & Moro, Mirko & Welsch, Heinz, 2024. "Using Life Satisfaction and Happiness Data for Environmental Valuation: An Experienced Preference Approach," IZA Discussion Papers 16718, Institute of Labor Economics (IZA).
    14. Andrew Chesher & Adam Rosen & Zahra Siddique, 2019. "Estimating Endogenous Effects on Ordinal Outcomes," CeMMAP working papers CWP66/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    15. Alós-Ferrer, Carlos & Ritschel, Alexander, 2021. "Multiple behavioral rules in Cournot oligopolies," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 250-267.
    16. Burger,Martijn & Hendriks,Martijn & Ianchovichina,Elena, 2022. "Anatomy of Brazil’s Subjective Well-Being : A Tale of Growing Discontent and Polarization in the 2010s," Policy Research Working Paper Series 9924, The World Bank.
    17. Yamada, Katsunori & Sato, Masayuki, 2013. "Another avenue for anatomy of income comparisons: Evidence from hypothetical choice experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 89(C), pages 35-57.
    18. repec:hal:spmain:info:hdl:2441/7fst0pcf5j8cr99e1nuobt97rn is not listed on IDEAS
    19. Lergetporer, Philipp & Schwerdt, Guido & Werner, Katharina & West, Martin R. & Woessmann, Ludger, 2018. "How information affects support for education spending: Evidence from survey experiments in Germany and the United States," Journal of Public Economics, Elsevier, vol. 167(C), pages 138-157.
    20. Strittmatter, Anthony & Sunde, Uwe & Zegners, Dainis, 2022. "Speed, Quality, and the Optimal Timing of Complex Decisions: Field Evidence," Rationality and Competition Discussion Paper Series 317, CRC TRR 190 Rationality and Competition.
    21. Keefer, Philip & Scartascini, Carlos & Vlaicu, Razvan, 2022. "Demand-side determinants of public spending allocations: Voter trust, risk and time preferences," Journal of Public Economics, Elsevier, vol. 206(C).

    More about this item

    Keywords

    surveys; ordinal data; response times; non-parametric; identification;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • D60 - Microeconomics - - Welfare Economics - - - General
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • I31 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - General Welfare, Well-Being

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_10360. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.