Measuring Time Use in Surveys: How Valid Are Time Use Questions in Surveys? Concordance of Survey and Experience Sampling Measures
AbstractSince it is still unclear to what extent time allocation retrospectively reported in questionnaires, reflects people¿s actual behavior, examining the accuracy of responses to time use survey questions is of crucial importance. We analyze the congruence of time use information assessed through retrospective questionnaires and through experience sampling methodology. The sample comprised 433 individuals ranging in age from 14 to 86 years. Participants completed standard survey questions on time allocation. In addition, a mobile-phone based experience sampling technology was used over a period of three weeks to obtain snapshots of, on average, 54 momentary activities in which participants participated while pursuing their normal daily routines. Experience sampling assessments were scheduled six times a day over at least nine days, including workdays, Saturdays, and Sundays. Results indicate that the congruence between time allocation assessed with survey questions (i.e. in SOEP) and time allocation assessed with experience sampling methodology depends on the characteristics of the respective activities. Associations between standard survey questions and experience sampling methods are quite substantial for long-lasting and externally structured activities, such as paid work on workdays. In contrast, associations between survey and experience sampling methods are somewhat weaker, though highly statistically significant, for less externally structured, short-term and infrequent activities, such as errands, housework, and leisure. These moderate and relatively small correlations may indicate either an error-prone estimation of the prevalence of shortterm and infrequent activities by experience sampling or respondents¿ overrating of sporadic and short activities in survey questions. We conclude that activities with a long duration, such as paid work, can be measured in a satisfactory manner using short survey questions. Future research is necessary to elucidate which method (experience sampling method or survey questions) delivers more reliable and valid measures for shortterm and sporadic activities. Day Reconstruction Methods (DRM) should be included in this future methodological research.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by DIW Berlin, The German Socio-Economic Panel (SOEP) in its series SOEPpapers on Multidisciplinary Panel Data Research with number 390.
Length: 30 p.
Date of creation: 2011
Date of revision:
Publication status: Published in: Social Science Research 41 (2012) Iss. 5, 1037-1052
Survey methods; experience sampling method; validity; time use; market work; housework; leisure; German Socio-Economic Panel Study; MMAA; SOEP;
Find related papers by JEL classification:
- C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
- C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
- C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
- D10 - Microeconomics - - Household Behavior - - - General
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Blair, Edward & Burton, Scot, 1987. " Cognitive Processes Used by Survey Respondents to Answer Behavioral Frequency Questions," Journal of Consumer Research, University of Chicago Press, vol. 14(2), pages 280-88, September.
- repec:eso:journl:v:38:y:2007:i:3:p:323-354 is not listed on IDEAS
- Thomas Siedler & Jürgen Schupp & C. Katharina Spieß & Gert G. Wagner, 2008.
"The German Socio-Economic Panel as a Reference Data Set,"
SOEPpapers on Multidisciplinary Panel Data Research
150, DIW Berlin, The German Socio-Economic Panel (SOEP).
- Thomas Siedler & Jürgen Schupp & C. Katharina Spiess & Gert G. Wagner, 2008. "The German Socio-Economic Panel as Reference Data Set," Working Paper Series of the German Council for Social and Economic Data 48, German Council for Social and Economic Data (RatSWD).
- Jens Bonke, 2005. "Paid Work and Unpaid Work: Diary Information Versus Questionnaire Information," Social Indicators Research, Springer, vol. 70(3), pages 349-368, 02.
- Mihaly Csikszentmihalyi & Jeremy Hunter, 2003. "Happiness in Everyday Life: The Uses of Experience Sampling," Journal of Happiness Studies, Springer, vol. 4(2), pages 185-199, June.
- Kan,Â Man Yee & Pudney, Stephen, 2007. "Measurement error in stylised and diary data on time use," ISER Working Paper Series 2007-03, Institute for Social and Economic Research.
- Gert G. Wagner & Joachim R. Frick & Jürgen Schupp, 2007.
"The German Socio-Economic Panel Study (SOEP): Scope, Evolution and Enhancements,"
SOEPpapers on Multidisciplinary Panel Data Research
1, DIW Berlin, The German Socio-Economic Panel (SOEP).
- Gert G. Wagner & Joachim R. Frick & Jürgen Schupp, 2007. "The German Socio-Economic Panel Study (SOEP) – Scope, Evolution and Enhancements," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 127(1), pages 139-169.
- Ragni Kitterød, 2001. "Does the recording of parallel activities in Time Use Diaries affect the way people report their main activities?," Social Indicators Research, Springer, vol. 56(2), pages 145-178, November.
- Merz, Joachim & Wolff, Klaus G, 1993. "The Shadow Economy: Illicit Work and Household Production: A Microanalysis of West Germany," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 39(2), pages 177-94, June.
- Steffen Otterbach & Alfonso Sousa-Poza, 2010. "How Accurate are German Work-time Data? A Comparison of Time-diary Reports and Stylized Estimates," Social Indicators Research, Springer, vol. 97(3), pages 325-339, July.
- Kimberly Fisher & Muriel Egerton & Jonathan Gershuny & John Robinson, 2007. "Gender Convergence in the American Heritage Time use Study (AHTUS)," Social Indicators Research, Springer, vol. 82(1), pages 1-33, May.
- Andrew Harvey, 1993. "Guidelines for time use data collection," Social Indicators Research, Springer, vol. 30(2), pages 197-228, November.
- Namkee Ahn, & Juan F. Jimeno & Arantza Ugidos, . "“Mondays at the sun”: Unemployment, Time Use, and Consumption Patterns in Spain," Working Papers 2003-18, FEDEA.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Bibliothek).
If references are entirely missing, you can add them using this form.