IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v45y2016i2p348-371.html
   My bibliography  Save this article

Measurement Directiveness as a Cause of Response Bias

Author

Listed:
  • Philip S. Brenner
  • John DeLamater

Abstract

Extant research comparing survey self-reports of normative behavior to direct observations and time diary data have yielded evidence of extensive measurement bias. However, most of this research program has relied on observational data, comparing independent samples from the same target population, rather than comparing survey self-reports to a criterion measure for individual respondents. This research addresses the next step using data from two studies. In each study, respondents completed a conventional survey questionnaire, including questions about frequency of religious behavior. Respondents were then asked to participate in a text messaging (short message service) data collection procedure, reporting either (1) participation in religious behavior specifically or (2) all changes in major activity without explicitly specifying religious behavior. Findings suggest that directive measurement, priming the respondent to consider the focal behavior, is a cause of measurement bias.

Suggested Citation

  • Philip S. Brenner & John DeLamater, 2016. "Measurement Directiveness as a Cause of Response Bias," Sociological Methods & Research, , vol. 45(2), pages 348-371, May.
    • Handle: RePEc:sae:somere:v:45:y:2016:i:2:p:348-371
    DOI: 10.1177/0049124114558630
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124114558630
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0049124114558630?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hans Andersson & Donald Granberg, 1997. "On the validity and reliability of self-reported vote: validity without reliability?," Quality & Quantity: International Journal of Methodology, Springer, vol. 31(2), pages 127-140, May.
    2. Philip Brenner & John DeLamater, 2014. "Social Desirability Bias in Self-reports of Physical Activity: Is an Exercise Identity the Culprit?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(2), pages 489-504, June.
    3. Iiris Niemi, 1993. "Systematic error in behavioural measurement: Comparing results from interview and time budget studies," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 30(2), pages 229-244, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marta Palczyńska & Maja Rynko, 2021. "ICT skills measurement in social surveys: Can we trust self-reports?," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(3), pages 917-943, June.
    2. Philip S. Brenner, 2021. "Effects of Nonresponse, Measurement, and Coverage Bias in Survey Estimates of Voting," Social Science Quarterly, Southwestern Social Science Association, vol. 102(2), pages 939-954, March.
    3. Yee Kan, Â Man & Gershuny, Jonathan, 2006. "Infusing time diary evidence into panel data: an exercise in calibrating time-use estimates for the BHPS," ISER Working Paper Series 2006-19, Institute for Social and Economic Research.
    4. repec:hal:spmain:info:hdl:2441/5j2m1g6i7j8pnapkjvifl6e30f is not listed on IDEAS
    5. Merz, Joachim, 2009. "Time Use and Time Budgets – Improvements, Future Challenges and Recommendations," MPRA Paper 16304, University Library of Munich, Germany.
    6. Alireza Nili & Mary Tate & David Johnstone, 2019. "The process of solving problems with self-service technologies: a study from the user’s perspective," Electronic Commerce Research, Springer, vol. 19(2), pages 373-407, June.
    7. Winter, James C. & Darmstadt, Gary L. & Davis, Jennifer, 2021. "The role of piped water supplies in advancing health, economic development, and gender equality in rural communities," Social Science & Medicine, Elsevier, vol. 270(C).
    8. I-Hua Chu & Yu-Ling Chen & Pei-Tzu Wu & Wen-Lan Wu & Lan-Yuen Guo, 2021. "The Associations between Self-Determined Motivation, Multidimensional Self-Efficacy, and Device-Measured Physical Activity," IJERPH, MDPI, vol. 18(15), pages 1-11, July.
    9. Costa-Font, Joan & Fleche, Sarah & Pagan, Ricardo, 2024. "The labour market returns to sleep," Journal of Health Economics, Elsevier, vol. 93(C).
    10. Körner Thomas & Wolff Loup, 2016. "“Do the Germans Really Work Six Weeks More than the French?” – Measuring Working Time with the Labour Force Survey in France and Germany," Journal of Official Statistics, Sciendo, vol. 32(2), pages 405-431, June.
    11. Yee Kan, Â Man, 2006. "Measuring housework participation: the gap between ‘stylised’ questionnaire estimates and diary-based estimates," ISER Working Paper Series 2006-11, Institute for Social and Economic Research.
    12. Monteiro Amaral,Sofia Fernando & Dinarte Diaz,Lelys Ileana & Dominguez,Patricio & Perez-Vincent,Santiago M. & Romero,Steffanny, 2022. "Talk or Text ? Evaluating Response Rates by Remote Survey Method during COVID-19," Policy Research Working Paper Series 9999, The World Bank.
    13. Pierre Walthery & Jonathan Gershuny, 2019. "Improving Stylised Working Time Estimates with Time Diary Data: A Multi Study Assessment for the UK," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(3), pages 1303-1321, August.
    14. Man Kan, 2008. "Measuring Housework Participation: The Gap between “Stylised” Questionnaire Estimates and Diary-based Estimates," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 86(3), pages 381-400, May.
    15. Ragni Kitterød, 2001. "Does the recording of parallel activities in Time Use Diaries affect the way people report their main activities?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 56(2), pages 145-178, November.
    16. Clara R. Warmath & Courtney C. Choy & Elizabeth A. Frame & Lauren B. Sherar & Rachel L. Duckham & Christina Soti-Ulberg & Take Naseri & Muagututia S. Reupena & Nicola L. Hawley, 2021. "Comparability of The Netherlands Physical Activity Questionnaire with Accelerometer-Measured Physical Activity in Samoan Children: A Retrospective Analysis of Ola Tuputupua’e Data," IJERPH, MDPI, vol. 18(16), pages 1-14, August.
    17. Michael Kevane & Leslie Gray, 1999. "A Woman's Field Is Made At Night: Gendered Land Rights And Norms In Burkina Faso," Feminist Economics, Taylor & Francis Journals, vol. 5(3), pages 1-26.
    18. Michael Bittman & Paula England & Nancy Folbre & George Matheson, 2001. "When Gender Trumps Money: Bargaining and Time in Household Work," JCPR Working Papers 221, Northwestern University/University of Chicago Joint Center for Poverty Research.
    19. Simon Bittmann, 2015. "Ressources économiques des femmes et travail domestique des conjoints : quels effets pour quelles tâches ?," SciencePo Working papers Main hal-01309219, HAL.
    20. Philip S. Brenner, 2017. "Narratives of Response Error From Cognitive Interviews of Survey Questions About Normative Behavior," Sociological Methods & Research, , vol. 46(3), pages 540-564, August.
    21. Christina Boll & Julian Leppin & Nora Reich, 2014. "Paternal childcare and parental leave policies: evidence from industrialized countries," Review of Economics of the Household, Springer, vol. 12(1), pages 129-158, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:45:y:2016:i:2:p:348-371. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.