IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v22y2013i1p1-13.html
   My bibliography  Save this article

Are Anchoring Vignettes Ratings Sensitive To Vignette Age And Sex?

Author

Listed:
  • Hendrik Jürges
  • Joachim Winter

Abstract

Anchoring vignettes are commonly used to study and correct for differential item functioning and response bias in subjective survey questions. Self‐assessed health status is a leading example. A crucial assumption of the vignette methodology is ‘vignette equivalence’: The health status of the person described in the vignette must be perceived by all respondents in the same way. We use data from a survey experiment conducted with a sample of almost 5000 older Americans to validate this assumption. We find weak evidence that respondents' vignette ratings may be sensitive to the sex and, for older respondents, also to the age (implied by the first name) of the person described in the vignette. Our findings suggest that vignette equivalence may not hold, at least if the potentially subtle connotations of vignette persons' names are not fully controlled. Copyright © 2011 John Wiley & Sons, Ltd.

Suggested Citation

  • Hendrik Jürges & Joachim Winter, 2013. "Are Anchoring Vignettes Ratings Sensitive To Vignette Age And Sex?," Health Economics, John Wiley & Sons, Ltd., vol. 22(1), pages 1-13, January.
  • Handle: RePEc:wly:hlthec:v:22:y:2013:i:1:p:1-13
    DOI: 10.1002/hec.1806
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.1806
    Download Restriction: no

    File URL: https://libkey.io/10.1002/hec.1806?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
    2. Datta Gupta, Nabanita & Kristensen, Nicolai & Pozzoli, Dario, 2010. "External validation of the use of vignettes in cross-country health studies," Economic Modelling, Elsevier, vol. 27(4), pages 854-865, July.
    3. Arie Kapteyn & James P. Smith & Arthur Van Soest & Hana Vonkova, 2011. "Anchoring Vignettes and Response Consistency," Working Papers WR-840, RAND Corporation.
    4. Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011. "Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Journal of Human Resources, University of Wisconsin Press, vol. 46(4), pages 875-906.
    5. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375, March.
    6. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    7. Florian Heiss & Daniel McFadden & Joachim Winter, 2011. "The Demand for Medicare Part D Prescription Drug Coverage: Evidence from Four Waves of the Retirement Perspectives Survey," NBER Chapters, in: Explorations in the Economics of Aging, pages 159-182, National Bureau of Economic Research, Inc.
    8. Arie Kapteyn & James P. Smith & Arthur Van Soest & Hana Vonkova, 2011. "Anchoring Vignettes and Response Consistency," Working Papers 840, RAND Corporation.
    9. Arnaud Chevalier & Antony Fielding, 2011. "An introduction to anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 569-574, July.
    10. Arthur van Soest & Liam Delaney & Colm Harmon & Arie Kapteyn & James P. Smith, 2011. "Validating the use of anchoring vignettes for the correction of response scale differences in subjective questions," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 575-595, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Knott, R. & Lorgelly, P. & Black, N. & Hollingsworth, B., 2016. "Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 16/14, HEDG, c/o Department of Economics, University of York.
    2. Knott, Rachel J. & Lorgelly, Paula K. & Black, Nicole & Hollingsworth, Bruce, 2017. "Differential item functioning in quality of life measurement: An analysis using anchoring vignettes," Social Science & Medicine, Elsevier, vol. 190(C), pages 247-255.
    3. Rachel J. Knott & Nicole Black & Bruce Hollingsworth & Paula K. Lorgelly, 2017. "Response to comment by robone: Practical advice for the implementation of anchoring vignettes," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 398-400, March.
    4. Silvana Robone, 2017. "Comment on ‘Response –scale heterogeneity in the EQ‐5D: Can we use vignettes to address response‐scale heterogeneity in the EQ‐5D? Not if but how’," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 395-397, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. William H. Greene & Mark N. Harris & Rachel J. Knott & Nigel Rice, 2021. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 31-64, January.
    2. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    3. Aparajita Dasgupta, 2018. "Systematic measurement error in self-reported health: is anchoring vignettes the way out?," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-30, December.
    4. Hullegie, P.G.J., 2012. "Essays on health and labor economics," Other publications TiSEM dcc68fc9-7af1-4ba9-8f90-6, Tilburg University, School of Economics and Management.
    5. Knott, R. & Lorgelly, P. & Black, N. & Hollingsworth, B., 2016. "Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 16/14, HEDG, c/o Department of Economics, University of York.
    6. Zhang, Hao & Bago d’Uva, Teresa & van Doorslaer, Eddy, 2015. "The gender health gap in China: A decomposition analysis," Economics & Human Biology, Elsevier, vol. 18(C), pages 13-26.
    7. Rachel J. Knott & Nicole Black & Bruce Hollingsworth & Paula K. Lorgelly, 2017. "Response‐Scale Heterogeneity in the EQ‐5D," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 387-394, March.
    8. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    9. Laura Rossouw & Teresa Bago d’Uva & Eddy Doorslaer, 2018. "Poor Health Reporting? Using Anchoring Vignettes to Uncover Health Disparities by Wealth and Race," Demography, Springer;Population Association of America (PAA), vol. 55(5), pages 1935-1956, October.
    10. Franco Peracchi & Claudio Rossetti, 2012. "Heterogeneity in health responses and anchoring vignettes," Empirical Economics, Springer, vol. 42(2), pages 513-538, April.
    11. Molina, Teresa, 2017. "Adjusting for heterogeneous response thresholds in cross-country comparisons of self-reported health," The Journal of the Economics of Ageing, Elsevier, vol. 10(C), pages 1-20.
    12. Omar Paccagnella, 2011. "Anchoring vignettes with sample selection due to non‐response," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 665-687, July.
    13. Raskina, Yulia & Podkorytova, Olga & Kuchakov, Ruslan, 2022. "Health determinants and the reporting heterogeneity bias in Russia: Anchoring vignettes approach," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 66, pages 118-143.
    14. Ren Mu, 2014. "Regional Disparities In Self‐Reported Health: Evidence From Chinese Older Adults," Health Economics, John Wiley & Sons, Ltd., vol. 23(5), pages 529-549, May.
    15. Knott, Rachel J. & Lorgelly, Paula K. & Black, Nicole & Hollingsworth, Bruce, 2017. "Differential item functioning in quality of life measurement: An analysis using anchoring vignettes," Social Science & Medicine, Elsevier, vol. 190(C), pages 247-255.
    16. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    17. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2012. "Age, Health and Life Satisfaction Among Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 293-308, January.
    18. Montgomery, Mallory, 2022. "Reversing the gender gap in happiness," Journal of Economic Behavior & Organization, Elsevier, vol. 196(C), pages 65-78.
    19. Teresa Molina, 2016. "Reporting Heterogeneity and Health Disparities Across Gender and Education Levels: Evidence From Four Countries," Demography, Springer;Population Association of America (PAA), vol. 53(2), pages 295-323, April.
    20. Andrew M. Jones; Nigel Rice, Silvana Robone; & Nigel Rice; & Silvana Robone:, 2012. "A comparison of parametric and non-parametric adjustments using vignettes for self-reported data," Health, Econometrics and Data Group (HEDG) Working Papers 12/10, HEDG, c/o Department of Economics, University of York.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:22:y:2013:i:1:p:1-13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.