IDEAS home Printed from https://ideas.repec.org/a/oup/geronb/v73y2018i1p54-63..html
   My bibliography  Save this article

In Pursuit of Anchoring Vignettes That Work: Evaluating Generality Versus Specificity in Vignette Texts

Author

Listed:
  • Hanna Grol-Prokopczyk

Abstract

ObjectiveAnchoring vignettes appear with growing frequency in surveys of health and aging, but little research investigates how to optimize their wording. This study experimentally tests whether mentioning specific health conditions and/or medical procedures enhances or undermines vignette validity. Methods: Three series of general health anchoring vignettes were fielded to 2,550 respondents in the Wisconsin Longitudinal Study: one mentioning no specific health conditions or procedures, one mentioning heart disease-related ones, and one mentioning diabetes-related ones. Variations on hierarchical ordered probit models were used to test whether vignette wording affected adherence to the key measurement assumptions of vignette equivalence (VE) and response consistency (RC). Results: While all vignette series showed substantial violations of VE, violations were larger (especially by sex and education) when using disease-specific texts. RC violations appeared relatively minor, but somewhat larger in disease-specific texts. Discussion: These findings suggest that more general, universal vignette texts may be preferable to ones describing highly specific conditions/procedures. The common advice to prioritize specificity and concreteness in survey texts may be misguided if sociodemographic groups differ in their familiarity or associations with the presented details. Anchoring vignettes are a potentially useful survey tool, but further efforts are needed to optimize their wording.

Suggested Citation

  • Hanna Grol-Prokopczyk, 2018. "In Pursuit of Anchoring Vignettes That Work: Evaluating Generality Versus Specificity in Vignette Texts," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 73(1), pages 54-63.
    • Handle: RePEc:oup:geronb:v:73:y:2018:i:1:p:54-63.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/geronb/gbx048
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nigel Rice & Silvana Robone & Peter Smith, 2011. "Analysis of the validity of the vignette approach to correct for heterogeneity in reporting health system responsiveness," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 12(2), pages 141-162, April.
    2. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    3. Courtenay, Will H., 2000. "Constructions of masculinity and their influence on men's well-being: a theory of gender and health," Social Science & Medicine, Elsevier, vol. 50(10), pages 1385-1401, May.
    4. Arie Kapteyn & James P. Smith & Arthur Van Soest & Hana Vonkova, 2011. "Anchoring Vignettes and Response Consistency," Working Papers WR-840, RAND Corporation.
    5. Arie Kapteyn, 2010. "What can we learn from (and about) global aging?," Demography, Springer;Population Association of America (PAA), pages 191-209.
    6. Corrado, L. & Weeks, M., 2010. "Identification Strategies in Survey Response Using Vignettes," Cambridge Working Papers in Economics 1031, Faculty of Economics, University of Cambridge.
    7. James Smith, 2007. "Diabetes and the Rise of the SES Health Gradient," NBER Working Papers 12905, National Bureau of Economic Research, Inc.
    8. Arie Kapteyn, 2010. "What can we learn from (and about) global aging?," Demography, Springer;Population Association of America (PAA), vol. 47(1), pages 191-209, March.
    9. Arie Kapteyn & James P. Smith & Arthur Van Soest & Hana Vonkova, 2011. "Anchoring Vignettes and Response Consistency," Working Papers 840, RAND Corporation.
    10. Shetterly, S.M. & Baxter, J. & Mason, L.D. & Hamman, R.F., 1996. "Self-rated health among hispanic vs non-hispanic white adults: The San Luis Valley health and aging study," American Journal of Public Health, American Public Health Association, vol. 86(12), pages 1798-1801.
    11. King, Gary & Wand, Jonathan, 2007. "Comparing Incomparable Survey Responses: Evaluating and Selecting Anchoring Vignettes," Political Analysis, Cambridge University Press, vol. 15(1), pages 46-66, January.
    12. Jennifer Beam Dowd & Megan Todd, 2011. "Does Self-reported Health Bias the Measurement of Health Inequalities in U.S. Adults? Evidence Using Anchoring Vignettes From the Health and Retirement Study," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 66(4), pages 478-489.
    13. Arthur van Soest & Liam Delaney & Colm Harmon & Arie Kapteyn & James P. Smith, 2011. "Validating the use of anchoring vignettes for the correction of response scale differences in subjective questions," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 575-595, July.
    14. Arthur van Soest & Hana Vonkova, 2014. "Testing the specification of parametric models by using anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 177(1), pages 115-133, January.
    15. Teresa Molina, 2016. "Reporting Heterogeneity and Health Disparities Across Gender and Education Levels: Evidence From Four Countries," Demography, Springer;Population Association of America (PAA), vol. 53(2), pages 295-323, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hanna Grol-Prokopczyk & Emese Verdes-Tennant & Mary McEniry & Márton Ispány, 2015. "Promises and Pitfalls of Anchoring Vignettes in Health Survey Research," Demography, Springer;Population Association of America (PAA), vol. 52(5), pages 1703-1728, October.
    2. William H. Greene & Mark N. Harris & Rachel J. Knott & Nigel Rice, 2021. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 31-64, January.
    3. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    4. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    5. Raskina, Yulia & Podkorytova, Olga & Kuchakov, Ruslan, 2022. "Health determinants and the reporting heterogeneity bias in Russia: Anchoring vignettes approach," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 66, pages 118-143.
    6. Knott, Rachel J. & Lorgelly, Paula K. & Black, Nicole & Hollingsworth, Bruce, 2017. "Differential item functioning in quality of life measurement: An analysis using anchoring vignettes," Social Science & Medicine, Elsevier, vol. 190(C), pages 247-255.
    7. Molina, Teresa, 2017. "Adjusting for heterogeneous response thresholds in cross-country comparisons of self-reported health," The Journal of the Economics of Ageing, Elsevier, vol. 10(C), pages 1-20.
    8. Hana Vonkova, 2019. "Life Satisfaction among Different Groups of Children: Self-Reports, Differential Scale Usage and Anchoring Vignettes," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 12(6), pages 2111-2136, December.
    9. Knott, R. & Lorgelly, P. & Black, N. & Hollingsworth, B., 2016. "Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 16/14, HEDG, c/o Department of Economics, University of York.
    10. Aparajita Dasgupta, 2018. "Systematic measurement error in self-reported health: is anchoring vignettes the way out?," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-30, December.
    11. Zhiyong Huang & Haoxian Wang & Wenyuan Zheng, 2021. "An extended hierarchical ordered probit model robust to heteroskedastic vignette perceptions with an application to functional limitation assessment," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-19, March.
    12. Laura Rossouw & Teresa Bago d’Uva & Eddy Doorslaer, 2018. "Poor Health Reporting? Using Anchoring Vignettes to Uncover Health Disparities by Wealth and Race," Demography, Springer;Population Association of America (PAA), vol. 55(5), pages 1935-1956, October.
    13. Laura Rossouw & Teresa Bago d'Uva & Eddy van Doorslaer, 2017. "Poor Health Reporting? Using Vignettes to Recover the Health Gradient by Wealth," Tinbergen Institute Discussion Papers 17-031/V, Tinbergen Institute.
    14. Arthur van Soest & Hana Vonkova, 2014. "Testing the specification of parametric models by using anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 177(1), pages 115-133, January.
    15. Hendrik Jürges & Joachim Winter, 2013. "Are Anchoring Vignettes Ratings Sensitive To Vignette Age And Sex?," Health Economics, John Wiley & Sons, Ltd., vol. 22(1), pages 1-13, January.
    16. Bzostek, Sharon & Sastry, Narayan & Goldman, Noreen & Pebley, Anne & Duffy, Denise, 2016. "Using vignettes to rethink Latino-white disparities in self-rated health," Social Science & Medicine, Elsevier, vol. 149(C), pages 46-65.
    17. Teresa Molina, 2016. "Reporting Heterogeneity and Health Disparities Across Gender and Education Levels: Evidence From Four Countries," Demography, Springer;Population Association of America (PAA), vol. 53(2), pages 295-323, April.
    18. Andrew M. Jones; Nigel Rice, Silvana Robone; & Nigel Rice; & Silvana Robone:, 2012. "A comparison of parametric and non-parametric adjustments using vignettes for self-reported data," Health, Econometrics and Data Group (HEDG) Working Papers 12/10, HEDG, c/o Department of Economics, University of York.
    19. Agree Emily M. & Wolf Douglas A., 2018. "Disability Measurement in the Health and Retirement Study," Forum for Health Economics & Policy, De Gruyter, vol. 21(1), pages 1-14, June.
    20. Laura Rossouw, 2015. "Poor Health Reporting: Do Poor South Africans Underestimate Their Health Needs?," WIDER Working Paper Series wp-2015-027, World Institute for Development Economic Research (UNU-WIDER).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:geronb:v:73:y:2018:i:1:p:54-63.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/psychsocgerontology .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.