IDEAS home Printed from https://ideas.repec.org/p/ran/wpaper/wr-840.html
   My bibliography  Save this paper

Anchoring Vignettes and Response Consistency

Author

Listed:
  • Arie Kapteyn
  • James P. Smith
  • Arthur Van Soest
  • Hana Vonkova

Abstract

The use of anchoring vignettes to correct for differential item functioning rests upon two identifying assumptions: vignette equivalence and response consistency. To test the second assumption the authors conduct an experiment in which respondents in an Internet panel are asked to both describe their health in a number of domains and rate their health in these domains. In a subsequent interview respondents are shown vignettes that are in fact descriptions of their own health. Under response consistency and some auxiliary assumptions with regard to the validity of the experiment, there should be no systematic differences between the evaluation of these vignettes in the second interview and the self-evaluations in the first interview. They analyze data for five health domains: sleep, mobility, concentration, breathing and affect. Although descriptively the vignettes and the self-evaluations are similar for a number of domains, their nonparametric analysis suggests that response consistency is satisfied for the domain of sleep, while it indicates rejection of either the auxiliary assumptions or response consistency for the other domains of health. Parametric analysis suggests that the auxiliary assumptions may be most problematic. The analysis points at the need for a systematic experimental approach to the design of anchoring vignettes before using them in practice.

Suggested Citation

  • Arie Kapteyn & James P. Smith & Arthur Van Soest & Hana Vonkova, 2011. "Anchoring Vignettes and Response Consistency," Working Papers WR-840, RAND Corporation.
  • Handle: RePEc:ran:wpaper:wr-840
    as

    Download full text from publisher

    File URL: https://www.rand.org/content/dam/rand/pubs/working_papers/2011/RAND_WR840.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. van Soest, Arthur & Delaney, Liam & Harmon, Colm P. & Kapteyn, Arie & Smith, James P., 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," IZA Discussion Papers 2860, Institute of Labor Economics (IZA).
    2. Kristensen, Nicolai & Johansson, Edvard, 2008. "New evidence on cross-country differences in job satisfaction using anchoring vignettes," Labour Economics, Elsevier, vol. 15(1), pages 96-117, February.
    3. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
    4. Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011. "Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Journal of Human Resources, University of Wisconsin Press, vol. 46(4), pages 875-906.
    5. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    6. Nicolas Sirven & Brigitte Santos-Eggimann & Jacques Spagnoli, 2008. "Comparability of Health Care Responsiveness in Europe using anchoring vignettes from SHARE," Working Papers DT15, IRDES institut for research and information in health economics, revised Sep 2008.
    7. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hullegie, P.G.J., 2012. "Essays on health and labor economics," Other publications TiSEM dcc68fc9-7af1-4ba9-8f90-6, Tilburg University, School of Economics and Management.
    2. Hendrik Jürges & Joachim Winter, 2013. "Are Anchoring Vignettes Ratings Sensitive To Vignette Age And Sex?," Health Economics, John Wiley & Sons, Ltd., vol. 22(1), pages 1-13, January.
    3. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    4. William H. Greene & Mark N. Harris & Rachel J. Knott & Nigel Rice, 2021. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 31-64, January.
    5. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    6. Knott, Rachel J. & Lorgelly, Paula K. & Black, Nicole & Hollingsworth, Bruce, 2017. "Differential item functioning in quality of life measurement: An analysis using anchoring vignettes," Social Science & Medicine, Elsevier, vol. 190(C), pages 247-255.
    7. Aparajita Dasgupta, 2018. "Systematic measurement error in self-reported health: is anchoring vignettes the way out?," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-30, December.
    8. Hanna Grol-Prokopczyk, 2018. "In Pursuit of Anchoring Vignettes That Work: Evaluating Generality Versus Specificity in Vignette Texts," Journals of Gerontology: Series B, Gerontological Society of America, vol. 73(1), pages 54-63.
    9. Knott, R. & Lorgelly, P. & Black, N. & Hollingsworth, B., 2016. "Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 16/14, HEDG, c/o Department of Economics, University of York.
    10. Rachel J. Knott & Nicole Black & Bruce Hollingsworth & Paula K. Lorgelly, 2017. "Response to comment by robone: Practical advice for the implementation of anchoring vignettes," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 398-400, March.
    11. Silvana Robone, 2017. "Comment on ‘Response –scale heterogeneity in the EQ‐5D: Can we use vignettes to address response‐scale heterogeneity in the EQ‐5D? Not if but how’," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 395-397, March.
    12. Hana Vonkova, 2019. "Life Satisfaction among Different Groups of Children: Self-Reports, Differential Scale Usage and Anchoring Vignettes," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 12(6), pages 2111-2136, December.
    13. Agree Emily M. & Wolf Douglas A., 2018. "Disability Measurement in the Health and Retirement Study," Forum for Health Economics & Policy, De Gruyter, vol. 21(1), pages 1-14, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nigel Rice & Silvana Robone & Peter Smith, 2011. "Analysis of the validity of the vignette approach to correct for heterogeneity in reporting health system responsiveness," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 12(2), pages 141-162, April.
    2. Hullegie, P.G.J., 2012. "Essays on health and labor economics," Other publications TiSEM dcc68fc9-7af1-4ba9-8f90-6, Tilburg University, School of Economics and Management.
    3. William H. Greene & Mark N. Harris & Rachel J. Knott & Nigel Rice, 2021. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 31-64, January.
    4. Renske Kok & Mauricio Avendano & Teresa Bago d’Uva & Johan Mackenbach, 2012. "Can Reporting Heterogeneity Explain Differences in Depressive Symptoms Across Europe?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 191-210, January.
    5. Knott, R. & Lorgelly, P. & Black, N. & Hollingsworth, B., 2016. "Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 16/14, HEDG, c/o Department of Economics, University of York.
    6. Datta Gupta, Nabanita & Kristensen, Nicolai & Pozzoli, Dario, 2010. "External validation of the use of vignettes in cross-country health studies," Economic Modelling, Elsevier, vol. 27(4), pages 854-865, July.
    7. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    8. Eric Bonsang & Arthur Soest, 2012. "Satisfaction with Social Contacts of Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 273-292, January.
    9. Zhang, Hao & Bago d’Uva, Teresa & van Doorslaer, Eddy, 2015. "The gender health gap in China: A decomposition analysis," Economics & Human Biology, Elsevier, vol. 18(C), pages 13-26.
    10. Corrado, L. & Weeks, M., 2010. "Identification Strategies in Survey Response Using Vignettes," Cambridge Working Papers in Economics 1031, Faculty of Economics, University of Cambridge.
    11. Rachel J. Knott & Nicole Black & Bruce Hollingsworth & Paula K. Lorgelly, 2017. "Response‐Scale Heterogeneity in the EQ‐5D," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 387-394, March.
    12. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    13. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2013. "Are A mericans Really Less Happy with Their Incomes?," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 59(1), pages 44-65, March.
    14. Carmelo León & Jorge Araña & Javier León, 2013. "Correcting for Scale Perception Bias in Measuring Corruption: an Application to Chile and Spain," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(3), pages 977-995, December.
    15. Laura Rossouw & Teresa Bago d’Uva & Eddy Doorslaer, 2018. "Poor Health Reporting? Using Anchoring Vignettes to Uncover Health Disparities by Wealth and Race," Demography, Springer;Population Association of America (PAA), vol. 55(5), pages 1935-1956, October.
    16. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2012. "Age, Health and Life Satisfaction Among Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 293-308, January.
    17. Montgomery, Mallory, 2022. "Reversing the gender gap in happiness," Journal of Economic Behavior & Organization, Elsevier, vol. 196(C), pages 65-78.
    18. Eric Bonsang & Arthur Soest, 2012. "Satisfaction with Job and Income Among Older Individuals Across European Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 227-254, January.
    19. Omar Paccagnella, 2011. "Anchoring vignettes with sample selection due to non‐response," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 665-687, July.
    20. Kapteyn, Arie & Wah, Saw Htay, 2016. "Challenges to small and medium-size businesses in Myanmar: What are they and how do we know?," Journal of Asian Economics, Elsevier, vol. 47(C), pages 1-22.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ran:wpaper:wr-840. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Benson Wong (email available below). General contact details of provider: https://edirc.repec.org/data/lpranus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.