Anchoring Vignettes and Response Consistency
The use of anchoring vignettes to correct for differential item functioning rests upon two identifying assumptions: vignette equivalence and response consistency. To test the second assumption the authors conduct an experiment in which respondents in an Internet panel are asked to both describe their health in a number of domains and rate their health in these domains. In a subsequent interview respondents are shown vignettes that are in fact descriptions of their own health. Under response consistency and some auxiliary assumptions with regard to the validity of the experiment, there should be no systematic differences between the evaluation of these vignettes in the second interview and the self-evaluations in the first interview. They analyze data for five health domains: sleep, mobility, concentration, breathing and affect. Although descriptively the vignettes and the self-evaluations are similar for a number of domains, their nonparametric analysis suggests that response consistency is satisfied for the domain of sleep, while it indicates rejection of either the auxiliary assumptions or response consistency for the other domains of health. Parametric analysis suggests that the auxiliary assumptions may be most problematic. The analysis points at the need for a systematic experimental approach to the design of anchoring vignettes before using them in practice.
|Date of creation:||Feb 2011|
|Date of revision:|
|Contact details of provider:|| Postal: 1776 Main Street, P.O. Box 2138, Santa Monica, California 90407-2138|
Phone: (310) 393-0411, x7359
Web page: http://www.rand.org
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- van Soest, A.H.O. & Delaney, L. & Harmon, C. & Kapteyn, A. & Smith, J.P., 2007.
"Validating the Use of Vignettes for Subjective Threshold Scales,"
2007-43, Tilburg University, Center for Economic Research.
- Liam Delaney & Colm Harmon & Arie Kapteyn & Arthur Van Soest & James P. Smith, 2008. "Validating the use of vignettes for subjective threshold scales," Working Papers 200808, School of Economics, University College Dublin.
- Arthur Van Soest & Liam Delaney & Colm Harmon & Arie Kapteyn & James P. Smith, 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," Working Papers 200714, Geary Institute, University College Dublin.
- van Soest, Arthur & Delaney, Liam & Harmon, Colm P. & Kapteyn, Arie & Smith, James P., 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," IZA Discussion Papers 2860, Institute for the Study of Labor (IZA).
- Arthur van Soest & Liam Delaney & Colm Harmon & Arie Kapteyn & James P. Smith, 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," Working Papers 501, RAND Corporation.
When requesting a correction, please mention this item's handle: RePEc:ran:wpaper:840. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Benson Wong)
If references are entirely missing, you can add them using this form.