Anchoring Vignettes and Response Consistency
AbstractThe use of anchoring vignettes to correct for differential item functioning rests upon two identifying assumptions: vignette equivalence and response consistency. To test the second assumption the authors conduct an experiment in which respondents in an Internet panel are asked to both describe their health in a number of domains and rate their health in these domains. In a subsequent interview respondents are shown vignettes that are in fact descriptions of their own health. Under response consistency and some auxiliary assumptions with regard to the validity of the experiment, there should be no systematic differences between the evaluation of these vignettes in the second interview and the self-evaluations in the first interview. They analyze data for five health domains: sleep, mobility, concentration, breathing and affect. Although descriptively the vignettes and the self-evaluations are similar for a number of domains, their nonparametric analysis suggests that response consistency is satisfied for the domain of sleep, while it indicates rejection of either the auxiliary assumptions or response consistency for the other domains of health. Parametric analysis suggests that the auxiliary assumptions may be most problematic. The analysis points at the need for a systematic experimental approach to the design of anchoring vignettes before using them in practice.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by RAND Corporation Publications Department in its series Working Papers with number 840.
Length: 33 pages
Date of creation: Feb 2011
Date of revision:
Contact details of provider:
Postal: 1776 Main Street, P.O. Box 2138, Santa Monica, California 90407-2138
Web page: http://www.rand.org/pubs/
More information through EDIRC
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- van Soest, Arthur & Delaney, Liam & Harmon, Colm P. & Kapteyn, Arie & Smith, James P., 2007.
"Validating the Use of Vignettes for Subjective Threshold Scales,"
IZA Discussion Papers
2860, Institute for the Study of Labor (IZA).
- Arthur van Soest & Liam Delaney & Colm Harmon & Arie Kapteyn & James P. Smith, 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," Working Papers 501, RAND Corporation Publications Department.
- Arthur Van Soest & Liam Delaney & Colm Harmon & Arie Kapteyn & James P. Smith, 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," Working Papers 200714, Geary Institute, University College Dublin.
- Liam Delaney & Colm Harmon & Arie Kapteyn & Arthur Van Soest & James P Smith, 2008. "Validating the Use of Vignettes for Subjective Threshold Scales," Working Papers 200808, School Of Economics, University College Dublin.
- Soest, A.H.O. van & Delaney, L. & Harmon, C. & Kapteyn, A. & Smith, J.P., 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," Discussion Paper 2007-43, Tilburg University, Center for Economic Research.
- Arie Kapteyn, 2010.
"What can we learn from (and about) global aging?,"
Springer, vol. 47(1), pages S191-S209, March.
- Hullegie, P.G.J., 2012. "Essays on health and labor economics," Open Access publications from Tilburg University urn:nbn:nl:ui:12-5637283, Tilburg University.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Benson Wong).
If references are entirely missing, you can add them using this form.