IDEAS home Printed from https://ideas.repec.org/p/ucd/wpaper/200714.html
   My bibliography  Save this paper

Validating the Use of Vignettes for Subjective Threshold Scales

Author

Listed:
  • Arthur Van Soest

    (RAND Corportation & Tiburg University, PO Box 90153, 5000 LE Tilburg, Netherlands)

  • Liam Delaney

    (Senior Researcher, Geary Institute, University College Dublin)

  • Colm Harmon

    (Geary Institute, University College Dublin)

  • Arie Kapteyn

    (RAND Corporation)

  • James P. Smith

    (RAND Corporation)

Abstract

Comparing self-assessed indicators of subjective outcomes such as health, work disability, political efficacy, job satisfaction, etc. across countries or socio-economic groups is often hampered by the fact that different groups use systematically different response scales. Anchoring vignettes have been introduced as an effective tool to correct for such differences. This paper develops an integrated framework in which objective measurements are used to validate the vignette based corrections. The framework is applied to vignettes and objective and subjective self-assessments of drinking behavior by students in Ireland. Model comparisons using the Akaike information criterion favor a specification with response consistency and vignette corrected response scales. Put differently, vignette based corrections appear quite effective in bringing objective and subjective measures closer together.

Suggested Citation

  • Arthur Van Soest & Liam Delaney & Colm Harmon & Arie Kapteyn & James P. Smith, 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," Working Papers 200714, Geary Institute, University College Dublin.
  • Handle: RePEc:ucd:wpaper:200714
    as

    Download full text from publisher

    File URL: http://www.ucd.ie/geary/static/publications/workingpapers/GearyWp200714.pdf
    File Function: First version, 2007
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. repec:cup:apsrev:v:97:y:2003:i:04:p:567-583_00 is not listed on IDEAS
    2. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, pages 461-473.
    3. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    4. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375.
    5. Lindeboom, Maarten & van Doorslaer, Eddy, 2004. "Cut-point shift and index shift in self-reported health," Journal of Health Economics, Elsevier, vol. 23(6), pages 1083-1099, November.
    6. Arie Kapteyn & James P. Smith & Arthur VanSoest, 2005. "Vignettes and Self Reported Work Disability," Labor and Demography 0511005, EconWPA.
    7. Kristensen, Nicolai & Johansson, Edvard, 2008. "New evidence on cross-country differences in job satisfaction using anchoring vignettes," Labour Economics, Elsevier, pages 96-117.
    8. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2004. "Self-reported Work Disability in the US and The Netherlands," Working Papers 206, RAND Corporation.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hullegie, P.G.J., 2012. "Essays on health and labor economics," Other publications TiSEM dcc68fc9-7af1-4ba9-8f90-6, Tilburg University, School of Economics and Management.
    2. Renske Kok & Mauricio Avendano & Teresa Bago d’Uva & Johan Mackenbach, 2012. "Can Reporting Heterogeneity Explain Differences in Depressive Symptoms Across Europe?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 191-210, January.
    3. Senik, Claudia, 2011. "The French Unhappiness Puzzle: The Cultural Dimension of Happiness," IZA Discussion Papers 6175, Institute for the Study of Labor (IZA).
    4. Nigel Rice & Silvana Robone & Peter Smith, 2011. "Analysis of the validity of the vignette approach to correct for heterogeneity in reporting health system responsiveness," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), pages 141-162.
    5. Franco Peracchi & Claudio Rossetti, 2009. "Gender and regional differences in self-rated health in Europe," CEIS Research Paper 142, Tor Vergata University, CEIS, revised 30 Sep 2009.
    6. Arie Kapteyn & James P. Smith & Arthur van Soest, 2009. "Work Disability, Work, and Justification Bias in Europe and the U.S," Working Papers wp207, University of Michigan, Michigan Retirement Research Center.
    7. Keese, Matthias, 2010. "Who Feels Constrained by High Debt Burdens? – Subjective vs. Objective Measures of Household Indebtedness," Ruhr Economic Papers 169, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    8. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2013. "Are A mericans Really Less Happy with Their Incomes?," Review of Income and Wealth, International Association for Research in Income and Wealth, pages 44-65.
    9. Antecol, Heather & Barcus, Vanessa E. & Cobb-Clark, Deborah, 2009. "Gender-biased behavior at work: Exploring the relationship between sexual harassment and sex discrimination," Journal of Economic Psychology, Elsevier, vol. 30(5), pages 782-792, October.
    10. Liam Delaney & Arie Kapteyn & James Smith, 2013. "Why do some Irish drink so much? Family, historical and regional effects on students’ alcohol consumption and subjective normative thresholds," Review of Economics of the Household, Springer, vol. 11(1), pages 1-27, March.
    11. Menz, Tobias & Welsch, Heinz, 2010. "Population aging and environmental preferences in OECD countries: The case of air pollution," Ecological Economics, Elsevier, vol. 69(12), pages 2582-2589, October.
    12. Eric Bonsang & Arthur Soest, 2012. "Satisfaction with Job and Income Among Older Individuals Across European Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 227-254, January.
    13. Carmelo León & Jorge Araña & Javier León, 2013. "Correcting for Scale Perception Bias in Measuring Corruption: an Application to Chile and Spain," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(3), pages 977-995, December.
    14. Viola Angelini & Danilo Cavapozzi & Omar Paccagnella, 2012. "Cross-Country Differentials in Work Disability Reporting Among Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 211-226, January.
    15. Arie Kapteyn, 2010. "What can we learn from (and about) global aging?," Demography, Springer;Population Association of America (PAA), vol. 47(1), pages 191-209, March.
    16. Eric Bonsang & Arthur Soest, 2012. "Satisfaction with Social Contacts of Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 273-292, January.
    17. Liam Delaney & Arie Kapteyn & James P. Smith, 2008. "Why do some Irish drink so much?," Working Papers 200809, School of Economics, University College Dublin.
    18. Corrado, L. & Weeks, M., 2010. "Identification Strategies in Survey Response Using Vignettes," Cambridge Working Papers in Economics 1031, Faculty of Economics, University of Cambridge.
    19. Kapteyn, Arie & Smith, James P. & van Soest, Arthur, 2009. "Life Satisfaction," IZA Discussion Papers 4015, Institute for the Study of Labor (IZA).
    20. Datta Gupta, Nabanita & Kristensen, Nicolai & Pozzoli, Dario, 2010. "External validation of the use of vignettes in cross-country health studies," Economic Modelling, Elsevier, vol. 27(4), pages 854-865, July.
    21. Jorge E. Arana & Carmelo León, 2011. "Scale Perception Bias in the Valuation of Environmental Risks," Post-Print hal-00701866, HAL.
    22. Arie Kapteyn & James P. Smith & Arthur Van Soest & Hana Vonkova, 2011. "Anchoring Vignettes and Response Consistency," Working Papers 840, RAND Corporation.

    More about this item

    Keywords

    anchoring vignettes; reporting bias; hopit model;

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • I12 - Health, Education, and Welfare - - Health - - - Health Behavior

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucd:wpaper:200714. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Geary Tech). General contact details of provider: http://edirc.repec.org/data/geucdie.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.