IDEAS home Printed from https://ideas.repec.org/a/eee/ecolet/v194y2020ics0165176520302147.html
   My bibliography  Save this article

Using externally collected vignettes to account for reporting heterogeneity in survey self-assessment

Author

Listed:
  • Harris, Mark N.
  • Knott, Rachel J.
  • Lorgelly, Paula K.
  • Rice, Nigel

Abstract

The anchoring vignette approach has grown in popularity as a method to adjust for reporting heterogeneity in self-reported survey questions, removing bias due to systematic variation in reporting styles across study respondents. The use of anchoring vignettes, however, has been limited to surveys where both self-reports and vignette questions have been included. This diminishes their wider application. We illustrate, using an application to self-reported health in a large household survey, how externally collected vignettes can be used to adjust for reporting heterogeneity in datasets that have not included anchoring vignettes. Given that self-reported measures are an important facet of social, health and economic research, we anticipate the approach described will lead to new applications of the anchoring vignette methodology.

Suggested Citation

  • Harris, Mark N. & Knott, Rachel J. & Lorgelly, Paula K. & Rice, Nigel, 2020. "Using externally collected vignettes to account for reporting heterogeneity in survey self-assessment," Economics Letters, Elsevier, vol. 194(C).
    • Handle: RePEc:eee:ecolet:v:194:y:2020:i:c:s0165176520302147
    DOI: 10.1016/j.econlet.2020.109325
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0165176520302147
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econlet.2020.109325?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
    2. Rachel J. Knott & Nicole Black & Bruce Hollingsworth & Paula K. Lorgelly, 2017. "Response‐Scale Heterogeneity in the EQ‐5D," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 387-394, March.
    3. Knott, Rachel J. & Lorgelly, Paula K. & Black, Nicole & Hollingsworth, Bruce, 2017. "Differential item functioning in quality of life measurement: An analysis using anchoring vignettes," Social Science & Medicine, Elsevier, vol. 190(C), pages 247-255.
    4. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    5. Paul Contoyannis & Andrew M. Jones & Nigel Rice, 2004. "The dynamics of health in the British Household Panel Survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(4), pages 473-503.
    6. Balia, Silvia & Jones, Andrew M., 2008. "Mortality, lifestyle and socio-economic status," Journal of Health Economics, Elsevier, vol. 27(1), pages 1-26, January.
    7. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2014. "Do Danes and Italians Rate Life Satisfaction in the Same Way? Using Vignettes to Correct for Individual-Specific Scale Biases," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(5), pages 643-666, October.
    8. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375, March.
    9. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    10. Ren Mu, 2014. "Regional Disparities In Self‐Reported Health: Evidence From Chinese Older Adults," Health Economics, John Wiley & Sons, Ltd., vol. 23(5), pages 529-549, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Greene, William & Harris, Mark N. & Knott, Rachel & Rice, Nigel, 2023. "Reporting heterogeneity in modeling self-assessed survey outcomes," Economic Modelling, Elsevier, vol. 124(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Knott, R. & Lorgelly, P. & Black, N. & Hollingsworth, B., 2016. "Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 16/14, HEDG, c/o Department of Economics, University of York.
    2. Greene, William & Harris, Mark N. & Knott, Rachel & Rice, Nigel, 2023. "Reporting heterogeneity in modeling self-assessed survey outcomes," Economic Modelling, Elsevier, vol. 124(C).
    3. William H. Greene & Mark N. Harris & Rachel J. Knott & Nigel Rice, 2021. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 31-64, January.
    4. Cinzia Di Novi & Anna Marenzi & Dino Rizzi, 2018. "Do healthcare tax credits help poor-health individuals on low incomes?," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(2), pages 293-307, March.
    5. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    6. Fontaine, Xavier & Haywood, Luke, 2018. "On the comparison of group inequalities using subjective data," Economics Letters, Elsevier, vol. 163(C), pages 17-21.
    7. Knott, Rachel J. & Lorgelly, Paula K. & Black, Nicole & Hollingsworth, Bruce, 2017. "Differential item functioning in quality of life measurement: An analysis using anchoring vignettes," Social Science & Medicine, Elsevier, vol. 190(C), pages 247-255.
    8. Rachel J. Knott & Nicole Black & Bruce Hollingsworth & Paula K. Lorgelly, 2017. "Response‐Scale Heterogeneity in the EQ‐5D," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 387-394, March.
    9. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    10. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2012. "Age, Health and Life Satisfaction Among Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 293-308, January.
    11. Molina, Teresa, 2017. "Adjusting for heterogeneous response thresholds in cross-country comparisons of self-reported health," The Journal of the Economics of Ageing, Elsevier, vol. 10(C), pages 1-20.
    12. Chris Muris & Pedro Raposo & Sotiris Vandoros, 2020. "A Dynamic Ordered Logit Model with Fixed Effects," Department of Economics Working Papers 2020-14, McMaster University.
    13. Montgomery, Mallory, 2022. "Reversing the gender gap in happiness," Journal of Economic Behavior & Organization, Elsevier, vol. 196(C), pages 65-78.
    14. Teresa Molina, 2016. "Reporting Heterogeneity and Health Disparities Across Gender and Education Levels: Evidence From Four Countries," Demography, Springer;Population Association of America (PAA), vol. 53(2), pages 295-323, April.
    15. Eric Bonsang & Arthur Soest, 2012. "Satisfaction with Job and Income Among Older Individuals Across European Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 227-254, January.
    16. Omar Paccagnella, 2011. "Anchoring vignettes with sample selection due to non‐response," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 665-687, July.
    17. Johnston, David W. & Propper, Carol & Shields, Michael A., 2009. "Comparing subjective and objective measures of health: Evidence from hypertension for the income/health gradient," Journal of Health Economics, Elsevier, vol. 28(3), pages 540-552, May.
    18. Datta Gupta, Nabanita & Kristensen, Nicolai & Pozzoli, Dario, 2010. "External validation of the use of vignettes in cross-country health studies," Economic Modelling, Elsevier, vol. 27(4), pages 854-865, July.
    19. Raskina, Yulia & Podkorytova, Olga & Kuchakov, Ruslan, 2022. "Health determinants and the reporting heterogeneity bias in Russia: Anchoring vignettes approach," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 66, pages 118-143.
    20. Zhiyong Huang & Haoxian Wang & Wenyuan Zheng, 2021. "An extended hierarchical ordered probit model robust to heteroskedastic vignette perceptions with an application to functional limitation assessment," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-19, March.

    More about this item

    Keywords

    Anchoring vignettes; Reporting heterogeneity; Differential item functioning; Self-reported measures; Survey measures;
    All these keywords.

    JEL classification:

    • I1 - Health, Education, and Welfare - - Health
    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • A1 - General Economics and Teaching - - General Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolet:v:194:y:2020:i:c:s0165176520302147. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.