IDEAS home Printed from https://ideas.repec.org/p/yor/hectdg/16-14.html
   My bibliography  Save this paper

Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes

Author

Listed:
  • Knott, R.
  • Lorgelly, P.
  • Black, N.
  • Hollingsworth, B.

Abstract

Inter-group comparisons using the EQ-5D, or any self-reported measure of health, rely on the measure being an accurate reflection of the true health of the groups or individuals concerned. However, responses to questions on subjective scales, such as those used in the EQ-5D, will be inaccurate if groups of individuals systematically differ in their use of the response categories, a phenomenon known as differential item functioning(DIF). This paper reports on an exploratory analysis involving the use of anchoring vignettes to identify differential item functioning (DIF) in the EQ-5D-5L. We demonstrate that using vignettes to appropriately identify DIF in EQ-5D reporting is possible, at least in certain age groups. We find that the EQ-5D is indeed subject to DIF, and that failure to account for DIF can lead to conclusions that are misleading when using the instrument to compare health or quality of life across heterogeneous groups. For instance, when adjusting for DIF in a sample aged 55-65 years, we found that differences between the highest and lowest education groups doubled in value afteradjusting for DIF, and increased from quantities that would not have had relevance in a clinical settings to ones that would (based on a suggested minimally important difference). Thus, our research provides evidence that the EQ-5D should be used with caution when comparing health or quality of life across heterogeneous groups. We also provide several important insights in terms of the identifying assumptions of response consistency and vignette equivalence.

Suggested Citation

  • Knott, R. & Lorgelly, P. & Black, N. & Hollingsworth, B., 2016. "Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 16/14, HEDG, c/o Department of Economics, University of York.
  • Handle: RePEc:yor:hectdg:16/14
    as

    Download full text from publisher

    File URL: https://www.york.ac.uk/media/economics/documents/hedg/workingpapers/1614.pdf
    File Function: Main text
    Download Restriction: no

    References listed on IDEAS

    as
    1. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    2. repec:cup:apsrev:v:97:y:2003:i:04:p:567-583_00 is not listed on IDEAS
    3. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
    4. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2013. "Are A mericans Really Less Happy with Their Incomes?," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 59(1), pages 44-65, March.
    5. Nancy Devlin & Paul Krabbe, 2013. "The development of new research methods for the valuation of EQ-5D-5L," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 14(1), pages 1-3, July.
    6. Hendrik Jürges & Joachim Winter, 2013. "Are Anchoring Vignettes Ratings Sensitive To Vignette Age And Sex?," Health Economics, John Wiley & Sons, Ltd., vol. 22(1), pages 1-13, January.
    7. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    8. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2014. "Do Danes and Italians Rate Life Satisfaction in the Same Way? Using Vignettes to Correct for Individual-Specific Scale Biases," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(5), pages 643-666, October.
    9. Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011. "Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Journal of Human Resources, University of Wisconsin Press, vol. 46(4), pages 875-906.
    10. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375.
    11. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    12. Dolan, Paul & Kavetsos, Georgios & Tsuchiya, Aki, 2013. "Sick but satisfied: The impact of life and health satisfaction on choice between health scenarios," Journal of Health Economics, Elsevier, vol. 32(4), pages 708-714.
    13. Kristensen, Nicolai & Johansson, Edvard, 2008. "New evidence on cross-country differences in job satisfaction using anchoring vignettes," Labour Economics, Elsevier, vol. 15(1), pages 96-117, February.
    14. Jones, Andrew M. & Rice, Nigel & Robone, Silvana & Dias, Pedro Rosa, 2011. "Inequality and polarisation in health systems' responsiveness: A cross-country analysis," Journal of Health Economics, Elsevier, vol. 30(4), pages 616-625, July.
    15. Nancy J. Devlin & David Parkin & John Browne, 2010. "Patient‐reported outcome measures in the NHS: new methods for analysing and reporting EQ‐5D data," Health Economics, John Wiley & Sons, Ltd., vol. 19(8), pages 886-905, August.
    16. Richard Norman & Paula Cronin & Rosalie Viney, 2013. "A Pilot Discrete Choice Experiment to Explore Preferences for EQ-5D-5L Health States," Applied Health Economics and Health Policy, Springer, vol. 11(3), pages 287-298, June.
    17. Teresa Bago d'Uva & Maarten Lindeboom & Owen O'Donnell & Eddy van Doorslaer, 2011. "Education‐related inequity in healthcare with heterogeneous reporting of health," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 639-664, July.
    18. Van de Poel, Ellen & Van Doorslaer, Eddy & O’Donnell, Owen, 2012. "Measurement of inequity in health care with heterogeneous response of use to need," Journal of Health Economics, Elsevier, vol. 31(4), pages 676-689.
    19. Teresa Molina, 2016. "Reporting Heterogeneity and Health Disparities Across Gender and Education Levels: Evidence From Four Countries," Demography, Springer;Population Association of America (PAA), vol. 53(2), pages 295-323, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Chris Sampson’s journal round-up for 11th September 2017
      by Chris Sampson in The Academic Health Economists' Blog on 2017-09-11 16:00:01

    More about this item

    Keywords

    differential item functioning; anchoring vignettes; EQ-5D; response consistency; vignette equivalence;

    JEL classification:

    • I10 - Health, Education, and Welfare - - Health - - - General
    • C19 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Other
    • C49 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Other

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:yor:hectdg:16/14. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jane Rawlings). General contact details of provider: http://edirc.repec.org/data/deyoruk.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.