IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0184883.html
   My bibliography  Save this article

Logical inconsistencies in time trade-off valuation of EQ-5D-5L health states: Whose fault is it?

Author

Listed:
  • Zhihao Yang
  • Jan van Busschbach
  • Reinier Timman
  • M F Janssen
  • Nan Luo

Abstract

Introduction: Inconsistency in the time trade-off (TTO) task in EQ-5D-5L occurs when a respondent gives a higher value to a logically worse health state, the occurrence of inconsistency compromises the quality of the data. It is not yet clear which factors are associated with individual level inconsistency. Relating inconsistency to the characteristics of the respondent, interviewer, and the interview process could be helpful in understanding the causes of inconsistency. The objective of this paper is to discover the factors associated with individual level inconsistencies. Methods: Twenty interviewers interviewed 1,296 respondents and each respondent valued 10 health states using the EQ-VT platform in 5 cities in China. At the respondent level, inconsistency was identified in terms of severity and quantity and related to the respondent’s background characteristics, the time and iterations spent on the wheelchair example task, and the formal TTO tasks, using multilevel multinomial regression analyses. Interviewers’ impact on inconsistencies was analyzed using single level multinomial regression analyses. Results: In the full dataset, slight inconsistency was more related to the interview process (Time spent on TTO task: RRR = 1.246 with 95%CI: 1.076,1.441; time spent on Wheelchair example: RRR = 0.815 with 95%CI:0.699,0.952) while severe inconsistency was more related to respondent’s gender (Gender: RRR = 2.347 with 95%CI:1.429,3.855). One Interviewer (Interviewer 7: RRR = 7.335 with 95%CI:1.908,28.195) and interviewer’s experience (Sequence: RRR = 0.511 with 95%CI:0.385,0.678) in general showed strong influence over inconsistency in the TTO task. Conclusion: In conclusion, logical inconsistency in the valuation of EQ-5D-5L health states is associated not only with respondents’ characteristics but also with interviewers’ performance and the interview process. The role of interviewers and the importance of interviewer training may be more crucial than hitherto believed. This finding could be generalizable to other interviewer-administered health-state valuation study.

Suggested Citation

  • Zhihao Yang & Jan van Busschbach & Reinier Timman & M F Janssen & Nan Luo, 2017. "Logical inconsistencies in time trade-off valuation of EQ-5D-5L health states: Whose fault is it?," PLOS ONE, Public Library of Science, vol. 12(9), pages 1-10, September.
    • Handle: RePEc:plo:pone00:0184883
    DOI: 10.1371/journal.pone.0184883
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0184883
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0184883&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0184883?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Nancy J. Devlin & Paul Hansen & Paul Kind & Alan Williams, 2003. "Logical inconsistencies in survey respondents' health state valuations ‐ a methodological challenge for estimating social tariffs," Health Economics, John Wiley & Sons, Ltd., vol. 12(7), pages 529-544, July.
    2. Leida M. Lamers & Peep F. M. Stalmeier & Paul F. M. Krabbe & Jan J. V. Busschbach, 2006. "Inconsistencies in TTO and VAS Values for EQ-5D Health States," Medical Decision Making, , vol. 26(2), pages 173-181, March.
    3. Badia, Xavier & Roset, Monserrat & Herdman, Michael, 1999. "Inconsistent responses in three preference-elicitation methods for health states," Social Science & Medicine, Elsevier, vol. 49(7), pages 943-950, October.
    4. Mark Oppe & Kim Rand-Hendriksen & Koonal Shah & Juan M. Ramos‐Goñi & Nan Luo, 2016. "EuroQol Protocols for Time Trade-Off Valuation of Health Outcomes," PharmacoEconomics, Springer, vol. 34(10), pages 993-1004, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zoltán Hermann & Márta Péntek & László Gulácsi & Irén Anna Kopcsóné Németh & Zsombor Zrubka, 2022. "Measuring the acceptability of EQ-5D-3L health states for different ages: a new adaptive survey methodology," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(7), pages 1243-1255, September.
    2. Aureliano Paolo Finch & Eva Gamper & Richard Norman & Rosalie Viney & Bernhard Holzner & Madeleine King & Georg Kemmler, 2021. "Estimation of an EORTC QLU-C10 Value Set for Spain Using a Discrete Choice Experiment," PharmacoEconomics, Springer, vol. 39(9), pages 1085-1098, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franz Ombler & Michael Albert & Paul Hansen, 2017. "The true significance of ‘high’ correlations between EQ-5D value sets," Working Papers 1704, University of Otago, Department of Economics, revised Mar 2017.
    2. Rodríguez-Míguez, E. & Abellán-Perpiñán, J.M. & Alvarez, X.C. & González, X.M. & Sampayo, A.R., 2016. "The DEP-6D, a new preference-based measure to assess health states of dependency," Social Science & Medicine, Elsevier, vol. 153(C), pages 210-219.
    3. Franz Ombler & Michael Albert & Paul Hansen, 2018. "How Significant Are “High†Correlations Between EQ-5D Value Sets?," Medical Decision Making, , vol. 38(6), pages 635-645, August.
    4. Nancy J. Devlin & Koonal K. Shah & Brendan J. Mulhern & Krystallia Pantiri & Ben van Hout, 2019. "A new method for valuing health: directly eliciting personal utility functions," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(2), pages 257-270, March.
    5. Bansback, Nick & Brazier, John & Tsuchiya, Aki & Anis, Aslam, 2012. "Using a discrete choice experiment to estimate health state utility values," Journal of Health Economics, Elsevier, vol. 31(1), pages 306-318.
    6. Leida M. Lamers & Peep F. M. Stalmeier & Paul F. M. Krabbe & Jan J. V. Busschbach, 2006. "Inconsistencies in TTO and VAS Values for EQ-5D Health States," Medical Decision Making, , vol. 26(2), pages 173-181, March.
    7. Mônica Viegas Andrade & Kenya Noronha & Paul Kind & Carla de Barros Reis & Lucas Resende de Carvalho, 2016. "Logical Inconsistencies in 3 Preference Elicitation Methods for EQ-5D Health States," Medical Decision Making, , vol. 36(2), pages 242-252, February.
    8. Bansback, Nick & Brazier, John & Tsuchiya, Aki & Anis, Aslam, 2010. "Using a discrete choice experiment to estimate societal health state utility values," MPRA Paper 29933, University Library of Munich, Germany.
    9. Eve Wittenberg & Lisa Prosser, 2011. "Ordering errors, objections and invariance in utility survey responses," Applied Health Economics and Health Policy, Springer, vol. 9(4), pages 225-241, July.
    10. Eva Rodríguez Míguez & José María Abellán Perpiñán & José Carlos Álvarez Villamarín & José Manuel González Martínez & Antonio Rodríguez Sampayo, 2013. "Development of a new preference-based instrument to measure dependency," Working Papers 1301, Universidade de Vigo, Departamento de Economía Aplicada.
    11. Zoltán Hermann & Márta Péntek & László Gulácsi & Irén Anna Kopcsóné Németh & Zsombor Zrubka, 2022. "Measuring the acceptability of EQ-5D-3L health states for different ages: a new adaptive survey methodology," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(7), pages 1243-1255, September.
    12. Stefan A. Lipman & Liying Zhang & Koonal K. Shah & Arthur E. Attema, 2023. "Time and lexicographic preferences in the valuation of EQ-5D-Y with time trade-off methodology," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 24(2), pages 293-305, March.
    13. Markian Pahuta & Aaron Frombach & Emile Hashem & Stewart Spence & Christina Sun & Eugene K. Wai & Joel Werier & Carl Walraven & Doug Coyle, 2019. "The Psychometric Properties of a Self-Administered, Open-Source Module for Valuing Metastatic Epidural Spinal Cord Compression Utilities," PharmacoEconomics - Open, Springer, vol. 3(2), pages 197-204, June.
    14. Attema, Arthur E. & Brouwer, Werner B.F., 2009. "The correction of TTO-scores for utility curvature using a risk-free utility elicitation method," Journal of Health Economics, Elsevier, vol. 28(1), pages 234-243, January.
    15. Asrul Akmal Shafie & Annushiah Vasan Thakumar, 2020. "Multiplicative modelling of EQ-5D-3L TTO and VAS values," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(9), pages 1411-1420, December.
    16. Anne‐Laure Samson & Erik Schokkaert & Clémence Thébaut & Brigitte Dormont & Marc Fleurbaey & Stéphane Luchini & Carine Van de Voorde, 2018. "Fairness in cost‐benefit analysis: A methodology for health technology assessment," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 102-114, January.
    17. Mathieu F. Janssen & Gouke J. Bonsel & Nan Luo, 2018. "Is EQ-5D-5L Better Than EQ-5D-3L? A Head-to-Head Comparison of Descriptive Systems and Value Sets from Seven Countries," PharmacoEconomics, Springer, vol. 36(6), pages 675-697, June.
    18. Irina Cleemput, 2010. "A social preference valuations set for EQ-5D health states in Flanders, Belgium," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 11(2), pages 205-213, April.
    19. Garry Barton & Tracey Sach & Michael Doherty & Anthony Avery & Claire Jenkinson & Kenneth Muir, 2008. "An assessment of the discriminative ability of the EQ-5D index , SF-6D, and EQ VAS, using sociodemographic factors and clinical conditions," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 9(3), pages 237-249, August.
    20. Mihir Gandhi & Marcus Ang & Kelvin Teo & Chee Wai Wong & Yvonne Chung-Hsi Wei & Rachel Lee-Yin Tan & Mathieu F. Janssen & Nan Luo, 2020. "A vision ‘bolt-on’ increases the responsiveness of EQ-5D: preliminary evidence from a study of cataract surgery," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(4), pages 501-511, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0184883. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.