IDEAS home Printed from https://ideas.repec.org/a/spr/pharmo/v8y2024i3d10.1007_s41669-024-00486-7.html
   My bibliography  Save this article

Behind the Scenes: A Qualitative Investigation of Interviewers' Performance in EQ-5D Valuation Studies

Author

Listed:
  • Carlotta Varriale

    (OECD)

  • Giovanni Andrulli

    (Lamb Weston Meijer)

  • Michela Meregaglia

    (CERGAS, SDA Bocconi School of Management)

  • Fanni Rencz

    (Corvinus University of Budapest)

  • Aureliano Paolo Finch

    (EuroQol Office, EuroQol Research Foundation
    Health Values Research and Consultancy)

Abstract

Background The EuroQol Valuation Technology (EQ-VT) protocol is currently employed by the valuation studies of the EQ family of instruments worldwide. To date, all the evidence in support of the quality control (QC) originates from quantitative indicators. Objective We aimed to explore interviewers’ conversational patterns in EQ-VT interviews, beyond quantitative QC indicators, and to provide a preliminary exploration of how the interaction between interviewer and respondent impacts data quality. Methods Two researchers transcribed and independently coded 24 video-recorded interviews from the Italian EQ-5D-5L valuation study, adopting the conversational analysis framework. The analysis identified positive and negative ‘patterns’ of conversational practice. These were categorized into themes and sub-themes and were used to score a random sample of 42 video-recorded interviews conducted at different time points by seven interviewers. Results The conversational analysis identified 20 positive and 14 negative interview patterns, which were grouped into two main themes (i.e., task execution and communication skills). Positive items included appending questions that stimulated respondents’ engagement, providing different explanations for an unclear aspect, supporting the participant with useful information for completing the tasks, and increasing the interview’s coherence by confirming the respondent answers. Negative patterns included moving forward in the exercise without making sure that the respondent understood, trying to force an answer from the respondent, speaking too fast, and providing incomplete or incorrect explanations of the task. Most interviewers exhibited a moderate increase in positive patterns or a decrease in negative patterns over time. A certain degree of consistency between the quantitative QC results and the qualitative scoring deriving from the interviewer-respondent interaction was observed, with the best and worst performers of the qualitative scoring showing good and bad scores on key QC items, respectively. Conclusions The identified positive and negative patterns may be useful to inform the training material of EQ-VT studies worldwide and complement the existing QC process.

Suggested Citation

  • Carlotta Varriale & Giovanni Andrulli & Michela Meregaglia & Fanni Rencz & Aureliano Paolo Finch, 2024. "Behind the Scenes: A Qualitative Investigation of Interviewers' Performance in EQ-5D Valuation Studies," PharmacoEconomics - Open, Springer, vol. 8(3), pages 389-401, May.
  • Handle: RePEc:spr:pharmo:v:8:y:2024:i:3:d:10.1007_s41669-024-00486-7
    DOI: 10.1007/s41669-024-00486-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s41669-024-00486-7
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1007/s41669-024-00486-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Nancy J. Devlin & Koonal K. Shah & Yan Feng & Brendan Mulhern & Ben van Hout, 2018. "Valuing health‐related quality of life: An EQ‐5D‐5L value set for England," Health Economics, John Wiley & Sons, Ltd., vol. 27(1), pages 7-22, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rowen, Donna & Mukuria, Clara & Bray, Nathan & Carlton, Jill & Longworth, Louise & Meads, David & O'Neill, Ciaran & Shah, Koonal & Yang, Yaling, 2022. "Assessing the comparative feasibility, acceptability and equivalence of videoconference interviews and face-to-face interviews using the time trade-off technique," Social Science & Medicine, Elsevier, vol. 309(C).
    2. Brendan Mulhern & Richard Norman & John Brazier, 2021. "Valuing SF-6Dv2 in Australia Using an International Protocol," PharmacoEconomics, Springer, vol. 39(10), pages 1151-1162, October.
    3. Tianxin Pan & Brendan Mulhern & Rosalie Viney & Richard Norman & Janel Hanmer & Nancy Devlin, 2022. "A Comparison of PROPr and EQ-5D-5L Value Sets," PharmacoEconomics, Springer, vol. 40(3), pages 297-307, March.
    4. Mihir Gandhi & Marcus Ang & Kelvin Teo & Chee Wai Wong & Yvonne Chung-Hsi Wei & Rachel Lee-Yin Tan & Mathieu F. Janssen & Nan Luo, 2020. "A vision ‘bolt-on’ increases the responsiveness of EQ-5D: preliminary evidence from a study of cataract surgery," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(4), pages 501-511, June.
    5. Mónica Hernández‐Alava & Stephen Pudney, 2022. "Mapping between EQ‐5D‐3L and EQ‐5D‐5L: A survey experiment on the validity of multi‐instrument data," Health Economics, John Wiley & Sons, Ltd., vol. 31(6), pages 923-939, June.
    6. John Mullahy, 2018. "Treatment Effects with Multiple Outcomes," NBER Working Papers 25307, National Bureau of Economic Research, Inc.
    7. Dhfer Alshayban & Royes Joseph, 2020. "Health-related quality of life among patients with type 2 diabetes mellitus in Eastern Province, Saudi Arabia: A cross-sectional study," PLOS ONE, Public Library of Science, vol. 15(1), pages 1-12, January.
    8. Ole Marten & Brendan Mulhern & Nick Bansback & Aki Tsuchiya, 2020. "Implausible States: Prevalence of EQ-5D-5L States in the General Population and Its Effect on Health State Valuation," Medical Decision Making, , vol. 40(6), pages 735-745, August.
    9. Elliott, Jack & Tsuchiya, Aki, 2022. "Do they just know more, or do they also have different preferences? An exploratory analysis of the effects of self-reporting serious health problems on health state valuation," Social Science & Medicine, Elsevier, vol. 315(C).
    10. Gamze Bayin Donar & Mehmet Top, 2020. "A conceptual framework of quality of life in chronic kidney disease in Turkey: A patient‐focused approach," International Journal of Health Planning and Management, Wiley Blackwell, vol. 35(6), pages 1335-1350, November.
    11. Admassu N. Lamu, 2020. "Does linear equating improve prediction in mapping? Crosswalking MacNew onto EQ-5D-5L value sets," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(6), pages 903-915, August.
    12. Héctor Pifarré i Arolas & Christian Dudel, 2019. "An Ordinal Measure of Population Health," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 143(3), pages 1219-1243, June.
    13. Wen Wan & M. Reza Skandari & Alexa Minc & Aviva G. Nathan & Parmida Zarei & Aaron N. Winn & Michael O’Grady & Elbert S. Huang, 2018. "Cost-effectiveness of Initiating an Insulin Pump in T1D Adults Using Continuous Glucose Monitoring Compared with Multiple Daily Insulin Injections: The DIAMOND Randomized Trial," Medical Decision Making, , vol. 38(8), pages 942-953, November.
    14. Rachael Maree Hunter & Rob Anderson & Tim Kirkpatrick & Charlotte Lennox & Fiona Warren & Rod S. Taylor & Jenny Shaw & Mark Haddad & Alex Stirzaker & Mike Maguire & Richard Byng, 2022. "Economic evaluation of a complex intervention (Engager) for prisoners with common mental health problems, near to and after release: a cost-utility and cost-consequences analysis," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(2), pages 193-210, March.
    15. Sahar Al Shabasy & Bram Roudijk & Maggie Abbassi & Aureliano Finch & Elly Stolk & Samar Farid, 2023. "The Egyptian EQ-5D-5L Extensive Pilot Study: Lessons Learned," PharmacoEconomics, Springer, vol. 41(3), pages 329-338, March.
    16. Teresa C. O. Tsui & Kelvin K. W. Chan & Feng Xie & Eleanor M. Pullenayegum, 2024. "Creating a Multiply Imputed Value Set for the EQ-5D-5L in Canada: State-Level Misspecification Terms Are Needed to Characterize Parameter Uncertainty Correctly," Medical Decision Making, , vol. 44(4), pages 405-414, May.
    17. Ernest H. Law & A. Simon Pickard & Feng Xie & Surrey M. Walton & Todd A. Lee & Alan Schwartz, 2018. "Parallel Valuation: A Direct Comparison of EQ-5D-3L and EQ-5D-5L Societal Value Sets," Medical Decision Making, , vol. 38(8), pages 968-982, November.
    18. Sullivan, Trudy & Hansen, Paul & Ombler, Franz & Derrett, Sarah & Devlin, Nancy, 2020. "A new tool for creating personal and social EQ-5D-5L value sets, including valuing ‘dead’," Social Science & Medicine, Elsevier, vol. 246(C).
    19. Donna Rowen & Clara Mukuria & Emily McDool, 2022. "A Systematic Review of the Methodologies and Modelling Approaches Used to Generate International EQ-5D-5L Value Sets," PharmacoEconomics, Springer, vol. 40(9), pages 863-882, September.
    20. Himmler, Sebastian & Jonker, Marcel & van Krugten, Frédérique & Hackert, Mariska & van Exel, Job & Brouwer, Werner, 2022. "Estimating an anchored utility tariff for the well-being of older people measure (WOOP) for the Netherlands," Social Science & Medicine, Elsevier, vol. 301(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:pharmo:v:8:y:2024:i:3:d:10.1007_s41669-024-00486-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.