IDEAS home Printed from https://ideas.repec.org/a/spr/patien/v18y2025i3d10.1007_s40271-025-00732-y.html
   My bibliography  Save this article

Using Best–Worst Scaling Survey to Investigate the Relative Importance of Attributes Associated with Public Hospital Outpatient Appointments

Author

Listed:
  • Tilley Pain

    (Allied Health Governance Office, Townsville Hospital and Health Service
    James Cook University)

  • Amy Brown

    (Townsville Hospital and Health Service
    James Cook University)

  • Gail Kingston

    (Allied Health Governance Office, Townsville Hospital and Health Service
    James Cook University)

  • Stephen Perks

    (James Cook University
    Townsville Hospital and Health Service)

  • Corey Patterson

    (Townsville Hospital and Health Service)

  • Nerida Firth

    (James Cook University
    Townsville Hospital and Health Service)

  • Jessica Lester

    (Townsville Hospital and Health Service)

  • Luke Sherwood

    (Townsville Hospital and Health Service)

  • Sonja Brennan

    (Townsville Hospital and Health Service)

  • Deborah Street

    (University of Technology)

Abstract

Introduction Obtaining patient input before healthcare redesign improves patient experience. The Townsville Hospital and Health Service, a regional Australian public health service, seeks to reduce the long wait list for medical specialist appointments by introducing allied health substitution models of care for low-acuity patients. This paper describes a best worst scaling survey conducted to refine attributes associated with outpatient appointments which will be used in a future discrete choice experiment (DCE). Methods A literature review was conducted to identify attributes associated with medical specialist outpatient appointments and allied health substitution models. An object (or case 1) best worst scaling (BWS) survey was designed using blocks of a balanced incomplete block design and analysed using multinomial logit and mixed logit models. Patients waiting at local specialist outpatient clinics were invited to complete the survey via an iPad. The interviewer collected field notes, which were analysed using content analysis. Results A total of 12 attributes were identified in the literature review and one from local discussion. The 167 completed responses demonstrated the ranking of attributes were diagnostic accuracy, symptom relief, continuity of care, satisfaction with care, healthcare professional, manner and communication, time on waitlist and onward referral. The least important attributes were reassurance offered, appointment wait time, cost and appointment duration. Conclusions This BWS survey allows us to reduce the attributes for inclusion in the DCE from 13 to 8. Diagnostic accuracy and symptom relief were of most importance, and appointment wait time and duration were of least importance. This suggests that patients would be willing to be attend different models of care such as allied health primary contact model if clinical outcomes were equivalent to the current medical-led models.

Suggested Citation

  • Tilley Pain & Amy Brown & Gail Kingston & Stephen Perks & Corey Patterson & Nerida Firth & Jessica Lester & Luke Sherwood & Sonja Brennan & Deborah Street, 2025. "Using Best–Worst Scaling Survey to Investigate the Relative Importance of Attributes Associated with Public Hospital Outpatient Appointments," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 18(3), pages 237-247, May.
    • Handle: RePEc:spr:patien:v:18:y:2025:i:3:d:10.1007_s40271-025-00732-y
    DOI: 10.1007/s40271-025-00732-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40271-025-00732-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40271-025-00732-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anika Reichert & Rowena Jacobs, 2018. "The impact of waiting time on patient outcomes: Evidence from early intervention in psychosis services in England," Health Economics, John Wiley & Sons, Ltd., vol. 27(11), pages 1772-1787, November.
    2. Verity Watson & Frauke Becker & Esther de Bekker‐Grob, 2017. "Discrete Choice Experiment Response Rates: A Meta‐analysis," Health Economics, John Wiley & Sons, Ltd., vol. 26(6), pages 810-817, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arntz, Melanie & Brüll, Eduard & Lipowski, Cäcilia, 2021. "Do preferences for urban amenities really differ by skill?," ZEW Discussion Papers 21-045, ZEW - Leibniz Centre for European Economic Research.
    2. Kevin Marsh & Nicolas Krucien, 2022. "Evaluating the Consistency of Patient Preference Estimates: Systematic Variation in Survival—Adverse Event Trade-Offs in Patients with Cancer or Cardiovascular Disease," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 15(1), pages 69-75, January.
    3. Maclean, Johanna Catherine & Tello-Trillo, Sebastian & Webber, Douglas, 2023. "Losing insurance and psychiatric hospitalizations," Journal of Economic Behavior & Organization, Elsevier, vol. 205(C), pages 508-527.
    4. Caplan, Arthur J. & Akhundjanov, Sherzod B. & Toll, Kristopher, 2021. "Measuring heterogeneous preferences for residential amenities," Regional Science and Urban Economics, Elsevier, vol. 87(C).
    5. Pestana, Joana & Frutuoso, João & Costa, Eduardo & Fonseca, Filipa, 2024. "Heterogeneity in physician's job preferences in a dual practice context – Evidence from a DCE," Social Science & Medicine, Elsevier, vol. 343(C).
    6. Reza Maleki & Mohammadreza Taghizadeh-Yazdi & Rohollah Ghasemi & Samar Rivandi, 2024. "A Hybrid Mathematical-Simulation Approach to Hospital Beds Capacity Optimization for COVID-19 Pandemic Conditions," SN Operations Research Forum, Springer, vol. 5(4), pages 1-33, December.
    7. Koşar, Gizem & Ransom, Tyler & van der Klaauw, Wilbert, 2022. "Understanding migration aversion using elicited counterfactual choice probabilities," Journal of Econometrics, Elsevier, vol. 231(1), pages 123-147.
    8. Maclean, J. Catherine & Tello-Trillo, Sebastian & Webber, Douglas A., 2019. "Losing Insurance and Behavioral Health Hospitalizations: Evidence from a Large-Scale Medicaid Disenrollment," IZA Discussion Papers 12463, Institute of Labor Economics (IZA).
    9. Christine A. Yee & Aaron Legler & Michael Davies & Julia Prentice & Steven Pizer, 2020. "Priority access to health care: Evidence from an exogenous policy shock," Health Economics, John Wiley & Sons, Ltd., vol. 29(3), pages 306-323, March.
    10. Luca Armanaschi & Elisabetta Barzan & Magda Cavallucci & Carlo Federici & Marco Sartirana & Florian Zerzer, 2022. "I dati amministrativi per la governance dei tempi di attesa delle prestazioni ambulatoriali: l?esperienza dell?Azienda Sanitaria dell?Alto Adige," MECOSAN, FrancoAngeli Editore, vol. 2022(123), pages 53-75.
    11. Marcel F. Jonker & Bas Donkers & Esther de Bekker‐Grob & Elly A. Stolk, 2019. "Attribute level overlap (and color coding) can reduce task complexity, improve choice consistency, and decrease the dropout rate in discrete choice experiments," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 350-363, March.
    12. Jorien Veldwijk & Rachael Lynn DiSantostefano & Ellen Janssen & Gwenda Simons & Matthias Englbrecht & Karin Schölin Bywall & Christine Radawski & Karim Raza & Brett Hauber & Marie Falahee, 2023. "Maximum Acceptable Risk Estimation Based on a Discrete Choice Experiment and a Probabilistic Threshold Technique," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 16(6), pages 641-653, November.
    13. de Bekker-Grob, E.W. & Donkers, B. & Bliemer, M.C.J. & Veldwijk, J. & Swait, J.D., 2020. "Can healthcare choice be predicted using stated preference data?," Social Science & Medicine, Elsevier, vol. 246(C).
    14. Anika Kreutzberg & Rowena Jacobs, 2020. "Improving access to services for psychotic patients: does implementing a waiting time target make a difference," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 21(5), pages 703-716, July.
    15. Julien Bergeot & Florence Jusot, 2024. "How did unmet care needs during the pandemic affect health outcomes of older European individuals?," Post-Print hal-04564156, HAL.
    16. Felipa de Mello-Sampayo, 2022. "On the timing and probability of Presurgical Teledermatology: how it becomes the dominant strategy," Health Care Management Science, Springer, vol. 25(3), pages 389-405, September.
    17. Moscelli, Giuseppe & Gravelle, Hugh & Siciliani, Luigi, 2023. "The effect of hospital choice and competition on inequalities in waiting times," Journal of Economic Behavior & Organization, Elsevier, vol. 205(C), pages 169-201.
    18. Giuseppe Moscelli & Hugh Gravelle & Luigi Siciliani, 2021. "Hospital competition and quality for non‐emergency patients in the English NHS," RAND Journal of Economics, RAND Corporation, vol. 52(2), pages 382-414, June.
    19. Williams, Jenny & Bretteville-Jensen, Anne Line, 2022. "What's Another Day? The Effects of Wait Time for Substance Abuse Treatment on Health-Care Utilization, Employment and Crime," IZA Discussion Papers 15083, Institute of Labor Economics (IZA).
    20. Gravelle, Hugh & Schroyen, Fred, 2020. "Optimal hospital payment rules under rationing by waiting," Journal of Health Economics, Elsevier, vol. 70(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:patien:v:18:y:2025:i:3:d:10.1007_s40271-025-00732-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.