IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0289009.html
   My bibliography  Save this article

Disciplinary trends in the use of the Delphi method: A bibliometric analysis

Author

Listed:
  • Dmitry Khodyakov
  • Sean Grant
  • Jack Kroger
  • Catria Gadwah-Meaden
  • Aneesa Motala
  • Jody Larkin

Abstract

The Delphi method is an iterative, anonymous, group-based process for eliciting and aggregating opinion on a topic to explore the existence of consensus among experts. The year 2023 marks the 60th anniversary of the first peer-reviewed journal article on the Delphi method. Originally developed for operations research, this method is now applied extensively by researchers representing diverse scientific fields. We used a bibliometric analysis to describe general trends in the expansion of its use across disciplines over time. We conducted a systematic literature search for all English-language, peer-reviewed journal articles on the Delphi method through its first 60 years. We found 19,831 articles: 96.8% (n = 19,204) on the actual use of the Delphi method in an empirical study and 3.2% (n = 627) describing, examining, or providing some guidance on how to use the Delphi method. Almost half (49.9%) of all articles were published in the 2010s and an additional third (32.5%) in the first few years of the 2020s. Nearly two-thirds (65%, n = 12,883) of all published articles have appeared in medical journals, compared to 15% in science and technology (n = 3,053) or social science (n = 3,016) journals. We conclude that the expanded use of the Delphi method has been driven largely by the medical field, though social scientists and technologists continue to be at the forefront of methodological work on the Delphi method. Therefore, we call for greater transdisciplinary collaboration on methodological guidance and standards for the Delphi method.

Suggested Citation

  • Dmitry Khodyakov & Sean Grant & Jack Kroger & Catria Gadwah-Meaden & Aneesa Motala & Jody Larkin, 2023. "Disciplinary trends in the use of the Delphi method: A bibliometric analysis," PLOS ONE, Public Library of Science, vol. 18(8), pages 1-11, August.
  • Handle: RePEc:plo:pone00:0289009
    DOI: 10.1371/journal.pone.0289009
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0289009
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0289009&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0289009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Park, R.E. & Fink, A. & Brook, R.H. & Chassin, M.R. & Kahn, K.L. & Merrick, N.J. & Kosecoff, J. & Solomon, D.H., 1986. "Physician ratings of appropriate indications for six medical and surgical procedures," American Journal of Public Health, American Public Health Association, vol. 76(7), pages 766-772.
    2. Norman Dalkey & Olaf Helmer, 1963. "An Experimental Application of the DELPHI Method to the Use of Experts," Management Science, INFORMS, vol. 9(3), pages 458-467, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Prommer, Lisa & Tiberius, Victor & Kraus, Sascha, 2020. "Exploring the future of startup leadership development," Journal of Business Venturing Insights, Elsevier, vol. 14(C).
    2. Bokrantz, Jon & Skoogh, Anders & Berlin, Cecilia & Stahre, Johan, 2017. "Maintenance in digitalised manufacturing: Delphi-based scenarios for 2030," International Journal of Production Economics, Elsevier, vol. 191(C), pages 154-169.
    3. Seung-Jin Han & Won-Jae Lee & So-Hee Kim & Sang-Hoon Yoon & Hyunwoong Pyun, 2022. "Assessing Expected Long-term Benefits for the Olympic Games: Delphi-AHP Approach from Korean Olympic Experts," SAGE Open, , vol. 12(4), pages 21582440221, December.
    4. Prianto Budi Saptono & Gustofan Mahmud & Intan Pratiwi & Dwi Purwanto & Ismail Khozen & Muhamad Akbar Aditama & Siti Khodijah & Maria Eurelia Wayan & Rina Yuliastuty Asmara & Ferry Jie, 2023. "Development of Climate-Related Disclosure Indicators for Application in Indonesia: A Delphi Method Study," Sustainability, MDPI, vol. 15(14), pages 1-25, July.
    5. Zhang, Hong & Gu, Chao-lin & Gu, Lu-wen & Zhang, Yan, 2011. "The evaluation of tourism destination competitiveness by TOPSIS & information entropy – A case in the Yangtze River Delta of China," Tourism Management, Elsevier, vol. 32(2), pages 443-451.
    6. Volkan Hasan Kaya & Doris Elster, 2019. "A Critical Consideration of Environmental Literacy: Concepts, Contexts, and Competencies," Sustainability, MDPI, vol. 11(6), pages 1-20, March.
    7. repec:plo:pone00:0178453 is not listed on IDEAS
    8. Petreski Marjan & Petreski Blagica & Tumanoska Despina & Narazani Edlira & Kazazi Fatush & Ognjanov Galjina & Jankovic Irena & Mustafa Arben & Kochovska Tereza, 2017. "The Size and Effects of Emigration and Remittances in the Western Balkans. A Forecasting Based on a Delphi Process," Südosteuropa. Journal of Politics and Society, De Gruyter, vol. 65(4), pages 679-695, December.
    9. Xinxin Liu & Xiaosheng Wang & Haiying Guo & Xiaojie An, 2021. "Benefit Allocation in Shared Water-Saving Management Contract Projects Based on Modified Expected Shapley Value," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(1), pages 39-62, January.
    10. Aparicio, Gloria & Basco, Rodrigo & Iturralde, Txomin & Maseda, Amaia, 2017. "An exploratory study of firm goals in the context of family firms: An institutional logics perspective," Journal of Family Business Strategy, Elsevier, vol. 8(3), pages 157-169.
    11. Nibedita Mukherjee & Jean Huge & Farid Dahdouh-Guebas & Nico Koedam, 2014. "Ecosystem service valuations of mangrove ecosystems to inform decision making and future valuation exercises," ULB Institutional Repository 2013/217963, ULB -- Universite Libre de Bruxelles.
    12. Di Zio, Simone & Bolzan, Mario & Marozzi, Marco, 2021. "Classification of Delphi outputs through robust ranking and fuzzy clustering for Delphi-based scenarios," Technological Forecasting and Social Change, Elsevier, vol. 173(C).
    13. Sheida Abdoli & Farah Habib & Mohammad Babazadeh, 2018. "Making spatial development scenario for south of Bushehr province, Iran, based on strategic foresight," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 20(3), pages 1293-1309, June.
    14. Shannon Li & Anne Honey & Francesca Coniglio & Peter Schaecken, 2022. "Mental Health Peer Worker Perspectives on Resources Developed from Lived Experience Research Findings: A Delphi Study," IJERPH, MDPI, vol. 19(7), pages 1-15, March.
    15. Alyami, Saleh. H. & Rezgui, Yacine & Kwan, Alan, 2013. "Developing sustainable building assessment scheme for Saudi Arabia: Delphi consultation approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 43-54.
    16. Chen, Peng-Ting & Cheng, Joe Z. & Yu, Ya-Wen & Ju, Pei-Hung, 2014. "Mobile advertising setting analysis and its strategic implications," Technology in Society, Elsevier, vol. 39(C), pages 129-141.
    17. Liping Wang & Xiufeng Sun & Junru Yan & Meiru Xie & Hua Qin, 2025. "Quantitative Assessment of Age-Friendly Design in Mountainous Urban Community Parks Based on Nonlinear Models: An Empirical Study in Chongqing, China," Land, MDPI, vol. 14(4), pages 1-30, April.
    18. Willem Karel M. Brauers & Romualdas Ginevičius, 2009. "Robustness in regional development studies. The case of Lithuania," Journal of Business Economics and Management, Taylor & Francis Journals, vol. 10(2), pages 121-140, February.
    19. F Ackermann & C Eden & T Williams & S Howick, 2007. "Systemic risk assessment: a case study," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(1), pages 39-51, January.
    20. Ju‐Lin Gao & Xiao‐Min Liu & Wen‐Fang Che & Xia Xin, 2018. "Construction of nursing‐sensitive quality indicators for haemodialysis using Delphi method," Journal of Clinical Nursing, John Wiley & Sons, vol. 27(21-22), pages 3920-3930, November.
    21. Fernando A. F. Ferreira & Ronald W. Spahr & Irina F. M. D. Gavancha & Amali Çipi, 2013. "Readjusting trade-offs among criteria in internal ratings of credit-scoring: an empirical essay of risk analysis in mortgage loans," Journal of Business Economics and Management, Taylor & Francis Journals, vol. 14(4), pages 715-740, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0289009. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.