IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0025983.html
   My bibliography  Save this article

New Tools for Systematic Evaluation of Teaching Qualities of Medical Faculty: Results of an Ongoing Multi-Center Survey

Author

Listed:
  • Onyebuchi A Arah
  • Joost B L Hoekstra
  • Albert P Bos
  • Kiki M J M H Lombarts

Abstract

Background: Tools for the evaluation, improvement and promotion of the teaching excellence of faculty remain elusive in residency settings. This study investigates (i) the reliability and validity of the data yielded by using two new instruments for evaluating the teaching qualities of medical faculty, (ii) the instruments' potential for differentiating between faculty, and (iii) the number of residents' evaluations needed per faculty to reliably use the instruments. Methods and Materials: Multicenter cross-sectional survey among 546 residents and 629 medical faculty representing 29 medical (non-surgical) specialty training programs in the Netherlands. Two instruments—one completed by residents and one by faculty—for measuring teaching qualities of faculty were developed. Statistical analyses included factor analysis, reliability and validity exploration using standard psychometric methods, calculation of the numbers of residents' evaluations needed per faculty to achieve reliable assessments and variance components and threshold analyses. Results: A total of 403 (73.8%) residents completed 3575 evaluations of 570 medical faculty while 494 (78.5%) faculty self-evaluated. In both instruments five composite-scales of faculty teaching qualities were detected with high internal consistency and reliability: learning climate (Cronbach's alpha of 0.85 for residents' instrument, 0.71 for self-evaluation instrument, professional attitude and behavior (0.84/0.75), communication of goals (0.90/0.84), evaluation of residents (0.91/0.81), and feedback (0.91/0.85). Faculty tended to evaluate themselves higher than did the residents. Up to a third of the total variance in various teaching qualities can be attributed to between-faculty differences. Some seven residents' evaluations per faculty are needed for assessments to attain a reliability level of 0.90. Conclusions: The instruments for evaluating teaching qualities of medical faculty appear to yield reliable and valid data. They are feasible for use in medical residencies, can detect between-faculty differences and supply potentially useful information for improving graduate medical education.

Suggested Citation

  • Onyebuchi A Arah & Joost B L Hoekstra & Albert P Bos & Kiki M J M H Lombarts, 2011. "New Tools for Systematic Evaluation of Teaching Qualities of Medical Faculty: Results of an Ongoing Multi-Center Survey," PLOS ONE, Public Library of Science, vol. 6(10), pages 1-10, October.
    • Handle: RePEc:plo:pone00:0025983
    DOI: 10.1371/journal.pone.0025983
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0025983
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0025983&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0025983?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lee Cronbach, 1951. "Coefficient alpha and the internal structure of tests," Psychometrika, Springer;The Psychometric Society, vol. 16(3), pages 297-334, September.
    2. Renée van der Leeuw & Kiki Lombarts & Maas Jan Heineman & Onyebuchi Arah, 2011. "Systematic Evaluation of the Teaching Qualities of Obstetrics and Gynecology Faculty: Reliability and Validity of the SETQ Tools," PLOS ONE, Public Library of Science, vol. 6(5), pages 1-7, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abdul Kadar Muhammad Masum & Md Abul Kalam Azad & Loo-See Beh, 2015. "Determinants of Academics' Job Satisfaction: Empirical Evidence from Private Universities in Bangladesh," PLOS ONE, Public Library of Science, vol. 10(2), pages 1-15, February.
    2. Irene A Slootweg & Kiki M J M H Lombarts & Benjamin C M Boerebach & Maas Jan Heineman & Albert J J A Scherpbier & Cees P M van der Vleuten, 2014. "Development and Validation of an Instrument for Measuring the Quality of Teamwork in Teaching Teams in Postgraduate Medical Training (TeamQ)," PLOS ONE, Public Library of Science, vol. 9(11), pages 1-11, November.
    3. Benjamin C M Boerebach & Kiki M J M H Lombarts & Albert J J Scherpbier & Onyebuchi A Arah, 2013. "The Teacher, the Physician and the Person: Exploring Causal Connections between Teaching Performance and Role Model Types Using Directed Acyclic Graphs," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-8, July.
    4. repec:plo:pone00:0032089 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yoon, Junghyun & Lee, Hee Yong & Dinwoodie, John, 2015. "Competitiveness of container terminal operating companies in South Korea and the industry–university–government network," Transportation Research Part A: Policy and Practice, Elsevier, vol. 80(C), pages 1-14.
    2. Md. Mominur Rahman & Bilkis Akhter, 2021. "The impact of investment in human capital on bank performance: evidence from Bangladesh," Future Business Journal, Springer, vol. 7(1), pages 1-13, December.
    3. Amolo Elvis Juma Amolo & Charles Mallans Rambo & Charles Misiko Wafula, 2024. "Hedging Derivatives and Performance of Renewable Energy Projects in Kenya," International Journal of Research and Scientific Innovation, International Journal of Research and Scientific Innovation (IJRSI), vol. 11(8), pages 619-630, August.
    4. Deepak, 2016. "Antecedent Value of Professional Commitment and Job Involvement in Determining Job Satisfaction," Management and Labour Studies, XLRI Jamshedpur, School of Business Management & Human Resources, vol. 41(2), pages 154-164, May.
    5. Marianela Denegri & María Baeza & Natalia Salinas-Oñate & Verónica Peñaloza & Horacio Miranda & Ligia Orellana, 2014. "Materialism in Pedagogy Students in Chile," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(2), pages 505-521, June.
    6. Tomislav Letnik & Katja Hanžič & Giuseppe Luppino & Matej Mencinger, 2022. "Impact of Logistics Trends on Freight Transport Development in Urban Areas," Sustainability, MDPI, vol. 14(24), pages 1-18, December.
    7. Julia Eichholz & Thorsten Knauer & Sandra Winkelmann, 2023. "Digital Maturity of Forecasting and its Impact in Times of Crisis," Schmalenbach Journal of Business Research, Springer, vol. 75(4), pages 443-481, December.
    8. Zhihui Wang & Liangzhen Nie & Eila Jeronen & Lihua Xu & Meiai Chen, 2023. "Understanding the Environmentally Sustainable Behavior of Chinese University Students as Tourists: An Integrative Framework," IJERPH, MDPI, vol. 20(4), pages 1-17, February.
    9. Amolo Elvis Juma Amolo, PhD & Charles Mallans Rambo, PhD & Charles Misiko Wafula, PhD, 2021. "Alternative Risk Transfer and Performance of Power Projects in Kenya," International Journal of Research and Scientific Innovation, International Journal of Research and Scientific Innovation (IJRSI), vol. 8(12), pages 28-35, December.
    10. Robert P. Garrett Jr. & Jeffrey G. Covin, 2015. "Internal Corporate Venture Operations Independence and Performance: A Knowledge–Based Perspective," Entrepreneurship Theory and Practice, , vol. 39(4), pages 763-790, July.
    11. repec:plo:pone00:0155225 is not listed on IDEAS
    12. Kang, Min Jung & Park, Heejun, 2011. "Impact of experience on government policy toward acceptance of hydrogen fuel cell vehicles in Korea," Energy Policy, Elsevier, vol. 39(6), pages 3465-3475, June.
    13. repec:plo:pone00:0121767 is not listed on IDEAS
    14. chatterjee, susmita, 2017. "Empowerment translated to transition," MPRA Paper 80067, University Library of Munich, Germany.
    15. Parry, Glenn & Bustinza, Oscar F. & Vendrell-Herrero, Ferran, 2012. "Servitisation and value co-production in the UK music industry: An empirical study of Consumer Attitudes," International Journal of Production Economics, Elsevier, vol. 135(1), pages 320-332.
    16. Ale Ebrahim, Nader & Ahmed Shamsuddin & Abdul Rashid, Salwa Hanim & Taha, Zahari, 2012. "Effective Virtual Teams for New Product Development," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 7(21), pages 1971-1985.
    17. Andreea-Ionela Puiu & Anca Monica Ardeleanu & Camelia Cojocaru & Anca Bratu, 2021. "Exploring the Effect of Status Quo, Innovativeness, and Involvement Tendencies on Luxury Fashion Innovations: The Mediation Role of Status Consumption," Mathematics, MDPI, vol. 9(9), pages 1-18, May.
    18. Yoonsun Oh & Jungsuk Oh, 2017. "A critical incident approach to consumer response in the smartphone market: product, service and contents," Information Systems and e-Business Management, Springer, vol. 15(3), pages 577-597, August.
    19. Bickenbach, Frank & Dohse, Dirk & Liu, Wan-Hsin, 2014. "An inquiry into the determinants of graduate entrepreneurship in Hong Kong and Guangzhou (Mainland China)," Kiel Working Papers 1940, Kiel Institute for the World Economy (IfW Kiel).
    20. Chuhan Chen & Syarmila Hany Haron, 2023. "The Influence of Multistakeholder Value Cognition and Risk Attitudes on Sustainable Interior Landscape Design Decisions," Sustainability, MDPI, vol. 15(3), pages 1-22, February.
    21. Allen, Jaime & Muñoz, Juan Carlos & Ortúzar, Juan de Dios, 2019. "On evasion behaviour in public transport: Dissatisfaction or contagion?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 130(C), pages 626-651.
    22. Li, Mengyu & Li, Jinglei & Yasin, Megat Al Imran & Hashim, Norliana Binti & Ang, Lay Hoon & Li, Fangyi, 2023. "Where do I belong? A study of associations between guanxi capital and local identity through WeChat use among Chinese youth," Technological Forecasting and Social Change, Elsevier, vol. 187(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0025983. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.