IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0305916.html
   My bibliography  Save this article

Enhancing post-training evaluation of annual performance agreement training: A fusion of fsQCA and artificial neural network approach

Author

Listed:
  • Md Zohurul Islam
  • Munshi Muhammad Abdul Kader Jilani
  • Mohammad Rezaul Karim

Abstract

This study aims to enhance the post-training evaluation of the annual performance agreement (APA) training organized by the Bangladesh Public Administration Training Centre (BPATC), the apex training institute for civil servants. Utilizing fuzzy-set qualitative comparative analysis (fsQCA) and artificial neural network (ANN) techniques within Kirkpatrick’s four-stage model framework, data were collected from a self-administered questionnaire survey of 71 in-service civil servants who participated in the APA training program. This study employs an asymmetric, non-linear model analyzed through a configurational approach and ANN to explore interrelationships among the four Kirkpatrick levels namely, reaction, learning, behavior, and results. Findings indicate that trainees were satisfied across all levels, identifying a non-linear relationship among these levels in post-training evaluation process. The research highlights that "learning skills" are most significant in the APA post-training evaluation, followed by behavior, results, and reaction. Theoretically, this research advances Kirkpatrick’s model and adds to the literature on public service post-training evaluation. Practically, it recommends prioritizing strategies that address cognitive barriers to enhance training effectiveness. This study’s innovative approach lies in its concurrent use of fsQCA and ANN methods to analyze the success or failure of APA-related trainees, offering alternative pathways to desired outcomes and contrasting traditional quantitative methods that provide a single solution. The findings have practical implications for public service training institutions and bureaucratic policymakers involved in capacity development, guiding the creation of more effective in-service training courses for public officials. The methodology and analysis can be applied in other contexts, allowing bureaucratic policymakers to replicate these findings in their learning institutes to identify unique configurations that lead to successful or unsuccessful training outcomes, adopt effective strategies, and avoid detrimental ones.

Suggested Citation

  • Md Zohurul Islam & Munshi Muhammad Abdul Kader Jilani & Mohammad Rezaul Karim, 2024. "Enhancing post-training evaluation of annual performance agreement training: A fusion of fsQCA and artificial neural network approach," PLOS ONE, Public Library of Science, vol. 19(6), pages 1-29, June.
  • Handle: RePEc:plo:pone00:0305916
    DOI: 10.1371/journal.pone.0305916
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0305916
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0305916&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0305916?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Román Salmerón Gómez & Ainara Rodríguez Sánchez & Catalina García García & José García Pérez, 2020. "The VIF and MSE in Raise Regression," Mathematics, MDPI, vol. 8(4), pages 1-28, April.
    2. Bates, Reid, 2004. "A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence," Evaluation and Program Planning, Elsevier, vol. 27(3), pages 341-347, August.
    3. Youcai Ma & Zhaobing Cui, 2023. "Influencing factors and improvement paths of manufacturing innovation performance: Configuration analysis based on TOE framework," PLOS ONE, Public Library of Science, vol. 18(11), pages 1-18, November.
    4. Narcis Eduard Mitu & Cristian Valeriu Stanciu, 2023. "Public Sector Performance and Public Sector Efficiency: An Analysis for CEE Countries," Eastern European Economics, Taylor & Francis Journals, vol. 61(6), pages 700-722, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Futris, Ted G. & Schramm, David G. & Richardson, Evin W. & Lee, Tae Kyoung, 2015. "The impact of organizational support on the transfer of learning to practice," Children and Youth Services Review, Elsevier, vol. 51(C), pages 36-43.
    2. Zuhri Arafah Zulkifli & Anis Afiqah Sharip & Siti Maisatah Md Zain & Nurul Najwa Abdul Rahid Abdul Rashid & Raihana Md Saidi & Nur Aimuni Md Rashid & Alya Geigiana, 2022. "Integration of Instructional Models and Learning Styles for Open and Distance Learning Environment," World Journal of English Language, Sciedu Press, vol. 12(2), pages 226-226, December.
    3. Alison Bullock & Zoё Slote Morris & Christine Atwell, 2013. "Exchanging knowledge through healthcare manager placements in research teams," The Service Industries Journal, Taylor & Francis Journals, vol. 33(13-14), pages 1363-1380, October.
    4. Yohanes Maria Vianey Mudayen & Lincolin Arsyad & Rimawan Pradiptyo & Sekar Utami Setiastuti, 2025. "Does Public Debt Encourage Economic Growth? An Application of Quantile Regressions to Panel Data for Developing Countries," Economies, MDPI, vol. 13(4), pages 1-31, April.
    5. Sobelson, Robyn K. & Young, Andrea C., 2013. "Evaluation of a federally funded workforce development program: The Centers for Public Health Preparedness," Evaluation and Program Planning, Elsevier, vol. 37(C), pages 50-57.
    6. Rebecca, E. & Sangarandeniya, Y. M. S. W. V., 2023. "The Impact of Trainee Characteristics, Training Design, and Work Environment on the Transfer of Training: A Study of Executive Level Employees of a Selected Tea Manufacturing Company in Sri Lanka," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 7(4), pages 648-656, April.
    7. Camelia Negri & Gheorghița Dincă, 2023. "Public sector’s efficiency as a reflection of governance quality, an European Union study," PLOS ONE, Public Library of Science, vol. 18(9), pages 1-23, September.
    8. Paul, Sudipta & Burman, Rajarshi Roy & Singh, Rahul, 2024. "Training effectiveness evaluation: Advancing a Kirkpatrick model based composite framework," Evaluation and Program Planning, Elsevier, vol. 107(C).
    9. Mazur, Rebecca & Woodland, Rebecca H., 2017. "Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning," Evaluation and Program Planning, Elsevier, vol. 62(C), pages 25-34.
    10. Adrienne Lewis & Suzanne Edwards & Glenda Whiting & Frank Donnelly, 2018. "Evaluating student learning outcomes in oral health knowledge and skills," Journal of Clinical Nursing, John Wiley & Sons, vol. 27(11-12), pages 2438-2449, June.
    11. Ninni Singh & Vinit Kumar Gunjan & Amit Kumar Mishra & Ram Krishn Mishra & Nishad Nawaz, 2022. "SeisTutor: A Custom-Tailored Intelligent Tutoring System and Sustainable Education," Sustainability, MDPI, vol. 14(7), pages 1-24, March.
    12. Collins, Mary Elizabeth, 2008. "Evaluating child welfare training in public agencies: Status and prospects," Evaluation and Program Planning, Elsevier, vol. 31(3), pages 241-246, August.
    13. Azizi Mohd Noor & Nik Hasnaa Nik Mahmood & Wan Normeza Wan Zakaria, 2021. "The Mediating Effect of Intention to Use on the Relationship between Mobile Learning Application and Knowledge and Skill Usage," Asian Social Science, Canadian Center of Science and Education, vol. 17(12), pages 1-31, December.
    14. Juliarti Jayani & Yoshitaka Yamazaki, 2012. "A Return on Investment Approach to Training Evaluation in Public Sectors," Working Papers EMS_2012_13, Research Institute, International University of Japan.
    15. Jose Antonio Diego-Mas & Jorge Alcaide-Marzal & Rocio Poveda-Bautista, 2020. "Effects of Using Immersive Media on the Effectiveness of Training to Prevent Ergonomics Risks," IJERPH, MDPI, vol. 17(7), pages 1-18, April.
    16. Alireza Ahadi & Matt Bower & Abhay Singh & Michael Garrett, 2021. "Online Professional Learning in Response to COVID-19—Towards Robust Evaluation," Future Internet, MDPI, vol. 13(3), pages 1-22, February.
    17. Muhammad Zaheer Asghar & Muhammad Naeem Afzaal & Javed Iqbal & Yasira Waqar & Pirita Seitamaa-Hakkarainen, 2022. "Evaluation of In-Service Vocational Teacher Training Program: A Blend of Face-to-Face, Online and Offline Learning Approaches," Sustainability, MDPI, vol. 14(21), pages 1-28, October.
    18. Rasha Ashraf, 2024. "Bank Customer Churn Prediction Using Machine Learning Framework," Journal of Applied Finance & Banking, SCIENPRESS Ltd, vol. 14(4), pages 1-5.
    19. Brigita Gajšek & Anca Draghici & Maria Elena Boatca & Alin Gaureanu & Diana Robescu, 2022. "Linking the Use of Ergonomics Methods to Workplace Social Sustainability: The Ovako Working Posture Assessment System and Rapid Entire Body Assessment Method," Sustainability, MDPI, vol. 14(7), pages 1-20, April.
    20. Vikas Kumar & Deepika Sharma, 2021. "E-Learning Theories, Components, and Cloud Computing-Based Learning Platforms," International Journal of Web-Based Learning and Teaching Technologies (IJWLTT), IGI Global, vol. 16(3), pages 1-16, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0305916. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.