IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i1p867-d1023928.html
   My bibliography  Save this article

Performance Measurement Systems in Continuous Improvement Environments: Obstacles to Their Effectiveness

Author

Listed:
  • Flávio Cunha

    (Department of Production and Systems, Algoritmi Centre, University of Minho, 4800-058 Guimarães, Portugal)

  • José Dinis-Carvalho

    (Department of Production and Systems, Algoritmi Centre, University of Minho, 4800-058 Guimarães, Portugal)

  • Rui M. Sousa

    (Department of Production and Systems, Algoritmi Centre, University of Minho, 4800-058 Guimarães, Portugal)

Abstract

The implementation of an effective performance measurement system (PMS) is essential in organizations seeking continuous improvement and sustainability, especially in the context of Industry 4.0. However, a number of barriers/obstacles hampers this effectiveness. For example, the inclusion of performance indicators without practical use, or presenting absurd results, are frequent in the industry, leading people to distrust and devalue such systems. The main research question in this study is: What are the main obstacles to effective performance measurement systems in organizations? These obstacles will be identified and categorized, and some conditions required to eliminate/mitigate them will be explored. A systematic literature review is carried out, according to the PRISMA methodology, to identify the most frequent factors referred to as obstacles to PMS effectiveness, due to their negative influence on the implementation, use or maintenance of these systems. This review resulted in the identification of 175 obstacles that were then classified into 19 types of obstacles divided into 6 categories, whose definition was inspired by the 6M approach usually associated with Ishikawa diagrams. Then, the relationships between the obstacles are explored and investigated in order to identify interdependencies that may further influence the effectiveness of the PMS. Solutions and methodologies that can help mitigate/eliminate their impact on PMS effectiveness are also identified.

Suggested Citation

  • Flávio Cunha & José Dinis-Carvalho & Rui M. Sousa, 2023. "Performance Measurement Systems in Continuous Improvement Environments: Obstacles to Their Effectiveness," Sustainability, MDPI, vol. 15(1), pages 1-12, January.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:1:p:867-:d:1023928
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/1/867/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/1/867/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. André A. de Waal & Harold Counet, 2009. "Lessons learned from performance management systems implementations," International Journal of Productivity and Performance Management, Emerald Group Publishing Limited, vol. 58(4), pages 367-390, April.
    2. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    3. Wouters, Marc & Wilderom, Celeste, 2008. "Developing performance-measurement systems as enabling formalization: A longitudinal field study of a logistics department," Accounting, Organizations and Society, Elsevier, vol. 33(4-5), pages 488-516.
    4. Judit Nagy & Judit Oláh & Edina Erdei & Domicián Máté & József Popp, 2018. "The Role and Impact of Industry 4.0 and the Internet of Things on the Business Strategy of the Value Chain—The Case of Hungary," Sustainability, MDPI, vol. 10(10), pages 1-25, September.
    5. Elena Giovannoni & Maria Pia Maraghini, 2013. "The challenges of integrated performance measurement systems," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 26(6), pages 978-1008, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gutierrez, Debora M. & Scavarda, Luiz F. & Fiorencio, Luiza & Martins, Roberto A., 2015. "Evolution of the performance measurement system in the Logistics Department of a broadcasting company: An action research," International Journal of Production Economics, Elsevier, vol. 160(C), pages 1-12.
    2. Nicola Castellano & Lorenzo Leto, 2021. "Implementazione di Sistemi di Misurazione delle Performance nelle PMI: elementi di analisi nella prospettiva del cambiamento organizzativo," MANAGEMENT CONTROL, FrancoAngeli Editore, vol. 2021(1), pages 129-150.
    3. İlkay Unay-Gailhard & Mark A. Brennen, 2022. "How digital communications contribute to shaping the career paths of youth: a review study focused on farming as a career option," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 39(4), pages 1491-1508, December.
    4. Mahin Ghafari & Vali Baigi & Zahra Cheraghi & Amin Doosti-Irani, 2016. "The Prevalence of Asymptomatic Bacteriuria in Iranian Pregnant Women: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-10, June.
    5. Santos Urbina & Sofía Villatoro & Jesús Salinas, 2021. "Self-Regulated Learning and Technology-Enhanced Learning Environments in Higher Education: A Scoping Review," Sustainability, MDPI, vol. 13(13), pages 1-12, June.
    6. Nadine Desrochers & Adèle Paul‐Hus & Jen Pecoskie, 2017. "Five decades of gratitude: A meta‐synthesis of acknowledgments research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2821-2833, December.
    7. Maryono, Maryono & Killoes, Aditya Marendra & Adhikari, Rajendra & Abdul Aziz, Ammar, 2024. "Agriculture development through multi-stakeholder partnerships in developing countries: A systematic literature review," Agricultural Systems, Elsevier, vol. 213(C).
    8. Alene Sze Jing Yong & Yi Heng Lim & Mark Wing Loong Cheong & Ednin Hamzah & Siew Li Teoh, 2022. "Willingness-to-pay for cancer treatment and outcome: a systematic review," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(6), pages 1037-1057, August.
    9. Agnieszka A. Tubis & Katarzyna Grzybowska, 2022. "In Search of Industry 4.0 and Logistics 4.0 in Small-Medium Enterprises—A State of the Art Review," Energies, MDPI, vol. 15(22), pages 1-26, November.
    10. García-Poole, Chloe & Byrne, Sonia & Rodrigo, María José, 2019. "How do communities intervene with adolescents at psychosocial risk? A systematic review of positive development programs," Children and Youth Services Review, Elsevier, vol. 99(C), pages 194-209.
    11. Qing Ye & Bao-Xin Qian & Wei-Li Yin & Feng-Mei Wang & Tao Han, 2016. "Association between the HFE C282Y, H63D Polymorphisms and the Risks of Non-Alcoholic Fatty Liver Disease, Liver Cirrhosis and Hepatocellular Carcinoma: An Updated Systematic Review and Meta-Analysis o," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-17, September.
    12. Bishal Mohindru & David Turner & Tracey Sach & Diana Bilton & Siobhan Carr & Olga Archangelidi & Arjun Bhadhuri & Jennifer A. Whitty, 2020. "Health State Utility Data in Cystic Fibrosis: A Systematic Review," PharmacoEconomics - Open, Springer, vol. 4(1), pages 13-25, March.
    13. Neal R. Haddaway & Matthew J. Page & Chris C. Pritchard & Luke A. McGuinness, 2022. "PRISMA2020: An R package and Shiny app for producing PRISMA 2020‐compliant flow diagrams, with interactivity for optimised digital transparency and Open Synthesis," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(2), June.
    14. Ding Zhu & Mindan Wu & Yuan Cao & Shihua Lin & Nanxia Xuan & Chen Zhu & Wen Li & Huahao Shen, 2018. "Heated humidification did not improve compliance of positive airway pressure and subjective daytime sleepiness in obstructive sleep apnea syndrome: A meta-analysis," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-16, December.
    15. Pelai, Ricardo & Hagerman, Shannon M. & Kozak, Robert, 2020. "Biotechnologies in agriculture and forestry: Governance insights from a comparative systematic review of barriers and recommendations," Forest Policy and Economics, Elsevier, vol. 117(C).
    16. Wesam Salah Alaloul & Muhammad Altaf & Muhammad Ali Musarat & Muhammad Faisal Javed & Amir Mosavi, 2021. "Systematic Review of Life Cycle Assessment and Life Cycle Cost Analysis for Pavement and a Case Study," Sustainability, MDPI, vol. 13(8), pages 1-38, April.
    17. Joesri Mohamad Saber & Kardina Kamaruddin, 2025. "A Bibliometric Analysis of Training, Competencies, and Job Readiness in the Hotel and Tourism Industry: Trends and Future Directions," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(14), pages 282-297, February.
    18. Mekuriaw Nibret Aweke & Elsa Awoke Fentie & Muluken Chanie Agimas & Lemlem Daniel Baffa & Ever Siyoum Shewarega & Aysheshim Kassahun Belew & Esmael Ali Muhammad & Berhanu Mengistu, 2025. "Folic acid supplementation during preconception period in sub-Saharan African countries: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 20(1), pages 1-24, January.
    19. Claudia Peters & Agnessa Kozak & Albert Nienhaus & Anja Schablon, 2020. "Risk of Occupational Latent Tuberculosis Infection among Health Personnel Measured by Interferon-Gamma Release Assays in Low Incidence Countries—A Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 17(2), pages 1-16, January.
    20. Sehee Kim & Mihyeon Park & Sukhee Ahn, 2022. "The Impact of Antepartum Depression and Postpartum Depression on Exclusive Breastfeeding: A Systematic Review and Meta-Analysis," Clinical Nursing Research, , vol. 31(5), pages 866-880, June.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:1:p:867-:d:1023928. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.