IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v18y2021i7p3336-d523016.html
   My bibliography  Save this article

Co-Production Performance Evaluation in Healthcare. A Systematic Review of Methods, Tools and Metrics

Author

Listed:
  • Marta Marsilio

    (Department of Economics, Management and Quantitative Methods (DEMM), Università degli Studi di Milano, via Conservatorio, 7, 20122 Milan, Italy)

  • Floriana Fusco

    (Department of Economics, Management and Quantitative Methods (DEMM), Università degli Studi di Milano, via Conservatorio, 7, 20122 Milan, Italy)

  • Eleonora Gheduzzi

    (School of Management, Politecnico di Milano, via Lambruschini 4, 20156 Milan, Italy)

  • Chiara Guglielmetti

    (Department of Economics, Management and Quantitative Methods (DEMM), Università degli Studi di Milano, via Conservatorio, 7, 20122 Milan, Italy)

Abstract

Co-produced practices and publications in the healthcare sector are gaining momentum, since they can be a useful tool in addressing the sustainability and resilience challenges of health systems. However, the investigation of positive and, mainly, negative outcomes is still confused and fragmented, and above all, a comprehensive knowledge of the metrics used to assess these outcomes is lacking. To fill this gap, this study aims to systematically review the extant literature to map the methods, tools and metrics used to empirically evaluate co-production in health services. The search took place in six databases: Scopus, Web of Science, Psych INFO, PubMed, Cochrane and CINAHL. A total of 2311 articles were screened and 203 articles were included in the analysis, according to PRISMA guidelines. Findings show that outcomes are mainly investigated through qualitative methods and from the lay actor or provider perspective. Moreover, the detailed categorisation of the quantitative measures found offers a multidimensional performance measurement system and highlights the impact areas where research is needed to develop and test new measures. Findings should also promote improvements in empirical data collection on the multiple faceted co-produced activities and spur the consciousness of the adoption of sustainable co-productive initiatives.

Suggested Citation

  • Marta Marsilio & Floriana Fusco & Eleonora Gheduzzi & Chiara Guglielmetti, 2021. "Co-Production Performance Evaluation in Healthcare. A Systematic Review of Methods, Tools and Metrics," IJERPH, MDPI, vol. 18(7), pages 1-28, March.
    • Handle: RePEc:gam:jijerp:v:18:y:2021:i:7:p:3336-:d:523016
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/18/7/3336/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1660-4601/18/7/3336/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Milena Vainieri & Guido Noto & Francesca Ferre & Laura C. Rosella, 2020. "A Performance Management System in Healthcare for All Seasons?," IJERPH, MDPI, vol. 17(15), pages 1-10, August.
    2. DonHee Lee, 2019. "Effects of key value co-creation elements in the healthcare system: focusing on technology applications," Service Business, Springer;Pan-Pacific Business Association, vol. 13(2), pages 389-417, June.
    3. Le Nguyen Hau & Pham Ngoc Tram Anh & Pham Ngoc Thuy, 2017. "The effects of interaction behaviors of service frontliners on customer participation in the value co-creation: a study of health care service," Service Business, Springer;Pan-Pacific Business Association, vol. 11(2), pages 253-277, June.
    4. Brian N. Williams & Seong-Cheol Kang & Japera Johnson, 2016. "(Co)-Contamination as the Dark Side of Co-Production: Public value failures in co-production processes," Public Management Review, Taylor & Francis Journals, vol. 18(5), pages 692-717, May.
    5. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    6. Erik M. Eriksson, 2019. "Representative co-production: broadening the scope of the public service logic," Public Management Review, Taylor & Francis Journals, vol. 21(2), pages 291-314, February.
    7. Reinhard, Susan C. & Gubman, Gayle D. & Horwitz, Allan V. & Minsky, Shula, 1994. "Burden assessment scale for families of the seriously mentally ill," Evaluation and Program Planning, Elsevier, vol. 17(3), pages 261-269.
    8. Sabina De Rosis & Francesca Pennucci & Guido Noto & Sabina Nuti, 2020. "Healthy Living and Co-Production: Evaluation of Processes and Outcomes of a Health Promotion Initiative Co-Produced with Adolescents," IJERPH, MDPI, vol. 17(21), pages 1-19, October.
    9. Denita Cepiku & Marta Marsilio & Mariafrancesca Sicilia & Milena Vainieri, 2020. "The Co-production of Public Services," Springer Books, Springer, number 978-3-030-60710-4, September.
    10. Sanne J. Kuipers & Anna P. Nieboer & Jane M. Cramm, 2020. "The Need for Co-Creation of Care with Multi-Morbidity Patients—A Longitudinal Perspective," IJERPH, MDPI, vol. 17(9), pages 1-11, May.
    11. Le Hau & Pham Thuy, 2012. "Impact of service personal values on service value and customer loyalty: a cross-service industry study," Service Business, Springer;Pan-Pacific Business Association, vol. 6(2), pages 137-155, June.
    12. Anna Nieboer & Siegwart Lindenberg & Anne Boomsma & Alinda Bruggen, 2005. "Dimensions Of Well-Being And Their Measurement: The Spf-Il Scale," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 73(3), pages 313-353, September.
    13. Jiyoung Kim, 2018. "The Effect of Patient Participation through Physician’s Resources on Experience and Wellbeing," Sustainability, MDPI, vol. 10(6), pages 1-14, June.
    14. Bin Ding & Wei Liu & Sang-Bing Tsai & Dongxiao Gu & Fang Bian & Xuefeng Shao, 2019. "Effect of Patient Participation on Nurse and Patient Outcomes in Inpatient Healthcare," IJERPH, MDPI, vol. 16(8), pages 1-16, April.
    15. Adina Dudau & Russ Glennon & Bram Verschuere, 2019. "Following the yellow brick road? (Dis)enchantment with co-design, co-production and value co-creation in public services," Public Management Review, Taylor & Francis Journals, vol. 21(11), pages 1577-1594, November.
    16. Nopraenue Sajjarax Dhirathiti, 2019. "Co-production and the provision of lifelong learning policy for elderly people in Thailand," Public Management Review, Taylor & Francis Journals, vol. 21(7), pages 1011-1028, July.
    17. Geoffrey L. Dickens & Emma Lamont & Jo Mullen & Nadine MacArthur & Fiona J. Stirling, 2019. "Mixed‐methods evaluation of an educational intervention to change mental health nurses' attitudes to people diagnosed with borderline personality disorder," Journal of Clinical Nursing, John Wiley & Sons, vol. 28(13-14), pages 2613-2623, July.
    18. Grootaert Grootaert & Deepa Narayan & Veronica Nyhan Jones & Michael Woolcock, 2004. "Measuring Social Capital : An Integrated Questionnaire," World Bank Publications - Books, The World Bank Group, number 15033, December.
    19. Denita Cepiku & Filippo Giordano & Tony Bovaird & Elke Loeffler, 2021. "New development: Managing the Covid-19 pandemic—from a hospital-centred model of care to a community co-production approach," Public Money & Management, Taylor & Francis Journals, vol. 41(1), pages 77-80, January.
    20. W. H. Voorberg & V. J. J. M. Bekkers & L. G. Tummers, 2015. "A Systematic Review of Co-Creation and Co-Production: Embarking on the social innovation journey," Public Management Review, Taylor & Francis Journals, vol. 17(9), pages 1333-1357, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Frida Betto & Alberto Sardi & Patrizia Garengo & Enrico Sorano, 2022. "The Evolution of Balanced Scorecard in Healthcare: A Systematic Review of Its Design, Implementation, Use, and Review," IJERPH, MDPI, vol. 19(16), pages 1-22, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Noella Edelmann & Ines Mergel, 2021. "Co-Production of Digital Public Services in Austrian Public Administrations," Administrative Sciences, MDPI, vol. 11(1), pages 1-21, February.
    2. Landriani, Loris & Agrifoglio, Rocco & Metallo, Concetta & Lepore, Luigi, 2022. "The role of knowledge in water service coproduction and policy implications," Utilities Policy, Elsevier, vol. 79(C).
    3. Le Nguyen Hau, 2019. "The role of customer operant resources in health care value creation," Service Business, Springer;Pan-Pacific Business Association, vol. 13(3), pages 457-478, September.
    4. Manila Bonciani & Ilaria Corazza & Sabina Rosis, 2022. "The COVID-19 emergency as an opportunity to co-produce an innovative approach to health services provision: the women's antenatal classes move on the web," Italian Journal of Marketing, Springer, vol. 2022(1), pages 59-85, March.
    5. Man-Man Peng & Jianli Xing & Xinfeng Tang & Qinglu Wu & Dannuo Wei & Mao-Sheng Ran, 2022. "Disease-Related Risk Factors for Caregiver Burden among Family Caregivers of Persons with Schizophrenia: A Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 19(3), pages 1-16, February.
    6. Tina Jukić & Primož Pevcin & Jože Benčina & Mitja Dečman & Sanja Vrbek, 2019. "Collaborative Innovation in Public Administration: Theoretical Background and Research Trends of Co-Production and Co-Creation," Administrative Sciences, MDPI, vol. 9(4), pages 1-17, November.
    7. Paolo Esposito & Paolo Ricci & Alessandro Sancino, 2021. "Leading for social change: Waste management in the place of social (ir)responsibility," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 28(2), pages 667-674, March.
    8. Cindy Yunhsin Chou & Chin Hsiu Huang & Tzu-An Lin, 2018. "Organizational intellectual capital and its relation to frontline service employee innovative behavior: consumer value co-creation behavior as a moderator," Service Business, Springer;Pan-Pacific Business Association, vol. 12(4), pages 663-684, December.
    9. Le Nguyen Hau & Pham Ngoc Thuy, 2022. "Enabling customer co-creation behavior at a distance: the case of patients using self-monitoring handheld devices in healthcare," Service Business, Springer;Pan-Pacific Business Association, vol. 16(1), pages 99-123, March.
    10. Tania Pearce & Myfanwy Maple & Anthony Shakeshaft & Sarah Wayland & Kathy McKay, 2020. "What is the Co-Creation of New Knowledge? A Content Analysis and Proposed Definition for Health Interventions," IJERPH, MDPI, vol. 17(7), pages 1-18, March.
    11. Le Nguyen Hau & Pham Ngoc Tram Anh & Pham Ngoc Thuy, 2017. "The effects of interaction behaviors of service frontliners on customer participation in the value co-creation: a study of health care service," Service Business, Springer;Pan-Pacific Business Association, vol. 11(2), pages 253-277, June.
    12. Jim Broch Skarli, 2021. "Creating or Destructing Value in Use? Handling Cognitive Impairments in Co-Creation with Serious and Chronically Ill Users," Administrative Sciences, MDPI, vol. 11(1), pages 1-17, February.
    13. Mai Thi My-Quyen & Le Nguyen Hau, 2021. "Transforming customer brand engagement to co-creation value through participation energy and effort," Service Business, Springer;Pan-Pacific Business Association, vol. 15(3), pages 493-514, September.
    14. Nila Armelia Windasari & Fu-ren Lin, 2021. "Why Do People Continue Using Fitness Wearables? The Effect of Interactivity and Gamification," SAGE Open, , vol. 11(4), pages 21582440211, November.
    15. İlkay Unay-Gailhard & Mark A. Brennen, 2022. "How digital communications contribute to shaping the career paths of youth: a review study focused on farming as a career option," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 39(4), pages 1491-1508, December.
    16. Mahin Ghafari & Vali Baigi & Zahra Cheraghi & Amin Doosti-Irani, 2016. "The Prevalence of Asymptomatic Bacteriuria in Iranian Pregnant Women: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-10, June.
    17. Elizabeth T Cafiero-Fonseca & Andrew Stawasz & Sydney T Johnson & Reiko Sato & David E Bloom, 2017. "The full benefits of adult pneumococcal vaccination: A systematic review," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-23, October.
    18. Santos Urbina & Sofía Villatoro & Jesús Salinas, 2021. "Self-Regulated Learning and Technology-Enhanced Learning Environments in Higher Education: A Scoping Review," Sustainability, MDPI, vol. 13(13), pages 1-12, June.
    19. Oded Berger-Tal & Alison L Greggor & Biljana Macura & Carrie Ann Adams & Arden Blumenthal & Amos Bouskila & Ulrika Candolin & Carolina Doran & Esteban Fernández-Juricic & Kiyoko M Gotanda & Catherine , 2019. "Systematic reviews and maps as tools for applying behavioral ecology to management and policy," Behavioral Ecology, International Society for Behavioral Ecology, vol. 30(1), pages 1-8.
    20. Nadine Desrochers & Adèle Paul‐Hus & Jen Pecoskie, 2017. "Five decades of gratitude: A meta‐synthesis of acknowledgments research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2821-2833, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:18:y:2021:i:7:p:3336-:d:523016. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.