IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v298y2022i3p1084-1100.html
   My bibliography  Save this article

Exploring the potential of Data Envelopment Analysis for enhancing pay-for-performance programme design in primary health care

Author

Listed:
  • Kalinichenko, Olena
  • Amado, Carla A.F.
  • Santos, Sérgio P.

Abstract

In recent years, implementation of pay-for-performance (P4P) programmes in health care has become a worldwide initiative. However, most P4P programmes incorporate systems of Performance Indicators (PI) without accounting for trade-offs between indicators. This article has two objectives: (1) to develop a Data Envelopment Analysis (DEA) methodology for performance assessment of primary care providers; and (2) to propose an innovative methodology for P4P contracting based on the DEA assessment results. To achieve the first objective, we modify the standard DEA model to account for the necessary relations between the weights attributed to each PI and domain of performance and to account for the effect of the relevant environmental variables. To achieve the second objective, we combine relative and absolute performance assessments in the elaboration of several bases for reward, and then we link these assessments to a system of graduated rewards. A benchmarking programme is also proposed to contribute to the dissemination of best practices. This article contributes to the literature by proposing an enhanced methodology for performance assessment of primary care providers which can form the basis for P4P rewards planning. The applicability and advantages of the proposed methodology are illustrated with data from Portugal, but it can easily be adapted to different sets of PIs or domains, making it relevant for performance assessment and for P4P reward setting in other contexts and countries.

Suggested Citation

  • Kalinichenko, Olena & Amado, Carla A.F. & Santos, Sérgio P., 2022. "Exploring the potential of Data Envelopment Analysis for enhancing pay-for-performance programme design in primary health care," European Journal of Operational Research, Elsevier, vol. 298(3), pages 1084-1100.
  • Handle: RePEc:eee:ejores:v:298:y:2022:i:3:p:1084-1100
    DOI: 10.1016/j.ejor.2021.07.037
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221721006329
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2021.07.037?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cooper, William W. & Ruiz, Jose L. & Sirvent, Inmaculada, 2007. "Choosing weights from alternative optimal solutions of dual multiplier models in DEA," European Journal of Operational Research, Elsevier, vol. 180(1), pages 443-458, July.
    2. Olena Kalinichenko & Carla A. F. Amado & Sérgio P. Santos, 2013. "Performance Assessment in Primary Health Care: A Systematic Literature Review," CEFAGE-UE Working Papers 2013_03, University of Evora, CEFAGE-UE (Portugal).
    3. P.C. Smith, 2002. "Measuring health system performance," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 3(3), pages 145-148, September.
    4. Shwartz, Michael & Burgess, James F. & Zhu, Joe, 2016. "A DEA based composite measure of quality and its associated data uncertainty interval for health care provider profiling and pay-for-performance," European Journal of Operational Research, Elsevier, vol. 253(2), pages 489-502.
    5. Filipe Amado, Carla Alexandra & Dyson, Robert G., 2008. "On comparing the performance of primary care providers," European Journal of Operational Research, Elsevier, vol. 185(3), pages 915-932, March.
    6. Pelone, Ferruccio & Kringos, Dionne Sofia & Valerio, Luca & Romaniello, Alessandro & Lazzari, Agnese & Ricciardi, Walter & de Belvis, Antonio Giulio, 2012. "The measurement of relative efficiency of general practice and the implications for policy makers," Health Policy, Elsevier, vol. 107(2), pages 258-268.
    7. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    8. Löber, Gerrit & Staat, Matthias, 2010. "Integrating categorical variables in Data Envelopment Analysis models: A simple solution technique," European Journal of Operational Research, Elsevier, vol. 202(3), pages 810-818, May.
    9. Sarrico, C. S. & Dyson, R. G., 2004. "Restricting virtual weights in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 159(1), pages 17-34, November.
    10. Emrouznejad, Ali & Yang, Guo-liang, 2018. "A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 4-8.
    11. Charnes, A. & Cooper, W. W. & Huang, Z. M. & Sun, D. B., 1990. "Polyhedral Cone-Ratio DEA Models with an illustrative application to large commercial banks," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 73-91.
    12. Maria Portela & Emmanuel Thanassoulis, 2006. "Zero weights and non-zero slacks: Different solutions to the same problem," Annals of Operations Research, Springer, vol. 145(1), pages 129-147, July.
    13. Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
    14. Rogge, Nicky & Archer, Geoffrey, 2021. "Measuring and analyzing country change in establishing ease of doing business using a revised version of World Bank's ease of doing business index," European Journal of Operational Research, Elsevier, vol. 290(1), pages 373-385.
    15. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min & Lin, Bruce J.Y., 2013. "A survey of DEA applications," Omega, Elsevier, vol. 41(5), pages 893-902.
    16. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    17. C A F Amado & R G Dyson, 2009. "Exploring the use of DEA for formative evaluation in primary diabetes care: An application to compare English practices," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(11), pages 1469-1482, November.
    18. Russell G. Thompson & F. D. Singleton & Robert M. Thrall & Barton A. Smith, 1986. "Comparative Site Evaluations for Locating a High-Energy Physics Lab in Texas," Interfaces, INFORMS, vol. 16(6), pages 35-49, December.
    19. A. Camanho & R. Dyson, 2006. "Data envelopment analysis and Malmquist indices for measuring group performance," Journal of Productivity Analysis, Springer, vol. 26(1), pages 35-49, August.
    20. Fare, Rolf & Knox Lovell, C. A., 1978. "Measuring the technical efficiency of production," Journal of Economic Theory, Elsevier, vol. 19(1), pages 150-162, October.
    21. R. Allen & A. Athanassopoulos & R.G. Dyson & E. Thanassoulis, 1997. "Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions," Annals of Operations Research, Springer, vol. 73(0), pages 13-34, October.
    22. Filippetti, Andrea & Peyrache, Antonio, 2011. "The Patterns of Technological Capabilities of Countries: A Dual Approach using Composite Indicators and Data Envelopment Analysis," World Development, Elsevier, vol. 39(7), pages 1108-1121, July.
    23. A Zanella & A S Camanho & T G Dias, 2013. "Benchmarking countries’ environmental performance," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(3), pages 426-438, March.
    24. Morais, Paulo & Camanho, Ana S., 2011. "Evaluation of performance of European cities with the aim to promote quality of life improvements," Omega, Elsevier, vol. 39(4), pages 398-409, August.
    25. Ramón, Nuria & Ruiz, José L. & Sirvent, Inmaculada, 2010. "A multiplier bound approach to assess relative efficiency in DEA without slacks," European Journal of Operational Research, Elsevier, vol. 203(1), pages 261-269, May.
    26. Tom Puyenbroeck, 2018. "On the Output Orientation of the Benefit-of-the-Doubt-Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(2), pages 415-431, September.
    27. Ya Chen & Wade D. Cook & Juan Du & Hanhui Hu & Joe Zhu, 2017. "Bounded and discrete data and Likert scales in data envelopment analysis: application to regional energy efficiency in China," Annals of Operations Research, Springer, vol. 255(1), pages 347-366, August.
    28. Cordero, José Manuel & Alonso-Morán, Edurne & Nuño-Solinis, Roberto & Orueta, Juan F. & Arce, Regina Sauto, 2015. "Efficiency assessment of primary care providers: A conditional nonparametric approach," European Journal of Operational Research, Elsevier, vol. 240(1), pages 235-244.
    29. Despotis, D.K., 2005. "Measuring human development via data envelopment analysis: the case of Asia and the Pacific," Omega, Elsevier, vol. 33(5), pages 385-390, October.
    30. Prior, Diego, 2007. "A reasonable benchmarking frontier using DEA : an incentive scheme to improve efficiency in public hospitals," DEE - Working Papers. Business Economics. WB wb071105, Universidad Carlos III de Madrid. Departamento de Economía de la Empresa.
    31. Peter Bogetoft, 1994. "Incentive Efficient Production Frontiers: An Agency Perspective on DEA," Management Science, INFORMS, vol. 40(8), pages 959-968, August.
    32. Thompson, Russell G. & Langemeier, Larry N. & Lee, Chih-Tah & Lee, Euntaik & Thrall, Robert M., 1990. "The role of multiplier bounds in efficiency analysis with application to Kansas farming," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 93-108.
    33. Stefan Felder & Horst Schmitt, 2004. "Data envelopment analysis based bonus payments," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 5(4), pages 357-364, November.
    34. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    35. Green, Rodney H. & Doyle, John R. & Cook, Wade D., 1996. "Efficiency bounds in Data Envelopment Analysis," European Journal of Operational Research, Elsevier, vol. 89(3), pages 482-490, March.
    36. Van Puyenbroeck, Tom & Montalto, Valentina & Saisana, Michaela, 2021. "Benchmarking culture in Europe: A data envelopment analysis approach to identify city-specific strengths," European Journal of Operational Research, Elsevier, vol. 288(2), pages 584-597.
    37. Cook, Wade D. & Ramón, Nuria & Ruiz, José L. & Sirvent, Inmaculada & Zhu, Joe, 2019. "DEA-based benchmarking for performance evaluation in pay-for-performance incentive plans," Omega, Elsevier, vol. 84(C), pages 45-54.
    38. Kalevi Luoma & Maija‐Liisa Järviö & Ilpo Suoniemi & Reino T. Hjerppe, 1996. "Financial incentives and productive efficiency in Finnish health centres," Health Economics, John Wiley & Sons, Ltd., vol. 5(5), pages 435-445, September.
    39. Stewart, Theodor J., 2010. "Goal directed benchmarking for organizational efficiency," Omega, Elsevier, vol. 38(6), pages 534-539, December.
    40. Rajiv D. Banker & Richard C. Morey, 1986. "The Use of Categorical Variables in Data Envelopment Analysis," Management Science, INFORMS, vol. 32(12), pages 1613-1627, December.
    41. Agrell, Per J. & Bogetoft, Peter & Tind, Jorgen, 2002. "Incentive plans for productive efficiency, innovation and learning," International Journal of Production Economics, Elsevier, vol. 78(1), pages 1-11, July.
    42. Eijkenaar, Frank & Emmert, Martin & Scheppach, Manfred & Schöffski, Oliver, 2013. "Effects of pay for performance in health care: A systematic review of systematic reviews," Health Policy, Elsevier, vol. 110(2), pages 115-130.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. An, Qingxian & Tao, Xiangyang & Chen, Xiaohong, 2023. "Nested frontier-based best practice regulation under asymmetric information in a principal–agent framework," European Journal of Operational Research, Elsevier, vol. 306(1), pages 269-285.
    2. Léopold Simar & Paul W. Wilson, 2023. "Another look at productivity growth in industrialized countries," Journal of Productivity Analysis, Springer, vol. 60(3), pages 257-272, December.
    3. Márcia N. F. Manoel & Sérgio P. Santos & Carla A. F. Amado, 2023. "Assessing the impact of COVID-19 on the performance of organ transplant services using data envelopment analysis," Health Care Management Science, Springer, vol. 26(2), pages 217-237, June.
    4. An, Qingxian & Zhang, Qiaoyu & Tao, Xiangyang, 2023. "Pay-for-performance incentives in benchmarking with quasi S-shaped technology," Omega, Elsevier, vol. 118(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    2. Ramón, Nuria & Ruiz, José L. & Sirvent, Inmaculada, 2010. "A multiplier bound approach to assess relative efficiency in DEA without slacks," European Journal of Operational Research, Elsevier, vol. 203(1), pages 261-269, May.
    3. Dovile Stumbriene & Ana S. Camanho & Audrone Jakaitiene, 2020. "The performance of education systems in the light of Europe 2020 strategy," Annals of Operations Research, Springer, vol. 288(2), pages 577-608, May.
    4. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    5. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    6. Rafael Benítez & Vicente Coll-Serrano & Vicente J. Bolós, 2021. "deaR-Shiny: An Interactive Web App for Data Envelopment Analysis," Sustainability, MDPI, vol. 13(12), pages 1-19, June.
    7. Toloo, Mehdi & Ebrahimi, Bohlool & Amin, Gholam R., 2021. "New data envelopment analysis models for classifying flexible measures: The role of non-Archimedean epsilon," European Journal of Operational Research, Elsevier, vol. 292(3), pages 1037-1050.
    8. An, Qingxian & Zhang, Qiaoyu & Tao, Xiangyang, 2023. "Pay-for-performance incentives in benchmarking with quasi S-shaped technology," Omega, Elsevier, vol. 118(C).
    9. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    10. Pereira, Miguel Alves & Camanho, Ana Santos & Figueira, José Rui & Marques, Rui Cunha, 2021. "Incorporating preference information in a range directional composite indicator: The case of Portuguese public hospitals," European Journal of Operational Research, Elsevier, vol. 294(2), pages 633-650.
    11. HOSSEINZADEH LOTFI, Farhad & HATAMI-MARBINI, Adel & AGRELL, Per & GHOLAMI, Kobra, 2013. "Centralized resource reduction and target setting under DEA control," LIDAM Discussion Papers CORE 2013005, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    12. Mai, Nhat Chi, 2015. "Efficiency of the banking system in Vietnam under financial liberalization," OSF Preprints qsf6d, Center for Open Science.
    13. Panagiotis Ravanos & Giannis Karagiannis, 2023. "On VEA, production trade-offs and weights restrictions," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 74(10), pages 2081-2093, October.
    14. Shimshak, Daniel G. & Lenard, Melanie L. & Klimberg, Ronald K., 2009. "Incorporating quality into data envelopment analysis of nursing home performance: A case study," Omega, Elsevier, vol. 37(3), pages 672-685, June.
    15. Ghasemi, M.-R. & Ignatius, Joshua & Emrouznejad, Ali, 2014. "A bi-objective weighted model for improving the discrimination power in MCDEA," European Journal of Operational Research, Elsevier, vol. 233(3), pages 640-650.
    16. Sebastian Kohl & Jan Schoenfelder & Andreas Fügener & Jens O. Brunner, 2019. "The use of Data Envelopment Analysis (DEA) in healthcare with a focus on hospitals," Health Care Management Science, Springer, vol. 22(2), pages 245-286, June.
    17. Ramón, Nuria & Ruiz, José L. & Sirvent, Inmaculada, 2010. "On the choice of weights profiles in cross-efficiency evaluations," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1564-1572, December.
    18. Oliveira, Renata & Zanella, Andreia & Camanho, Ana S., 2019. "The assessment of corporate social responsibility: The construction of an industry ranking and identification of potential for improvement," European Journal of Operational Research, Elsevier, vol. 278(2), pages 498-513.
    19. Roets, Bart & Verschelde, Marijn & Christiaens, Johan, 2018. "Multi-output efficiency and operational safety: An analysis of railway traffic control centre performance," European Journal of Operational Research, Elsevier, vol. 271(1), pages 224-237.
    20. Mariano, Enzo Barberio & Sobreiro, Vinicius Amorim & Rebelatto, Daisy Aparecida do Nascimento, 2015. "Human development and data envelopment analysis: A structured literature review," Omega, Elsevier, vol. 54(C), pages 33-49.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:298:y:2022:i:3:p:1084-1100. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.