IDEAS home Printed from https://ideas.repec.org/a/wly/jpamgt/v41y2022i4p1090-1117.html

Value‐Based Payments in Health Care: Evidence from a Nationwide Randomized Experiment in the Home Health Sector

Author

Listed:
  • Jun Li

Abstract

Value‐based payment programs, also known as pay‐for‐performance, use financial incentives to motivate providers to invest in quality and are a critical part of Medicare health care reform. This study examines the first year of the Home Health Value‐Based Purchasing program, a nationally representative cluster randomized experiment implemented by the Centers for Medicare & Medicaid Services in 2016. The goal of the program is to achieve better home health care quality. Home health agencies in treatment states were rewarded or penalized based on their performance on agency‐reported and non‐agency‐reported quality measures. The program improved agency‐reported measures by approximately one percentage point, and performance gains suggest a dose‐response relationship with respect to incentive size. However, the performance gains in agency‐reported measures did not reflect true quality improvement. I find evidence that agencies manipulated their coding of patients and inflated their performance. Coding manipulation explains the entirety of the program's impact on agency‐reported measures.

Suggested Citation

  • Jun Li, 2022. "Value‐Based Payments in Health Care: Evidence from a Nationwide Randomized Experiment in the Home Health Sector," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(4), pages 1090-1117, September.
    • Handle: RePEc:wly:jpamgt:v:41:y:2022:i:4:p:1090-1117
    DOI: 10.1002/pam.22415
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/pam.22415
    Download Restriction: no
    File URL: https://libkey.io/10.1002/pam.22415?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. James J. Heckman & Carolyn Heinrich & Jeffrey Smith, 2002. "The Performance of Performance Standards," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 778-811.
    2. Prashant C. Fuloria & Stefanos A. Zenios, 2001. "Outcomes-Adjusted Reimbursement in a Health-Care Delivery System," Management Science, INFORMS, vol. 47(6), pages 735-751, June.
    3. Edward C. Norton & Emily J. Lawton & Jun Li, 2023. "Moneyball in Medicare," American Journal of Health Economics, University of Chicago Press, vol. 9(1), pages 96-126.
    4. Pierre Koning & Carolyn J. Heinrich, 2013. "Cream‐Skimming, Parking and Other Intended and Unintended Effects of High‐Powered, Performance‐Based Contracts," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(3), pages 461-483, June.
    5. Carolyn J. Heinrich & Gerald Marschke, 2010. "Incentives and their dynamics in public sector performance management systems," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(1), pages 183-208.
    6. Figlio, David N., 2006. "Testing, crime and punishment," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 837-851, May.
    7. C. Kirabo Jackson & Jonah E. Rockoff & Douglas O. Staiger, 2014. "Teacher Effects and Teacher-Related Policies," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 801-825, August.
    8. Eric A. Hanushek & Margaret E. Raymond, 2005. "Does school accountability lead to improved student performance?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(2), pages 297-327.
    9. Young, Alwyn, 2019. "Channeling Fisher: randomization tests and the statistical insignificance of seemingly significant experimental results," LSE Research Online Documents on Economics 101401, London School of Economics and Political Science, LSE Library.
    10. Pascal Courty & Gerald Marschke, 2004. "An Empirical Investigation of Gaming Responses to Explicit Performance Incentives," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 23-56, January.
    11. David N. Figlio & Lawrence S. Getzler, 2002. "Accountability , Ability and Disability: Gaming the System," NBER Working Papers 9307, National Bureau of Economic Research, Inc.
    12. Alwyn Young, 2019. "Channeling Fisher: Randomization Tests and the Statistical Insignificance of Seemingly Significant Experimental Results," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(2), pages 557-598.
    13. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    14. Randall Reback & Julie Berry Cullen, 2006. "Tinkering toward accolades: School gaming under a performance accountability system," Working Papers 0601, Barnard College, Department of Economics.
    15. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    16. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    17. Kostas Selviaridis & Finn Wynstra, 2015. "Performance-based contracting: a literature review and future research directions," International Journal of Production Research, Taylor & Francis Journals, vol. 53(12), pages 3505-3540, June.
    18. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    19. Burt S Barnow, 2000. "Exploring the relationship between performance management and program impact: A case study of the job training partnership act," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 19(1), pages 118-141.
    20. Margaret E. Brehm, 2018. "The Effects of Federal Adoption Incentive Awards for Older Children on Adoptions From U.S. Foster Care," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 37(2), pages 301-330, March.
    21. Frank A. Sloan & Hirschel Kasper (ed.), 2008. "Incentives and Choice in Health Care," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262693658, December.
    22. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    23. Weisbrod, Burton A, 1991. "The Health Care Quadrilemma: An Essay on Technological Change, Insurance, Quality of Care, and Cost Containment," Journal of Economic Literature, American Economic Association, vol. 29(2), pages 523-552, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stephane Lavertu & Long Tran, 2025. "For‐profit milk in nonprofit cartons? The case of nonprofit charter schools subcontracting with for‐profit education management organizations," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 44(1), pages 236-265, January.
    2. Sandro Cabral & Marcelo Marchesini da Costa & Sergio Firpo & Joana Monteiro & Leonardo T. Viotti, 2026. "Incentive‐Based Compensation in Police Forces," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 45(2), March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Reback, Randall, 2009. "Corrigendum for Table 4 of "Teaching to the rating: School accountability and the distribution of student achievement" [Journal of Public Economics 92 (2008) 1394-1415]," Journal of Public Economics, Elsevier, vol. 93(1-2), pages 352-353, February.
    2. Stock, Wendy & Schultz, Gunnar, 2025. "Public health insurance and special education enrollment," Economics of Education Review, Elsevier, vol. 105(C).
    3. Pirog, Maureen & Gerrish, Ed, 2015. "Impact of the Child Support Performance and Incentive Act on child support order establishment," Children and Youth Services Review, Elsevier, vol. 58(C), pages 104-117.
    4. Rezende, Marcelo, 2010. "The effects of accountability on higher education," Economics of Education Review, Elsevier, vol. 29(5), pages 842-856, October.
    5. Yitayew, Asresu & Abdulai, Awudu & Yigezu, Yigezu A. & Deneke, Tilaye T. & Kassie, Girma T., 2021. "Impact of agricultural extension services on the adoption of improved wheat variety in Ethiopia: A cluster randomized controlled trial," World Development, Elsevier, vol. 146(C).
    6. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
    7. Courtney Bell & Jessalynn James & Eric S. Taylor & James Wyckoff, 2025. "Measuring returns to experience using supervisor ratings of observed performance: The case of classroom teachers," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 44(1), pages 12-44, January.
    8. Anell, Anders & Dietrichson, Jens & Ellegård, Lina Maria & Kjellsson, Gustav, 2021. "Information, switching costs, and consumer choice: Evidence from two randomised field experiments in Swedish primary health care," Journal of Public Economics, Elsevier, vol. 196(C).
    9. Bruno Caprettini, 2021. "Team Visibility and City Travel: Evidence From the UEFA Champions' League Random Draw," Journal of Sports Economics, , vol. 22(1), pages 85-114, January.
    10. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    11. Pascal Courty & Gerald Marschke, 2003. "Making Government Accountable: Lessons from a Federal Job Training Program," The Centre for Market and Public Organisation 03/083, The Centre for Market and Public Organisation, University of Bristol, UK.
    12. Cardim, Joana & Molina-Millán, Teresa & Vicente, Pedro C., 2023. "Can technology improve the classroom experience in primary education? An African experiment on a worldwide program," Journal of Development Economics, Elsevier, vol. 164(C).
    13. Lubega, Patrick & Nakakawa, Frances & Narciso, Gaia & Newman, Carol & Kaaya, Archileo N. & Kityo, Cissy & Tumuhimbise, Gaston A., 2021. "Body and mind: Experimental evidence from women living with HIV," Journal of Development Economics, Elsevier, vol. 150(C).
    14. Sevim, Dilek & Baranov, Victoria & Bhalotra, Sonia R. & Maselko, Joanna & Biroli, Pietro, 2023. "Socioemotional Skills in Early Childhood: Evidence from a Maternal Psychosocial Intervention," IZA Discussion Papers 15925, IZA Network @ LISER.
    15. James J. Heckman & Ganesh Karapakula, 2019. "The Perry Preschoolers at Late Midlife: A Study in Design-Specific Inference," Working Papers 2019-034, Human Capital and Economic Opportunity Working Group.
    16. David McKenzie, 2025. "Designing and analysing powerful experiments: practical tips for applied researchers," Fiscal Studies, John Wiley & Sons, vol. 46(3), pages 305-322, September.
    17. Rajashri Chakrabarti, 2013. "Vouchers, Public School Response, And The Role Of Incentives: Evidence From Florida," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 500-526, January.
    18. Hermes, Henning & Lergetporer, Philipp & Peter, Frauke & Wiederhold, Simon, 2021. "Behavioral Barriers and the Socioeconomic Gap in Child Care Enrollment," IZA Discussion Papers 14698, IZA Network @ LISER.
    19. Abu Siddique & Tabassum Rahman & Debayan Pakrashi & Asad Islam & Firoz Ahmed, 2020. "Raising COVID-19 Awareness in Rural Communities: A Randomized Experiment in Bangladesh and India," Munich Papers in Political Economy 09, Munich School of Politics and Public Policy and the School of Management at the Technical University of Munich.
    20. Peter, Frauke & Spiess, C. Katharina & Zambre, Vaishali, 2021. "Informing students about college: Increasing enrollment using a behavioral intervention?," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 524-549.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jpamgt:v:41:y:2022:i:4:p:1090-1117. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/journal/34787/home .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.