IDEAS home Printed from https://ideas.repec.org/a/wly/jpamgt/v41y2022i4p1090-1117.html
   My bibliography  Save this article

Value‐Based Payments in Health Care: Evidence from a Nationwide Randomized Experiment in the Home Health Sector

Author

Listed:
  • Jun Li

Abstract

Value‐based payment programs, also known as pay‐for‐performance, use financial incentives to motivate providers to invest in quality and are a critical part of Medicare health care reform. This study examines the first year of the Home Health Value‐Based Purchasing program, a nationally representative cluster randomized experiment implemented by the Centers for Medicare & Medicaid Services in 2016. The goal of the program is to achieve better home health care quality. Home health agencies in treatment states were rewarded or penalized based on their performance on agency‐reported and non‐agency‐reported quality measures. The program improved agency‐reported measures by approximately one percentage point, and performance gains suggest a dose‐response relationship with respect to incentive size. However, the performance gains in agency‐reported measures did not reflect true quality improvement. I find evidence that agencies manipulated their coding of patients and inflated their performance. Coding manipulation explains the entirety of the program's impact on agency‐reported measures.

Suggested Citation

  • Jun Li, 2022. "Value‐Based Payments in Health Care: Evidence from a Nationwide Randomized Experiment in the Home Health Sector," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(4), pages 1090-1117, September.
    • Handle: RePEc:wly:jpamgt:v:41:y:2022:i:4:p:1090-1117
    DOI: 10.1002/pam.22415
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/pam.22415
    Download Restriction: no
    File URL: https://libkey.io/10.1002/pam.22415?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Figlio, David N., 2006. "Testing, crime and punishment," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 837-851, May.
    2. Pascal Courty & Gerald Marschke, 2004. "An Empirical Investigation of Gaming Responses to Explicit Performance Incentives," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 23-56, January.
    3. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    4. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    5. Margaret E. Brehm, 2018. "The Effects of Federal Adoption Incentive Awards for Older Children on Adoptions From U.S. Foster Care," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 37(2), pages 301-330, March.
    6. James J. Heckman & Carolyn Heinrich & Jeffrey Smith, 2002. "The Performance of Performance Standards," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 778-811.
    7. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    8. Prashant C. Fuloria & Stefanos A. Zenios, 2001. "Outcomes-Adjusted Reimbursement in a Health-Care Delivery System," Management Science, INFORMS, vol. 47(6), pages 735-751, June.
    9. Carolyn J. Heinrich & Gerald Marschke, 2010. "Incentives and their dynamics in public sector performance management systems," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(1), pages 183-208.
    10. C. Kirabo Jackson & Jonah E. Rockoff & Douglas O. Staiger, 2014. "Teacher Effects and Teacher-Related Policies," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 801-825, August.
    11. Young, Alwyn, 2019. "Channeling Fisher: randomization tests and the statistical insignificance of seemingly significant experimental results," LSE Research Online Documents on Economics 101401, London School of Economics and Political Science, LSE Library.
    12. Edward C. Norton & Emily J. Lawton & Jun Li, 2023. "Moneyball in Medicare," American Journal of Health Economics, University of Chicago Press, vol. 9(1), pages 96-126.
    13. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    14. Randall Reback & Julie Berry Cullen, 2006. "Tinkering toward accolades: School gaming under a performance accountability system," Working Papers 0601, Barnard College, Department of Economics.
    15. Kostas Selviaridis & Finn Wynstra, 2015. "Performance-based contracting: a literature review and future research directions," International Journal of Production Research, Taylor & Francis Journals, vol. 53(12), pages 3505-3540, June.
    16. Frank A. Sloan & Hirschel Kasper (ed.), 2008. "Incentives and Choice in Health Care," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262693658, December.
    17. Eric A. Hanushek & Margaret E. Raymond, 2005. "Does school accountability lead to improved student performance?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(2), pages 297-327.
    18. Burt S Barnow, 2000. "Exploring the relationship between performance management and program impact: A case study of the job training partnership act," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 19(1), pages 118-141.
    19. Pierre Koning & Carolyn J. Heinrich, 2013. "Cream‐Skimming, Parking and Other Intended and Unintended Effects of High‐Powered, Performance‐Based Contracts," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(3), pages 461-483, June.
    20. David N. Figlio & Lawrence S. Getzler, 2002. "Accountability , Ability and Disability: Gaming the System," NBER Working Papers 9307, National Bureau of Economic Research, Inc.
    21. Alwyn Young, 2019. "Channeling Fisher: Randomization Tests and the Statistical Insignificance of Seemingly Significant Experimental Results," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(2), pages 557-598.
    22. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    23. Weisbrod, Burton A, 1991. "The Health Care Quadrilemma: An Essay on Technological Change, Insurance, Quality of Care, and Cost Containment," Journal of Economic Literature, American Economic Association, vol. 29(2), pages 523-552, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Reback, Randall, 2008. "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1394-1415, June.
    2. Cardim, Joana & Molina-Millán, Teresa & Vicente, Pedro C., 2023. "Can technology improve the classroom experience in primary education? An African experiment on a worldwide program," Journal of Development Economics, Elsevier, vol. 164(C).
    3. Pirog, Maureen & Gerrish, Ed, 2015. "Impact of the Child Support Performance and Incentive Act on child support order establishment," Children and Youth Services Review, Elsevier, vol. 58(C), pages 104-117.
    4. Anell, Anders & Dietrichson, Jens & Ellegård, Lina Maria & Kjellsson, Gustav, 2021. "Information, switching costs, and consumer choice: Evidence from two randomised field experiments in Swedish primary health care," Journal of Public Economics, Elsevier, vol. 196(C).
    5. Rezende, Marcelo, 2010. "The effects of accountability on higher education," Economics of Education Review, Elsevier, vol. 29(5), pages 842-856, October.
    6. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
    7. Bruno Caprettini, 2021. "Team Visibility and City Travel: Evidence From the UEFA Champions' League Random Draw," Journal of Sports Economics, , vol. 22(1), pages 85-114, January.
    8. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    9. Yitayew, Asresu & Abdulai, Awudu & Yigezu, Yigezu A. & Deneke, Tilaye T. & Kassie, Girma T., 2021. "Impact of agricultural extension services on the adoption of improved wheat variety in Ethiopia: A cluster randomized controlled trial," World Development, Elsevier, vol. 146(C).
    10. Seth Gershenson, 2016. "Performance Standards and Employee Effort: Evidence From Teacher Absences," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(3), pages 615-638, June.
    11. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    12. Hermes, Henning & Lergetporer, Philipp & Peter, Frauke & Wiederhold, Simon, 2021. "Behavioral Barriers and the Socioeconomic Gap in Child Care Enrollment," IZA Discussion Papers 14698, Institute of Labor Economics (IZA).
    13. Julie Berry Cullen & Randall Reback, 2006. "Tinkering Toward Accolades: School Gaming Under a Performance Accountability System," NBER Working Papers 12286, National Bureau of Economic Research, Inc.
    14. Rajashri Chakrabarti, 2013. "Vouchers, Public School Response, And The Role Of Incentives: Evidence From Florida," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 500-526, January.
    15. Koning, Pierre & van de Meerendonk, Arthur, 2014. "The impact of scoring weights on price and quality outcomes: An application to the procurement of Welfare-to-Work contracts," European Economic Review, Elsevier, vol. 71(C), pages 1-14.
    16. Rafkin, Charlie & Shreekumar, Advik & Vautrey, Pierre-Luc, 2021. "When guidance changes: Government stances and public beliefs," Journal of Public Economics, Elsevier, vol. 196(C).
    17. Jan Berkes & Frauke Peter & C. Katharina Spiess & Felix Weinhardt, 2022. "Information Provision and Postgraduate Studies," Economica, London School of Economics and Political Science, vol. 89(355), pages 627-646, July.
    18. Ham, Andrés & Michelson, Hope C., 2018. "Does the form of delivering incentives in conditional cash transfers matter over a decade later?," Journal of Development Economics, Elsevier, vol. 134(C), pages 96-108.
    19. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    20. Hege Marie Gjefsen & Trude Gunnes, 2015. "School accountability Incentives or sorting?," Discussion Papers 815, Statistics Norway, Research Department.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jpamgt:v:41:y:2022:i:4:p:1090-1117. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/journal/34787/home .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.