IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/16909.html
   My bibliography  Save this paper

Physician Response to Pay-for-Performance: Evidence from a Natural Experiment

Author

Listed:
  • Jinhu Li
  • Jeremiah Hurley
  • Philip DeCicca
  • Gioia Buckley

Abstract

Explicit financial incentives, especially pay-for-performance (P4P) incentives, have been extensively employed in recent years by health plans and governments in an attempt to improve the quality of health care services. This study exploits a natural experiment in the province of Ontario, Canada to identify empirically the impact of pay-for-performance (P4P) incentives on the provision of targeted primary care services, and whether physicians' responses differ by age, practice size and baseline compliance level. We use an administrative data source which covers the full population of the province of Ontario and nearly all the services provided by practicing primary care physicians in Ontario. With an individual-level data set of physicians, we employ a difference-in-differences approach that controls for both "selection on observables" and "selection on unobservables" that may cause estimation bias in the identification. We also implemented a set of robustness checks to control for confounding from the other contemporary interventions of the primary care reform in Ontario. The results indicate that, while all responses are of modest size, physicians responded to some of the financial incentives but not the others. The differential responses appear related to the cost of responding and the strength of the evidence linking a service with quality. Overall, the results provide a cautionary message regarding the effectiveness of pay-for-performance schemes for increasing quality of care.

Suggested Citation

  • Jinhu Li & Jeremiah Hurley & Philip DeCicca & Gioia Buckley, 2011. "Physician Response to Pay-for-Performance: Evidence from a Natural Experiment," NBER Working Papers 16909, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:16909
    Note: EH
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w16909.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Thomas G. McGuire & Mark V. Pauly, 1991. "Physician Response to Fee Changes with Multiple Payers," Papers 0015, Boston University - Industry Studies Programme.
    2. Stephen G. Donald & Kevin Lang, 2007. "Inference with Difference-in-Differences and Other Panel Data," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 221-233, May.
    3. Baker, George P, 1992. "Incentive Contracts and Performance Measurement," Journal of Political Economy, University of Chicago Press, vol. 100(3), pages 598-614, June.
    4. Matt Sutton & Ross Elder & Bruce Guthrie & Graham Watt, 2010. "Record rewards: the effects of targeted quality incentives on the recording of risk factors by primary care providers," Health Economics, John Wiley & Sons, Ltd., vol. 19(1), pages 1-13, January.
    5. Frolich, Anne & Talavera, Jason A. & Broadhead, Peter & Dudley, R. Adams, 2007. "A behavioral model of clinician responses to incentives to improve quality," Health Policy, Elsevier, vol. 80(1), pages 179-193, January.
    6. Fairbrother, G. & Hanson, K.L. & Friedman, S. & Butts, G.C., 1999. "The impact of physician bonuses, enhanced fees, and feedback on childhood immunization coverage rates," American Journal of Public Health, American Public Health Association, vol. 89(2), pages 171-175.
    7. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    8. Brian Bell & Richard Blundell & John Reenen, 1999. "Getting the Unemployed Back to Work: The Role of Targeted Wage Subsidies," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 6(3), pages 339-360, August.
    9. Joseph E. Stiglitz, 1974. "Incentives and Risk Sharing in Sharecropping," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 41(2), pages 219-255.
    10. Kathleen J. Mullen & Richard G. Frank & Meredith B. Rosenthal, 2010. "Can you get what you pay for? Pay‐for‐performance and the quality of healthcare providers," RAND Journal of Economics, RAND Corporation, vol. 41(1), pages 64-91, March.
    11. Eggleston, Karen, 2005. "Multitasking and mixed systems for provider payment," Journal of Health Economics, Elsevier, vol. 24(1), pages 211-223, January.
    12. Ellis, Randall P. & McGuire, Thomas G., 1990. "Optimal payment systems for health services," Journal of Health Economics, Elsevier, vol. 9(4), pages 375-396, December.
    13. Hillman, A.L. & Ripley, K. & Goldfarb, N. & Nuamah, I. & Weiner, J. & Lusk, E., 1998. "Physician financial incentives and feedback: Failure to increase cancer screening in Medicaid managed care," American Journal of Public Health, American Public Health Association, vol. 88(11), pages 1699-1701.
    14. Moulton, Brent R., 1986. "Random group effects and the precision of regression estimates," Journal of Econometrics, Elsevier, vol. 32(3), pages 385-397, August.
    15. Ma, Ching-to Albert & McGuire, Thomas G, 1997. "Optimal Health Insurance and Provider Payment," American Economic Review, American Economic Association, vol. 87(4), pages 685-704, September.
    16. Moulton, Brent R, 1990. "An Illustration of a Pitfall in Estimating the Effects of Aggregate Variables on Micro Unit," The Review of Economics and Statistics, MIT Press, vol. 72(2), pages 334-338, May.
    17. McGuire, Thomas G. & Pauly, Mark V., 1991. "Physician response to fee changes with multiple payers," Journal of Health Economics, Elsevier, vol. 10(4), pages 385-410.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bernard Fortin & Nicolas Jacquemet & Bruce Shearer, 2008. "Policy Analysis in Health-Services Market: Accounting for Quality and Quantity," Annals of Economics and Statistics, GENES, issue 91-92, pages 293-319.
    2. Victoria Barham & Olga Milliken, 2015. "Payment Mechanisms and the Composition of Physician Practices: Balancing Cost‐Containment, Access, and Quality of Care," Health Economics, John Wiley & Sons, Ltd., vol. 24(7), pages 895-906, July.
    3. Mitchell A. Petersen, 2009. "Estimating Standard Errors in Finance Panel Data Sets: Comparing Approaches," The Review of Financial Studies, Society for Financial Studies, vol. 22(1), pages 435-480, January.
    4. Oddvar Kaarboe & Luigi Siciliani, 2011. "Multi‐tasking, quality and pay for performance," Health Economics, John Wiley & Sons, Ltd., vol. 20(2), pages 225-238, February.
    5. Dumont, Etienne & Fortin, Bernard & Jacquemet, Nicolas & Shearer, Bruce, 2008. "Physicians' multitasking and incentives: Empirical evidence from a natural experiment," Journal of Health Economics, Elsevier, vol. 27(6), pages 1436-1450, December.
    6. Hansen, Bruce E. & Lee, Seojeong, 2019. "Asymptotic theory for clustered samples," Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
    7. James G. MacKinnon & Matthew D. Webb, 2017. "Wild Bootstrap Inference for Wildly Different Cluster Sizes," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 233-254, March.
    8. Grant Miller & Kimberly Singer Babiarz, 2013. "Pay-for-Performance Incentives in Low- and Middle-Income Country Health Programs," NBER Working Papers 18932, National Bureau of Economic Research, Inc.
    9. Nibene H. Somé & Rose Anne Devlin & Nirav Mehta & Gregory S. Zaric & Sisira Sarma, 2020. "Stirring the pot: Switching from blended fee‐for‐service to blended capitation models of physician remuneration," Health Economics, John Wiley & Sons, Ltd., vol. 29(11), pages 1435-1455, November.
    10. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    11. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    12. Mak, Henry Y., 2018. "Managing imperfect competition by pay for performance and reference pricing," Journal of Health Economics, Elsevier, vol. 57(C), pages 131-146.
    13. A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 318, University of California, Davis, Department of Economics.
    14. Tisamarie B. Sherry & Sebastian Bauhoff & Manoj Mohanan, 2017. "Multitasking and Heterogeneous Treatment Effects in Pay-for-Performance in Health Care: Evidence from Rwanda," American Journal of Health Economics, MIT Press, vol. 3(2), pages 192-226, Spring.
    15. James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.
    16. Alberto Abadie & Susan Athey & Guido W Imbens & Jeffrey M Wooldridge, 2023. "When Should You Adjust Standard Errors for Clustering?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 1-35.
    17. A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 106, University of California, Davis, Department of Economics.
    18. Jessica Cohen & Pascaline Dupas, 2008. "Free Distribution or Cost-Sharing? Evidence from a Malaria Prevention Experiment," NBER Working Papers 14406, National Bureau of Economic Research, Inc.
    19. Jungmo Yoon & Antonio F. Galvao, 2020. "Cluster robust covariance matrix estimation in panel quantile regression with individual fixed effects," Quantitative Economics, Econometric Society, vol. 11(2), pages 579-608, May.
    20. Frank Eijkenaar, 2013. "Key issues in the design of pay for performance programs," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 14(1), pages 117-131, February.

    More about this item

    JEL classification:

    • I18 - Health, Education, and Welfare - - Health - - - Government Policy; Regulation; Public Health
    • J33 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Compensation Packages; Payment Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:16909. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.