Use of propensity scores in non-linear response models: The case for health care expenditures
AbstractUnder the assumption of no unmeasured confounders, a large literature exists on methods that can be used to estimating average treatment effects (ATE) from observational data and that spans regression models, propensity score adjustments using stratification, weighting or regression and even the combination of both as in doubly-robust estimators. However, comparison of these alternative methods is sparse in the context of data generated via nonlinear models where treatment effects are heterogeneous, such as is in the case of healthcare cost data. In this paper, we compare the performance of alternative regression and propensity score-based estimators in estimating average treatment effects on outcomes that are generated via non-linear models. Using simulations, we find that in moderate size samples (n= 5000), balancing on estimated propensity scores balances the covariate means across treatment arms but fails to balance higher-order moments and covariances amongst covariates, raising concern about its use in non-linear outcomes generating mechanisms. We also find that besides inverse-probability weighting (IPW) with propensity scores, no one estimator is consistent under all data generating mechanisms. The IPW estimator is itself prone to inconsistency due to misspecification of the model for estimating propensity scores. Even when it is consistent, the IPW estimator is usually extremely inefficient. Thus care should be taken before naively applying any one estimator to estimate ATE in these data. We develop a recommendation for an algorithm which may help applied researchers to arrive at the optimal estimator. We illustrate the application of this algorithm and also the performance of alternative methods in a cost dataset on breast cancer treatment.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by HEDG, c/o Department of Economics, University of York in its series Health, Econometrics and Data Group (HEDG) Working Papers with number 08/11.
Date of creation: May 2008
Date of revision:
Contact details of provider:
Postal: HEDG/HERC, Department of Economics and Related Studies, University of York, York, YO10 5DD, United Kingdom
Phone: (0)1904 323776
Fax: (0)1904 323759
Web page: http://www.york.ac.uk/economics/postgrad/herc/hedg/
More information through EDIRC
Propensity score; Non-linear regression; average treatment effect; Healthcare costs;
Other versions of this item:
- Anirban Basu & Daniel Polsky & Willard G. Manning, 2008. "Use of Propensity Scores in Non-Linear Response Models: The Case for Health Care Expenditures," NBER Working Papers 14086, National Bureau of Economic Research, Inc.
- C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
- C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
- I10 - Health, Education, and Welfare - - Health - - - General
This paper has been announced in the following NEP Reports:
- NEP-ALL-2008-06-07 (All new papers)
- NEP-ECM-2008-06-07 (Econometrics)
- NEP-HEA-2008-06-07 (Health Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Michael LECHNER, 2008. "A Note on the Common Support Problem in Applied Evaluation Studies," Annales d'Economie et de Statistique, ENSAE, issue 91-92, pages 217-235.
- Manning, Willard G. & Mullahy, John, 2001.
"Estimating log models: to transform or not to transform?,"
Journal of Health Economics,
Elsevier, vol. 20(4), pages 461-494, July.
- Willard G. Manning & John Mullahy, 1999. "Estimating Log Models: To Transform or Not to Transform?," NBER Technical Working Papers 0246, National Bureau of Economic Research, Inc.
- Rajeev H. Dehejia, 2002.
"Program evaluation as a decision problem,"
0102-23, Columbia University, Department of Economics.
- Heckman, James J, 1990. "Varieties of Selection Bias," American Economic Review, American Economic Association, vol. 80(2), pages 313-18, May.
- Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2000.
"Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score,"
NBER Technical Working Papers
0251, National Bureau of Economic Research, Inc.
- Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, 07.
- Guido Imbens, 2000. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometric Society World Congress 2000 Contributed Papers 1166, Econometric Society.
- Nandita Mitra & Alka Indurkhya, 2005. "A propensity score approach to estimating the cost-effectiveness of medical therapies from observational data," Health Economics, John Wiley & Sons, Ltd., vol. 14(8), pages 805-815.
- James J. Heckman & Salvador Navarro-Lozano, 2003.
"Using Matching, Instrumental Variables and Control Functions to Estimate Economic Choice Models,"
NBER Working Papers
9497, National Bureau of Economic Research, Inc.
- James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
- Heckman, James & Navarro-Lozano, Salvador, 2003. "Using matching, instrumental variables and control functions to estimate economic choice models," Working Paper Series 2003:4, IFAU - Institute for Evaluation of Labour Market and Education Policy.
- Heckman, James J. & Navarro, Salvador, 2003. "Using Matching, Instrumental Variables and Control Functions to Estimate Economic Choice Models," IZA Discussion Papers 768, Institute for the Study of Labor (IZA).
- Manning, Willard G., 1998. "The logged dependent variable, heteroscedasticity, and the retransformation problem," Journal of Health Economics, Elsevier, vol. 17(3), pages 283-295, June.
- James J. Heckman & Jeffrey A. Smith, 1998. "Evaluating the Welfare State," NBER Working Papers 6542, National Bureau of Economic Research, Inc.
- Mullahy, John, 1998. "Much ado about two: reconsidering retransformation and the two-part model in health econometrics," Journal of Health Economics, Elsevier, vol. 17(3), pages 247-281, June.
- Jack Hadley & Daniel Polsky & Jeanne S. Mandelblatt & Jean M. Mitchell & Jane C. Weeks & Qin Wang & Yi-Ting Hwang, 2003. "An exploratory instrumental variable analysis of the outcomes of localized breast cancer treatments in a medicare population," Health Economics, John Wiley & Sons, Ltd., vol. 12(3), pages 171-186.
- Joshua Angrist & Jinyong Hahn, 2004. "When to Control for Covariates? Panel Asymptotics for Estimates of Treatment Effects," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 58-72, February.
- Blough, David K. & Madden, Carolyn W. & Hornbrook, Mark C., 1999. "Modeling risk using generalized linear models," Journal of Health Economics, Elsevier, vol. 18(2), pages 153-171, April.
- Manning, Willard G, et al, 1987. "Health Insurance and the Demand for Medical Care: Evidence from a Randomized Experiment," American Economic Review, American Economic Association, vol. 77(3), pages 251-77, June.
- Coyte, Peter C. & Young, Wendy & Croxford, Ruth, 2000. "Costs and outcomes associated with alternative discharge strategies following joint replacement surgery: analysis of an observational study using a propensity score," Journal of Health Economics, Elsevier, vol. 19(6), pages 907-929, November.
- Albert Okunade & Andrew Hussey & Mustafa Karakus, 2009. "Overweight Adolescents and On-time High School Graduation: Racial and Gender Disparities," Atlantic Economic Journal, International Atlantic Economic Society, vol. 37(3), pages 225-242, September.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jane Rawlings).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.