A “politically robust” experimental design for public policy evaluation, with application to the Mexican Universal Health Insurance program
AbstractWe develop an approach to conducting large-scale randomized public policy experiments intended to be more robust to the political interventions that have ruined some or all parts of many similar previous efforts. Our proposed design is insulated from selection bias in some circumstances even if we lose observations; our inferences can still be unbiased even if politics disrupts any two of the three steps in our analytical procedures; and other empirical checks are available to validate the overall design. We illustrate with a design and empirical validation of an evaluation of the Mexican Seguro Popular de Salud (Universal Health Insurance) program we are conducting. Seguro Popular, which is intended to grow to provide medical care, drugs, preventative services, and financial health protection to the 50 million Mexicans without health insurance, is one of the largest health reforms of any country in the last two decades. The evaluation is also large scale, constituting one of the largest policy experiments to date and what may be the largest randomized health policy experiment ever. © 2007 by the Association for Public Policy Analysis and Management
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by John Wiley & Sons, Ltd. in its journal Journal of Policy Analysis and Management.
Volume (Year): 26 (2007)
Issue (Month): 3 ()
Contact details of provider:
Web page: http://www3.interscience.wiley.com/journal/34787/home
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Michael J. Camasso & Radha Jagannathan & Carol Harvey & Mark Killingsworth, 2003. "The use of client surveys to gauge the threat of contamination in welfare reform experiments," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 22(2), pages 207-223.
- Holzer, Harry J. & Quigley, John M. & Raphael, Steven, 2004.
"Public Transit and the Spatial Distribution of Minority Employment: Evidence from a Natural Experiment,"
Berkeley Program on Housing and Urban Policy, Working Paper Series
qt0f3725dm, Berkeley Program on Housing and Urban Policy.
- Harry J. Holzer & John M. Quigley & Steven Raphael, 2003. "Public transit and the spatial distribution of minority employment: Evidence from a natural experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 22(3), pages 415-441.
- Holzer, Harry J. & Quigley, John M. & Raphael, Steven, 2003. "Public Transit and the Spatial Distribution of Minority Employment: Evidence from a Natural Experiment," University of California Transportation Center, Working Papers qt1x09f824, University of California Transportation Center.
- Daniel Ho & Kosuke Imai & Gary King & Elizabeth A. Stuart, . "MatchIt: Nonparametric Preprocessing for Parametric Causal Inference," Journal of Statistical Software, American Statistical Association, vol. 42(i08).
- James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
- Glenn W. Harrison & John A. List, 2004.
Journal of Economic Literature,
American Economic Association, vol. 42(4), pages 1009-1055, December.
- Barnard J. & Frangakis C.E. & Hill J.L. & Rubin D.B., 2003. "Principal Stratification Approach to Broken Randomized Experiments: A Case Study of School Choice Vouchers in New York City," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 299-323, January.
- Steven Glazerman & Daniel Mayer & Paul Decker, 2006. "Alternative routes to teaching: The impacts of Teach for America on student achievement and other outcomes," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 25(1), pages 75-96.
- Elizabeth Ty Wilde & Robinson Hollister, 2007. "How close is close enough? Evaluating propensity score matching using data from a class size reduction experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(3), pages 455-477.
- David H. Greenberg & Charles Michalopoulos & Philip K. Robin, 2006. "Do experimental and nonexperimental evaluations give different answers about the effectiveness of government-funded training programs?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 25(3), pages 523-552.
- Zhang, Xuanchuan & Chen, Li-Wu & Mueller, Keith & Yu, Qiao & Liu, Jiapeng & Lin, Ge, 2011. "Tracking the effectiveness of health care reform in China: A case study of community health centers in a district of Beijing," Health Policy, Elsevier, vol. 100(2), pages 181-188.
- Omar Galárraga & Sandra Sosa-Rubí & Aarón Salinas-Rodríguez & Sergio Sesma-Vázquez, 2010. "Health insurance for the poor: impact on catastrophic and out-of-pocket health expenditures in Mexico," The European Journal of Health Economics, Springer, vol. 11(5), pages 437-447, October.
- Rodrigo Barros, 2008. "Wealthier But Not Much Healthier: Effects of a Health Insurance Program for the Poor in Mexico," Discussion Papers 09-002, Stanford Institute for Economic Policy Research.
- Azuara, Oliver & Marinescu, Ioana, 2011. "Informality and the expansion of social protection programs," MPRA Paper 35073, University Library of Munich, Germany.
- Spenkch, Jörg L., 2011. "Adverse selection and moral hazard among the poor: evidence from a randomized experiment," MPRA Paper 31443, University Library of Munich, Germany.
- Azuara, Oliver, 2011. "Effect of universal health coverage on marriage, cohabitation and labor force participation," MPRA Paper 35074, University Library of Munich, Germany.
- Rebecca L. Thornton & Laurel E. Hatt & Erica M. Field & Mursaleena Islam & Freddy Solís Diaz & Martha Azucena González, 2010. "Social security health insurance for the informal sector in Nicaragua: a randomized evaluation," Health Economics, John Wiley & Sons, Ltd., vol. 19(S1), pages 181-206, September.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum).
If references are entirely missing, you can add them using this form.