International Comparison of Public Sector Performance: The Use of Anchoring Vignettes to adjust Self-Reported Data
International comparison of performance has become an influential lever for change in the provision of public services. For health care, patients’ views and opinions are increasingly being recognized as legitimate means for assessing the provision of services, to stimulate quality improvements, and more recently, in evaluating system performance. This has shifted the focus of analyses towards the use of individual-level surveys of performance from the perspective of the user and raises the issue of how to compare appropriately self-reported data across institutional settings and population groups. This represents a major challenge for all public services, the fundamental problem being that comparative evaluation needs to take account of variations in social and cultural expectations and norms when relying on self-reported information. Using data on health systems responsiveness across 18 OECD countries contained within the World Health Survey, this paper outlines the issues that arise in comparative inference that relies on respondent self-reports. The problem of reporting bias is described and illustrated together with potential solutions brought about through the use of anchoring vignettes. The utility of vignettes to aid cross-country analyses and its implications for comparative inference of health system performance are discussed.
|Date of creation:||Nov 2008|
|Contact details of provider:|| Postal: HEDG/HERC, Department of Economics and Related Studies, University of York, York, YO10 5DD, United Kingdom|
Phone: (0)1904 323776
Web page: https://www.york.ac.uk/economics/postgrad/herc/hedg/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Arie Kapteyn & James P. Smith & Arthur van Soest, 2007.
"Vignettes and Self-Reports of Work Disability in the United States and the Netherlands,"
American Economic Review,
American Economic Association, vol. 97(1), pages 461-473, March.
- Kapteyn, A. & Smith, J.P. & van Soest, A.H.O., 2007. "Vignettes and self-reports of work disability in the United States and the Netherlands," Other publications TiSEM 17902a1e-7cbb-4f3f-a772-e, Tilburg University, School of Economics and Management.
- Jonas Schreyögg & Oliver Tiemann & Tom Stargardt & Reinhard Busse, 2008. "Cross-country comparisons of costs: the use of episode-specific transitive purchasing power parities with standardised cost categories," Health Economics, John Wiley & Sons, Ltd., vol. 17(S1), pages 95-103.
- Gravelle, H.S.E. & Backhouse, M.E., 1987. "International cross-section analysis of the determination of mortality," Social Science & Medicine, Elsevier, vol. 25(5), pages 427-441, January.
- Siciliani, Luigi & Hurst, Jeremy, 2005. "Tackling excessive waiting times for elective surgery: a comparative analysis of policies in 12 OECD countries," Health Policy, Elsevier, vol. 72(2), pages 201-215, May.
- Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375.
- Teresa Bago d’Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O’Donnell & Somnath Chatterji, 2006. "Does reporting heterogeneity bias the measurement of health disparities?," Health, Econometrics and Data Group (HEDG) Working Papers 06/03, HEDG, c/o Department of Economics, University of York.
- Teresa Bago d'Uva & Eddy van Doorslaer & Maarten Lindeboom & Owen O'Donnell & Somnath Chatterji, 2006. "Does Reporting Heterogeneity bias the Measurement of Health Disparities?," Tinbergen Institute Discussion Papers 06-033/3, Tinbergen Institute.
- Eddy van Doorslaer & Cristina Masseria, 2004. "Income-Related Inequality in the Use of Medical Care in 21 OECD Countries," OECD Health Working Papers 14, OECD Publishing.
- Gonzalez Block, Miguel Angel, 1997. "Comparative research and analysis methods for shared learning from health system reforms," Health Policy, Elsevier, vol. 42(3), pages 187-209, December.
- Groot, Wim, 2000. "Adaptation and scale of reference bias in self-assessments of quality of life," Journal of Health Economics, Elsevier, vol. 19(3), pages 403-420, May.
- John Nixon & Philippe Ulmann, 2006. "The relationship between health care expenditure and health outcomes," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 7(1), pages 7-18, March.
- Philip Stevens & Mary O'Mahoney, 2004. "International Comparisons Of Performance In The Provision Of Public Services," Royal Economic Society Annual Conference 2004 164, Royal Economic Society.
- Balk, B.M., 2001. "Aggregation Methods in International Comparisons," ERIM Report Series Research in Management ERS-2001-41-MKT, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam. Full references (including those not matched with items on IDEAS)