International Comparison of Public Sector Performance: The Use of Anchoring Vignettes to adjust Self-Reported Data
Abstract
International comparison of performance has become an influential lever for change in the provision of public services. For health care, patients’ views and opinions are increasingly being recognized as legitimate means for assessing the provision of services, to stimulate quality improvements, and more recently, in evaluating system performance. This has shifted the focus of analyses towards the use of individual-level surveys of performance from the perspective of the user and raises the issue of how to compare appropriately self-reported data across institutional settings and population groups. This represents a major challenge for all public services, the fundamental problem being that comparative evaluation needs to take account of variations in social and cultural expectations and norms when relying on self-reported information. Using data on health systems responsiveness across 18 OECD countries contained within the World Health Survey, this paper outlines the issues that arise in comparative inference that relies on respondent self-reports. The problem of reporting bias is described and illustrated together with potential solutions brought about through the use of anchoring vignettes. The utility of vignettes to aid cross-country analyses and its implications for comparative inference of health system performance are discussed.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by HEDG, c/o Department of Economics, University of York in its series Health, Econometrics and Data Group (HEDG) Working Papers with number 08/28.Length:
Date of creation: Nov 2008
Date of revision:
Handle: RePEc:yor:hectdg:08/28
Contact details of provider:
Postal: HEDG/HERC, Department of Economics and Related Studies, University of York, York, YO10 5DD, United Kingdom
Phone: (0)1904 323776
Fax: (0)1904 323759
Email:
Web page: http://www.york.ac.uk/res/herc/research/hedg/
More information through EDIRC
Related research
Keywords: Health system performance; Responsiveness; Cross-country comparison; Vignettes.;This paper has been announced in the following NEP Reports:
- NEP-ALL-2008-12-01 (All new papers)
- NEP-HEA-2008-12-01 (Health Economics)
- NEP-PBE-2008-12-01 (Public Economics)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- John Nixon & Philippe Ulmann, 2006. "The relationship between health care expenditure and health outcomes," The European Journal of Health Economics, Springer, vol. 7(1), pages 7-18, March.
- Philip Stevens & Mary O'Mahoney, 2004. "International Comparisons Of Performance In The Provision Of Public Services," Royal Economic Society Annual Conference 2004 164, Royal Economic Society.
- Jonas Schreyögg & Oliver Tiemann & Tom Stargardt & Reinhard Busse, 2008. "Cross-country comparisons of costs: the use of episode-specific transitive purchasing power parities with standardised cost categories," Health Economics, John Wiley & Sons, Ltd., vol. 17(S1), pages S95-S103.
- Gravelle, H.S.E. & Backhouse, M.E., 1987. "International cross-section analysis of the determination of mortality," Social Science & Medicine, Elsevier, vol. 25(5), pages 427-441, January.
- Siciliani, Luigi & Hurst, Jeremy, 2005. "Tackling excessive waiting times for elective surgery: a comparative analysis of policies in 12 OECD countries," Health Policy, Elsevier, vol. 72(2), pages 201-215, May.
- Kapteyn, A. & Smith, J.P. & Soest, A.H.O. van, 2007.
"Vignettes and self-reports of work disability in the United States and the Netherlands,"
Open Access publications from Tilburg University
urn:nbn:nl:ui:12-210598, Tilburg University.
- Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
- Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008.
"Does reporting heterogeneity bias the measurement of health disparities?,"
Health Economics,
John Wiley & Sons, Ltd., vol. 17(3), pages 351-375.
- Teresa Bago d’Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O’Donnell & Somnath Chatterji, 2006. "Does reporting heterogeneity bias the measurement of health disparities?," Health, Econometrics and Data Group (HEDG) Working Papers 06/03, HEDG, c/o Department of Economics, University of York.
- Eddy van Doorslaer & Cristina Masseria, 2004. "Income-Related Inequality in the Use of Medical Care in 21 OECD Countries," OECD Health Working Papers 14, OECD Publishing.
- Gonzalez Block, Miguel Angel, 1997. "Comparative research and analysis methods for shared learning from health system reforms," Health Policy, Elsevier, vol. 42(3), pages 187-209, December.
- Groot, Wim, 2000. "Adaptation and scale of reference bias in self-assessments of quality of life," Journal of Health Economics, Elsevier, vol. 19(3), pages 403-420, May.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Nigel Rice & Silvana Robone & Peter Smith, 2009.
"Analysis of the Validity of the Vignette Approach to Correct for Heterogeneity in Reporting Health System Responsiveness,"
Health, Econometrics and Data Group (HEDG) Working Papers
09/28, HEDG, c/o Department of Economics, University of York.
- Nigel Rice & Silvana Robone & Peter Smith, 2011. "Analysis of the validity of the vignette approach to correct for heterogeneity in reporting health system responsiveness," The European Journal of Health Economics, Springer, vol. 12(2), pages 141-162, April.
- Bonsang Eric & Soest Arthur van, 2010.
"Satisfaction with Social Contacts of Older Europeans,"
Research Memoranda
012, Maastricht : ROA, Research Centre for Education and the Labour Market.
- Eric Bonsang & Arthur Soest, 2012. "Satisfaction with Social Contacts of Older Europeans," Social Indicators Research, Springer, vol. 105(2), pages 273-292, January.
- Bonsang Eric & Soest Arthur van, 2010. "Satisfaction with Social Contacts of Older Europeans," Research Memoranda 060, Maastricht : METEOR, Maastricht Research School of Economics of Technology and Organization.
- Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011.
"Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity,"
Journal of Human Resources,
University of Wisconsin Press, vol. 46(4), pages 875-906.
- Bago d'Uva T & Lindeboom M & O'Donnell O & van Doorslaer E, 2009. "Slipping Anchor? Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Health, Econometrics and Data Group (HEDG) Working Papers 09/30, HEDG, c/o Department of Economics, University of York.
- Janoes, A; & Rice, N; & Robone, S; & Rosa Dias, P;, 2010.
"Inequality and Polarisation in Health Systems’ Responsiveness: A Cross-Country Analysis,"
Health, Econometrics and Data Group (HEDG) Working Papers
10/27, HEDG, c/o Department of Economics, University of York.
- Jones, Andrew M. & Rice, Nigel & Robone, Silvana & Dias, Pedro Rosa, 2011. "Inequality and polarisation in health systems' responsiveness: A cross-country analysis," Journal of Health Economics, Elsevier, vol. 30(4), pages 616-625, July.
- Hendrik Jürges & Arthur Soest, 2012. "Comparing the Well-Being of Older Europeans: Introduction," Social Indicators Research, Springer, vol. 105(2), pages 187-190, January.
- Teresa Bago d'Uva & Maarten Lindeboom & Owen O'Donnell & Eddy van Doorslaer, 2009. "Slipping Anchor? Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Tinbergen Institute Discussion Papers 09-091/3, Tinbergen Institute.
- Nicolas Sirven & Brigitte Santos-Eggimann & Jacques Spagnoli, 2012. "Comparability of Health Care Responsiveness in Europe," Social Indicators Research, Springer, vol. 105(2), pages 255-271, January.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:yor:hectdg:08/28For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jane Rawlings).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

