IDEAS home Printed from https://ideas.repec.org/p/yor/hectdg/08-28.html
   My bibliography  Save this paper

International Comparison of Public Sector Performance: The Use of Anchoring Vignettes to adjust Self-Reported Data

Author

Listed:
  • Rice, N
  • Robone, S
  • Smith, P.C

Abstract

International comparison of performance has become an influential lever for change in the provision of public services. For health care, patients’ views and opinions are increasingly being recognized as legitimate means for assessing the provision of services, to stimulate quality improvements, and more recently, in evaluating system performance. This has shifted the focus of analyses towards the use of individual-level surveys of performance from the perspective of the user and raises the issue of how to compare appropriately self-reported data across institutional settings and population groups. This represents a major challenge for all public services, the fundamental problem being that comparative evaluation needs to take account of variations in social and cultural expectations and norms when relying on self-reported information. Using data on health systems responsiveness across 18 OECD countries contained within the World Health Survey, this paper outlines the issues that arise in comparative inference that relies on respondent self-reports. The problem of reporting bias is described and illustrated together with potential solutions brought about through the use of anchoring vignettes. The utility of vignettes to aid cross-country analyses and its implications for comparative inference of health system performance are discussed.

Suggested Citation

  • Rice, N & Robone, S & Smith, P.C, 2008. "International Comparison of Public Sector Performance: The Use of Anchoring Vignettes to adjust Self-Reported Data," Health, Econometrics and Data Group (HEDG) Working Papers 08/28, HEDG, c/o Department of Economics, University of York.
  • Handle: RePEc:yor:hectdg:08/28
    as

    Download full text from publisher

    File URL: https://www.york.ac.uk/media/economics/documents/herc/wp/08_28.pdf
    File Function: Main text
    Download Restriction: no

    References listed on IDEAS

    as
    1. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
    2. Jonas Schreyögg & Oliver Tiemann & Tom Stargardt & Reinhard Busse, 2008. "Cross-country comparisons of costs: the use of episode-specific transitive purchasing power parities with standardised cost categories," Health Economics, John Wiley & Sons, Ltd., vol. 17(S1), pages 95-103.
    3. Gravelle, H.S.E. & Backhouse, M.E., 1987. "International cross-section analysis of the determination of mortality," Social Science & Medicine, Elsevier, vol. 25(5), pages 427-441, January.
    4. Siciliani, Luigi & Hurst, Jeremy, 2005. "Tackling excessive waiting times for elective surgery: a comparative analysis of policies in 12 OECD countries," Health Policy, Elsevier, vol. 72(2), pages 201-215, May.
    5. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375.
    6. Eddy van Doorslaer & Cristina Masseria, 2004. "Income-Related Inequality in the Use of Medical Care in 21 OECD Countries," OECD Health Working Papers 14, OECD Publishing.
    7. Gonzalez Block, Miguel Angel, 1997. "Comparative research and analysis methods for shared learning from health system reforms," Health Policy, Elsevier, vol. 42(3), pages 187-209, December.
    8. Groot, Wim, 2000. "Adaptation and scale of reference bias in self-assessments of quality of life," Journal of Health Economics, Elsevier, vol. 19(3), pages 403-420, May.
    9. John Nixon & Philippe Ulmann, 2006. "The relationship between health care expenditure and health outcomes," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 7(1), pages 7-18, March.
    10. Philip Stevens & Mary O'Mahoney, 2004. "International Comparisons Of Performance In The Provision Of Public Services," Royal Economic Society Annual Conference 2004 164, Royal Economic Society.
    11. Balk, B.M., 2001. "Aggregation Methods in International Comparisons," ERIM Report Series Research in Management ERS-2001-41-MKT, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nigel Rice & Silvana Robone & Peter Smith, 2011. "Analysis of the validity of the vignette approach to correct for heterogeneity in reporting health system responsiveness," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 12(2), pages 141-162, April.
    2. G. Fiorentini & S. Robone & R. Verzulli, 2016. "How do hospital-specialty characteristics influence health system responsiveness? An empirical evaluation of in-patient care in the Italian Region of Emilia-Romagna," Working Papers wp1077, Dipartimento Scienze Economiche, Universita' di Bologna.
    3. Eric Bonsang & Arthur Soest, 2012. "Satisfaction with Social Contacts of Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 273-292, January.
    4. Hendrik Jürges & Arthur Soest, 2012. "Comparing the Well-Being of Older Europeans: Introduction," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 187-190, January.
    5. Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011. "Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Journal of Human Resources, University of Wisconsin Press, vol. 46(4), pages 875-906.
    6. Jones, Andrew M. & Rice, Nigel & Robone, Silvana & Dias, Pedro Rosa, 2011. "Inequality and polarisation in health systems' responsiveness: A cross-country analysis," Journal of Health Economics, Elsevier, vol. 30(4), pages 616-625, July.
    7. Fiorentini, Gianluca & Ragazzi, Giovanni & Robone, Silvana, 2015. "Are bad health and pain making us grumpy? An empirical evaluation of reporting heterogeneity in rating health system responsiveness," Social Science & Medicine, Elsevier, vol. 144(C), pages 48-58.
    8. Samir KC & Harold Lentzner, 2010. "The effect of education on adult mortality and disability: a global perspective," Vienna Yearbook of Population Research, Vienna Institute of Demography (VID) of the Austrian Academy of Sciences in Vienna, vol. 8(1), pages 201-235.
    9. Nicolas Sirven & Brigitte Santos-Eggimann & Jacques Spagnoli, 2012. "Comparability of Health Care Responsiveness in Europe," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 255-271, January.

    More about this item

    Keywords

    Health system performance; Responsiveness; Cross-country comparison; Vignettes.;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:yor:hectdg:08/28. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jane Rawlings). General contact details of provider: http://edirc.repec.org/data/deyoruk.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.