IDEAS home Printed from https://ideas.repec.org/p/yor/hectdg/09-29.html
   My bibliography  Save this paper

Vignettes and health systems responsiveness in crosscountry comparative analyses

Author

Listed:
  • Nigel Rice
  • Silvana Robone
  • Peter Smith

Abstract

This paper explores the use of anchoring vignettes as a means to adjust survey reports of health system performance for differential reporting behaviour using data contained within the World Health Survey (WHS). Survey respondents are asked to rate their experiences of health systems across a number of domains on a five-point categorical scale. Using data provided through a set of vignettes we investigate variations in reporting of interactions with health services across both socio-demographic groups and countries. We show how the method of anchoring vignettes can be used to enhance cross-country comparability of performance. Our results show large differences in the rankings of country performance once adjustment for systematic country-level reporting behaviour has been undertaken compared to a ranking based on raw unadjusted data.

Suggested Citation

  • Nigel Rice & Silvana Robone & Peter Smith, 2009. "Vignettes and health systems responsiveness in crosscountry comparative analyses," Health, Econometrics and Data Group (HEDG) Working Papers 09/29, HEDG, c/o Department of Economics, University of York.
    • Handle: RePEc:yor:hectdg:09/29
    as

    Download full text from publisher

    File URL: https://www.york.ac.uk/media/economics/documents/herc/wp/09_29.pdf
    File Function: Main text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    2. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
    3. Marcel Kerkhofs & Maarten Lindeboom, 1995. "Subjective health measures and state dependent reporting errors," Health Economics, John Wiley & Sons, Ltd., vol. 4(3), pages 221-235, May.
    4. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375, March.
    5. Alan Williams, 2001. "Science or marketing at who? Rejoinder from Alan Williams," Health Economics, John Wiley & Sons, Ltd., vol. 10(4), pages 283-285, June.
    6. Kristensen, Nicolai & Johansson, Edvard, 2008. "New evidence on cross-country differences in job satisfaction using anchoring vignettes," Labour Economics, Elsevier, vol. 15(1), pages 96-117, February.
    7. Lindeboom, Maarten & van Doorslaer, Eddy, 2004. "Cut-point shift and index shift in self-reported health," Journal of Health Economics, Elsevier, vol. 23(6), pages 1083-1099, November.
    8. Jeff Richardson & John Wildman & Iain K. Robertson, 2003. "A critique of the World Health Organisation's evaluation of health system performance," Health Economics, John Wiley & Sons, Ltd., vol. 12(5), pages 355-366, May.
    9. Stephen Pudney & Michael Shields, 2000. "Gender, race, pay and promotion in the British nursing profession: estimation of a generalized ordered probit model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(4), pages 367-399.
    10. Gonzalez Block, Miguel Angel, 1997. "Comparative research and analysis methods for shared learning from health system reforms," Health Policy, Elsevier, vol. 42(3), pages 187-209, December.
    11. Groot, Wim, 2000. "Adaptation and scale of reference bias in self-assessments of quality of life," Journal of Health Economics, Elsevier, vol. 19(3), pages 403-420, May.
    12. Philip Stevens & Mary O'Mahoney, 2004. "International Comparisons Of Performance In The Provision Of Public Services," Royal Economic Society Annual Conference 2004 164, Royal Economic Society.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. W. Kip Viscusi, 2016. "Risk Beliefs and Preferences for E-cigarettes," American Journal of Health Economics, University of Chicago Press, vol. 2(2), pages 213-240, Spring.
    2. Cinzia Di Novi & Massimiliano Piacenza & Silvana Robone & Gilberto Turati, 2015. "How does fiscal decentralization affect within-regional disparities in well-being? Evidence from health inequalities in Italy," Working Papers 2015:21, Department of Economics, University of Venice "Ca' Foscari".
    3. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    4. Di Novi, Cinzia & Piacenza, Massimiliano & Robone, Silvana & Turati, Gilberto, 2019. "Does fiscal decentralization affect regional disparities in health? Quasi-experimental evidence from Italy," Regional Science and Urban Economics, Elsevier, vol. 78(C).
    5. Joan Costa-Font & Frank A. Cowell, 2022. "The measurement of health inequalities: does status matter?," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 20(2), pages 299-325, June.
    6. Cottini, Elena & Lucifora, Claudio, 2010. "Mental Health and Working Conditions in European Countries," IZA Discussion Papers 4717, Institute of Labor Economics (IZA).
    7. Greene, William & Harris, Mark N. & Knott, Rachel & Rice, Nigel, 2023. "Reporting heterogeneity in modeling self-assessed survey outcomes," Economic Modelling, Elsevier, vol. 124(C).
    8. Fiorentini, Gianluca & Ragazzi, Giovanni & Robone, Silvana, 2015. "Are bad health and pain making us grumpy? An empirical evaluation of reporting heterogeneity in rating health system responsiveness," Social Science & Medicine, Elsevier, vol. 144(C), pages 48-58.
    9. Laura Rossouw & Teresa Bago d’Uva & Eddy Doorslaer, 2018. "Poor Health Reporting? Using Anchoring Vignettes to Uncover Health Disparities by Wealth and Race," Demography, Springer;Population Association of America (PAA), vol. 55(5), pages 1935-1956, October.
    10. S. Robone & G. Fiorentini & M. A. Nicoli & S. Rodella, 2014. "La responsiveness dei sistemi sanitari: un analisi empirica sull assistenza ospedaliera nel Servizio Sanitario Regionale dell Emilia Romagna," Working Papers wp934, Dipartimento Scienze Economiche, Universita' di Bologna.
    11. Silvana Robone, 2025. "Gender-Specific Analysis of Self-Reported Health and Educational Mismatch: Evidence from Employees in Russia," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 177(2), pages 763-786, March.
    12. Gianluca Fiorentini & Silvana Robone & Rossella Verzulli, 2018. "How do hospital‐specialty characteristics influence health system responsiveness? An empirical evaluation of in‐patient care in the Italian region of Emilia‐Romagna," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 266-281, February.
    13. Laura Rossouw, 2015. "Poor health reporting: Do poor South Africans underestimate their health needs?," WIDER Working Paper Series 027, World Institute for Development Economic Research (UNU-WIDER).
    14. Nicolas Sirven & Brigitte Santos-Eggimann & Jacques Spagnoli, 2012. "Comparability of Health Care Responsiveness in Europe," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 255-271, January.
    15. Laura Rossouw & Teresa Bago d'Uva & Eddy van Doorslaer, 2017. "Poor Health Reporting? Using Vignettes to Recover the Health Gradient by Wealth," Tinbergen Institute Discussion Papers 17-031/V, Tinbergen Institute.
    16. Joan Costa Font & Frank Cowell, 2013. "Measuring Health Inequality with Categorical Data: Some Regional Patterns," Research on Economic Inequality, in: Health and Inequality, volume 21, pages 53-76, Emerald Group Publishing Limited.
    17. Silvana Robone, 2017. "Comment on ‘Response –scale heterogeneity in the EQ‐5D: Can we use vignettes to address response‐scale heterogeneity in the EQ‐5D? Not if but how’," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 395-397, March.
    18. Andrew M. Jones; Nigel Rice, Silvana Robone; & Nigel Rice; & Silvana Robone:, 2012. "A comparison of parametric and non-parametric adjustments using vignettes for self-reported data," Health, Econometrics and Data Group (HEDG) Working Papers 12/10, HEDG, c/o Department of Economics, University of York.
    19. Valentine, Nicole & Verdes-Tennant, Emese & Bonsel, Gouke, 2015. "Health systems' responsiveness and reporting behaviour: Multilevel analysis of the influence of individual-level factors in 64 countries," Social Science & Medicine, Elsevier, vol. 138(C), pages 152-160.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Greene, William & Harris, Mark N. & Knott, Rachel & Rice, Nigel, 2023. "Reporting heterogeneity in modeling self-assessed survey outcomes," Economic Modelling, Elsevier, vol. 124(C).
    2. Rice, N & Robone, S & Smith, P.C, 2008. "International Comparison of Public Sector Performance: The Use of Anchoring Vignettes to adjust Self-Reported Data," Health, Econometrics and Data Group (HEDG) Working Papers 08/28, HEDG, c/o Department of Economics, University of York.
    3. William H. Greene & Mark N. Harris & Rachel J. Knott & Nigel Rice, 2021. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 31-64, January.
    4. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    5. Fontaine, Xavier & Haywood, Luke, 2018. "On the comparison of group inequalities using subjective data," Economics Letters, Elsevier, vol. 163(C), pages 17-21.
    6. van Soest, Arthur & Delaney, Liam & Harmon, Colm P. & Kapteyn, Arie & Smith, James P., 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," IZA Discussion Papers 2860, Institute of Labor Economics (IZA).
    7. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    8. Laura Rossouw & Teresa Bago d’Uva & Eddy Doorslaer, 2018. "Poor Health Reporting? Using Anchoring Vignettes to Uncover Health Disparities by Wealth and Race," Demography, Springer;Population Association of America (PAA), vol. 55(5), pages 1935-1956, October.
    9. Costa-Font, Joan & Hernández-Quevedo, Cristina, 2012. "Measuring inequalities in health: What do we know? What do we need to know?," Health Policy, Elsevier, vol. 106(2), pages 195-206.
    10. Silvana Robone & Andrew Jones & Nigel Rice, 2011. "Contractual conditions, working conditions and their impact on health and well-being," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 12(5), pages 429-444, October.
    11. Chris Muris & Pedro Raposo & Sotiris Vandoros, 2020. "A Dynamic Ordered Logit Model with Fixed Effects," Department of Economics Working Papers 2020-14, McMaster University.
    12. Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011. "Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Journal of Human Resources, University of Wisconsin Press, vol. 46(4), pages 875-906.
    13. Fabrice Etilé & Carine Milcent, 2006. "Income‐related reporting heterogeneity in self‐assessed health: evidence from France," Health Economics, John Wiley & Sons, Ltd., vol. 15(9), pages 965-981, September.
    14. repec:hal:psewpa:halshs-00590524 is not listed on IDEAS
    15. Datta Gupta, Nabanita & Kristensen, Nicolai & Pozzoli, Dario, 2010. "External validation of the use of vignettes in cross-country health studies," Economic Modelling, Elsevier, vol. 27(4), pages 854-865, July.
    16. Raskina, Yulia & Podkorytova, Olga & Kuchakov, Ruslan, 2022. "Health determinants and the reporting heterogeneity bias in Russia: Anchoring vignettes approach," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 66, pages 118-143.
    17. Franco Peracchi & Claudio Rossetti, 2009. "Gender and regional differences in self-rated health in Europe," CEIS Research Paper 142, Tor Vergata University, CEIS, revised 30 Sep 2009.
    18. Ralitza Dobreva & Dorrit Posel, 2023. "“Your Health at Present”: Are Patterns of Reporting Heterogeneity in Self-rated Health Gendered?," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 18(5), pages 2197-2226, October.
    19. Knott, R. & Lorgelly, P. & Black, N. & Hollingsworth, B., 2016. "Differential item functioning in the EQ-5D: An exploratory analysis using anchoring vignettes," Health, Econometrics and Data Group (HEDG) Working Papers 16/14, HEDG, c/o Department of Economics, University of York.
    20. Groot, Wim & Maassen van den Brink, Henriette, 2007. "The health effects of education," Economics of Education Review, Elsevier, vol. 26(2), pages 186-200, April.
    21. Jorge E. Araña & Carmelo J. León, 2012. "Scale-perception bias in the valuation of environmental risks," Applied Economics, Taylor & Francis Journals, vol. 44(20), pages 2607-2617, July.

    More about this item

    Keywords

    Anchoring vignettes; Cross-country comparison; Health care responsiveness; Health system performance;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:yor:hectdg:09/29. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jane Rawlings (email available below). General contact details of provider: https://edirc.repec.org/data/deyoruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.