IDEAS home Printed from https://ideas.repec.org/p/yor/hectdg/09-28.html
   My bibliography  Save this paper

Analysis of the Validity of the Vignette Approach to Correct for Heterogeneity in Reporting Health System Responsiveness

Author

Listed:
  • Nigel Rice
  • Silvana Robone
  • Peter Smith

Abstract

Despite the growing popularity of the vignette methodology to deal with self-reported, categorical data, the formal evaluation of the validity of this methodology is still a topic of research. Some critical assumptions need to hold in order for this method to be valid. In this paper we analyse the assumption of “vignette equivalence” using data on health system responsiveness contained within the World Health Survey. We perform several tests to check the assumption of vignette equivalence. First, we use a test based on the global ordering of the vignettes. A minimal condition for the assumption of vignette equivalence to hold is that individual responses are consistent with the global ordering of vignettes. Secondly, using the HOPIT model on the pool of countries, we undertake sensitivity analyses, stratifying countries according to the Inglehart-Welzel scale and the Human Development Index. The results of this analysis are robust, suggesting that the vignette equivalence assumption is not contradicted. Thirdly, we model the reporting behaviour of the respondents through a two-step regression procedure to evaluate whether the vignettes construct is perceived by respondents in different ways. Overall, across the analyses the results do not contradict the assumption of vignette equivalence and accordingly lend support to the use of the vignette methodology when analysing self-reported data and health system responsiveness.

Suggested Citation

  • Nigel Rice & Silvana Robone & Peter Smith, 2009. "Analysis of the Validity of the Vignette Approach to Correct for Heterogeneity in Reporting Health System Responsiveness," Health, Econometrics and Data Group (HEDG) Working Papers 09/28, HEDG, c/o Department of Economics, University of York.
  • Handle: RePEc:yor:hectdg:09/28
    as

    Download full text from publisher

    File URL: https://www.york.ac.uk/media/economics/documents/herc/wp/09_28.pdf
    File Function: Main text
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. van Soest, Arthur & Delaney, Liam & Harmon, Colm P. & Kapteyn, Arie & Smith, James P., 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," IZA Discussion Papers 2860, Institute for the Study of Labor (IZA).
    2. Rice, N & Robone, S & Smith, P.C, 2008. "International Comparison of Public Sector Performance: The Use of Anchoring Vignettes to adjust Self-Reported Data," Health, Econometrics and Data Group (HEDG) Working Papers 08/28, HEDG, c/o Department of Economics, University of York.
    3. repec:cup:apsrev:v:97:y:2003:i:04:p:567-583_00 is not listed on IDEAS
    4. Nigel Rice & Silvana Robone & Peter Smith, 2011. "Analysis of the validity of the vignette approach to correct for heterogeneity in reporting health system responsiveness," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 12(2), pages 141-162, April.
    5. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    6. Nicolas Sirven & Brigitte Santos-Eggimann & Jacques Spagnoli, 2008. "Comparability of Health Care Responsiveness in Europe using anchoring vignettes from SHARE," Working Papers DT15, IRDES institut for research and information in health economics, revised Sep 2008.
    7. Datta Gupta, Nabanita & Kristensen, Nicolai & Pozzoli, Dario, 2010. "External validation of the use of vignettes in cross-country health studies," Economic Modelling, Elsevier, vol. 27(4), pages 854-865, July.
    8. Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011. "Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Journal of Human Resources, University of Wisconsin Press, vol. 46(4), pages 875-906.
    9. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375.
    10. Lewis, Jeffrey B. & Linzer, Drew A., 2005. "Estimating Regression Models in Which the Dependent Variable Is Based on Estimates," Political Analysis, Cambridge University Press, vol. 13(04), pages 345-364, September.
    11. Kristensen, Nicolai & Johansson, Edvard, 2008. "New evidence on cross-country differences in job satisfaction using anchoring vignettes," Labour Economics, Elsevier, vol. 15(1), pages 96-117, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Röttger, Julia & Blümel, Miriam & Fuchs, Sabine & Busse, Reinhard, 2014. "Assessing the responsiveness of chronic disease care - Is the World Health Organization's concept of health system responsiveness applicable?," Social Science & Medicine, Elsevier, vol. 113(C), pages 87-94.
    2. Nigel Rice & Silvana Robone & Peter Smith, 2011. "Analysis of the validity of the vignette approach to correct for heterogeneity in reporting health system responsiveness," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 12(2), pages 141-162, April.
    3. Bertoni, Marco, 2015. "Hungry today, unhappy tomorrow? Childhood hunger and subjective wellbeing later in life," Journal of Health Economics, Elsevier, vol. 40(C), pages 40-53.
    4. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2013. "Are A mericans Really Less Happy with Their Incomes?," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 59(1), pages 44-65, March.
    5. Maarten Lindeboom, 2012. "Health and Work of Older Workers," Chapters,in: The Elgar Companion to Health Economics, Second Edition, chapter 3 Edward Elgar Publishing.
    6. G. Fiorentini & S. Robone & R. Verzulli, 2016. "How do hospital-specialty characteristics influence health system responsiveness? An empirical evaluation of in-patient care in the Italian Region of Emilia-Romagna," Working Papers wp1077, Dipartimento Scienze Economiche, Universita' di Bologna.
    7. Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011. "Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Journal of Human Resources, University of Wisconsin Press, vol. 46(4), pages 875-906.
    8. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2014. "Do Danes and Italians Rate Life Satisfaction in the Same Way? Using Vignettes to Correct for Individual-Specific Scale Biases," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(5), pages 643-666, October.
    9. repec:oup:geronb:v:73:y:2018:i:1:p:54-63. is not listed on IDEAS
    10. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2013. "Are A mericans Really Less Happy with Their Incomes?," Review of Income and Wealth, International Association for Research in Income and Wealth, pages 44-65.
    11. Andrew M. Jones; Nigel Rice, Silvana Robone; & Nigel Rice; & Silvana Robone:, 2012. "A comparison of parametric and non-parametric adjustments using vignettes for self-reported data," Health, Econometrics and Data Group (HEDG) Working Papers 12/10, HEDG, c/o Department of Economics, University of York.
    12. Zhang, Hao & Bago d’Uva, Teresa & van Doorslaer, Eddy, 2015. "The gender health gap in China: A decomposition analysis," Economics & Human Biology, Elsevier, vol. 18(C), pages 13-26.
    13. Carmelo León & Jorge Araña & Javier León, 2013. "Correcting for Scale Perception Bias in Measuring Corruption: an Application to Chile and Spain," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(3), pages 977-995, December.
    14. Hanna Grol-Prokopczyk & Emese Verdes-Tennant & Mary McEniry & Márton Ispány, 2015. "Promises and Pitfalls of Anchoring Vignettes in Health Survey Research," Demography, Springer;Population Association of America (PAA), vol. 52(5), pages 1703-1728, October.
    15. Valentine, Nicole & Verdes-Tennant, Emese & Bonsel, Gouke, 2015. "Health systems' responsiveness and reporting behaviour: Multilevel analysis of the influence of individual-level factors in 64 countries," Social Science & Medicine, Elsevier, vol. 138(C), pages 152-160.
    16. Omar Paccagnella, 2011. "Anchoring vignettes with sample selection due to non‐response," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 665-687, July.
    17. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2011. "Are Americans Really Less Happy With Their Incomes?," Working Papers WR-858, RAND Corporation.
    18. repec:spr:soinre:v:134:y:2017:i:3:d:10.1007_s11205-016-1457-4 is not listed on IDEAS

    More about this item

    Keywords

    Health system responsiveness; Anchoring vignettes; Vignette Equivalence;

    JEL classification:

    • I10 - Health, Education, and Welfare - - Health - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:yor:hectdg:09/28. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jane Rawlings). General contact details of provider: http://edirc.repec.org/data/deyoruk.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.