IDEAS home Printed from https://ideas.repec.org/p/cam/camdae/1031.html
   My bibliography  Save this paper

Identification Strategies in Survey Response Using Vignettes

Author

Listed:
  • Corrado, L.
  • Weeks, M.

Abstract

In this paper we explore solutions to a particular type of heterogeneity in survey data which is manifest in the presence of individual-specific response scales. We consider this problem in the context of existing evidence on cross-country differences in subjective life satisfaction, and in particular the extent of cross-country comparability. In this instance observed responses are not directly comparable, and inference is compromised. We utilise two broad identification strategies to account for scale heterogeneity. Keeping the data fixed, we consider a number of estimators based on alternative generalisations of the ordered response model. We also examine a number of alternative approaches based on the use of additional information in the form of responses on one or more additional questions with the same response categories as the self-assessment question. These additional questions, referred to as anchoring vignettes, can under certain conditions, be used to correct for the resultant biases in model parameters.

Suggested Citation

  • Corrado, L. & Weeks, M., 2010. "Identification Strategies in Survey Response Using Vignettes," Cambridge Working Papers in Economics 1031, Faculty of Economics, University of Cambridge.
  • Handle: RePEc:cam:camdae:1031
    as

    Download full text from publisher

    File URL: http://www.econ.cam.ac.uk/research-files/repec/cam/pdf/cwpe1031.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. van Soest, Arthur & Delaney, Liam & Harmon, Colm P. & Kapteyn, Arie & Smith, James P., 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," IZA Discussion Papers 2860, Institute of Labor Economics (IZA).
    2. Flavio Cunha & James J. Heckman & Salvador Navarro, 2007. "The Identification And Economic Content Of Ordered Choice Models With Stochastic Thresholds," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1273-1309, November.
    3. Stefan Boes & Rainer Winkelmann, 2006. "Ordered Response Models," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 12, pages 167-181, Springer.
    4. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    5. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
    6. Bruno S. Frey & Alois Stutzer, 2009. "Should National Happiness be Maximized?," Chapters, in: Amitava Krishna Dutt & Benjamin Radcliff (ed.), Happiness, Economics and Politics, chapter 14, Edward Elgar Publishing.
    7. Franco Peracchi & Claudio Rossetti, 2009. "Gender and regional differences in self-rated health in Europe," CEIS Research Paper 142, Tor Vergata University, CEIS, revised 30 Sep 2009.
    8. Brent Kreider, 1999. "Latent Work Disability and Reporting Bias," Journal of Human Resources, University of Wisconsin Press, vol. 34(4), pages 734-769.
    9. Hausman, J. A. & Abrevaya, Jason & Scott-Morton, F. M., 1998. "Misclassification of the dependent variable in a discrete-response setting," Journal of Econometrics, Elsevier, vol. 87(2), pages 239-269, September.
    10. Van Praag, Bernard, 1971. "The welfare function of income in Belgium: An empirical investigation," European Economic Review, Elsevier, vol. 11(3), pages 337-369.
    11. Brent Kreider & John Pepper, 2008. "Inferring disability status from corrupt data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 329-349.
    12. Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011. "Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Journal of Human Resources, University of Wisconsin Press, vol. 46(4), pages 875-906.
    13. Ramalho, Esmeralda A., 2002. "Regression models for choice-based samples with misclassification in the response variable," Journal of Econometrics, Elsevier, vol. 106(1), pages 171-201, January.
    14. Li, Tong & Vuong, Quang, 1998. "Nonparametric Estimation of the Measurement Error Model Using Multiple Indicators," Journal of Multivariate Analysis, Elsevier, vol. 65(2), pages 139-165, May.
    15. Andrew E. Clark & Paul Frijters & Michael A. Shields, 2008. "Relative Income, Happiness, and Utility: An Explanation for the Easterlin Paradox and Other Puzzles," Journal of Economic Literature, American Economic Association, vol. 46(1), pages 95-144, March.
    16. Kristensen, Nicolai & Johansson, Edvard, 2008. "New evidence on cross-country differences in job satisfaction using anchoring vignettes," Labour Economics, Elsevier, vol. 15(1), pages 96-117, February.
    17. King, Gary & Wand, Jonathan, 2007. "Comparing Incomparable Survey Responses: Evaluating and Selecting Anchoring Vignettes," Political Analysis, Cambridge University Press, vol. 15(1), pages 46-66, January.
    18. Stephen Pudney & Michael Shields, 2000. "Gender, race, pay and promotion in the British nursing profession: estimation of a generalized ordered probit model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(4), pages 367-399.
    19. Rossi P. E & Gilula Z. & Allenby G. M, 2001. "Overcoming Scale Usage Heterogeneity: A Bayesian Hierarchical Approach," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 20-31, March.
    20. Ed Diener, 2006. "Guidelines for National Indicators of Subjective Well-Being and Ill-Being," Journal of Happiness Studies, Springer, vol. 7(4), pages 397-404, November.
    21. Susanne M. Schennach, 2004. "Estimation of Nonlinear Models with Measurement Error," Econometrica, Econometric Society, vol. 72(1), pages 33-75, January.
    22. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    23. Arthur Van Soest & Liam Delaney & Colm Harmon & Arie Kapteyn & James P. Smith, 2007. "Validating the Use of Vignettes for Subjective Threshold Scales," Working Papers 200714, Geary Institute, University College Dublin.
    24. Martin Browning & Thomas Crossley, 2009. "Are Two Cheap, Noisy Measures Better Than One Expensive, Accurate One?," American Economic Review, American Economic Association, vol. 99(2), pages 99-103, May.
    25. repec:ucn:wpaper:10197/580 is not listed on IDEAS
    26. Greene,William H. & Hensher,David A., 2010. "Modeling Ordered Choices," Cambridge Books, Cambridge University Press, number 9780521142373.
    27. Daniel Kahneman & Alan B. Krueger & David Schkade & Norbert Schwarz & Arthur Stone, 2004. "Toward National Well-Being Accounts," American Economic Review, American Economic Association, vol. 94(2), pages 429-434, May.
    28. Ada Ferrer-i-Carbonell & Paul Frijters, 2004. "How Important is Methodology for the estimates of the determinants of Happiness?," Economic Journal, Royal Economic Society, vol. 114(497), pages 641-659, July.
    29. Flavio Cunha & James J. Heckman & Salvador Navarro, 2007. "The Identification & Economic Content of Ordered Choice Models with Stochastic Thresholds," Working Papers 200726, Geary Institute, University College Dublin.
    30. Greene,William H. & Hensher,David A., 2010. "Modeling Ordered Choices," Cambridge Books, Cambridge University Press, number 9780521194204.
    31. Aslam, A. & Corrado, L., 2007. "No Man is an Island, the Inter-personal Determinants of Regional Well-Being in Europe," Cambridge Working Papers in Economics 0717, Faculty of Economics, University of Cambridge.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Leonardo Becchetti & Gianluigi Conzo, 2021. "Avoiding a “despair death crisis” in Europe: the drivers of human (un)sustainability," International Review of Economics, Springer;Happiness Economics and Interpersonal Relations (HEIRS), vol. 68(4), pages 485-526, December.
    2. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    3. William H. Greene & Mark N. Harris & Rachel J. Knott & Nigel Rice, 2021. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 31-64, January.
    4. Arthur van Soest & Hana Vonkova, 2014. "Testing the specification of parametric models by using anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 177(1), pages 115-133, January.
    5. Daniel J. Benjamin & Kristen Cooper & Ori Heffetz & Miles S. Kimball, 2023. "From Happiness Data to Economic Conclusions," NBER Working Papers 31727, National Bureau of Economic Research, Inc.
    6. Leonardo Becchetti & Fabio Pisani, 2014. "Family Economic Well-Being, and (Class) Relative Wealth: An Empirical Analysis of Life Satisfaction of Secondary School Students in Three Italian Cities," Journal of Happiness Studies, Springer, vol. 15(3), pages 503-525, June.
    7. Luisa Corrado & Paola Samˆ, 2012. "Inside the Life Satisfaction Blackbox," Econometica Working Papers wp44, Econometica.
    8. Hanna Grol-Prokopczyk, 2018. "In Pursuit of Anchoring Vignettes That Work: Evaluating Generality Versus Specificity in Vignette Texts," The Journals of Gerontology: Series B, The Gerontological Society of America, vol. 73(1), pages 54-63.
    9. Andrew M. Jones; Nigel Rice, Silvana Robone; & Nigel Rice; & Silvana Robone:, 2012. "A comparison of parametric and non-parametric adjustments using vignettes for self-reported data," Health, Econometrics and Data Group (HEDG) Working Papers 12/10, HEDG, c/o Department of Economics, University of York.
    10. Hanna Grol-Prokopczyk & Emese Verdes-Tennant & Mary McEniry & Márton Ispány, 2015. "Promises and Pitfalls of Anchoring Vignettes in Health Survey Research," Demography, Springer;Population Association of America (PAA), vol. 52(5), pages 1703-1728, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    2. William H. Greene & Mark N. Harris & Rachel J. Knott & Nigel Rice, 2021. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 31-64, January.
    3. Chen, Le-Yu & Oparina, Ekaterina & Powdthavee, Nattavudh & Srisuma, Sorawoot, 2022. "Robust Ranking of Happiness Outcomes: A Median Regression Perspective," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 672-686.
    4. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    5. Chen, Le-Yu & Oparina, Ekaterina & Powdthavee, Nattavudh & Srisuma, Sorawoot, 2019. "Have Econometric Analyses of Happiness Data Been Futile? A Simple Truth about Happiness Scales," IZA Discussion Papers 12152, Institute of Labor Economics (IZA).
    6. Senik, Claudia, 2014. "The French unhappiness puzzle: The cultural dimension of happiness," Journal of Economic Behavior & Organization, Elsevier, vol. 106(C), pages 379-401.
    7. Greene, William & Harris, Mark N. & Knott, Rachel & Rice, Nigel, 2023. "Reporting heterogeneity in modeling self-assessed survey outcomes," Economic Modelling, Elsevier, vol. 124(C).
    8. Stefan Boes, 2013. "Nonparametric analysis of treatment effects in ordered response models," Empirical Economics, Springer, vol. 44(1), pages 81-109, February.
    9. Datta Gupta, Nabanita & Kristensen, Nicolai & Pozzoli, Dario, 2010. "External validation of the use of vignettes in cross-country health studies," Economic Modelling, Elsevier, vol. 27(4), pages 854-865, July.
    10. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2014. "Do Danes and Italians Rate Life Satisfaction in the Same Way? Using Vignettes to Correct for Individual-Specific Scale Biases," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(5), pages 643-666, October.
    11. Carmelo León & Jorge Araña & Javier León, 2013. "Correcting for Scale Perception Bias in Measuring Corruption: an Application to Chile and Spain," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(3), pages 977-995, December.
    12. William H. Greene & David A. Hensher, 2008. "Modeling Ordered Choices: A Primer and Recent Developments," Working Papers 08-26, New York University, Leonard N. Stern School of Business, Department of Economics.
    13. William Greene & Mark N. Harris & Bruce Hollingsworth & Rachel Knott & Nigel Rice, 2016. "Reporting heterogeneity effects in modelling self reports of health," Working Papers 16-12, New York University, Leonard N. Stern School of Business, Department of Economics.
    14. Timothy A. Weterings & Mark N. Harris & Bruce Hollingsworth, 2012. "Extending Unobserved Heterogeneity - A Strategy for Accounting for Respondent Perceptions in the Absence of Suitable Data," Monash Econometrics and Business Statistics Working Papers 12/12, Monash University, Department of Econometrics and Business Statistics.
    15. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2012. "Age, Health and Life Satisfaction Among Older Europeans," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 293-308, January.
    16. William Greene, 2014. "Models for ordered choices," Chapters, in: Stephane Hess & Andrew Daly (ed.), Handbook of Choice Modelling, chapter 15, pages 333-362, Edward Elgar Publishing.
    17. Eric Bonsang & Arthur Soest, 2012. "Satisfaction with Job and Income Among Older Individuals Across European Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 227-254, January.
    18. Omar Paccagnella, 2011. "Anchoring vignettes with sample selection due to non‐response," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(3), pages 665-687, July.
    19. Senik, Claudia, 2009. "Direct evidence on income comparisons and their welfare effects," Journal of Economic Behavior & Organization, Elsevier, vol. 72(1), pages 408-424, October.
    20. Renske Kok & Mauricio Avendano & Teresa Bago d’Uva & Johan Mackenbach, 2012. "Can Reporting Heterogeneity Explain Differences in Depressive Symptoms Across Europe?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 105(2), pages 191-210, January.

    More about this item

    Keywords

    Vignettes; ordered response; generalised ordered response; stochastic thresholds; attitudinal surveys.;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cam:camdae:1031. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jake Dyer (email available below). General contact details of provider: https://www.econ.cam.ac.uk/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.