IDEAS home Printed from https://ideas.repec.org/a/eee/ecmode/v124y2023ics0264999323000895.html
   My bibliography  Save this article

Reporting heterogeneity in modeling self-assessed survey outcomes

Author

Listed:
  • Greene, William
  • Harris, Mark N.
  • Knott, Rachel
  • Rice, Nigel

Abstract

The analysis of self-reports will be severely biased if they are subject to reporting heterogeneity. Moreover, there are several types of such heterogeneity, which have all shown to be widespread in the literature. We consider two predominant types of reporting heterogeneity: differential item functioning and middle inflation bias. We consider and extend approaches for adjusting for each type of reporting heterogeneity in isolation and propose models that allow for both types in combination. Monte Carlo experiments favor more complex models (that allow for reporting heterogeneity), even when the underlying data generating process is of a simpler form. The results suggest that failure to account for these nuances will lead to erroneous inference concerning the analysis of self-reported data. We apply these new methods to the important area of self-reported health outcomes.

Suggested Citation

  • Greene, William & Harris, Mark N. & Knott, Rachel & Rice, Nigel, 2023. "Reporting heterogeneity in modeling self-assessed survey outcomes," Economic Modelling, Elsevier, vol. 124(C).
  • Handle: RePEc:eee:ecmode:v:124:y:2023:i:c:s0264999323000895
    DOI: 10.1016/j.econmod.2023.106277
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0264999323000895
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econmod.2023.106277?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jerry Hausman, 2001. "Mismeasured Variables in Econometric Analysis: Problems from the Right and Problems from the Left," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 57-67, Fall.
    2. Arie Kapteyn & James P. Smith & Arthur van Soest, 2007. "Vignettes and Self-Reports of Work Disability in the United States and the Netherlands," American Economic Review, American Economic Association, vol. 97(1), pages 461-473, March.
    3. Stephen Pudney & Michael Shields, 2000. "Gender, race, pay and promotion in the British nursing profession: estimation of a generalized ordered probit model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(4), pages 367-399.
    4. Sarah Brown & Mark N. Harris & Christopher Spencer, 2020. "Modelling Category Inflation with Multiple Inflation Processes: Estimation, Specification and Testing," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(6), pages 1342-1361, December.
    5. Nigel Rice & Silvana Robone & Peter C. Smith, 2012. "Vignettes and health systems responsiveness in cross‐country comparative analyses," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(2), pages 337-369, April.
    6. Fabrice Etilé & Carine Milcent, 2006. "Income-related reporting heterogeneity in self-assessed health: evidence from France," Health Economics, John Wiley & Sons, Ltd., vol. 15(9), pages 965-981.
    7. Currie, Janet & Madrian, Brigitte C., 1999. "Health, health insurance and the labor market," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 50, pages 3309-3416, Elsevier.
    8. Knott, Rachel J. & Lorgelly, Paula K. & Black, Nicole & Hollingsworth, Bruce, 2017. "Differential item functioning in quality of life measurement: An analysis using anchoring vignettes," Social Science & Medicine, Elsevier, vol. 190(C), pages 247-255.
    9. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    10. Paul Contoyannis & Andrew M. Jones & Nigel Rice, 2004. "The dynamics of health in the British Household Panel Survey," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 19(4), pages 473-503.
    11. Lalji, Chitwan & Pakrashi, Debayan & Smyth, Russell, 2018. "Can eating five fruit and veg a day really keep the doctor away?," Economic Modelling, Elsevier, vol. 70(C), pages 320-330.
    12. Greene, William H. & Gillman, Max & Harris, Mark N. & Spencer, Christopher, 2013. "The Tempered Ordered Probit (TOP) Model with an Application to Monetary Policy," CEI Working Paper Series 2013-04, Center for Economic Institutions, Institute of Economic Research, Hitotsubashi University.
    13. Wilson, Paul, 2015. "The misuse of the Vuong test for non-nested models to test for zero-inflation," Economics Letters, Elsevier, vol. 127(C), pages 51-53.
    14. Jesus M. Carro & Alejandra Traferri, 2014. "State Dependence And Heterogeneity In Health Using A Bias‐Corrected Fixed‐Effects Estimator," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(2), pages 181-207, March.
    15. Marcel Kerkhofs & Maarten Lindeboom, 1995. "Subjective health measures and state dependent reporting errors," Health Economics, John Wiley & Sons, Ltd., vol. 4(3), pages 221-235, May.
    16. Hamparsum Bozdogan, 1987. "Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions," Psychometrika, Springer;The Psychometric Society, vol. 52(3), pages 345-370, September.
    17. Viola Angelini & Danilo Cavapozzi & Luca Corazzini & Omar Paccagnella, 2014. "Do Danes and Italians Rate Life Satisfaction in the Same Way? Using Vignettes to Correct for Individual-Specific Scale Biases," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(5), pages 643-666, October.
    18. Nathan Berg & Donald Lien, 2006. "Same-sex sexual behaviour: US frequency estimates from survey data with simultaneous misreporting and non-response," Applied Economics, Taylor & Francis Journals, vol. 38(7), pages 757-769.
    19. Fabrice Etilé & Carine Milcent, 2006. "Income‐related reporting heterogeneity in self‐assessed health: evidence from France," Health Economics, John Wiley & Sons, Ltd., vol. 15(9), pages 965-981, September.
    20. Harris, Mark N. & Knott, Rachel J. & Lorgelly, Paula K. & Rice, Nigel, 2020. "Using externally collected vignettes to account for reporting heterogeneity in survey self-assessment," Economics Letters, Elsevier, vol. 194(C).
    21. William H. Greene & Mark N. Harris & Bruce Hollingsworth, 2015. "Inflated Responses in Measures of Self-Assessed Health," American Journal of Health Economics, MIT Press, vol. 1(4), pages 461-493, Fall.
    22. Lindeboom, Maarten & van Doorslaer, Eddy, 2004. "Cut-point shift and index shift in self-reported health," Journal of Health Economics, Elsevier, vol. 23(6), pages 1083-1099, November.
    23. Chen, Yuanyuan & Wang, Haining & Cheng, Zhiming & Smyth, Russell, 2023. "Education and Migrant Health in China," Economic Modelling, Elsevier, vol. 121(C).
    24. William Greene & Mark N. Harris & Bruce Hollingsworth & Timothy A. Weterings, 2014. "Heterogeneity In Ordered Choice Models: A Review With Applications To Self-Assessed Health," Journal of Economic Surveys, Wiley Blackwell, vol. 28(1), pages 109-133, February.
    25. Harris, Mark N. & Zhao, Xueyan, 2007. "A zero-inflated ordered probit model, with an application to modelling tobacco consumption," Journal of Econometrics, Elsevier, vol. 141(2), pages 1073-1099, December.
    26. Groot, Wim, 2000. "Adaptation and scale of reference bias in self-assessments of quality of life," Journal of Health Economics, Elsevier, vol. 19(3), pages 403-420, May.
    27. Hausman, J. A. & Abrevaya, Jason & Scott-Morton, F. M., 1998. "Misclassification of the dependent variable in a discrete-response setting," Journal of Econometrics, Elsevier, vol. 87(2), pages 239-269, September.
    28. Kristensen, Nicolai & Johansson, Edvard, 2008. "New evidence on cross-country differences in job satisfaction using anchoring vignettes," Labour Economics, Elsevier, vol. 15(1), pages 96-117, February.
    29. Greene,William H. & Hensher,David A., 2010. "Modeling Ordered Choices," Cambridge Books, Cambridge University Press, number 9780521142373.
    30. Crossley, Thomas F. & Kennedy, Steven, 2002. "The reliability of self-assessed health status," Journal of Health Economics, Elsevier, vol. 21(4), pages 643-658, July.
    31. John Bound, 1991. "Self-Reported Versus Objective Measures of Health in Retirement Models," Journal of Human Resources, University of Wisconsin Press, vol. 26(1), pages 106-138.
    32. Sarah Brown & Mark N. Harris & Preety Srivastava & Xiaohui Zhang, 2018. "Modelling illegal drug participation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(1), pages 133-154, January.
    33. Kesavayuth, Dusanee & Poyago-Theotoky, Joanna & Tran, Dai Binh & Zikos, Vasileios, 2020. "Locus of control, health and healthcare utilization," Economic Modelling, Elsevier, vol. 86(C), pages 227-238.
    34. Black, Nicole & Johnston, David W. & Suziedelyte, Agne, 2017. "Justification bias in self-reported disability: New evidence from panel data," Journal of Health Economics, Elsevier, vol. 54(C), pages 124-134.
    35. Greene,William H. & Hensher,David A., 2010. "Modeling Ordered Choices," Cambridge Books, Cambridge University Press, number 9780521194204.
    36. Sirchenko Andrei, 2020. "A model for ordinal responses with heterogeneous status quo outcomes," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 24(1), pages 1-16, February.
    37. Jones, Andrew M. & Rice, Nigel & Roberts, Jennifer, 2010. "Sick of work or too sick to work? Evidence on self-reported health shocks and early retirement from the BHPS," Economic Modelling, Elsevier, vol. 27(4), pages 866-880, July.
    38. Currie, Janet, 2000. "Child health in developed countries," Handbook of Health Economics, in: A. J. Culyer & J. P. Newhouse (ed.), Handbook of Health Economics, edition 1, volume 1, chapter 19, pages 1053-1090, Elsevier.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. William H. Greene & Mark N. Harris & Bruce Hollingsworth, 2015. "Inflated Responses in Measures of Self-Assessed Health," American Journal of Health Economics, MIT Press, vol. 1(4), pages 461-493, Fall.
    2. William Greene & Mark N. Harris & Bruce Hollingsworth & Rachel Knott & Nigel Rice, 2016. "Reporting heterogeneity effects in modelling self reports of health," Working Papers 16-12, New York University, Leonard N. Stern School of Business, Department of Economics.
    3. Davillas, Apostolos & de Oliveira, Victor Hugo & Jones, Andrew M., 2023. "Is inconsistent reporting of self-assessed health persistent and systematic? Evidence from the UKHLS," Economics & Human Biology, Elsevier, vol. 49(C).
    4. Black, Nicole & Johnston, David W. & Shields, Michael A. & Suziedelyte, Agne, 2017. "Who provides inconsistent reports of their health status? The importance of age, cognitive ability and socioeconomic status," Social Science & Medicine, Elsevier, vol. 191(C), pages 9-18.
    5. Au, N. & Johnston, D. W., 2013. "An econometric analysis of self-assessed health: what does it mean and what is it hiding?," Health, Econometrics and Data Group (HEDG) Working Papers 13/31, HEDG, c/o Department of Economics, University of York.
    6. Franco Peracchi & Claudio Rossetti, 2013. "The heterogeneous thresholds ordered response model: identification and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 703-722, June.
    7. Sarah Brown & Mark N. Harris & Preety Srivastava & Karl Taylor, 2018. "Mental Health and Reporting Bias: Analysis of the GHQ - 12," Working Papers 2018013, The University of Sheffield, Department of Economics.
    8. William Greene & Mark N. Harris & Preety Srivastava & Xueyan Zhao, 2018. "Misreporting and econometric modelling of zeros in survey data on social bads: An application to cannabis consumption," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 372-389, February.
    9. Pfarr, Christian & Schmid, Andreas & Schneider, Udo, 2011. "Reporting Heterogeneity in Self-Assessed Health among Elderly Europeans: The Impact of Mental and Physical Health Status," MPRA Paper 29900, University Library of Munich, Germany.
    10. Johnston, David W. & Propper, Carol & Shields, Michael A., 2009. "Comparing subjective and objective measures of health: Evidence from hypertension for the income/health gradient," Journal of Health Economics, Elsevier, vol. 28(3), pages 540-552, May.
    11. Udo Schneider & Christian Pfarr & Brit Schneider & Volker Ulrich, 2012. "I feel good! Gender differences and reporting heterogeneity in self-assessed health," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 13(3), pages 251-265, June.
    12. William H. Greene & Mark N. Harris & Rachel J. Knott & Nigel Rice, 2021. "Specification and testing of hierarchical ordered response models with anchoring vignettes," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(1), pages 31-64, January.
    13. Gimenez-Nadal, J. Ignacio & Molina, Jose Alberto, 2015. "Health status and the allocation of time: Cross-country evidence from Europe," Economic Modelling, Elsevier, vol. 46(C), pages 188-203.
    14. Teresa Bago d'Uva & Eddy Van Doorslaer & Maarten Lindeboom & Owen O'Donnell, 2008. "Does reporting heterogeneity bias the measurement of health disparities?," Health Economics, John Wiley & Sons, Ltd., vol. 17(3), pages 351-375, March.
    15. Corrado, L. & Weeks, M., 2010. "Identification Strategies in Survey Response Using Vignettes," Cambridge Working Papers in Economics 1031, Faculty of Economics, University of Cambridge.
    16. Aparajita Dasgupta, 2018. "Systematic measurement error in self-reported health: is anchoring vignettes the way out?," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-30, December.
    17. Beni­tez-Silva, Hugo & Ni, Huan, 2008. "Health status and health dynamics in an empirical model of expected longevity," Journal of Health Economics, Elsevier, vol. 27(3), pages 564-584, May.
    18. Nigel Rice & Silvana Robone & Peter C. Smith, 2012. "Vignettes and health systems responsiveness in cross‐country comparative analyses," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(2), pages 337-369, April.
    19. Laura Rossouw & Teresa Bago d’Uva & Eddy Doorslaer, 2018. "Poor Health Reporting? Using Anchoring Vignettes to Uncover Health Disparities by Wealth and Race," Demography, Springer;Population Association of America (PAA), vol. 55(5), pages 1935-1956, October.
    20. Teresa Bago d’Uva & Maarten Lindeboom & Owen O’Donnell & Eddy van Doorslaer, 2011. "Slipping Anchor?: Testing the Vignettes Approach to Identification and Correction of Reporting Heterogeneity," Journal of Human Resources, University of Wisconsin Press, vol. 46(4), pages 875-906.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecmode:v:124:y:2023:i:c:s0264999323000895. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/30411 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.