IDEAS home Printed from https://ideas.repec.org/a/ucp/ecdecc/doi10.1086-686793.html
   My bibliography  Save this article

Can Subjective Questions on Economic Welfare Be Trusted?

Author

Listed:
  • Martin Ravallion
  • Kristen Himelein
  • Kathleen Beegle

Abstract

While self-assessments of welfare have become popular for measuring poverty and estimating welfare effects, the methods can be deceptive given systematic heterogeneity in respondents’ scales. Little is known about this problem. We study scale heterogeneity using specially designed surveys in three countries: Tajikistan, Guatemala, and Tanzania. Respondents were asked to score stylized vignettes, as well as their own household. Diverse scales are in evidence, casting considerable doubt on the meaning of widely used summary measures such as subjective poverty rates. Nonetheless, under our identifying assumptions, only small biases are induced in the coefficients on widely used regressors for subjective poverty and welfare.

Suggested Citation

  • Martin Ravallion & Kristen Himelein & Kathleen Beegle, 2016. "Can Subjective Questions on Economic Welfare Be Trusted?," Economic Development and Cultural Change, University of Chicago Press, vol. 64(4), pages 697-726.
  • Handle: RePEc:ucp:ecdecc:doi:10.1086/686793
    DOI: 10.1086/686793
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1086/686793
    Download Restriction: Access to the online full text or PDF requires a subscription.

    File URL: http://dx.doi.org/10.1086/686793
    Download Restriction: Access to the online full text or PDF requires a subscription.

    File URL: https://libkey.io/10.1086/686793?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gero Carletto & Alberto Zezza, 2006. "Being poor, feeling poorer: Combining objective and subjective measures of welfare in Albania," Journal of Development Studies, Taylor & Francis Journals, vol. 42(5), pages 739-760.
    2. Oswald, Andrew J, 1997. "Happiness and Economic Performance," Economic Journal, Royal Economic Society, vol. 107(445), pages 1815-1831, November.
    3. Clark, Andrew E & Oswald, Andrew J, 1994. "Unhappiness and Unemployment," Economic Journal, Royal Economic Society, vol. 104(424), pages 648-659, May.
    4. C. Graham & S. Pettinato, 2002. "Frustrated Achievers: Winners, Losers and Subjective Well-Being in New Market Economies," Journal of Development Studies, Taylor & Francis Journals, vol. 38(4), pages 100-140.
    5. Martin Ravallion & Michael Lokshin, 2001. "Identifying Welfare Effects from Subjective Questions," Economica, London School of Economics and Political Science, vol. 68(271), pages 335-357, August.
    6. Bruno S. Frey & Alois Stutzer, 2002. "What Can Economists Learn from Happiness Research?," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 402-435, June.
    7. Menno Pradhan & Martin Ravallion, 2000. "Measuring Poverty Using Qualitative Perceptions Of Consumption Adequacy," The Review of Economics and Statistics, MIT Press, vol. 82(3), pages 462-471, August.
    8. John Knight & Ramani Gunatilaka, 2010. "The Rural-Urban Divide in China: Income but Not Happiness?," Journal of Development Studies, Taylor & Francis Journals, vol. 46(3), pages 506-534.
    9. Kristensen, Nicolai & Johansson, Edvard, 2008. "New evidence on cross-country differences in job satisfaction using anchoring vignettes," Labour Economics, Elsevier, vol. 15(1), pages 96-117, February.
    10. Javier Herrera & Mireille Razafindrakoto & François Roubaud, 2006. "The determinants of subjective poverty: A comparative analysis between Madagascar and Peru," Working Papers DT/2006/01, DIAL (Développement, Institutions et Mondialisation).
    11. Gabriella Conti & Stephen Pudney, 2011. "Survey Design and the Analysis of Satisfaction," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 1087-1093, August.
    12. Dolan, Paul & Peasgood, Tessa & White, Mathew, 2008. "Do we really know what makes us happy A review of the economic literature on the factors associated with subjective well-being," Journal of Economic Psychology, Elsevier, vol. 29(1), pages 94-122, February.
    13. Geeta Gandhi Kingdon & John Knight, 2006. "Subjective well-being poverty vs. Income poverty and capabilities poverty?," Journal of Development Studies, Taylor & Francis Journals, vol. 42(7), pages 1199-1224.
    14. Senik, Claudia, 2004. "When information dominates comparison: Learning from Russian subjective panel data," Journal of Public Economics, Elsevier, vol. 88(9-10), pages 2099-2123, August.
    15. King, Gary & Wand, Jonathan, 2007. "Comparing Incomparable Survey Responses: Evaluating and Selecting Anchoring Vignettes," Political Analysis, Cambridge University Press, vol. 15(1), pages 46-66, January.
    16. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    17. Carolina Castilla, 2010. "Subjective Poverty and Reference-Dependence: Income over Time, Aspirations and Reference Groups," WIDER Working Paper Series wp-2010-076, World Institute for Development Economic Research (UNU-WIDER).
    18. Arie Kapteyn & James P. Smith & Arthur Van Soest, 2009. "Comparing Life Satisfaction," Working Papers WR-623-1, RAND Corporation.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ravallion, Martin, 2019. "Global inequality when unequal countries create unequal people," European Economic Review, Elsevier, vol. 111(C), pages 85-97.
    2. Želinský, Tomáš & Ng, Jason Wei Jian & Mysíková, Martina, 2020. "Estimating subjective poverty lines with discrete information," Economics Letters, Elsevier, vol. 196(C).
    3. Van Landeghem, Bert & Vandeplas, Anneleen, 2018. "The relationship between status and happiness: Evidence from the caste system in rural India," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 77(C), pages 62-71.
    4. Zhiyong Huang & Haoxian Wang & Wenyuan Zheng, 2021. "An extended hierarchical ordered probit model robust to heteroskedastic vignette perceptions with an application to functional limitation assessment," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-19, March.
    5. Jeffrey R. Bloem & Andrew J. Oswald, 2022. "The Analysis of Human Feelings: A Practical Suggestion for a Robustness Test," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 68(3), pages 689-710, September.
    6. DECANCQ Koen & OLIVERA Javier & SCHOKKAERT Erik, 2018. "Program evaluation and ethnic differences: the Pension 65 program in Peru," LISER Working Paper Series 2018-21, Luxembourg Institute of Socio-Economic Research (LISER).
    7. Micael Dahlen & Helge Thorbjørnsen, 2022. "Individuals’ Assessments of Their Own Wellbeing, Subjective Welfare, and Good Life: Four Exploratory Studies," IJERPH, MDPI, vol. 19(19), pages 1-10, September.
    8. Kaiser, Caspar, 2022. "Using memories to assess the intrapersonal comparability of wellbeing reports," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 410-442.
    9. Bernard, Tanguy & Doss, Cheryl & Hidrobo, Melissa & Hoel, Jessica & Kieran, Caitlin, 2020. "Ask me why: Patterns of intrahousehold decision-making," World Development, Elsevier, vol. 125(C).
    10. Bert Van Landeghem & Anneleen Vandeplas, 2016. "Lower in rank, but happier: the complex relationship between status and happiness," Working Papers of LICOS - Centre for Institutions and Economic Performance 556194, KU Leuven, Faculty of Economics and Business (FEB), LICOS - Centre for Institutions and Economic Performance.
    11. Koen Decancq & Marc Fleurbaey & Erik Schokkaert, 2017. "Wellbeing Inequality and Preference Heterogeneity," Economica, London School of Economics and Political Science, vol. 84(334), pages 210-238, April.
    12. Christensen, Cheryl, 2018. "Progress and Challenges in Global Food Security," Amber Waves:The Economics of Food, Farming, Natural Resources, and Rural America, United States Department of Agriculture, Economic Research Service, vol. 0(01), February.
    13. Antonio M. Salcedo & Gregorio Izquierdo Llanes, 2019. "Drawing the optimal monetary poverty lines based on empirical data: an application to Spain," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(1), pages 513-527, January.
    14. Sutirtha Bandyopadhyay, 2020. "Gendered Well-Being: Cross-Sectional Evidence from Poor Urban Households in India," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 151(1), pages 281-308, August.
    15. Antonio M. Salcedo & Gregorio Izquierdo, 2018. "An Empirical Approach to the Poverty Indicators Based on Revealed Parameters: The Case of Spain," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 138(2), pages 623-638, July.
    16. Romina Boarini & Marc Fleurbaey & Fabrice Murtin & Paul Schreyer, 2022. "Well‐being during the Great Recession: new evidence from a measure of multi‐dimensional living standards with heterogeneous preferences," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(1), pages 104-138, January.
    17. Olukorede Abiona, 2017. "Adverse Effects of Early Life Extreme Precipitation Shocks on Short-term Health and Adulthood Welfare Outcomes," Review of Development Economics, Wiley Blackwell, vol. 21(4), pages 1229-1254, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ravallion, Martin & Himelein, Kristen & Beegle, Kathleen, 2013. "Can subjective questions on economic welfare be trusted ? evidence for three developing countries," Policy Research Working Paper Series 6726, The World Bank.
    2. Ravallion, Martin, 2012. "Poor, or just feeling poor ? on using subjective data in measuring poverty," Policy Research Working Paper Series 5968, The World Bank.
    3. Beegle, Kathleen & Himelein, Kristen & Ravallion, Martin, 2012. "Frame-of-reference bias in subjective welfare," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 556-570.
    4. Geeta G. Kingdon & John Knight, 2003. "Well-being poverty versus income poverty and capabilities poverty?," CSAE Working Paper Series 2003-16, Centre for the Study of African Economies, University of Oxford.
    5. Akay, Alpaslan & Bargain, Olivier & Zimmermann, Klaus F., 2012. "Relative concerns of rural-to-urban migrants in China," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 421-441.
    6. Zsoka Koczan, 2022. "Perceptions of economic well‐being in the Western Balkans," Economics of Transition and Institutional Change, John Wiley & Sons, vol. 30(4), pages 845-867, October.
    7. David G. Blanchflower & Andrew J. Oswald, 2004. "Money, Sex and Happiness: An Empirical Study," Scandinavian Journal of Economics, Wiley Blackwell, vol. 106(3), pages 393-415, October.
    8. Litchfield, Julie & Reilly, Barry & Veneziani, Mario, 2012. "An analysis of life satisfaction in Albania: An heteroscedastic ordered probit model approach," Journal of Economic Behavior & Organization, Elsevier, vol. 81(3), pages 731-741.
    9. Feeny, Simon & McDonald, Lachlan & Posso, Alberto, 2014. "Are Poor People Less Happy? Findings from Melanesia," World Development, Elsevier, vol. 64(C), pages 448-459.
    10. Alois Stutzer & Bruno S. Frey, 2008. "Stress that Doesn't Pay: The Commuting Paradox," Scandinavian Journal of Economics, Wiley Blackwell, vol. 110(2), pages 339-366, June.
    11. KNIGHT, John & SONG, Lina & GUNATILAKA, Ramani, 2009. "Subjective well-being and its determinants in rural China," China Economic Review, Elsevier, vol. 20(4), pages 635-649, December.
    12. Roberta Distante, 2013. "Subjective Well-Being, Income and Relative Concerns in the UK," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 113(1), pages 81-105, August.
    13. Byela Tibesigwa & Martine Visser & Brennan Hodkinson, 2016. "Effects of Objective and Subjective Income Comparisons on Subjective Wellbeing," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(1), pages 361-389, August.
    14. Geeta Kingdon & John Knight, 2005. "Subjective well-being poverty versus income poverty and capabilities poverty?," Economics Series Working Papers GPRG-WPS-003, University of Oxford, Department of Economics.
    15. Thomas Markussen & Maria Fibæk & Finn Tarp & Nguyen Do Anh Tuan, 2018. "The Happy Farmer: Self-Employment and Subjective Well-Being in Rural Vietnam," Journal of Happiness Studies, Springer, vol. 19(6), pages 1613-1636, August.
    16. Molnár, György & Kapitány, Zsuzsa, 2006. "Mobilitás, bizonytalanság és szubjektív jóllét Magyarországon [Mobility, uncertainty and subjective welfare in Hungary]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(10), pages 845-872.
    17. Olivia S. Jin & Phanindra V. Wunnava, 2023. "“Feeling richer and happier? The effect of self-perceived economic welfare on life satisfaction: longitudinal evidence from a transition economy”," SN Business & Economics, Springer, vol. 3(3), pages 1-19, March.
    18. Thomas Markussen & Maria Fibæk & Finn Tarp & Nguyen Do Anh Tuan, 2018. "The Happy Farmer: Self-Employment and Subjective Well-Being in Rural Vietnam," Journal of Happiness Studies, Springer, vol. 19(6), pages 1613-1636, August.
    19. Claudia Senik, 2002. "When Information Dominates Comparison. A Panel Data Analysis Using Russian Subjective Data," DELTA Working Papers 2002-02, DELTA (Ecole normale supérieure).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucp:ecdecc:doi:10.1086/686793. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Journals Division (email available below). General contact details of provider: https://www.journals.uchicago.edu/EDCC .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.