IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp4389.html
   My bibliography  Save this paper

Experimental Tests of Survey Responses to Expenditure Questions

Author

Listed:
  • Comerford, David

    (University College Dublin)

  • Delaney, Liam

    (University of Stirling)

  • Harmon, Colm P.

    (University of Edinburgh)

Abstract

This paper tests for a number of survey effects in the elicitation of expenditure items. In particular we examine the extent to which individuals use features of the expenditure question to construct their answers. We test whether respondents interpret question wording as researchers intend and examine the extent to which prompts, clarifications and seemingly arbitrary features of survey design influence expenditure reports. We find that over one quarter of respondents have difficulty distinguishing between "you" and “your household” when making expenditure reports; that respondents report higher pro-rata expenditure when asked to give responses on a weekly as opposed to monthly or annual time scale; that respondents give higher estimates when using a scale with a higher mid-point; and that respondents report higher aggregated expenditure when categories are presented in a disaggregated form. In summary, expenditure reports are constructed using convenient rules of thumb and available information, which will depend on the characteristics of the respondent, the expenditure domain and features of the survey question. It is crucial to further account for these features in ongoing surveys.

Suggested Citation

  • Comerford, David & Delaney, Liam & Harmon, Colm P., 2009. "Experimental Tests of Survey Responses to Expenditure Questions," IZA Discussion Papers 4389, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp4389
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp4389.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Martin Browning & Thomas F. Crossley & Guglielmo Weber, 2003. "Asking consumption questions in general purpose surveys," Economic Journal, Royal Economic Society, vol. 113(491), pages 540-567, November.
    2. Kahneman, Daniel & Ritov, Ilana & Schkade, David A, 1999. "Economic Preferences or Attitude Expressions?: An Analysis of Dollar Responses to Public Issues," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 203-235, December.
    3. Oswald, Andrew J., 2008. "On the curvature of the reporting function from objective reality to subjective feelings," Economics Letters, Elsevier, vol. 100(3), pages 369-372, September.
    4. Delaney, Liam & O'Toole, Francis, 2008. "Individual, household and gender preferences for social transfers," Journal of Economic Psychology, Elsevier, vol. 29(3), pages 348-359, June.
    5. Drazen Prelec & George Loewenstein, 1991. "Decision Making Over Time and Under Uncertainty: A Common Approach," Management Science, INFORMS, vol. 37(7), pages 770-786, July.
    6. Schkade David A. & Payne John W., 1994. "How People Respond to Contingent Valuation Questions: A Verbal Protocol Analysis of Willingness to Pay for an Environmental Regulation," Journal of Environmental Economics and Management, Elsevier, vol. 26(1), pages 88-109, January.
    7. Winter, Joachim, 0000. "Bracketing effects in categorized survey questions and the measurement of economic quantities," Sonderforschungsbereich 504 Publications 02-35, Sonderforschungsbereich 504, Universität Mannheim;Sonderforschungsbereich 504, University of Mannheim.
    8. Lindhjem, Henrik & Navrud, Ståle, 2008. "Asking for Individual or Household Willingness to Pay for Environmental Goods? Implication for aggregate welfare measures," MPRA Paper 11469, University Library of Munich, Germany.
    9. Joachim Winter, 2004. "Response bias in survey-based measures of household consumption," Economics Bulletin, AccessEcon, vol. 3(9), pages 1-12.
    10. Emily Haisley & Romel Mostafa & George Loewenstein, 2008. "Myopic risk-seeking: The impact of narrow decision bracketing on lottery play," Journal of Risk and Uncertainty, Springer, vol. 37(1), pages 57-75, August.
    11. Menon, Geeta & Raghubir, Priya & Schwarz, Norbert, 1995. "Behavioral Frequency Judgments: An Accessibility-Diagnosticity Framework," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 22(2), pages 212-228, September.
    12. Dan Ariely & George Loewenstein & Drazen Prelec, 2003. ""Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 73-106.
    13. Hurd, Michael D, 1999. "Anchoring and Acquiescence Bias in Measuring Assets in Household Surveys," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 111-136, December.
    14. Loomis John & Lockwood Michael & DeLacy Terry, 1993. "Some Empirical Evidence on Embedding Effects in Contingent Valuation of Forest Protection," Journal of Environmental Economics and Management, Elsevier, vol. 25(1), pages 45-55, July.
    15. Hurd, Michael D, 1999. "Anchoring and Acquiescence Bias in Measuring Assets in Household Surveys," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 111-136, December.
    16. Menon, Geeta, 1993. "The Effects of Accessibility of Information in Memory on Judgments of Behavioral Frequency," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 20(3), pages 431-440, December.
    17. Weber, Bethany J. & Chapman, Gretchen B., 2005. "Playing for peanuts: Why is risk seeking more common for low-stakes gambles?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 97(1), pages 31-46, May.
    18. Liam Delaney & Francis O’Toole, 2006. "Willingness to pay: individual or household?," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 30(4), pages 305-309, December.
    19. repec:ebl:ecbull:v:3:y:2004:i:9:p:1-12 is not listed on IDEAS
    20. Peter A. Diamond & Jerry A. Hausman, 1994. "Contingent Valuation: Is Some Number Better than No Number?," Journal of Economic Perspectives, American Economic Association, vol. 8(4), pages 45-64, Fall.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Geary Working Paper - Experimental Tests of Expenditure Response
      by Liam Delaney in Geary Behaviour Centre on 2009-08-12 16:22:00
    2. Bundle: Microeconomic Insights from Citibank Data
      by Martin Ryan in Geary Behaviour Centre on 2011-02-07 03:14:00
    3. Geary Summer Internships
      by Liam Delaney in Geary Behaviour Centre on 2011-02-21 03:27:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Battistin, Erich & De Nadai, Michele & Krishnan, Nandini, 2020. "The Insights and Illusions of Consumption Measurements," IZA Discussion Papers 13222, Institute of Labor Economics (IZA).
    2. Martin Browning & Thomas F. Crossley & Joachim Winter, 2014. "The Measurement of Household Consumption Expenditures," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 475-501, August.
    3. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    4. Thomas F. Crossley & Joachim K. Winter, 2014. "Asking Households about Expenditures: What Have We Learned?," NBER Chapters, in: Improving the Measurement of Consumer Expenditures, pages 23-50, National Bureau of Economic Research, Inc.
    5. Battistin, Erich & De Nadai, Michele & Krishnan, Nandini, 2023. "The insights and illusions of consumption measurements," Journal of Development Economics, Elsevier, vol. 161(C).
    6. Persichina, Marco & Kriström, Bengt, 2022. "Self-selected intervals in psycho-physic experiments and the measurement of willingness to pay," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Powe, N. A. & Bateman, I. J., 2003. "Ordering effects in nested 'top-down' and 'bottom-up' contingent valuation designs," Ecological Economics, Elsevier, vol. 45(2), pages 255-270, June.
    2. Hopfensitz, Astrid, 2009. "Previous outcomes and reference dependence: A meta study of repeated investment tasks with and without restricted feedback," MPRA Paper 16096, University Library of Munich, Germany.
    3. van Soest, A.H.O. & Hurd, M., 2004. "Models for Anchoring and Acquiescence Bias in Consumption Data," Other publications TiSEM 45bba4af-d462-4b9f-a064-b, Tilburg University, School of Economics and Management.
    4. Thomas F. Crossley & Joachim K. Winter, 2014. "Asking Households about Expenditures: What Have We Learned?," NBER Chapters, in: Improving the Measurement of Consumer Expenditures, pages 23-50, National Bureau of Economic Research, Inc.
    5. Schlapfer, Felix & Schmitt, Marcel, 2007. "Anchors, endorsements, and preferences: A field experiment," Resource and Energy Economics, Elsevier, vol. 29(3), pages 229-243, September.
    6. Schlapfer, Felix, 2008. "Contingent valuation: A new perspective," Ecological Economics, Elsevier, vol. 64(4), pages 729-740, February.
    7. Sælensminde, Kjartan, 2003. "Embedding effects in valuation of non-market goods," Transport Policy, Elsevier, vol. 10(1), pages 59-72, January.
    8. Winter, Joachim, 0000. "Bracketing effects in categorized survey questions and the measurement of economic quantities," Sonderforschungsbereich 504 Publications 02-35, Sonderforschungsbereich 504, Universität Mannheim;Sonderforschungsbereich 504, University of Mannheim.
    9. Bateman, Ian J. & Brouwer, Roy, 2006. "Consistency and construction in stated WTP for health risk reductions: A novel scope-sensitivity test," Resource and Energy Economics, Elsevier, vol. 28(3), pages 199-214, August.
    10. Svedsater, Henrik, 2000. "Contingent valuation of global environmental resources: Test of perfect and regular embedding," Journal of Economic Psychology, Elsevier, vol. 21(6), pages 605-623, December.
    11. Hopfensitz, Astrid, 2009. "Previous Outcomes and Reference Dependence: A Meta Study of Repeated Investment Tasks with Restricted Feedback," TSE Working Papers 09-087, Toulouse School of Economics (TSE).
    12. Araña, Jorge E. & León, Carmelo J., 2008. "Do emotions matter? Coherent preferences under anchoring and emotional effects," Ecological Economics, Elsevier, vol. 66(4), pages 700-711, July.
    13. Munro, Alistair, 2007. "When is some number really better than no number? On the optimal choice between non-market valuation methods," MPRA Paper 8978, University Library of Munich, Germany.
    14. Arthur van Soest & Michael Hurd, 2004. "Models for Anchoring and Acquiescence Bias in Consumption Data," NBER Working Papers 10461, National Bureau of Economic Research, Inc.
    15. Amos Schurr & Yaakov Kareev & Judith Avrahami & Ilana Ritov, 2012. "Taking the Broad Perspective: Risky Choices in Repeated Proficiency Tasks," Discussion Paper Series dp621, The Federmann Center for the Study of Rationality, the Hebrew University, Jerusalem.
    16. Butler, Monika & Teppa, Federica, 2005. "Should You Take a Lump-Sum or Annuitize? Results from Swiss Pension Funds," CEPR Discussion Papers 5316, C.E.P.R. Discussion Papers.
    17. Daniel McFadden, 2009. "The human side of mechanism design: a tribute to Leo Hurwicz and Jean-Jacque Laffont," Review of Economic Design, Springer;Society for Economic Design, vol. 13(1), pages 77-100, April.
    18. Lefebvre, Mathieu & Vieider, Ferdinand M. & Villeval, Marie Claire, 2010. "Incentive effects on risk attitude in small probability prospects," Economics Letters, Elsevier, vol. 109(2), pages 115-120, November.
    19. Diane Dupont, 2003. "CVM Embedding Effects When There Are Active, Potentially Active and Passive Users of Environmental Goods," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 25(3), pages 319-341, July.
    20. A. Peter McGraw & Eldar Shafir & Alexander Todorov, 2010. "Valuing Money and Things: Why a $20 Item Can Be Worth More and Less Than $20," Management Science, INFORMS, vol. 56(5), pages 816-830, May.

    More about this item

    Keywords

    survey design; expenditure surveys; data experiments;
    All these keywords.

    JEL classification:

    • D03 - Microeconomics - - General - - - Behavioral Microeconomics: Underlying Principles
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp4389. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.