IDEAS home Printed from
MyIDEAS: Log in (now much improved!) to save this paper

An analysis of consumer panel data

Listed author(s):
  • Andrew Leicester


    (Institute for Fiscal Studies)

  • Zoe Oldfield


    (Institute for Fiscal Studies and Institute for Fiscal Studies)

In terms of collecting comprehensive panel expenditure data, there are trade-offs to be made in terms of the demands imposed on respondents and the level of detail and spending coverage collected. Existing comprehensive spending data tends to be cross-sectional whilst panel studies include only limited expenditure questions that record spending only as broad aggregates. More recently, economists have begun to use spending information collected by market research companies that records very detailed spending down to the barcode level from a panel of households, usually recorded by in-home barcode scanners, which may provide considerable advantages over existing data more commonly used in social sciences. However, there has not been a comprehensive assessment of the strengths and weaknesses of this kind of data collection method and the potential implications of survey mode on the recorded data. This paper seeks to address this, by an in-depth examination of scanner data from one company, Taylor Nelson Sofres (TNS), on grocery purchases over a five-year period. We assess how far the ongoing demands of participation inherent in this kind of survey lead to 'fatigue' in respondents' recording of their spending and compare the demographic representativeness of the data to the well-established Expenditure and Food Survey (EFS), constructing weights for the TNS that account for observed demographic differences. We also look at demographic transitions, comparing the panel aspect of the TNS to the British Household Panel Study (BHPS). We examine in detail the expenditure data in the TNS and EFS surveys and discuss the implications of this method of data collection for survey attrition. Broadly, we suggest that problems of fatigue and attrition may not be so severe as may be expected, though there are some differences in expenditure levels (and to some extent patterns of spending) that cannot be attributed to demographic or time differences in the two surveys alone and may be suggestive of survey mode effects. Demographic transitions appear to occur less frequently than we might expect which may limit the usefulness of the panel aspect of the data for some applications.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by Institute for Fiscal Studies in its series IFS Working Papers with number W09/09.

in new window

Date of creation: 02 Apr 2009
Handle: RePEc:ifs:ifsewp:09/09
Contact details of provider: Postal:
The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE

Phone: (+44) 020 7291 4800
Fax: (+44) 020 7323 4780
Web page:

More information through EDIRC

Order Information: Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE

No references listed on IDEAS
You can help add them by filling out this form.

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:ifs:ifsewp:09/09. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Emma Hyman)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.