Scanner Data, Time Aggregation and the Construction of Price Indexes
AbstractThe impact of weekly, monthly and quarterly time aggregation on estimates of price change is examined for nineteen different supermarket item categories over a fifteen month period using scanner data. We find that time aggregation choices (the choice of a weekly, monthly or quarterly unit value concept for prices) have a considerable impact on estimates of price change. When chained indexes are used, the difference in price change estimates can be huge, ranging from 0.28% to 29.73% for a superlative (Fisher) index and an incredible 14.88% to 46,463.71% for a non-superlative (Laspeyres) index. The results suggest that traditional index number theory breaks down when weekly data with severe price bouncing are used, even for superlative indexes. Monthly and (in some cases even) quarterly time aggregation were found to be insufficient to eliminate downward drift in superlative indexes. In order to eliminate chain drift, multilateral index number methods are adapted to provide drift free measures of price change.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by UBC Department of Economics in its series UBC Departmental Archives with number erwin_diewert-2009-48.
Length: 51 pages
Date of creation: 22 Sep 2009
Date of revision: 22 Sep 2009
Contact details of provider:
Price indexes; aggregation; scanner data; chain drift; superlative indexes; unit values; multilateral index number methods; rolling window GEKS; rolli;
Other versions of this item:
- Ivancic, Lorraine & Erwin Diewert, W. & Fox, Kevin J., 2011. "Scanner data, time aggregation and the construction of price indexes," Journal of Econometrics, Elsevier, vol. 161(1), pages 24-35, March.
- C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
- E31 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Price Level; Inflation; Deflation
This paper has been announced in the following NEP Reports:
- NEP-ALL-2009-09-26 (All new papers)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- W. Erwin Diewert, 1996.
"Axiomatic and Economic Approaches to International Comparisons,"
NBER Working Papers
5559, National Bureau of Economic Research, Inc.
- W. Erwin Diewert, 1999. "Axiomatic and Economic Approaches to International Comparisons," NBER Chapters, in: International and Interarea Comparisons of Income, Output, and Prices, pages 13-107 National Bureau of Economic Research, Inc.
- Diewert, W. Erwin, . "Axiomatic and Economic Approaches to International Comparisons," Old UBC Departmental Papers 9611, UBC Department of Economics.
- Robert C. Feenstra & Matthew D. Shapiro, 2003.
"High-Frequency Substitution and the Measurement of Price Indexes,"
in: Scanner Data and Price Indexes, pages 123-150
National Bureau of Economic Research, Inc.
- Robert C. Feenstra & Matthew D. Shapiro, 2001. "High-Frequency Substitution and the Measurement of Price Indexes," NBER Working Papers 8176, National Bureau of Economic Research, Inc.
- Diewert, W Erwin, 1978. "Superlative Index Numbers and Consistency in Aggregation," Econometrica, Econometric Society, vol. 46(4), pages 883-900, July.
- Reinsdorf, Marshall B, 1999. "Using Scanner Data to Construct CPI Basic Component Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(2), pages 152-60, April.
- Mary F. Kokoski & Brent R. Moulton & Kimberly D. Zieschang, 1999. "Interarea Price Comparisons for Heterogeneous Goods and Several Levels of Commodity Aggregation," NBER Chapters, in: International and Interarea Comparisons of Income, Output, and Prices, pages 123-169 National Bureau of Economic Research, Inc.
- W. Erwin Diewert, 1995. "Axiomatic and Economic Approaches to Elementary Price Indexes," NBER Working Papers 5104, National Bureau of Economic Research, Inc.
- Drechsler, Laszlo, 1973. "Weighting of Index Numbers in Multilateral International Comparisons," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 19(1), pages 17-34, March.
- Caves, Douglas W & Christensen, Laurits R & Diewert, W Erwin, 1982. "Multilateral Comparisons of Output, Input, and Productivity Using Superlative Index Numbers," Economic Journal, Royal Economic Society, vol. 92(365), pages 73-86, March.
- Kravis, Irving B, 1984. "Comparative Studies of National Incomes and Prices," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 1-39, March.
- William J. Hawkes & Frank W. Piotrowski, 2003. "Using Scanner Data to Improve the Quality of Measurement in the Consumer Price Index," NBER Chapters, in: Scanner Data and Price Indexes, pages 17-38 National Bureau of Economic Research, Inc.
- Hill, Robert J., 2006. "Superlative index numbers: not all of them are super," Journal of Econometrics, Elsevier, vol. 130(1), pages 25-43, January.
- Diewert, W. E., 1976. "Exact and superlative index numbers," Journal of Econometrics, Elsevier, vol. 4(2), pages 115-145, May.
- Berka, Martin & Devereux, Michael B. & Rudolph, Thomas, 2011.
"Price setting in a leading Swiss online supermarket,"
Working Paper Series
1685, Victoria University of Wellington, School of Economics and Finance.
- Martin Berka & Michael B. Devereux & Thomas Rudolph, 2011. "Price setting in a leading Swiss online supermarket," CAMA Working Papers 2011-19, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Martin Berka & Michael B. Devereux & Thomas Rudolph, 2011. "Price setting in a leading Swiss online supermarket," Globalization and Monetary Policy Institute Working Paper 83, Federal Reserve Bank of Dallas.
- Martin Berka & Michael B. Devereux & Thomas Rudolph, 2011. "Price Setting in a Leading Swiss Online Supermarket," NBER Working Papers 17126, National Bureau of Economic Research, Inc.
- Ivancic, Lorraine & Fox, Kevin J., 2013.
"Can dissimilarity indexes resolve the issue of when to chain price indexes?,"
Elsevier, vol. 118(1), pages 6-9.
- Lorraine Ivancic & Kevin J. Fox, 2010. "Can Dissimilarity Indexes Resolve the Issue of When to Chain Price Indexes?," Discussion Papers 2010-16, School of Economics, The University of New South Wales.
- Abe, Naohito & Moriguchi, Chiaki & Inakura, Noriko, 2012. "The Great East Japan Earthquake and its Short-run Effects on Household Purchasing Behavior," Research Center for Price Dynamics Working Paper Series 2, Research Center for Price Dynamics, Institute of Economic Research, Hitotsubashi University.
- Marcelo Delajara & José Antonio Murillo Garza, 2012. "Weekday with Low Prices: Evidence on Daily Seasonality of Foods, Beverages, and Tobacco Prices," Working Papers 2012-09, Banco de México.
- von der Lippe, Peter, 2012. "Notes on GEKS and RGEKS indices," MPRA Paper 42730, University Library of Munich, Germany.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Maureen Chin).
If references are entirely missing, you can add them using this form.