IDEAS home Printed from https://ideas.repec.org/p/ubc/bricol/erwin_diewert-2009-48.html
   My bibliography  Save this paper

Scanner Data, Time Aggregation and the Construction of Price Indexes

Author

Listed:
  • Diewert, Erwin
  • Fox, Kevin J.
  • Ivancic, Lorraine

Abstract

The impact of weekly, monthly and quarterly time aggregation on estimates of price change is examined for nineteen different supermarket item categories over a fifteen month period using scanner data. We find that time aggregation choices (the choice of a weekly, monthly or quarterly unit value concept for prices) have a considerable impact on estimates of price change. When chained indexes are used, the difference in price change estimates can be huge, ranging from 0.28% to 29.73% for a superlative (Fisher) index and an incredible 14.88% to 46,463.71% for a non-superlative (Laspeyres) index. The results suggest that traditional index number theory breaks down when weekly data with severe price bouncing are used, even for superlative indexes. Monthly and (in some cases even) quarterly time aggregation were found to be insufficient to eliminate downward drift in superlative indexes. In order to eliminate chain drift, multilateral index number methods are adapted to provide drift free measures of price change.

Suggested Citation

  • Diewert, Erwin & Fox, Kevin J. & Ivancic, Lorraine, 2009. "Scanner Data, Time Aggregation and the Construction of Price Indexes," Economics working papers erwin_diewert-2009-48, Vancouver School of Economics, revised 22 Sep 2009.
  • Handle: RePEc:ubc:bricol:erwin_diewert-2009-48
    as

    Download full text from publisher

    File URL: http://www.econ.ubc.ca/diewert/dp0909.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Chen, Yi Vivian & Heston, Alan & Lipsey, Robert, 2000. "International and interarea comparisons of income, output and prices," Journal of Asian Economics, Elsevier, vol. 11(3), pages 363-364, December.
    2. Mary F. Kokoski & Brent R. Moulton & Kimberly D. Zieschang, 1999. "Interarea Price Comparisons for Heterogeneous Goods and Several Levels of Commodity Aggregation," NBER Chapters, in: International and Interarea Comparisons of Income, Output, and Prices, pages 123-169, National Bureau of Economic Research, Inc.
    3. William J. Hawkes & Frank W. Piotrowski, 2003. "Using Scanner Data to Improve the Quality of Measurement in the Consumer Price Index," NBER Chapters, in: Scanner Data and Price Indexes, pages 17-38, National Bureau of Economic Research, Inc.
    4. Ivancic, Lorraine & Erwin Diewert, W. & Fox, Kevin J., 2011. "Scanner data, time aggregation and the construction of price indexes," Journal of Econometrics, Elsevier, vol. 161(1), pages 24-35, March.
    5. Hill, Robert J., 2006. "Superlative index numbers: not all of them are super," Journal of Econometrics, Elsevier, vol. 130(1), pages 25-43, January.
    6. W. Erwin Diewert, 1999. "Axiomatic and Economic Approaches to International Comparisons," NBER Chapters, in: International and Interarea Comparisons of Income, Output, and Prices, pages 13-107, National Bureau of Economic Research, Inc.
    7. Kravis, Irving B, 1984. "Comparative Studies of National Incomes and Prices," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 1-39, March.
    8. László Drechsler, 1973. "Weighting Of Index Numbers In Multilateral International Comparisons," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 19(1), pages 17-34, March.
    9. Diewert, W Erwin, 1978. "Superlative Index Numbers and Consistency in Aggregation," Econometrica, Econometric Society, vol. 46(4), pages 883-900, July.
    10. Robert C. Feenstra & Matthew D. Shapiro, 2003. "High-Frequency Substitution and the Measurement of Price Indexes," NBER Chapters, in: Scanner Data and Price Indexes, pages 123-146, National Bureau of Economic Research, Inc.
    11. W. Erwin Diewert, 1995. "Axiomatic and Economic Approaches to Elementary Price Indexes," NBER Working Papers 5104, National Bureau of Economic Research, Inc.
    12. Reinsdorf, Marshall B, 1999. "Using Scanner Data to Construct CPI Basic Component Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(2), pages 152-160, April.
    13. Caves, Douglas W & Christensen, Laurits R & Diewert, W Erwin, 1982. "Multilateral Comparisons of Output, Input, and Productivity Using Superlative Index Numbers," Economic Journal, Royal Economic Society, vol. 92(365), pages 73-86, March.
    14. Diewert, W. E., 1976. "Exact and superlative index numbers," Journal of Econometrics, Elsevier, vol. 4(2), pages 115-145, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Haan, Jan & van der Grient, Heymerik A., 2011. "Eliminating chain drift in price indexes based on scanner data," Journal of Econometrics, Elsevier, vol. 161(1), pages 36-46, March.
    2. Neary, J Peter, 2000. "True Multilateral Indexes for International Comparisons of Real Income: Theory and Empirics," CEPR Discussion Papers 2590, C.E.P.R. Discussion Papers.
    3. Daniel Melser & Michael Webster, 2021. "Multilateral Methods, Substitution Bias, and Chain Drift: Some Empirical Comparisons," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(3), pages 759-785, September.
    4. W. Erwin Diewert, 1995. "Price and Volume Measures in the System of National Accounts," NBER Working Papers 5103, National Bureau of Economic Research, Inc.
    5. Diewert, Erwin, 2018. "Scanner Data, Elementary Price Indexes and the Chain Drift Problem," Microeconomics.ca working papers erwin_diewert-2018-10, Vancouver School of Economics, revised 25 Oct 2018.
    6. Sebastian Weinand, 2022. "Measuring spatial price differentials at the basic heading level: a comparison of stochastic index number methods," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 106(1), pages 117-143, March.
    7. Ludwig Auer, 2012. "Räumliche Preisvergleiche: Aggregationskonzepte und Forschungsperspektiven," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 6(1), pages 27-56, December.
    8. Diewert, Erwin & Marandola, Tina, 2018. "Scanner Data, Elementary Price Indexes and the Chain Drift Problem," Microeconomics.ca working papers tina_marandola-2018-9, Vancouver School of Economics, revised 10 Oct 2018.
    9. Barnett, William A. & Erwin Diewert, W. & Zellner, Arnold, 2011. "Introduction to measurement with theory," Journal of Econometrics, Elsevier, vol. 161(1), pages 1-5, March.
    10. Craig, Barbara J. & Pardey, Philip G., 1990. "Multidimensional Output Indices," Staff Papers 13828, University of Minnesota, Department of Applied Economics.
    11. Angus Deaton & Alan Heston, 2010. "Understanding PPPs and PPP-Based National Accounts," American Economic Journal: Macroeconomics, American Economic Association, vol. 2(4), pages 1-35, October.
    12. J. Peter Neary, 2004. "Rationalizing the Penn World Table: True Multilateral Indices for International Comparisons of Real Income," American Economic Review, American Economic Association, vol. 94(5), pages 1411-1428, December.
    13. Neary, P.J., 1996. "True Multilateral Indexex for International Comparisons of Purchasing Power and Real Income," Papers 96/22, College Dublin, Department of Political Economy-.
    14. Laureti, Tiziana & Prasada Rao, D.S., 2018. "Measuring Spatial Price Level Differences within a Country: Current status and Future Developments /Medición de las diferencias de nivel de precios espaciales dentro de un país: Estado actual y evoluc," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 36, pages 119-148, Enero.
    15. Gregory Kurtzon, 2022. "How much does formula versus chaining matter for a cost‐of‐living index? The CPI‐U versus the C‐CPI‐U," Economic Inquiry, Western Economic Association International, vol. 60(2), pages 645-667, April.
    16. Fox, Kevin J. & Syed, Iqbal A., 2016. "Price discounts and the measurement of inflation," Journal of Econometrics, Elsevier, vol. 191(2), pages 398-406.
    17. Jacek Bia{l}ek & Maciej Berk{e}sewicz, 2020. "Scanner data in inflation measurement: from raw data to price indices," Papers 2005.11233, arXiv.org.
    18. Lorraine Ivancic & Kevin J. Fox, 2013. "Understanding Price Variation Across Stores and Supermarket Chains: Some Implications for CPI Aggregation Methods," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 59(4), pages 629-647, December.
    19. Diewert, Erwin, 2007. "Index Numbers," Economics working papers diewert-07-01-03-08-17-23, Vancouver School of Economics, revised 31 Jan 2007.
    20. Diewert, W. Erwin & Fox, Kevin J., 2017. "Substitution Bias in Multilateral Methods for CPI Construction using Scanner Data," Microeconomics.ca working papers erwin_diewert-2017-3, Vancouver School of Economics, revised 23 Mar 2017.

    More about this item

    Keywords

    Price indexes; aggregation; scanner data; chain drift; superlative indexes; unit values; multilateral index number methods; rolling window GEKS; rolli;
    All these keywords.

    JEL classification:

    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • E31 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Price Level; Inflation; Deflation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ubc:bricol:erwin_diewert-2009-48. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.economics.ubc.ca/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Maureen Chin (email available below). General contact details of provider: http://www.economics.ubc.ca/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.