IDEAS home Printed from https://ideas.repec.org/p/ifs/ifsewp/23-29.html
   My bibliography  Save this paper

Inflation measurement with high frequency data

Author

Listed:
  • Kevin J. Fox

    (UNSW Sydney)

  • Peter Levell

    (Institute for Fiscal Studies)

  • Martin O'Connell

    (Institute for Fiscal Studies)

Abstract

The availability of large transaction level datasets, such as retail scanner data, provides a wealth of information on prices and quantities that national statistical institutes can use to produce more accurate, timely, measures of inflation. However, there is no universally agreed upon method for calculating price indexes with such high frequency data, reflecting a lack of systematic evidence on the performance of different approaches. We use a dataset that covers 178 product categories comprising all fast-moving consumer goods over 8 years to provide a systematic comparison of the leading bilateral and multilateral index number methods for computing month-to-month inflation.

Suggested Citation

  • Kevin J. Fox & Peter Levell & Martin O'Connell, 2023. "Inflation measurement with high frequency data," IFS Working Papers W23/29, Institute for Fiscal Studies.
    • Handle: RePEc:ifs:ifsewp:23/29
    as

    Download full text from publisher

    File URL: https://ifs.org.uk/sites/default/files/2023-10/WP202329-Inflation-measurement-with-high-frequency-data.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Christian Broda & David E. Weinstein, 2010. "Product Creation and Destruction: Evidence and Price Implications," American Economic Review, American Economic Association, vol. 100(3), pages 691-723, June.
    2. Emi Nakamura & Jón Steinsson, 2013. "Price Rigidity: Microeconomic Evidence and Macroeconomic Implications," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 133-163, May.
    3. W. Erwin Diewert & Kevin J. Fox, 2022. "Substitution Bias in Multilateral Methods for CPI Construction," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(1), pages 355-369, January.
    4. Daniel Melser & Michael Webster, 2021. "Multilateral Methods, Substitution Bias, and Chain Drift: Some Empirical Comparisons," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(3), pages 759-785, September.
    5. Olivier Coibion & Yuriy Gorodnichenko & Rupal Kamdar, 2018. "The Formation of Expectations, Inflation, and the Phillips Curve," Journal of Economic Literature, American Economic Association, vol. 56(4), pages 1447-1491, December.
    6. Ivancic, Lorraine & Erwin Diewert, W. & Fox, Kevin J., 2011. "Scanner data, time aggregation and the construction of price indexes," Journal of Econometrics, Elsevier, vol. 161(1), pages 24-35, March.
    7. Kaplan, Greg & Schulhofer-Wohl, Sam, 2017. "Inflation at the household level," Journal of Monetary Economics, Elsevier, vol. 91(C), pages 19-38.
    8. Robert J. Hill, 1999. "Comparing Price Levels across Countries Using Minimum-Spanning Trees," The Review of Economics and Statistics, MIT Press, vol. 81(1), pages 135-142, February.
    9. de Haan, Jan & van der Grient, Heymerik A., 2011. "Eliminating chain drift in price indexes based on scanner data," Journal of Econometrics, Elsevier, vol. 161(1), pages 36-46, March.
    10. Olivier Coibion & Yuriy Gorodnichenko & Gee Hee Hong, 2015. "The Cyclicality of Sales, Regular and Effective Prices: Business Cycle and Policy Implications," American Economic Review, American Economic Association, vol. 105(3), pages 993-1029, March.
    11. Jaravel, Xavier & O'Connell, Martin, 2020. "Real-time price indices: Inflation spike and falling product variety during the Great Lockdown," Journal of Public Economics, Elsevier, vol. 191(C).
    12. Hill, Robert J, 2001. "Measuring Inflation and Growth Using Spanning Trees," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 42(1), pages 167-185, February.
    13. Jessie Handbury & Tsutomu Watanabe & David E. Weinstein, 2013. "How Much Do Official Price Indexes Tell Us about Inflation?," NBER Working Papers 19504, National Bureau of Economic Research, Inc.
    14. Inklaar, Robert & Diewert, W. Erwin, 2016. "Measuring industry productivity and cross-country convergence," Journal of Econometrics, Elsevier, vol. 191(2), pages 426-433.
    15. Caves, Douglas W & Christensen, Laurits R & Diewert, W Erwin, 1982. "Multilateral Comparisons of Output, Input, and Productivity Using Superlative Index Numbers," Economic Journal, Royal Economic Society, vol. 92(365), pages 73-86, March.
    16. Diewert, W. E., 1976. "Exact and superlative index numbers," Journal of Econometrics, Elsevier, vol. 4(2), pages 115-145, May.
    17. Diewert, W. Erwin & Fox, Kevin J. & de Haan, Jan, 2016. "A newly identified source of potential CPI bias: Weekly versus monthly unit value price indexes," Economics Letters, Elsevier, vol. 141(C), pages 169-172.
    18. Martin Eichenbaum & Nir Jaimovich & Sergio Rebelo, 2011. "Reference Prices, Costs, and Nominal Rigidities," American Economic Review, American Economic Association, vol. 101(1), pages 234-262, February.
    19. Xavier Jaravel, 2019. "The Unequal Gains from Product Innovations: Evidence from the U.S. Retail Sector," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(2), pages 715-783.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Robert J. Hill & Norbert Pfeifer & Miriam Steurer, 2025. "Spatial Rent Indices for Cities Around the World: A Comparison of Airbnb and Long-Term Rentals," Graz Economics Papers 2025-01, University of Graz, Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Diewert, W. Erwin & Fox, Kevin J., 2017. "Substitution Bias in Multilateral Methods for CPI Construction using Scanner Data," Microeconomics.ca working papers erwin_diewert-2017-3, Vancouver School of Economics, revised 23 Mar 2017.
    2. Martin O'Connell & Pierre Dubois & Rachel Griffith, 2022. "The Use of Scanner Data for Economics Research," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 723-745, August.
    3. Fox, Kevin J. & Syed, Iqbal A., 2016. "Price discounts and the measurement of inflation," Journal of Econometrics, Elsevier, vol. 191(2), pages 398-406.
    4. Diewert, W. Erwin & Fox, Kevin J., 2016. "Kevin J. Fox Interview of W. Erwin Diewert," Microeconomics.ca working papers erwin_diewert-2016-6, Vancouver School of Economics, revised 02 Jun 2016.
    5. Kevin J, Fox. & Iqbal A. Syed, 2016. "Price Discounts and the Measurement of Inflation: Further Results," Discussion Papers 2016-05, School of Economics, The University of New South Wales.
    6. Tao Chen & Peter Levell & Martin O'Connell, 2024. "Cheapflation and the rise of inflation inequality," IFS Working Papers W36, Institute for Fiscal Studies.
    7. W. Erwin Diewert, 2022. "Scanner Data, Elementary Price Indexes and the Chain Drift Problem," Springer Books, in: Duangkamon Chotikapanich & Alicia N. Rambaldi & Nicholas Rohde (ed.), Advances in Economic Measurement, chapter 0, pages 445-606, Springer.
    8. Diewert, Erwin & Marandola, Tina, 2018. "Scanner Data, Elementary Price Indexes and the Chain Drift Problem," Microeconomics.ca working papers tina_marandola-2018-9, Vancouver School of Economics, revised 10 Oct 2018.
    9. Glandon, PJ, 2018. "Sales and the (Mis)measurement of price level fluctuations," Journal of Macroeconomics, Elsevier, vol. 58(C), pages 60-77.
    10. Jacek Bia{l}ek & Maciej Berk{e}sewicz, 2020. "Scanner data in inflation measurement: from raw data to price indices," Papers 2005.11233, arXiv.org.
    11. Jaravel, Xavier & O'Connell, Martin, 2020. "Real-time price indices: Inflation spike and falling product variety during the Great Lockdown," Journal of Public Economics, Elsevier, vol. 191(C).
    12. Jacek Białek, 2023. "Improving quality of the scanner CPI: proposition of new multilateral methods," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(3), pages 2893-2921, June.
    13. Xavier Jaravel & Martin O'Connell, 2020. "High‐Frequency Changes in Shopping Behaviours, Promotions and the Measurement of Inflation: Evidence from the Great Lockdown," Fiscal Studies, John Wiley & Sons, vol. 41(3), pages 733-755, September.
    14. Kozo Ueda & Kota Watanabe & Tsutomu Watanabe, 2020. "Consumer Inventory and the Cost of Living Index: Theory and Some Evidence from Japan," Working Papers on Central Bank Communication 025, University of Tokyo, Graduate School of Economics.
    15. Cavallo, Alberto & Kryvtsov, Oleksiy, 2024. "Price discounts and cheapflation during the post-pandemic inflation surge," Journal of Monetary Economics, Elsevier, vol. 148(S).
    16. Kevin J. Fox & Peter Levell & Martin O'Connell, 2022. "Multilateral index number methods for Consumer Price Statistics," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2022-08, Economic Statistics Centre of Excellence (ESCoE).
    17. Sweitzer, Megan & Byrne, Anne T. & Page, Elina T. & Carlson, Andrea & Kantor, Linda & Muth, Mary K. & Karns, Shawn & Zhen, Chen, 2024. "Development of the Food-at-Home Monthly Area Prices Data," Technical Bulletins 342467, United States Department of Agriculture, Economic Research Service.
    18. Chihiro Shimizu & Erwin Diewert & Naohito Abe & Akiyuki Tonogi, 2025. "Scanner Data and the Construction of Inter-Regional Price Indexes," Working Papers e211, Tokyo Center for Economic Research.
    19. Diewert, W. Erwin, 2017. "Productivity Measurement in the Public Sector: Theory and Practice," Microeconomics.ca working papers erwin_diewert-2017-1, Vancouver School of Economics, revised 02 Feb 2017.
    20. Daniel Melser & Michael Webster, 2021. "Multilateral Methods, Substitution Bias, and Chain Drift: Some Empirical Comparisons," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(3), pages 759-785, September.

    More about this item

    JEL classification:

    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • E31 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Price Level; Inflation; Deflation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:ifsewp:23/29. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.