IDEAS home Printed from https://ideas.repec.org/p/tcr/wpaper/e219.html

Challenges in Consumer Price Index Construction

Author

Listed:
  • Chihiro Shimizu
  • W. Erwin Diewert

Abstract

The paper discusses many of the problems that compilers of a Consumer Price Index face. The paper also provides a survey of the four main approaches to bilateral index number theory. These approaches are used by National Statistical Offices to construct their CPIs but these approaches cannot deal with the problems caused by the use of scanner data at the first stage of aggregation. The two main problems are the chain drift problem and the lack of matching problem. In order to deal with these problems, it is necessary to use multilateral index numbers and so seven of the main multilateral methods are explained in the remainder of the paper. The paper concludes with a listing of other challenges to the construction of a CPI. There is some new material on the interpretation of the Commensurability Test and on the Econometric Approach to multilateral index number theory.

Suggested Citation

  • Chihiro Shimizu & W. Erwin Diewert, 2025. "Challenges in Consumer Price Index Construction," Working Papers e219, Tokyo Center for Economic Research.
    • Handle: RePEc:tcr:wpaper:e219
    as

    Download full text from publisher

    File URL: https://www.tcer.or.jp/wp/pdf/e219.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Samuelson, Paul A & Swamy, S, 1974. "Invariant Economic Index Numbers and Canonical Duality: Survey and Synthesis," American Economic Review, American Economic Association, vol. 64(4), pages 566-593, September.
    2. Ivancic, Lorraine & Erwin Diewert, W. & Fox, Kevin J., 2011. "Scanner data, time aggregation and the construction of price indexes," Journal of Econometrics, Elsevier, vol. 161(1), pages 24-35, March.
    3. Chihiro Shimizu & Erwin Diewert, 2023. "Scanner Data, Product Churn and Quality Adjustment," Working Papers e185, Tokyo Center for Economic Research.
    4. Diewert, W E, 1974. "Intertemporal Consumer Theory and the Demand for Durables," Econometrica, Econometric Society, vol. 42(3), pages 497-516, May.
    5. D. S. Prasada Rao, 2005. "On The Equivalence Of Weighted Country‐Product‐Dummy (Cpd) Method And The Rao‐System For Multilateral Price Comparisons," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 51(4), pages 571-580, December.
    6. Feenstra, Robert C, 1994. "New Product Varieties and the Measurement of International Prices," American Economic Review, American Economic Association, vol. 84(1), pages 157-177, March.
    7. Robert B. Archibald, 1977. "On the Theory of Industrial Price Measurement Output Price Indexes," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 6, number 1, pages 57-72, National Bureau of Economic Research, Inc.
    8. W. Erwin Diewert & Chihiro Shimizu, 2022. "Residential Property Price Indexes: Spatial Coordinates Versus Neighborhood Dummy Variables," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 68(3), pages 770-796, September.
    9. Feenstra, Robert C., 1986. "Functional equivalence between liquidity costs and the utility of money," Journal of Monetary Economics, Elsevier, vol. 17(2), pages 271-291, March.
    10. Diewert, W. E., 1976. "Exact and superlative index numbers," Journal of Econometrics, Elsevier, vol. 4(2), pages 115-145, May.
    11. Diewart, W Erwin & Morrison, Catherine J, 1986. "Adjusting Output and Productivity Indexes for Changes in the Terms of Trade," Economic Journal, Royal Economic Society, vol. 96(383), pages 659-679, September.
    12. Hirofumi Uzawa, 1962. "Production Functions with Constant Elasticities of Substitution," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 29(4), pages 291-299.
    13. Pollak, Robert A., 1989. "The Theory of the Cost-of-Living Index," OUP Catalogue, Oxford University Press, number 9780195058703.
    14. Erwin Diewert, 2005. "Weighted Country Product Dummy Variable Regressions And Index Number Formulae," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 51(4), pages 561-570, December.
    15. William A. Barnett, 2000. "Economic Monetary Aggregates: An Application of Index Number and Aggregation Theory," Contributions to Economic Analysis, in: The Theory of Monetary Aggregation, pages 11-48, Emerald Group Publishing Limited.
    16. Fixler, Dennis & Zieschang, Kimberly D, 1991. "Measuring the Nominal Value of Financial Services in the National Income Accounts," Economic Inquiry, Western Economic Association International, vol. 29(1), pages 53-68, January.
    17. W. Erwin Diewert & Jan de Haan & Rens Hendriks, 2015. "Hedonic Regressions and the Decomposition of a House Price Index into Land and Structure Components," Econometric Reviews, Taylor & Francis Journals, vol. 34(1-2), pages 106-126, February.
    18. Fare, Rolf, 1989. "Multilateral Productivity Comparisons When Some Outputs Are Undesirable: A Nonparametric Approach," The Review of Economics and Statistics, MIT Press, vol. 71(1), pages 90-98, February.
    19. Fleurbaey, Marc & Blanchet, Didier, 2013. "Beyond GDP: Measuring Welfare and Assessing Sustainability," OUP Catalogue, Oxford University Press, number 9780199767199.
    20. Pollak, Robert A & Wachter, Michael L, 1975. "The Relevance of the Household Production Function and Its Implications for the Allocation of Time," Journal of Political Economy, University of Chicago Press, vol. 83(2), pages 255-277, April.
    21. de Haan, Jan & van der Grient, Heymerik A., 2011. "Eliminating chain drift in price indexes based on scanner data," Journal of Econometrics, Elsevier, vol. 161(1), pages 36-46, March.
    22. Pittman, Russell W, 1983. "Multilateral Productivity Comparisons with Undesirable Outputs," Economic Journal, Royal Economic Society, vol. 93(372), pages 883-891, December.
    23. Willard C. Fisher, 1913. "The Tabular Standard in Massachusetts History," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 27(3), pages 417-454.
    24. W. Erwin Diewert & Kevin J. Fox, 2022. "Substitution Bias in Multilateral Methods for CPI Construction," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(1), pages 355-369, January.
    25. Sato, Kazuo, 1976. "The Ideal Log-Change Index Number," The Review of Economics and Statistics, MIT Press, vol. 58(2), pages 223-228, May.
    26. Paul Schreyer & W. Erwin Diewert, 2014. "Household Production, Leisure, and Living Standards," NBER Chapters, in: Measuring Economic Sustainability and Progress, pages 89-114, National Bureau of Economic Research, Inc.
    27. W. Erwin Diewert, 1997. "Alternative strategies for aggregating prices in the CPI - commentary," Review, Federal Reserve Bank of St. Louis, issue May, pages 127-138.
    28. Sidney N. Afriat, 1972. "The Theory of International Comparisons of Real Income and Prices," NBER Chapters, in: International Comparisons of Prices and Output, pages 13-84, National Bureau of Economic Research, Inc.
    29. Diewert, Erwin & Feenstra, Robert, 2019. "Estimating the Benefits of New Products: Some Approximations," Microeconomics.ca working papers erwin_diewert-2019-3, Vancouver School of Economics, revised 13 Mar 2019.
    30. E. A. Selvanathan & D. S. Prasada Rao, 1994. "Stochastic Approach to Index Numbers," Palgrave Macmillan Books, in: Index Numbers, chapter 0, pages 47-73, Palgrave Macmillan.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Diewert, Erwin, 2019. "Quality Adjustment and Hedonics: A Unified Approach," Microeconomics.ca working papers erwin_diewert-2019-2, Vancouver School of Economics, revised 14 Mar 2019.
    2. Diewert, W. Erwin, 2017. "Productivity Measurement in the Public Sector: Theory and Practice," Microeconomics.ca working papers erwin_diewert-2017-1, Vancouver School of Economics, revised 02 Feb 2017.
    3. Diewert, W. Erwin & Fox, Kevin J., 2016. "Kevin J. Fox Interview of W. Erwin Diewert," Microeconomics.ca working papers erwin_diewert-2016-6, Vancouver School of Economics, revised 02 Jun 2016.
    4. Diewert, W. Erwin & Fox, Kevin J., 2017. "Substitution Bias in Multilateral Methods for CPI Construction using Scanner Data," Microeconomics.ca working papers erwin_diewert-2017-3, Vancouver School of Economics, revised 23 Mar 2017.
    5. W. Erwin Diewert & Naohito Abe & Akiyuki Tonogi & Chihiro Shimizu, 2025. "Scanner Data and the Construction of Inter‐Regional Price Indexes," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 71(4), November.
    6. Daniel Melser & Michael Webster, 2021. "Multilateral Methods, Substitution Bias, and Chain Drift: Some Empirical Comparisons," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(3), pages 759-785, September.
    7. W. Erwin Diewert, 1995. "Price and Volume Measures in the System of National Accounts," NBER Working Papers 5103, National Bureau of Economic Research, Inc.
    8. W. Erwin Diewert & Robert C. Feenstra, 2021. "Estimating the Benefits of New Products," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 437-473, National Bureau of Economic Research, Inc.
    9. W. Diewert, 2011. "Measuring productivity in the public sector: some conceptual problems," Journal of Productivity Analysis, Springer, vol. 36(2), pages 177-191, October.
    10. W. Erwin Diewert & Kevin J. Fox, 2017. "Decomposing Value Added Growth into Explanatory Factors," Discussion Papers 2017-02, School of Economics, The University of New South Wales.
    11. Abe, Naohito & 阿部, 修人 & Rao, D.S.Prasada, 2020. "Generalized Logarithmic Index Numbers with Demand Shocks: Bridging the Gap between Theory and Practice," RCESR Discussion Paper Series DP20-1, Research Center for Economic and Social Risks, Institute of Economic Research, Hitotsubashi University.
    12. W. Erwin Diewert, 2022. "Scanner Data, Elementary Price Indexes and the Chain Drift Problem," Springer Books, in: Duangkamon Chotikapanich & Alicia N. Rambaldi & Nicholas Rohde (ed.), Advances in Economic Measurement, chapter 0, pages 445-606, Springer.
    13. Adam Gorajek, 2018. "Econometric Perspectives on Economic Measurement," RBA Research Discussion Papers rdp2018-08, Reserve Bank of Australia.
    14. Gholamreza Hajargasht, 2022. "Reliability of Ideal Indexes," Papers 2210.13684, arXiv.org.
    15. Daniel Melser, 2019. "Valuing the quantity and quality of product variety to consumers," Empirical Economics, Springer, vol. 57(6), pages 2107-2128, December.
    16. Diewert, Erwin & Fox, Kevin J., 2019. "Productivity Indexes and National Statistics: Theory, Methods and Challenges," Microeconomics.ca working papers erwin_diewert-2019-8, Vancouver School of Economics, revised 25 Apr 2019.
    17. Diewert, Erwin & Marandola, Tina, 2018. "Scanner Data, Elementary Price Indexes and the Chain Drift Problem," Microeconomics.ca working papers tina_marandola-2018-9, Vancouver School of Economics, revised 10 Oct 2018.
    18. Paul Schreyer, 2021. "Framing Measurement Beyond GDP," CEPA Working Papers Series WP172021, School of Economics, University of Queensland, Australia.
    19. Diewert, Erwin & Feenstra, Robert, 2019. "Estimating the Benefits of New Products: Some Approximations," Microeconomics.ca working papers erwin_diewert-2019-3, Vancouver School of Economics, revised 13 Mar 2019.
    20. Kozo Ueda & Kota Watanabe & Tsutomu Watanabe, 2024. "Household Inventory, Temporary Sales, Price Indices," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 65(1), pages 217-251, February.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tcr:wpaper:e219. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/tctokjp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.