IDEAS home Printed from https://ideas.repec.org/a/bla/revinw/v67y2021i2p394-417.html
   My bibliography  Save this article

Price Measurement Using Scanner Data: Time‐Product Dummy Versus Time Dummy Hedonic Indexes

Author

Listed:
  • Jan de Haan
  • Rens Hendriks
  • Michael Scholz

Abstract

This paper compares two model‐based multilateral price indexes: the time‐product dummy (TPD) index and the time dummy hedonic (TDH) index, both estimated by expenditure‐share weighted least squares regression. The TPD model can be viewed as the saturated version of the underlying TDH model, and we argue that the regression residuals are “distorted toward zero” due to overfitting. We decompose the ratio of the two indexes in terms of average regression residuals of the new and disappearing items. The decomposition aims to explain the conditions under which the TPD index suffers from quality‐change bias or, more generally, lack‐of‐matching bias. An example using scanner data on packaged men's T‐shirts illustrates our framework.

Suggested Citation

  • Jan de Haan & Rens Hendriks & Michael Scholz, 2021. "Price Measurement Using Scanner Data: Time‐Product Dummy Versus Time Dummy Hedonic Indexes," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(2), pages 394-417, June.
    • Handle: RePEc:bla:revinw:v:67:y:2021:i:2:p:394-417
    DOI: 10.1111/roiw.12468
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/roiw.12468
    Download Restriction: no
    File URL: https://libkey.io/10.1111/roiw.12468?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mark Bils, 2009. "Do Higher Prices for New Goods Reflect Quality Growth or Inflation?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 637-675.
    2. Harvey, A C, 1976. "Estimating Regression Models with Multiplicative Heteroscedasticity," Econometrica, Econometric Society, vol. 44(3), pages 461-465, May.
    3. Ivancic, Lorraine & Erwin Diewert, W. & Fox, Kevin J., 2011. "Scanner data, time aggregation and the construction of price indexes," Journal of Econometrics, Elsevier, vol. 161(1), pages 24-35, March.
    4. Robert Summers, 1973. "International Price Comparisons Based Upon Incomplete Data," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 19(1), pages 1-16, March.
    5. Gary Solon & Steven J. Haider & Jeffrey M. Wooldridge, 2015. "What Are We Weighting For?," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 301-316.
    6. Silver, Mick & Heravi, Saeed, 2005. "A Failure in the Measurement of Inflation: Results From a Hedonic and Matched Experiment Using Scanner Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 269-281, July.
    7. Daniel Melser & Iqbal A. Syed, 2016. "Life Cycle Price Trends and Product Replacement: Implications for the Measurement of Inflation," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 62(3), pages 509-533, September.
    8. Nobuhiro Abe & Yojiro Ito & Ko Munakata & Shinsuke Ohyama & Kimiaki Shinozaki, 2016. "Pricing Patterns over Product Life-Cycle and Quality Growth at Product Turnover: Empirical Evidence from Japan," Bank of Japan Working Paper Series 16-E-5, Bank of Japan.
    9. Reinsdorf, Marshall B, 1999. "Using Scanner Data to Construct CPI Basic Component Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(2), pages 152-160, April.
    10. W. Erwin Diewert & Saeed Heravi & Mick Silver, 2009. "Hedonic Imputation versus Time Dummy Hedonic Indexes," NBER Chapters, in: Price Index Concepts and Measurement, pages 161-196, National Bureau of Economic Research, Inc.
    11. W. Erwin Diewert & John S. Greenlees & Charles R. Hulten, 2009. "Price Index Concepts and Measurement," NBER Books, National Bureau of Economic Research, Inc, number diew08-1, March.
    12. Diewert, W. Erwin & Fox, Kevin J., 2017. "Substitution Bias in Multilateral Methods for CPI Construction using Scanner Data," Microeconomics.ca working papers erwin_diewert-2017-3, Vancouver School of Economics, revised 23 Mar 2017.
    13. Erwin Diewert, 2005. "Weighted Country Product Dummy Variable Regressions And Index Number Formulae," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 51(4), pages 561-570, December.
    14. Jan de Haan & Frances Krsinich, 2014. "Scanner Data and the Treatment of Quality Change in Nonrevisable Price Indexes," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(3), pages 341-358, July.
    15. Kennedy, Peter E, 1981. "Estimation with Correctly Interpreted Dummy Variables in Semilogarithmic Equations [The Interpretation of Dummy Variables in Semilogarithmic Equations]," American Economic Review, American Economic Association, vol. 71(4), pages 801-801, September.
    16. de Haan, Jan & van der Grient, Heymerik A., 2011. "Eliminating chain drift in price indexes based on scanner data," Journal of Econometrics, Elsevier, vol. 161(1), pages 36-46, March.
    17. Kevin J. Fox & Daniel Melser, 2014. "Non-Linear Pricing and Price Indexes: Evidence and Implications from Scanner Data," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 60(2), pages 261-278, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Masahiro Higo & Shigenori Shiratsuka, 2022. "Was Inflation Observed under the First Wave of the COVID-19 Spread in Japan? Scanner Data Evidence for Retailers in Tokyo," Keio-IES Discussion Paper Series 2022-013, Institute for Economics Studies, Keio University.
    2. Beck, Günter W. & Carstensen, Kai & Menz, Jan-Oliver & Schnorrenberger, Richard & Wieland, Elisabeth, 2023. "Nowcasting consumer price inflation using high-frequency scanner data: Evidence from Germany," Discussion Papers 34/2023, Deutsche Bundesbank.
    3. Jacek Białek, 2023. "Improving quality of the scanner CPI: proposition of new multilateral methods," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(3), pages 2893-2921, June.
    4. Higo, Masahiro & Shiratsuka, Shigenori, 2023. "Consumer price measurement under the first wave of the COVID-19 spread in Japan: Scanner data evidence for retailers in Tokyo," Japan and the World Economy, Elsevier, vol. 65(C).
    5. von Auer, Ludwig & Weinand, Sebastian, 2022. "A nonlinear generalization of the country-product-dummy method," Discussion Papers 45/2022, Deutsche Bundesbank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jan de Haan & Rens Hendriks & Michael Scholz, 2016. "A Comparison of Weighted Time-Product Dummy and Time Dummy Hedonic Indexes," Graz Economics Papers 2016-13, University of Graz, Department of Economics.
    2. Diewert, Erwin, 2019. "Quality Adjustment and Hedonics: A Unified Approach," Microeconomics.ca working papers erwin_diewert-2019-2, Vancouver School of Economics, revised 14 Mar 2019.
    3. Adam Gorajek, 2018. "Econometric Perspectives on Economic Measurement," RBA Research Discussion Papers rdp2018-08, Reserve Bank of Australia.
    4. Daniel Melser & Iqbal A. Syed, 2016. "Life Cycle Price Trends and Product Replacement: Implications for the Measurement of Inflation," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 62(3), pages 509-533, September.
    5. Iqbal A. Syed & Jan De Haan, 2017. "Age, Time, Vintage, And Price Indexes: Measuring The Depreciation Pattern Of Houses," Economic Inquiry, Western Economic Association International, vol. 55(1), pages 580-600, January.
    6. Daniel Melser & Michael Webster, 2021. "Multilateral Methods, Substitution Bias, and Chain Drift: Some Empirical Comparisons," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(3), pages 759-785, September.
    7. Silver Mick, 2022. "Econometric Issues in Hedonic Property Price Indices: Some Practical Help," Journal of Official Statistics, Sciendo, vol. 38(1), pages 153-186, March.
    8. Daniel Melser & Iqbal A. Syed, 2017. "The product life cycle and sample representativity bias in price indexes," Applied Economics, Taylor & Francis Journals, vol. 49(6), pages 573-586, February.
    9. Diewert, W. Erwin & Fox, Kevin J., 2016. "Kevin J. Fox Interview of W. Erwin Diewert," Microeconomics.ca working papers erwin_diewert-2016-6, Vancouver School of Economics, revised 02 Jun 2016.
    10. Kozo Ueda & Kota Watanabe & Tsutomu Watanabe, 2021. "Household Inventory, Temporary Sales, and Price Indices," CARF F-Series CARF-F-520, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    11. Robert J. Hill & Iqbal A. Syed, 2012. "Accounting for Unrepresentative Products and Urban-Rural Price Differences in International Comparisons of Real Income: An Application to the Asia-Pacific Region," Graz Economics Papers 2012-07, University of Graz, Department of Economics.
    12. Daniel Melser & Iqbal A. Syed, 2013. "Prices over the Product Life Cycle: Implications for Quality-Adjustment and the Measurement of Inflation," Discussion Papers 2013-26, School of Economics, The University of New South Wales.
    13. Mick Silver, 2016. "How to Better Measure Hedonic Residential Property Price Indexes," IMF Working Papers 2016/213, International Monetary Fund.
    14. Lorraine Ivancic & Kevin J. Fox, 2013. "Understanding Price Variation Across Stores and Supermarket Chains: Some Implications for CPI Aggregation Methods," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 59(4), pages 629-647, December.
    15. Diewert, W. Erwin & Fox, Kevin J. & de Haan, Jan, 2016. "A newly identified source of potential CPI bias: Weekly versus monthly unit value price indexes," Economics Letters, Elsevier, vol. 141(C), pages 169-172.
    16. Diewert, Erwin & Shimizu, Chihiro, 2015. "Residential Property Price Indices For Tokyo," Macroeconomic Dynamics, Cambridge University Press, vol. 19(8), pages 1659-1714, December.
    17. Diewert, W. Erwin & Fox, Kevin J., 2017. "Substitution Bias in Multilateral Methods for CPI Construction using Scanner Data," Microeconomics.ca working papers erwin_diewert-2017-3, Vancouver School of Economics, revised 23 Mar 2017.
    18. Tsutomu Watanabe & Tomoyoshi Yabu, 2018. "The Demand for Money at the Zero Interest Rate Bound," CARF F-Series CARF-F-444, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    19. Erica L. Groshen & Brian C. Moyer & Ana M. Aizcorbe & Ralph Bradley & David M. Friedman, 2017. "How Government Statistics Adjust for Potential Biases from Quality Change and New Goods in an Age of Digital Technologies: A View from the Trenches," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 187-210, Spring.
    20. Bentley Alan, 2022. "Rentals for Housing: A Property Fixed-Effects Estimator of Inflation from Administrative Data," Journal of Official Statistics, Sciendo, vol. 38(1), pages 187-211, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:revinw:v:67:y:2021:i:2:p:394-417. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/iariwea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.