IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/14436.html
   My bibliography  Save this paper

Not-so-Classical Measurement Errors: A Validation Study of Homescan

Author

Listed:
  • Liran Einav
  • Ephraim Leibtag
  • Aviv Nevo

Abstract

We report results from a validation study of Nielsen Homescan data. We use data from a large grocery chain to match thousands of individual transactions that were recorded by both the retailer (at the store) and the Nielsen Homescan panelist (at home). First, we report how often shopping trips are not reported, and how often trip information, product information, price, and quantity are reported with error. We focus on recording errors in prices, which are more prevalent, and show that they can be classified to two categories, one due to standard recording errors, while the other due to the way Nielsen constructs the price data. We then show how the validation data can be used to correct the impact of recording errors on estimates obtained from Nielsen Homescan data. We use a simple application to illustrate the impact of recording errors as well as the ability to correct for these errors. The application suggests that while recording errors are clearly present, and potentially impact results, corrections, like the one we employ, can be adopted by users of Homescan data to investigate the robustness of their results.

Suggested Citation

  • Liran Einav & Ephraim Leibtag & Aviv Nevo, 2008. "Not-so-Classical Measurement Errors: A Validation Study of Homescan," NBER Working Papers 14436, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:14436
    Note: IO LS ME PR
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w14436.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bound, John & Krueger, Alan B, 1991. "The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 1-24, January.
    2. Einav, Liran & Leibtag, Ephraim S. & Nevo, Aviv, 2008. "On the Accuracy of Nielsen Homescan Data," Economic Research Report 56490, United States Department of Agriculture, Economic Research Service.
    3. Xiaohong Chen & Han Hong & Elie Tamer, 2005. "Measurement Error Models with Auxiliary Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(2), pages 343-366.
    4. Ashenfelter, Orley & Krueger, Alan B, 1994. "Estimates of the Economic Returns to Schooling from a New Sample of Twins," American Economic Review, American Economic Association, vol. 84(5), pages 1157-1173, December.
    5. Christian Broda & David E. Weinstein, 2008. "Understanding International Price Differences Using Barcode Data," NBER Working Papers 14017, National Bureau of Economic Research, Inc.
    6. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    7. Jerry Hausman & Ephraim Leibtag, 2007. "Consumer benefits from increased competition in shopping outlets: Measuring the effect of Wal-Mart," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(7), pages 1157-1177.
    8. Mark Aguiar & Erik Hurst, 2007. "Life-Cycle Prices and Production," American Economic Review, American Economic Association, vol. 97(5), pages 1533-1559, December.
    9. Jean-Pierre Dubé, 2004. "Multiple Discreteness and Product Differentiation: Demand for Carbonated Soft Drinks," Marketing Science, INFORMS, vol. 23(1), pages 66-81, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Noriko Amano, 2018. "Nutrition Inequality: The Role of Prices, Income, and Preferences," 2018 Meeting Papers 453, Society for Economic Dynamics.
    2. Cotti, Chad & Dunn, Richard A. & Tefft, Nathan, 2013. "Alcohol-Related Motor Vehicle Crash Risk and the Location of Alcohol Purchase," Working Paper series 160000, University of Connecticut, Charles J. Zwick Center for Food and Resource Policy.
    3. Cotti, Chad & Dunn, Richard A. & Tefft, Nathan, 2014. "Alcohol-impaired motor vehicle crash risk and the location of alcohol purchase," Social Science & Medicine, Elsevier, vol. 108(C), pages 201-209.
    4. Edward C. Jaenicke & Andrea C. Carlson, 2015. "Estimating and Investigating Organic Premiums for Retail‐Level Food Products," Agribusiness, John Wiley & Sons, Ltd., vol. 31(4), pages 453-471, October.
    5. Ferrier, Peyton & Zhen, Chen, 2014. "Explaining the Shift from Preserved to Fresh Vegetable Consumption," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 170555, Agricultural and Applied Economics Association.
    6. Madani, Fatima & Seenivasan, Satheesh & Ma, Junzhao, 2021. "Determinants of store patronage: The roles of political ideology, consumer and market characteristics," Journal of Retailing and Consumer Services, Elsevier, vol. 63(C).
    7. Chad Cotti & Richard A. Dunn & Chad Cotti, 2015. "The Great Recession and Consumer Demand for Alcohol: A Dynamic Panel-Data Analysis of US Households," American Journal of Health Economics, University of Chicago Press, vol. 1(3), pages 297-325, Summer.
    8. Rhodes, Charles, 2010. "Demographic Variability In U.S. Consumer Responsiveness To Carbonated Soft-Drink Marketing Practices," 115th Joint EAAE/AAEA Seminar, September 15-17, 2010, Freising-Weihenstephan, Germany 116419, European Association of Agricultural Economists.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liran Einav & Ephraim Leibtag & Aviv Nevo, 2010. "Recording discrepancies in Nielsen Homescan data: Are they present and do they matter?," Quantitative Marketing and Economics (QME), Springer, vol. 8(2), pages 207-239, June.
    2. Gutknecht, Daniel, 2011. "Nonclassical Measurement Error in a Nonlinear (Duration) Model," Economic Research Papers 270763, University of Warwick - Department of Economics.
    3. Yingyao Hu & Geert Ridder, 2012. "Estimation of nonlinear models with mismeasured regressors using marginal information," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(3), pages 347-385, April.
    4. An, Yonghong & Hu, Yingyao, 2012. "Well-posedness of measurement error models for self-reported data," Journal of Econometrics, Elsevier, vol. 168(2), pages 259-269.
    5. Mitchell Hoffman & Steven Tadelis, 2021. "People Management Skills, Employee Attrition, and Manager Rewards: An Empirical Analysis," Journal of Political Economy, University of Chicago Press, vol. 129(1), pages 243-285.
    6. Arie Kapteyn & Jelmer Y. Ypma, 2007. "Measurement Error and Misclassification: A Comparison of Survey and Administrative Data," Journal of Labor Economics, University of Chicago Press, vol. 25(3), pages 513-551.
    7. Susanne M. Schennach, 2012. "Measurement error in nonlinear models - a review," CeMMAP working papers 41/12, Institute for Fiscal Studies.
    8. Einav, Liran & Leibtag, Ephraim S. & Nevo, Aviv, 2008. "On the Accuracy of Nielsen Homescan Data," Economic Research Report 56490, United States Department of Agriculture, Economic Research Service.
    9. Yingyao Hu & Susanne M. Schennach, 2008. "Instrumental Variable Treatment of Nonclassical Measurement Error Models," Econometrica, Econometric Society, vol. 76(1), pages 195-216, January.
    10. Aaron Chalfin & Justin McCrary, 2013. "The Effect of Police on Crime: New Evidence from U.S. Cities, 1960-2010," NBER Working Papers 18815, National Bureau of Economic Research, Inc.
    11. John Abowd & Martha Stinson, 2011. "Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Bureau Survey and SSA Administrative Data," Working Papers 11-20, Center for Economic Studies, U.S. Census Bureau.
    12. Richard Volpe & Edward C Jaenicke & Lauren Chenarides, 2018. "Store Formats, Market Structure, and Consumers’ Food Shopping Decisions," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 40(4), pages 672-694, December.
    13. Shiu, Ji-Liang & Hu, Yingyao, 2013. "Identification and estimation of nonlinear dynamic panel data models with unobserved covariates," Journal of Econometrics, Elsevier, vol. 175(2), pages 116-131.
    14. Ekaterina Oparina & Sorawoot Srisuma, 2022. "Analyzing Subjective Well-Being Data with Misclassification," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(2), pages 730-743, April.
    15. de Nicola, Francesca & Giné, Xavier, 2014. "How accurate are recall data? Evidence from coastal India," Journal of Development Economics, Elsevier, vol. 106(C), pages 52-65.
    16. Christopher R. Bollinger & Barry T. Hirsch, 2010. "GDP & Beyond – die europäische Perspektive," RatSWD Working Papers 165, German Data Forum (RatSWD).
    17. Meghir, Costas & Pistaferri, Luigi, 2011. "Earnings, Consumption and Life Cycle Choices," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 9, pages 773-854, Elsevier.
    18. Michele Lalla & Patrizio Frederic & Daniela Mantovani, 2022. "The inextricable association of measurement errors and tax evasion as examined through a microanalysis of survey data matched with fiscal data: a case study," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(5), pages 1375-1401, December.
    19. Dongwoo Kim & Daniel Wilhelm, 2017. "Powerful t-Tests in the presence of nonclassical measurement error," CeMMAP working papers CWP57/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    20. Quinn Moore & Irma Perez-Johnson & Robert Santillano, 2018. "Decomposing Differences in Impacts on Survey- and Administrative-Measured Earnings From a Job Training Voucher Experiment," Evaluation Review, , vol. 42(5-6), pages 515-549, October.

    More about this item

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:14436. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.