Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Bureau Survey and SSA Administrative Data
We quantify sources of variation in annual job earnings data collected by the Survey of Income and Program Participation (SIPP) to determine how much of the variation is the result of measurement error. Jobs reported in the SIPP are linked to jobs reported in an administrative database, the Detailed Earnings Records (DER) drawn from the Social Security Administration’s Master Earnings File, a universe file of all earnings reported on W-2 tax forms. As a result of the match, each job potentially has two earnings observations per year: survey and administrative. Unlike previous validation studies, both of these earnings measures are viewed as noisy measures of some underlying true amount of annual earnings. While the existence of survey error resulting from respondent mistakes or misinterpretation is widely accepted, the idea that administrative data are also error-prone is new. Possible sources of employer reporting error, employee under-reporting of compensation such as tips, and general differences between how earnings may be reported on tax forms and in surveys, necessitates the discarding of the assumption that administrative data are a true measure of the quantity that the survey was designed to collect. In addition, errors in matching SIPP and DER jobs, a necessary task in any use of administrative data, also contribute to measurement error in both earnings variables. We begin by comparing SIPP and DER earnings for different demographic and education groups of SIPP respondents. We also calculate different measures of changes in earnings for individuals switching jobs. We estimate a standard earnings equation model using SIPP and DER earnings and compare the resulting coefficients. Finally exploiting the presence of individuals with multiple jobs and shared employers over time, we estimate an econometric model that includes random person and firm effects, a common error component shared by SIPP and DER earnings, and two independent error components that represent the variation unique to each earnings measure. We compare the variance components from this model and consider how the DER and SIPP differ across unobservable components.
|Date of creation:||Jul 2011|
|Date of revision:|
|Contact details of provider:|| Postal: 4600 Silver Hill Road, Washington, DC 20233|
Phone: (301) 763-6460
Fax: (301) 763-5935
Web page: http://www.census.gov/ces
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- John M. Abowd & Lars Vilhuber, 2002.
"The Sensitivity of Economic Statistics to Coding Errors in Personal Identifiers,"
Longitudinal Employer-Household Dynamics Technical Papers
2002-17, Center for Economic Studies, U.S. Census Bureau, revised Mar 2003.
- Abowd, John M. & Vilhuber, Lars, 2005. "The Sensitivity of Economic Statistics to Coding Errors in Personal Identifiers," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 133-152, April.
- John M. Abowd & Francis Kramarz & David N. Margolis, 1999.
"High Wage Workers and High Wage Firms,"
Econometric Society, vol. 67(2), pages 251-334, March.
- John M. Abowd & Francis Kramarz & David N. Margolis, 1994. "High Wage Workers and High Wage Firms," NBER Working Papers 4917, National Bureau of Economic Research, Inc.
- Abowd, J.M. & Kramarz, F. & Margolis, D.N., 1995. "High-Wage Workers and High-Wage Firms," Cahiers de recherche 9503, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
- John M. Abowd & Francis Kramarz & David N. Margolis, 1994. "High-Wage Workers and High-Wage Firms," CIRANO Working Papers 94s-23, CIRANO.
- John M. Abowd & Francis Kramarz & David Margolis, 1999. "High Wage Workers and High Wage Firms," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00353892, HAL.
- Abowd, J.M. & Kramarz, F. & Margolis, D.N., 1995. "High-Wage Workers and High-Wage Firms," Cahiers de recherche 9503, Universite de Montreal, Departement de sciences economiques.
- David Margolis, 1995. "High Wage Workers and High Wage Firms," Post-Print halshs-00378229, HAL.
- Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843 Elsevier.
- Bound, John, et al, 1994. "Evidence on the Validity of Cross-Sectional and Longitudinal Labor Market Data," Journal of Labor Economics, University of Chicago Press, vol. 12(3), pages 345-68, July.
- John M. Abowd & David Card, 1986.
"On the Covariance Structure of Earnings and Hours Changes,"
NBER Working Papers
1832, National Bureau of Economic Research, Inc.
- Abowd, John M & Card, David, 1989. "On the Covariance Structure of Earnings and Hours Changes," Econometrica, Econometric Society, vol. 57(2), pages 411-45, March.
- John Bound & Alan B. Krueger, 1989.
"The Extent of Measurement Error In Longitudinal Earnings Data: Do Two Wrongs Make A Right?,"
NBER Working Papers
2885, National Bureau of Economic Research, Inc.
- Bound, John & Krueger, Alan B, 1991. "The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 1-24, January.
- Joshua Angrist & Alan Krueger, 1998.
"Empirical Strategies in Labor Economics,"
98-7, Massachusetts Institute of Technology (MIT), Department of Economics.
- Duncan, Greg J & Hill, Daniel H, 1985. "An Investigation of the Extent and Consequences of Measurement Error in Labor-Economic Survey Data," Journal of Labor Economics, University of Chicago Press, vol. 3(4), pages 508-32, October.
- Mellow, Wesley & Sider, Hal, 1983. "Accuracy of Response in Labor Market Surveys: Evidence and Implications," Journal of Labor Economics, University of Chicago Press, vol. 1(4), pages 331-44, October.
When requesting a correction, please mention this item's handle: RePEc:cen:wpaper:11-20. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Fariha Kamal)
If references are entirely missing, you can add them using this form.