IDEAS home Printed from https://ideas.repec.org/p/ven/wpaper/201424.html
   My bibliography  Save this paper

Measurement error in occupational coding:an analysis on SHARE data

Author

Listed:
  • Michele Belloni

    (Department of Economics, University Of Venice C� Foscari)

  • Agar Brugiavini

    (Department of Economics, University Of Milan, Bicocca)

  • Elena Maschi

    (Elena.meschi@unive.it)

  • Kea Tijdens

    (K.G.Tijdens@uva.nl)

Abstract

This article studies the potential measurement errors when coding occupational data. The quality of occupational data is important but often neglected. We recoded open-ended questions on occupation for last and current job in the Dutch SHARE data, using the CASCOT ex-post coding software. The disagreement rate, defined as the percentage of observations coded differently in SHARE and CASCOT, is high even when compared at ISCO 1-digit level (33.7% for last job and 40% for current job). This finding is striking, considering our conservative approach to exclude vague and incomplete answers. The level of miscoding should thus be considered as a lower bound of the �true� miscoding. This highlights the complexity of occupational coding and suggests that measurement error due to miscoding should be taken into account when making statistical analysis or writing econometric models. We tested whether the measurement error is random or correlated to individual or job-related characteristics, and we found that the measurement error is indeed more evident in ISCO-88 groups 1 and 3 and is more pronounced for higher educated individuals and males. These groups may be sorted in occupations that are intrinsically more difficult to be classified, or education and gender may affect the way people describe their jobs.

Suggested Citation

  • Michele Belloni & Agar Brugiavini & Elena Maschi & Kea Tijdens, 2014. "Measurement error in occupational coding:an analysis on SHARE data," Working Papers 2014: 24, Department of Economics, University of Venice "Ca' Foscari".
  • Handle: RePEc:ven:wpaper:2014:24
    as

    Download full text from publisher

    File URL: http://www.unive.it/pag/fileadmin/user_upload/dipartimenti/economia/doc/Pubblicazioni_scientifiche/working_papers/2014/WP_DSE_belloni_brugiavini_meschi_tijdens_24_14.pdf
    File Function: First version, anno
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hartog, Joop, 2000. "Over-education and earnings: where are we, where should we go?," Economics of Education Review, Elsevier, vol. 19(2), pages 131-147, April.
    2. Autor, David H., 2013. "The "task approach" to labor markets : an overview," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 46(3), pages 185-199.
    3. Bastian Ravesteijn & Hans van Kippersluis & Eddy van Doorslaer, 2018. "The wear and tear on health: What is the role of occupation?," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 69-86, February.
    4. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue Nov.
    5. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    6. Jason M. Fletcher & Jody L. Sindelar & Shintaro Yamaguchi, 2011. "Cumulative effects of job characteristics on health," Health Economics, John Wiley & Sons, Ltd., vol. 20(5), pages 553-570, May.
    7. Maarten Goos & Alan Manning, 2007. "Lousy and Lovely Jobs: The Rising Polarization of Work in Britain," The Review of Economics and Statistics, MIT Press, vol. 89(1), pages 118-133, February.
    8. Autor, David H., 2013. "The "task approach" to labor markets : an overview," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 46(3), pages 185-199.
    9. repec:ilo:ilowps:310566 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Turrell, Arthur & Thurgood, James & Djumalieva, Jyldyz & Copple, David & Speigner, Bradley, 2018. "Using online job vacancies to understand the UK labour market from the bottom-up," Bank of England working papers 742, Bank of England.
    2. Jyldyz Djumalieva & Antonio Lima & Cath Sleeman, 2018. "Classifying Occupations According to Their Skill Requirements in Job Advertisements," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2018-04, Economic Statistics Centre of Excellence (ESCoE).
    3. Arthur Turrell & Bradley Speigner & Jyldyz Djumalieva & David Copple & James Thurgood, 2019. "Transforming Naturally Occurring Text Data into Economic Statistics: The Case of Online Job Vacancy Postings," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 173-207, National Bureau of Economic Research, Inc.
    4. Alejandra Bellatin & Gabriela Galassi, 2022. "What COVID-19 May Leave Behind: Technology-Related Job Postings in Canada," Staff Working Papers 22-17, Bank of Canada.
    5. Gweon Hyukjun & Schonlau Matthias & Steiner Stefan & Kaczmirek Lars & Blohm Michael, 2017. "Three Methods for Occupation Coding Based on Statistical Learning," Journal of Official Statistics, Sciendo, vol. 33(1), pages 101-122, March.
    6. Bellatin, Alejandra & Galassi, Gabriela, 2022. "What COVID-19 May Leave Behind: Technology-Related Job Postings in Canada," IZA Discussion Papers 15209, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Belloni Michele & Brugiavini Agar & Meschi Elena & Tijdens Kea, 2016. "Measuring and Detecting Errors in Occupational Coding: an Analysis of SHARE Data," Journal of Official Statistics, Sciendo, vol. 32(4), pages 917-945, December.
    2. Davide Consoli & Francesco Vona & Francesco Rentocchini, 2016. "That was then, this is now: skills and routinization in the 2000s," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 25(5), pages 847-866.
    3. David Hémous & Morten Olsen, 2022. "The Rise of the Machines: Automation, Horizontal Innovation, and Income Inequality," American Economic Journal: Macroeconomics, American Economic Association, vol. 14(1), pages 179-223, January.
    4. Gaggl, Paul & Kaufmann, Sylvia, 2020. "The cyclical component of labor market polarization and jobless recoveries in the US," Journal of Monetary Economics, Elsevier, vol. 116(C), pages 334-347.
    5. Brindusa Anghel & Sara Rica & Aitor Lacuesta, 2014. "The impact of the great recession on employment polarization in Spain," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 5(2), pages 143-171, August.
    6. Ipsita Roy & Davide Consoli, 2018. "Employment Polarization in Germany: Role of Technology, Trade and Human Capital," The Indian Journal of Labour Economics, Springer;The Indian Society of Labour Economics (ISLE), vol. 61(2), pages 251-279, June.
    7. Dengler, Katharina & Matthes, Britta & Paulus, Wiebke, 2014. "Occupational Tasks in the German Labour Market : an alternative measurement on the basis of an expert database," FDZ Methodenreport 201412_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    8. Suzanne Kok & Bas ter Weel, 2014. "Cities, Tasks, And Skills," Journal of Regional Science, Wiley Blackwell, vol. 54(5), pages 856-892, November.
    9. repec:hal:spmain:info:hdl:2441/2ajduu0gqt9ho8h2tavbin6ops is not listed on IDEAS
    10. repec:aia:aiaswp:151 is not listed on IDEAS
    11. Dengler, Katharina & Matthes, Britta & Paulus, Wiebke, 2014. "Berufliche Tasks auf dem deutschen Arbeitsmarkt : eine alternative Messung auf Basis einer Expertendatenbank (Occupational Tasks in the German Labour Market : an alternative measurement on the basis o," FDZ Methodenreport 201412_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    12. David Autor, 2014. "Polanyi's Paradox and the Shape of Employment Growth," NBER Working Papers 20485, National Bureau of Economic Research, Inc.
    13. Gustavsson, Magnus, 2017. "Is Job Polarization a Recent Phenomenon? Evidence from Sweden, 1950–2013, and a Comparison to the United States," Working Paper Series 2017:14, Uppsala University, Department of Economics.
    14. Salverda, Wiemer & Checchi, Daniele, 2014. "Labour-Market Institutions and the Dispersion of Wage Earnings," IZA Discussion Papers 8220, Institute of Labor Economics (IZA).
    15. Suzanne Kok & Bas ter Weel, 2014. "Cities, Tasks and Skills," CPB Discussion Paper 269, CPB Netherlands Bureau for Economic Policy Analysis.
    16. Léné, Alexandre, 2011. "Occupational downgrading and bumping down: The combined effects of education and experience," Labour Economics, Elsevier, vol. 18(2), pages 257-269, April.
    17. Silvia Vannutelli & Sergio Scicchitano & Marco Biagetti, 2022. "Routine-biased technological change and wage inequality: do workers’ perceptions matter?," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 12(3), pages 409-450, September.
    18. Dirk Antonczyk & Thomas DeLeire & Bernd Fitzenberger, 2018. "Polarization and Rising Wage Inequality: Comparing the U.S. and Germany," Econometrics, MDPI, vol. 6(2), pages 1-33, April.
    19. Leonardo Gasparini & Irene Brambilla & Guillermo Falcone & Carlo Lombardo & Andrés César, 2021. "Routinization and Employment: Evidence for Latin America," CEDLAS, Working Papers 0276, CEDLAS, Universidad Nacional de La Plata.
    20. Antoni, Manfred & Janser, Markus & Lehmer, Florian, 2015. "The hidden winners of renewable energy promotion: Insights into sector-specific wage differentials," Energy Policy, Elsevier, vol. 86(C), pages 595-613.
    21. Koster, Hans R.A. & Ozgen, Ceren, 2021. "Cities and tasks," Journal of Urban Economics, Elsevier, vol. 126(C).
    22. Consoli, Davide & Marin, Giovanni & Rentocchini, Francesco & Vona, Francesco, 2023. "Routinization, within-occupation task changes and long-run employment dynamics," Research Policy, Elsevier, vol. 52(1).

    More about this item

    Keywords

    occupation; ISCO; disagreement rate; coding software; gender; education;
    All these keywords.

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C88 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Other Computer Software
    • J01 - Labor and Demographic Economics - - General - - - Labor Economics: General
    • J21 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Force and Employment, Size, and Structure
    • J82 - Labor and Demographic Economics - - Labor Standards - - - Labor Force Composition

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ven:wpaper:2014:24. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Geraldine Ludbrook (email available below). General contact details of provider: https://edirc.repec.org/data/dsvenit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.