IDEAS home Printed from https://ideas.repec.org/a/spr/jlabrs/v57y2023i1d10.1186_s12651-023-00332-z.html
   My bibliography  Save this article

On the measurement of tasks: does expert data get it right?

Author

Listed:
  • Eduard Storm

    (RWI-Leibniz Institute for Economic Research)

Abstract

Using German survey and expert data on job tasks, this paper explores the presence of omitted-variable bias suspected in conventional task data derived from expert assessment. I show expert task data, which is expressed at the occupation-level, introduces omitted-variable bias in task returns on the order of 26–34%. Motivated by a theoretical framework, I argue this bias results from expert data ignoring individual heterogeneity rather than fundamental differences on the assessment of tasks between experts and workers. My findings have important implications for the interpretation of conventional task models as occupational task returns are overestimated. Moreover, a rigorous comparison of the statistical performance of various models offers guidance for future research regarding choice of task data and construction of task measures.

Suggested Citation

  • Eduard Storm, 2023. "On the measurement of tasks: does expert data get it right?," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 57(1), pages 1-24, December.
  • Handle: RePEc:spr:jlabrs:v:57:y:2023:i:1:d:10.1186_s12651-023-00332-z
    DOI: 10.1186/s12651-023-00332-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1186/s12651-023-00332-z
    File Function: Abstract
    Download Restriction: no

    File URL: https://libkey.io/10.1186/s12651-023-00332-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Card & Jörg Heining & Patrick Kline, 2013. "Workplace Heterogeneity and the Rise of West German Wage Inequality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(3), pages 967-1015.
    2. Britta Matthes & Bernhard Christoph & Florian Janik & Michael Ruland, 2014. "Collecting information on job tasks—an instrument to measure tasks required at the workplace in a multi-topic survey [Die Erfassung von Job-Tasks in persönlichen Befragungen. Ein neues Instrument z," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 47(4), pages 273-297, December.
    3. Giovanni Peri & Chad Sparber, 2016. "Task Specialization, Immigration, and Wages," World Scientific Book Chapters,in: The Economics of International Migration, chapter 3, pages 81-115 World Scientific Publishing Co. Pte. Ltd..
    4. Matthes, Britta & Burkert, Carola & Biersack, Wolfgang, 2008. "Berufssegmente: Eine empirisch fundierte Neuabgrenzung vergleichbarer beruflicher Einheiten," IAB-Discussion Paper 200835, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    5. Jae Song & David J Price & Fatih Guvenen & Nicholas Bloom & Till von Wachter, 2019. "Firming Up Inequality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(1), pages 1-50.
    6. Brad Hershbein & Lisa B. Kahn, 2018. "Do Recessions Accelerate Routine-Biased Technological Change? Evidence from Vacancy Postings," American Economic Review, American Economic Association, vol. 108(7), pages 1737-1772, July.
    7. Dostie, Benoit & Li, Jiang & Card, David & Parent, Daniel, 2023. "Employer policies and the immigrant–native earnings gap," Journal of Econometrics, Elsevier, vol. 233(2), pages 544-567.
    8. Ralph Stinebrickner & Todd Stinebrickner & Paul Sullivan, 2019. "Job Tasks, Time Allocation, and Wages," Journal of Labor Economics, University of Chicago Press, vol. 37(2), pages 399-433.
    9. Janser, Markus, 2018. "The greening of jobs in Germany : First evidence from a text mining based index and employment register data," IAB-Discussion Paper 201814, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    10. repec:iab:iabfme:201412(en is not listed on IDEAS
    11. Guido Matias Cortes, 2016. "Where Have the Middle-Wage Workers Gone? A Study of Polarization Using Panel Data," Journal of Labor Economics, University of Chicago Press, vol. 34(1), pages 63-105.
    12. David H. Autor & Michael J. Handel, 2013. "Putting Tasks to the Test: Human Capital, Job Tasks, and Wages," Journal of Labor Economics, University of Chicago Press, vol. 31(S1), pages 59-96.
    13. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue Nov.
    14. Enghin Atalay & Phai Phongthiengtham & Sebastian Sotelo & Daniel Tannenbaum, 2020. "The Evolution of Work in the United States," American Economic Journal: Applied Economics, American Economic Association, vol. 12(2), pages 1-34, April.
    15. Hugh Cassidy, 2017. "Task Variation Within Occupations," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 56(3), pages 393-410, July.
    16. Dengler, Katharina & Matthes, Britta, 2018. "The impacts of digital transformation on the labour market: Substitution potentials of occupations in Germany," Technological Forecasting and Social Change, Elsevier, vol. 137(C), pages 304-316.
    17. Alexandra Spitz-Oener, 2006. "Technical Change, Job Tasks, and Rising Educational Demands: Looking outside the Wage Structure," Journal of Labor Economics, University of Chicago Press, vol. 24(2), pages 235-270, April.
    18. Cortes, Guido Matias & Salvatori, Andrea, 2019. "Delving into the demand side: Changes in workplace specialization and job polarization," Labour Economics, Elsevier, vol. 57(C), pages 164-176.
    19. Antonczyk Dirk & Leuschner Ute & Fitzenberger Bernd, 2009. "Can a Task-Based Approach Explain the Recent Changes in the German Wage Structure?," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 229(2-3), pages 214-238, April.
    20. Daniela Rohrbach-Schmidt, 2019. "Putting Tasks to the Test: The Case of Germany," Social Inclusion, Cogitatio Press, vol. 7(3), pages 122-135.
    21. Cavaglia, Chiara & Etheridge, Ben, 2020. "Job polarization and the declining quality of knowledge workers: evidence from the UK and Germany," LSE Research Online Documents on Economics 105819, London School of Economics and Political Science, LSE Library.
    22. Rica, Sara De La & Gortazar, Lucas & Lewandowski, Piotr, 2020. "Job Tasks and Wages in Developed Countries: Evidence from PIAAC," Labour Economics, Elsevier, vol. 65(C).
    23. Dengler, Katharina & Matthes, Britta & Paulus, Wiebke, 2014. "Occupational Tasks in the German Labour Market : an alternative measurement on the basis of an expert database," FDZ Methodenreport 201412_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    24. Mario Reinhold & Stephan Thomsen, 2017. "The changing situation of labor market entrants in Germany [Die veränderliche Situation für Berufseinsteiger in Deutschland]," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 50(1), pages 161-174, August.
    25. A. D. Roy, 1951. "Some Thoughts On The Distribution Of Earnings," Oxford Economic Papers, Oxford University Press, vol. 3(2), pages 135-146.
    26. Nancy Kracke & Margarida Rodrigues, 2020. "A Task-Based Indicator for Labour Market Mismatch," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(2), pages 399-421, June.
    27. Nancy Kracke & Malte Reichelt & Basha Vicari, 2018. "Wage Losses Due to Overqualification: The Role of Formal Degrees and Occupational Skills," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(3), pages 1085-1108, October.
    28. Handel, Michael J., 2016. "The O-NET content model: strengths and limitations," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 49(2), pages 157-176.
    29. Rohrbach-Schmidt, Daniela & Tiemann, Michael, 2013. "Changes in workplace tasks in Germany : evaluating skill and task measures," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 46(3), pages 215-237.
    30. Erling Barth & Alex Bryson & James C. Davis & Richard Freeman, 2016. "It's Where You Work: Increases in the Dispersion of Earnings across Establishments and Individuals in the United States," Journal of Labor Economics, University of Chicago Press, vol. 34(S2), pages 67-97.
    31. Cavaglia, Chiara & Etheridge, Ben, 2020. "Job polarization and the declining quality of knowledge workers: Evidence from the UK and Germany," Labour Economics, Elsevier, vol. 66(C).
    32. Atalay, Enghin & Phongthiengtham, Phai & Sotelo, Sebastian & Tannenbaum, Daniel, 2018. "New technologies and the labor market," Journal of Monetary Economics, Elsevier, vol. 97(C), pages 48-67.
    33. Handel, Michael J., 2016. "The O-NET content model: strengths and limitations," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 49(2), pages 157-176.
    34. Giovanni Peri & Chad Sparber, 2016. "Task Specialization, Immigration, and Wages," World Scientific Book Chapters, in: The Economics of International Migration, chapter 3, pages 81-115, World Scientific Publishing Co. Pte. Ltd..
    35. Daniela Rohrbach-Schmidt & Michael Tiemann, 2013. "Changes in workplace tasks in Germany—evaluating skill and task measures [Wandel der Tätigkeiten am Arbeitsplatz in Deutschland – Analysen von Skill und Task-Maßen]," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 46(3), pages 215-237, September.
    36. Shintaro Yamaguchi, 2012. "Tasks and Heterogeneous Human Capital," Journal of Labor Economics, University of Chicago Press, vol. 30(1), pages 1-53.
    37. Matthes, Britta & Christoph, Bernhard & Janik, Florian & Ruland, Michael, 2014. "Collecting information on job tasks - an instrument to measure tasks required at the workplace in a multi-topic survey," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 47(4), pages 273-297.
    38. Brenner, Lyle A. & Koehler, Derek J. & Liberman, Varda & Tversky, Amos, 1996. "Overconfidence in Probability and Frequency Judgments: A Critical Examination," Organizational Behavior and Human Decision Processes, Elsevier, vol. 65(3), pages 212-219, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Storm, Eduard, 2023. "Skill mismatch and learning-by-doing: Theory and evidence from time allocation on tasks," Ruhr Economic Papers 1021, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eduard Storm, 2022. "Task specialization and the Native‐Foreign Wage Gap," LABOUR, CEIS, vol. 36(2), pages 167-195, June.
    2. Silvia Vannutelli & Sergio Scicchitano & Marco Biagetti, 2022. "Routine-biased technological change and wage inequality: do workers’ perceptions matter?," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 12(3), pages 409-450, September.
    3. Storm, Eduard, 2022. "On the measurement of tasks: Does expert data get it right?," Ruhr Economic Papers 948, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    4. Dengler, Katharina & Matthes, Britta & Paulus, Wiebke, 2014. "Occupational Tasks in the German Labour Market : an alternative measurement on the basis of an expert database," FDZ Methodenreport 201412_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    5. Koomen, Miriam & Backes-Gellner, Uschi, 2022. "Occupational Tasks and Wage Inequality in Germany: A Decomposition Analysis," IZA Discussion Papers 15702, Institute of Labor Economics (IZA).
    6. Freund, L. B., 2022. "Superstar Teams: The Micro Origins and Macro Implications of Coworker Complementarities," Janeway Institute Working Papers 2235, Faculty of Economics, University of Cambridge.
    7. Böhm, Michael Johannes & Gaudecker, Hans-Martin von & Schran, Felix, 2019. "Occupation Growth, Skill Prices, and Wage Inequality," IZA Discussion Papers 12647, Institute of Labor Economics (IZA).
    8. Ian Nicole A. Generalao, 2019. "Mapping tasks to occupations using Philippine data," UP School of Economics Discussion Papers 201904, University of the Philippines School of Economics.
    9. repec:iab:iabfme:201412(de is not listed on IDEAS
    10. Emil Mihaylov & Kea Tijdens, 2019. "Measuring the Routine and Non-Routine Task Content of 427 Four-Digit ISCO-08 Occupations," Tinbergen Institute Discussion Papers 19-035/IV, Tinbergen Institute.
    11. Tobias Maier, 2022. "Change in occupational tasks and its implications: evidence from a task panel from 1973 to 2011 for Western Germany," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(3), pages 889-921, June.
    12. repec:iab:iabfme:201412(en is not listed on IDEAS
    13. Storm, Eduard, 2021. "Task specialization and the native-foreign wage gap: Evidence from worker-level data," Ruhr Economic Papers 928, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    14. Ross, Matthew B., 2017. "Routine-biased technical change: Panel evidence of task orientation and wage effects," Labour Economics, Elsevier, vol. 48(C), pages 198-214.
    15. Storm, Eduard, 2023. "Skill mismatch and learning-by-doing: Theory and evidence from time allocation on tasks," Ruhr Economic Papers 1021, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    16. Koomen, Miriam & Backes-Gellner, Uschi, 2022. "Occupational tasks and wage inequality in West Germany: A decomposition analysis," Labour Economics, Elsevier, vol. 79(C).
    17. Arntz, Melanie & Genz, Sabrina & Gregory, Terry & Lehmer, Florian & Zierahn-Weilage, Ulrich, 2024. "De-routinization in the fourth industrial revolution: Firm-level evidence," ZEW Discussion Papers 24-005, ZEW - Leibniz Centre for European Economic Research.
    18. Dengler, Katharina & Matthes, Britta & Paulus, Wiebke, 2014. "Berufliche Tasks auf dem deutschen Arbeitsmarkt : eine alternative Messung auf Basis einer Expertendatenbank (Occupational Tasks in the German Labour Market : an alternative measurement on the basis o," FDZ Methodenreport 201412_de, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    19. Cavaglia, Chiara & Etheridge, Ben, 2020. "Job polarization and the declining quality of knowledge workers: Evidence from the UK and Germany," Labour Economics, Elsevier, vol. 66(C).
    20. Cavaglia, Chiara & Etheridge, Ben, 2020. "Job polarization and the declining quality of knowledge workers: evidence from the UK and Germany," LSE Research Online Documents on Economics 105819, London School of Economics and Political Science, LSE Library.
    21. Arntz, Melanie & Genz, Sabrina & Gregory, Terry & Lehmer, Florian & Zierahn-Weilage, Ulrich, 2024. "De-Routinization in the Fourth Industrial Revolution - Firm-Level Evidence," IZA Discussion Papers 16740, Institute of Labor Economics (IZA).
    22. Arief A. Yusuf & Reza Anglingkusumo & Andy Sumner & Putri R. Halim & Anggita C.M. Kusuma, 2020. "Routinization And The Changing Task Composition In The Labor Market: Evidence From Indonesia," Working Papers WP/06/2020, Bank Indonesia.

    More about this item

    Keywords

    Expert vs survey task data; Individual heterogeneity; Omitted-variable bias;
    All these keywords.

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J31 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Wage Level and Structure; Wage Differentials

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jlabrs:v:57:y:2023:i:1:d:10.1186_s12651-023-00332-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.