IDEAS home Printed from https://ideas.repec.org/p/nsr/escoet/escoe-tr-19.html

The Use of Online Job Sites for Measuring Skills and Labour Market Trends: A Review

Author

Listed:
  • Oleksii Romanko

  • Mary O'Mahony

Abstract

We explore the use of online job postings as an innovative complementary source of labour demand statistics. The paper concentrates on new developments in the area, including the usage and validation of online data sources, trends, biases and caveats of the data generation and data extraction process. We provide detailed explanations of the data cleansing and data preparation process which proves to be useful for anyone working with raw online data sources. We explore the general data pipeline underpinning continuous data mining and data utilization, that could be beneficial for any organization building its own online data analysis process. We provide detailed discussions of the design of the skills extraction process using word2vec model. We discuss the application of the model and explore some of the skills analysis methods and visualizations, such as job titles, salaries, frequent skills histograms, skills correlation scatterplots, graph analysis of skills co-occurrence, UK regional skills analysis. We applied regression analysis, outlining various effects of person competencies on the salary. We conclude that online job postings provide rich and extensive insights into the labour market and can complement the official statistics.

Suggested Citation

  • Oleksii Romanko & Mary O'Mahony, 2022. "The Use of Online Job Sites for Measuring Skills and Labour Market Trends: A Review," Economic Statistics Centre of Excellence (ESCoE) Technical Reports ESCOE-TR-19, Economic Statistics Centre of Excellence (ESCoE).
    • Handle: RePEc:nsr:escoet:escoe-tr-19
    as

    Download full text from publisher

    File URL: https://escoe-website.s3.amazonaws.com/wp-content/uploads/2022/05/30133155/TR-19.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Acemoglu, Daron & Scott, Andrew, 1994. "Asymmetries in the Cyclical Behaviour of UK Labour Markets," Economic Journal, Royal Economic Society, vol. 104(427), pages 1303-1323, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dossche, Wouter & Vansteenkiste, Sarah & Baesens, Bart & Lemahieu, Wilfried, 2026. "Anticipating delays in recruitment: Explainable machine learning for the prediction of hard-to-fill online job vacancies," European Journal of Operational Research, Elsevier, vol. 328(2), pages 680-693.
    2. Marc Pinski & Thomas Hofmann & Alexander Benlian, 2024. "AI Literacy for the top management: An upper echelons perspective on corporate AI orientation and implementation ability," Electronic Markets, Springer;IIM University of St. Gallen, vol. 34(1), pages 1-23, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arestis, Philip & Mariscal, Iris Biefang-Frisancho, 1998. "Capital shortages and asymmetries in UK unemployment," Structural Change and Economic Dynamics, Elsevier, vol. 9(2), pages 189-204, June.
    2. Nikolaos Mylonidis, 2003. "Financial variables as leading indicators in Greece," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 9(4), pages 268-278, November.
    3. Karen Mumford & Peter N. Smith, 2000. "Men, Women and the Hiring Function," The Economic Record, The Economic Society of Australia, vol. 76(235), pages 374-385, December.
    4. Feve, Patrick, 2002. "Solving labor demand models under asymmetric adjustment costs," Journal of Economic Dynamics and Control, Elsevier, vol. 26(5), pages 797-809, May.
    5. Adjemian, Stéphane & Karamé, Frédéric & Langot, François, 2021. "Nonlinearities and Workers’ Heterogeneity in Unemployment Dynamics," Dynare Working Papers 71, CEPREMAP.
    6. Karamé, Frédéric, 2015. "Asymmetries and Markov-switching structural VAR," Journal of Economic Dynamics and Control, Elsevier, vol. 53(C), pages 85-102.
    7. Jesús Crespo Cuaresma, 2003. "Okun's Law Revisited," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(4), pages 439-451, September.
    8. McKay, Alisdair & Reis, Ricardo, 2008. "The brevity and violence of contractions and expansions," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 738-751, May.
    9. Jorge Andr�s Tamayo Casta�o, 2012. "Asimetr�as en la demanda por trabajo en Colombia: el papel del ciclo econ�mico," Borradores de Economia 9286, Banco de la Republica.
    10. Burgess, Matthew G. & Langendorf, Ryan E. & Ippolito, Tara & Pielke, Roger Jr, 2020. "Optimistically biased economic growth forecasts and negatively skewed annual variation," SocArXiv vndqr, Center for Open Science.
    11. Guglielmo Maria Caporale & Marinko Skare, 2011. "Employment Growth, Inflation and Output Growth: Was Phillips Right?: Evidence from a Dynamic Panel," Discussion Papers of DIW Berlin 1138, DIW Berlin, German Institute for Economic Research.
    12. Clements, M.C. & Krolzig, H.-M., 2001. "Modelling Business Cycle Features Using Switching Regime Models," Economics Series Working Papers 9958, University of Oxford, Department of Economics.
    13. Michael P. Clements & Hans-Martin Krolzig, 2004. "Can regime-switching models reproduce the business cycle features of US aggregate consumption, investment and output?," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 9(1), pages 1-14.
    14. Arango, Luis E. & Melo, Luis F., 2006. "Expansions and contractions in Brazil, Colombia and Mexico: A view through nonlinear models," Journal of Development Economics, Elsevier, vol. 80(2), pages 501-517, August.
    15. Krolzig, Hans-Martin & Marcellino, Massimiliano & Mizon, Grayham E., 2000. "A Markov-switching vector equilibrium correction model of the UK labour market," Discussion Paper Series In Economics And Econometrics 0105, Economics Division, School of Social Sciences, University of Southampton.
    16. Alogoskoufis, George & Malliaris, A.G. & Stengos, Thanasis, 2023. "The scope and methodology of economic and financial asymmetries," The Journal of Economic Asymmetries, Elsevier, vol. 27(C).
    17. Stevens, Philip Andrew, 2007. "Skill shortages and firms' employment behaviour," Labour Economics, Elsevier, vol. 14(2), pages 231-249, April.
    18. Gunnar Bårdsen & Stan Hurn & Zoë McHugh, 2002. "A smooth-transition model of the Australian unemployment rate," Working Paper Series 1002, Department of Economics, Norwegian University of Science and Technology, revised 01 Jul 2003.
    19. Colleen Carey & Stephen H. Shore, 2013. "From the Peaks to the Valleys: Cross-State Evidence on Income Volatility over the Business Cycle," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 549-562, May.
    20. repec:osf:socarx:vndqr_v1 is not listed on IDEAS
    21. Clements, Michael P & Smith, Jeremy, 1999. "A Monte Carlo Study of the Forecasting Performance of Empirical SETAR Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(2), pages 123-141, March-Apr.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • J23 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Demand
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J31 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Wage Level and Structure; Wage Differentials

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nsr:escoet:escoe-tr-19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ESCoE Centre Manager (email available below). General contact details of provider: https://edirc.repec.org/data/escoeuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.