IDEAS home Printed from https://ideas.repec.org/p/nsr/escoet/escoe-tr-19.html
   My bibliography  Save this paper

The Use of Online Job Sites for Measuring Skills and Labour Market Trends: A Review

Author

Listed:
  • Oleksii Romanko
  • Mary O'Mahony

Abstract

We explore the use of online job postings as an innovative complementary source of labour demand statistics. The paper concentrates on new developments in the area, including the usage and validation of online data sources, trends, biases and caveats of the data generation and data extraction process. We provide detailed explanations of the data cleansing and data preparation process which proves to be useful for anyone working with raw online data sources. We explore the general data pipeline underpinning continuous data mining and data utilization, that could be beneficial for any organization building its own online data analysis process. We provide detailed discussions of the design of the skills extraction process using word2vec model. We discuss the application of the model and explore some of the skills analysis methods and visualizations, such as job titles, salaries, frequent skills histograms, skills correlation scatterplots, graph analysis of skills co-occurrence, UK regional skills analysis. We applied regression analysis, outlining various effects of person competencies on the salary. We conclude that online job postings provide rich and extensive insights into the labour market and can complement the official statistics.

Suggested Citation

  • Oleksii Romanko & Mary O'Mahony, 2022. "The Use of Online Job Sites for Measuring Skills and Labour Market Trends: A Review," Economic Statistics Centre of Excellence (ESCoE) Technical Reports ESCOE-TR-19, Economic Statistics Centre of Excellence (ESCoE).
    • Handle: RePEc:nsr:escoet:escoe-tr-19
    as

    Download full text from publisher

    File URL: https://escoe-website.s3.amazonaws.com/wp-content/uploads/2022/05/30133155/TR-19.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Acemoglu, Daron & Scott, Andrew, 1994. "Asymmetries in the Cyclical Behaviour of UK Labour Markets," Economic Journal, Royal Economic Society, vol. 104(427), pages 1303-1323, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arestis, Philip & Mariscal, Iris Biefang-Frisancho, 1998. "Capital shortages and asymmetries in UK unemployment," Structural Change and Economic Dynamics, Elsevier, vol. 9(2), pages 189-204, June.
    2. Eleni Iliopulos & François Langot & Thepthida Sopraseuth, 2019. "Welfare Cost of Fluctuations When Labor Market Search Interacts with Financial Frictions," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 51(8), pages 2207-2237, December.
    3. Bårdsen Gunnar & Hurn Stanley & McHugh Zöe, 2012. "Asymmetric Unemployment Rate Dynamics in Australia," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 16(1), pages 1-22, January.
    4. Nikolaos Mylonidis, 2003. "Financial variables as leading indicators in Greece," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 9(4), pages 268-278, November.
    5. Karen Mumford & Peter N. Smith, 2000. "Men, Women and the Hiring Function," The Economic Record, The Economic Society of Australia, vol. 76(235), pages 374-385, December.
    6. Feve, Patrick, 2002. "Solving labor demand models under asymmetric adjustment costs," Journal of Economic Dynamics and Control, Elsevier, vol. 26(5), pages 797-809, May.
    7. Adjemian, Stéphane & Karamé, Frédéric & Langot, François, 2021. "Nonlinearities and Workers’ Heterogeneity in Unemployment Dynamics," Dynare Working Papers 71, CEPREMAP.
    8. Caporale, Guglielmo Maria & Gil-Alana, Luis A., 2008. "Modelling the US, UK and Japanese unemployment rates: Fractional integration and structural breaks," Computational Statistics & Data Analysis, Elsevier, vol. 52(11), pages 4998-5013, July.
    9. Karamé, Frédéric, 2015. "Asymmetries and Markov-switching structural VAR," Journal of Economic Dynamics and Control, Elsevier, vol. 53(C), pages 85-102.
    10. Jesús Crespo Cuaresma, 2003. "Okun's Law Revisited," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(4), pages 439-451, September.
    11. Gilles Dufrénot & Valérie Mignon, 2002. "La cointégration non linéaire : une note méthodologique," Économie et Prévision, Programme National Persée, vol. 155(4), pages 117-137.
    12. McKay, Alisdair & Reis, Ricardo, 2008. "The brevity and violence of contractions and expansions," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 738-751, May.
    13. Jorge Andrés Tamayo Castaño, 2012. "Asimetrías en la demanda por trabajo en Colombia: el papel del ciclo económico," Borradores de Economia 9286, Banco de la Republica.
    14. Burgess, Matthew G. & Langendorf, Ryan E. & Ippolito, Tara & Pielke, Roger Jr, 2020. "Optimistically biased economic growth forecasts and negatively skewed annual variation," SocArXiv vndqr, Center for Open Science.
    15. Guglielmo Maria Caporale & Marinko Skare, 2011. "Employment Growth, Inflation and Output Growth: Was Phillips Right?: Evidence from a Dynamic Panel," Discussion Papers of DIW Berlin 1138, DIW Berlin, German Institute for Economic Research.
    16. Clements, M.C. & Krolzig, H.-M., 2001. "Modelling Business Cycle Features Using Switching Regime Models," Economics Series Working Papers 9958, University of Oxford, Department of Economics.
    17. Michael P. Clements & Hans-Martin Krolzig, 2004. "Can regime-switching models reproduce the business cycle features of US aggregate consumption, investment and output?," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 9(1), pages 1-14.
    18. Arango, Luis E. & Melo, Luis F., 2006. "Expansions and contractions in Brazil, Colombia and Mexico: A view through nonlinear models," Journal of Development Economics, Elsevier, vol. 80(2), pages 501-517, August.
    19. Krolzig, Hans-Martin & Marcellino, Massimiliano & Mizon, Grayham E., 2000. "A Markov-switching vector equilibrium correction model of the UK labour market," Discussion Paper Series In Economics And Econometrics 0105, Economics Division, School of Social Sciences, University of Southampton.
    20. Alogoskoufis, George & Malliaris, A.G. & Stengos, Thanasis, 2023. "The scope and methodology of economic and financial asymmetries," The Journal of Economic Asymmetries, Elsevier, vol. 27(C).

    More about this item

    Keywords

    labour demand; skills analysis; skills demand; skills extraction; web scraping;
    All these keywords.

    JEL classification:

    • J23 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Demand
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J31 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Wage Level and Structure; Wage Differentials

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nsr:escoet:escoe-tr-19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ESCoE Centre Manager (email available below). General contact details of provider: https://edirc.repec.org/data/escoeuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.