IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022is2ps310-s342.html
   My bibliography  Save this article

Analysing establishment survey non‐response using administrative data and machine learning

Author

Listed:
  • Benjamin Küfner
  • Joseph W. Sakshaug
  • Stefan Zins

Abstract

Declining participation in voluntary establishment surveys poses a risk of increasing non‐response bias over time. In this paper, response rates and non‐response bias are examined for the 2010–2019 IAB Job Vacancy Survey. Using comprehensive administrative data, we formulate and test several theory‐driven hypotheses on survey participation and evaluate the potential of various machine learning algorithms for non‐response bias adjustment. The analysis revealed that while the response rate decreased during the decade, no concomitant increase in aggregate non‐response bias was observed. Several hypotheses of participation were at least partially supported. Lastly, the expanded use of administrative data reduced non‐response bias over the standard weighting variables, but only limited evidence was found for further non‐response bias reduction through the use of machine learning methods.

Suggested Citation

  • Benjamin Küfner & Joseph W. Sakshaug & Stefan Zins, 2022. "Analysing establishment survey non‐response using administrative data and machine learning," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(S2), pages 310-342, December.
  • Handle: RePEc:bla:jorssa:v:185:y:2022:i:s2:p:s310-s342
    DOI: 10.1111/rssa.12942
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12942
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssa.12942?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. R?diger Bachmann & Steffen Elstner & Eric R. Sims, 2013. "Uncertainty and Economic Activity: Evidence from Business Survey Data," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(2), pages 217-249, April.
    2. Susan N. Houseman, 2001. "Why Employers Use Flexible Staffing Arrangements: Evidence from an Establishment Survey," ILR Review, Cornell University, ILR School, vol. 55(1), pages 149-170, October.
    3. Yusuf Mercan & Benjamin Schoefer, 2020. "Jobs and Matches: Quits, Replacement Hiring, and Vacancy Chains," American Economic Review: Insights, American Economic Association, vol. 2(1), pages 101-124, March.
    4. Mario Bossler & Nicole Gürtzgen & Alexander Kubis & Benjamin Küfner & Benjamin Lochner, 2020. "The IAB Job Vacancy Survey: design and research potential," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 54(1), pages 1-12, December.
    5. repec:mpr:mprres:4780 is not listed on IDEAS
    6. repec:mpr:mprres:4937 is not listed on IDEAS
    7. Seth, Stefan & Stüber, Heiko, 2018. "The Administrative Wage and Labor Market Flow Panel," FAU Discussion Papers in Economics 01/2017, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics, revised 2018.
    8. Hecht, Veronika & Litzel, Nicole & Schäffler, Johannes, 2019. "Unit nonresponse at the firm level: a cross-border analysis using the IAB-ReLOC data," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 53(1), pages 1-2.
    9. Kapelner, Adam & Bleich, Justin, 2016. "bartMachine: Machine Learning with Bayesian Additive Regression Trees," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 70(i04).
    10. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    11. White, Michael & Bryson, Alex, 2013. "Positive employee attitudes: how much human resource management do you need?," LSE Research Online Documents on Economics 51167, London School of Economics and Political Science, LSE Library.
    12. Mario Bossler & Nicole Gürtzgen & Alexander Kubis & Benjamin Küfner & Benjamin Lochner, 2020. "The IAB Job Vacancy Survey: design and research potential," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 54(1), pages 1-12, December.
    13. J. Michael Brick & Douglas Williams, 2013. "Explaining Rising Nonresponse Rates in Cross-Sectional Surveys," The ANNALS of the American Academy of Political and Social Science, , vol. 645(1), pages 36-59, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gaul, Johannes J. & Keusch, Florian & Rostam-Afschar, Davud & Simon, Thomas, 2024. "Invitation Messages for Business Surveys: A Multi-Armed Bandit Experiment," IZA Discussion Papers 17534, Institute of Labor Economics (IZA).
    2. Khatri, Puja & Shukla, Shalu & Thomas, Asha & Shiva, Atul & Behl, Abhishek, 2025. "Towards work life fulfilment: Scale development and validation," Journal of Business Research, Elsevier, vol. 186(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin Küfner & Joseph W. Sakshaug & Stefan Zins, 2022. "Establishment survey participation during the COVID-19 pandemic," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 56(1), pages 1-18, December.
    2. repec:iab:iabfme:202102(en is not listed on IDEAS
    3. Lochner, Benjamin & Merkl, Christian & Stüber, Heiko & Gürtzgen, Nicole, 2021. "Recruiting intensity and hiring practices: Cross-sectional and time-series evidence," Labour Economics, Elsevier, vol. 68(C).
    4. Martin Huber & David Imhof & Rieko Ishii, 2022. "Transnational machine learning with screens for flagging bid‐rigging cartels," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 1074-1114, July.
    5. Bossler, Mario & Popp, Martin, 2024. "Labor Demand on a Tight Leash," IZA Discussion Papers 16837, Institute of Labor Economics (IZA).
    6. Christian Merkl & Timo Sauerbier, 2024. "Public Employment Agency Reform, Matching Efficiency, and German Unemployment," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 72(1), pages 393-440, March.
    7. repec:iab:iabfda:202109(en is not listed on IDEAS
    8. Mario Bossler & Martin Popp, 2022. "Labor Demand on a Tight Leash," Papers 2203.05593, arXiv.org, revised Feb 2024.
    9. Gürtzgen, Nicole & Küfner, Benjamin, 2021. "Hirings in the IAB Job Vacancy Survey and the administrative data - an aggregate comparison," FDZ Methodenreport 202102_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    10. repec:iab:iabfda:202109(de is not listed on IDEAS
    11. Karolin Hiesinger & Laura Pohlan & Franka Vetter, 2025. "The employment statistics of severely disabled people: description and research potential," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 59(1), pages 1-20, December.
    12. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    13. Holger Görg & Dennis Görlich, 2015. "Offshoring, wages and job security of temporary workers," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 151(3), pages 533-554, August.
    14. Blanka Škrabić Perić & Petar Sorić, 2018. "A Note on the “Economic Policy Uncertainty Index”," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 137(2), pages 505-526, June.
    15. Nikolay Hristov & Markus Roth, 2019. "Uncertainty Shocks and Financial Crisis Indicators," CESifo Working Paper Series 7839, CESifo.
    16. John S. Heywood & W.S. Siebert & Xiangdong Wei, 2011. "Estimating the Use of Agency Workers: Can Family-Friendly Practices Reduce Their Use?," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 50(3), pages 535-564, July.
    17. Gareth Harman & Dakota Kliamovich & Angelica M Morales & Sydney Gilbert & Deanna M Barch & Michael A Mooney & Sarah W Feldstein Ewing & Damien A Fair & Bonnie J Nagel, 2021. "Prediction of suicidal ideation and attempt in 9 and 10 year-old children using transdiagnostic risk features," PLOS ONE, Public Library of Science, vol. 16(5), pages 1-14, May.
    18. Viet Hoang Dinh & Didier Nibbering & Benjamin Wong, 2023. "Random Subspace Local Projections," CAMA Working Papers 2023-34, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    19. Oliver de Groot & Alexander W. Richter & Nathaniel A. Throckmorton, 2018. "Uncertainty Shocks in a Model of Effective Demand: Comment," Econometrica, Econometric Society, vol. 86(4), pages 1513-1526, July.
    20. Bonciani, Dario, 2015. "Estimating the effects of uncertainty over the business cycle," MPRA Paper 65921, University Library of Munich, Germany.
    21. Anja Sebbesen & Harald Oberhofer, 2024. "The propagation of business expectations within the European Union," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(6), pages 1082-1103, September.
    22. Benchimol, Jonathan & El-Shagi, Makram & Saadon, Yossi, 2022. "Do expert experience and characteristics affect inflation forecasts?," Journal of Economic Behavior & Organization, Elsevier, vol. 201(C), pages 205-226.
    23. Jan Kluge & Sarah Lappöhn & Kerstin Plank, 2023. "Predictors of TFP growth in European countries," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 50(1), pages 109-140, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:s2:p:s310-s342. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.