IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022is2ps310-s342.html
   My bibliography  Save this article

Analysing establishment survey non‐response using administrative data and machine learning

Author

Listed:
  • Benjamin Küfner
  • Joseph W. Sakshaug
  • Stefan Zins

Abstract

Declining participation in voluntary establishment surveys poses a risk of increasing non‐response bias over time. In this paper, response rates and non‐response bias are examined for the 2010–2019 IAB Job Vacancy Survey. Using comprehensive administrative data, we formulate and test several theory‐driven hypotheses on survey participation and evaluate the potential of various machine learning algorithms for non‐response bias adjustment. The analysis revealed that while the response rate decreased during the decade, no concomitant increase in aggregate non‐response bias was observed. Several hypotheses of participation were at least partially supported. Lastly, the expanded use of administrative data reduced non‐response bias over the standard weighting variables, but only limited evidence was found for further non‐response bias reduction through the use of machine learning methods.

Suggested Citation

  • Benjamin Küfner & Joseph W. Sakshaug & Stefan Zins, 2022. "Analysing establishment survey non‐response using administrative data and machine learning," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(S2), pages 310-342, December.
    • Handle: RePEc:bla:jorssa:v:185:y:2022:i:s2:p:s310-s342
    DOI: 10.1111/rssa.12942
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12942
    Download Restriction: no
    File URL: https://libkey.io/10.1111/rssa.12942?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Susan N. Houseman, 2001. "Why Employers Use Flexible Staffing Arrangements: Evidence from an Establishment Survey," ILR Review, Cornell University, ILR School, vol. 55(1), pages 149-170, October.
    2. Hecht, Veronika & Litzel, Nicole & Schäffler, Johannes, 2019. "Unit nonresponse at the firm level: a cross-border analysis using the IAB-ReLOC data," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 53(1), pages 1-2.
    3. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    4. Yusuf Mercan & Benjamin Schoefer, 2020. "Jobs and Matches: Quits, Replacement Hiring, and Vacancy Chains," American Economic Review: Insights, American Economic Association, vol. 2(1), pages 101-124, March.
    5. repec:mpr:mprres:4937 is not listed on IDEAS
    6. Seth, Stefan & Stüber, Heiko, 2018. "The Administrative Wage and Labor Market Flow Panel," FAU Discussion Papers in Economics 01/2017, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics, revised 2018.
    7. Mario Bossler & Nicole Gürtzgen & Alexander Kubis & Benjamin Küfner & Benjamin Lochner, 2020. "The IAB Job Vacancy Survey: design and research potential," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 54(1), pages 1-12, December.
    8. J. Michael Brick & Douglas Williams, 2013. "Explaining Rising Nonresponse Rates in Cross-Sectional Surveys," The ANNALS of the American Academy of Political and Social Science, , vol. 645(1), pages 36-59, January.
    9. R?diger Bachmann & Steffen Elstner & Eric R. Sims, 2013. "Uncertainty and Economic Activity: Evidence from Business Survey Data," American Economic Journal: Macroeconomics, American Economic Association, vol. 5(2), pages 217-249, April.
    10. Mario Bossler & Nicole Gürtzgen & Alexander Kubis & Benjamin Küfner & Benjamin Lochner, 2020. "The IAB Job Vacancy Survey: design and research potential," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 54(1), pages 1-12, December.
    11. repec:mpr:mprres:4780 is not listed on IDEAS
    12. Kapelner, Adam & Bleich, Justin, 2016. "bartMachine: Machine Learning with Bayesian Additive Regression Trees," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 70(i04).
    13. White, Michael & Bryson, Alex, 2013. "Positive employee attitudes: how much human resource management do you need?," LSE Research Online Documents on Economics 51167, London School of Economics and Political Science, LSE Library.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin Küfner & Joseph W. Sakshaug & Stefan Zins, 2022. "Establishment survey participation during the COVID-19 pandemic," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 56(1), pages 1-18, December.
    2. Lochner, Benjamin & Merkl, Christian & Stüber, Heiko & Gürtzgen, Nicole, 2021. "Recruiting intensity and hiring practices: Cross-sectional and time-series evidence," Labour Economics, Elsevier, vol. 68(C).
    3. Martin Huber & David Imhof & Rieko Ishii, 2022. "Transnational machine learning with screens for flagging bid‐rigging cartels," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 1074-1114, July.
    4. Gürtzgen, Nicole & Küfner, Benjamin, 2021. "Hirings in the IAB Job Vacancy Survey and the administrative data - an aggregate comparison," FDZ Methodenreport 202102_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    5. repec:iab:iabfda:202109(de is not listed on IDEAS
    6. repec:iab:iabfme:202102(en is not listed on IDEAS
    7. Bossler, Mario & Popp, Martin, 2024. "Labor Demand on a Tight Leash," IZA Discussion Papers 16837, Institute of Labor Economics (IZA).
    8. repec:iab:iabfda:202109(en is not listed on IDEAS
    9. Mario Bossler & Martin Popp, 2022. "Labor Demand on a Tight Leash," Papers 2203.05593, arXiv.org, revised Feb 2024.
    10. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    11. Nikolay Hristov & Markus Roth, 2019. "Uncertainty Shocks and Financial Crisis Indicators," CESifo Working Paper Series 7839, CESifo.
    12. John S. Heywood & W.S. Siebert & Xiangdong Wei, 2011. "Estimating the Use of Agency Workers: Can Family-Friendly Practices Reduce Their Use?," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 50(3), pages 535-564, July.
    13. Bonciani, Dario, 2015. "Estimating the effects of uncertainty over the business cycle," MPRA Paper 65921, University Library of Munich, Germany.
    14. Jan Kluge & Sarah Lappöhn & Kerstin Plank, 2023. "Predictors of TFP growth in European countries," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 50(1), pages 109-140, February.
    15. Idriss Fontaine, 2021. "Uncertainty and Labour Force Participation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(2), pages 437-471, April.
    16. Salzmann, Leonard, 2020. "The Impact of Uncertainty and Financial Shocks in Recessions and Booms," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224588, Verein für Socialpolitik / German Economic Association.
    17. Ernesto Carrella & Richard M. Bailey & Jens Koed Madsen, 2018. "Indirect inference through prediction," Papers 1807.01579, arXiv.org.
    18. Rui Wang & Naihua Xiu & Kim-Chuan Toh, 2021. "Subspace quadratic regularization method for group sparse multinomial logistic regression," Computational Optimization and Applications, Springer, vol. 79(3), pages 531-559, July.
    19. Marfatia, Hardik A., 2015. "Monetary policy's time-varying impact on the US bond markets: Role of financial stress and risks," The North American Journal of Economics and Finance, Elsevier, vol. 34(C), pages 103-123.
    20. Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.
    21. Kyle Jurado & Sydney C. Ludvigson & Serena Ng, 2015. "Measuring Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1177-1216, March.
    22. Masakazu Higuchi & Mitsuteru Nakamura & Shuji Shinohara & Yasuhiro Omiya & Takeshi Takano & Daisuke Mizuguchi & Noriaki Sonota & Hiroyuki Toda & Taku Saito & Mirai So & Eiji Takayama & Hiroo Terashi &, 2022. "Detection of Major Depressive Disorder Based on a Combination of Voice Features: An Exploratory Approach," IJERPH, MDPI, vol. 19(18), pages 1-13, September.
    23. Alessandri, Piergiorgio & Mumtaz, Haroon, 2019. "Financial regimes and uncertainty shocks," Journal of Monetary Economics, Elsevier, vol. 101(C), pages 31-46.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:s2:p:s310-s342. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.