IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022i3p798-821.html
   My bibliography  Save this article

Transitioning a panel survey from in‐person to predominantly web data collection: Results and lessons learned

Author

Listed:
  • Paul P. Biemer
  • Kathleen Mullan Harris
  • Brian J. Burke
  • Dan Liao
  • Carolyn Tucker Halpern

Abstract

Over the last two decades, in‐person interviewing costs continued to increase while the data quality advantages traditionally identified with this data collection mode have faded. Consequently, some longitudinal surveys have begun transitioning from in‐person to web data collection despite risks to data quality and longitudinal comparability. This paper addresses the major issues involved in the transition process and proposes a multi‐sample, multi‐phase responsive design that attempts to minimize the data quality risks while preserving the considerable cost savings promised by the transition. The paper describes the design as it was applied to the National Longitudinal Study of Adolescent to Adult Health (Add Health)—a nationally representative panel survey of around 20,000 adolescents selected from grades 7 to 12 (typically 13 to 18 years of age) in the 1994–95 school year. Also described are key results from several experiments embedded within the design and the analysis of mode effects. Also presented are some lessons learned and recommendations for other in‐person panel surveys that may be contemplating a similar transition to web or mixed‐mode data collection.

Suggested Citation

  • Paul P. Biemer & Kathleen Mullan Harris & Brian J. Burke & Dan Liao & Carolyn Tucker Halpern, 2022. "Transitioning a panel survey from in‐person to predominantly web data collection: Results and lessons learned," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 798-821, July.
    • Handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:798-821
    DOI: 10.1111/rssa.12750
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12750
    Download Restriction: no
    File URL: https://libkey.io/10.1111/rssa.12750?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Robert M. Groves & Steven G. Heeringa, 2006. "Responsive design for household surveys: tools for actively controlling survey errors and costs," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 439-457, July.
    2. Abowd, John M & Zellner, Arnold, 1985. "Estimating Gross Labor-Force Flows," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(3), pages 254-283, June.
    3. Lynn, Peter, 2009. "Sample design for Understanding Society," Understanding Society Working Paper Series 2009-01, Understanding Society at the Institute for Social and Economic Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lynn, Peter, 2014. "Targeted initial letters to longitudinal survey sample members: effects on response rates, response speed, and sample composition," Understanding Society Working Paper Series 2014-08, Understanding Society at the Institute for Social and Economic Research.
    2. Lagorio, Carlos, 2016. "Call and response: modelling longitudinal contact and cooperation using Wave 1 call records data," Understanding Society Working Paper Series 2016-01, Understanding Society at the Institute for Social and Economic Research.
    3. Kibuchi, Eliud & Durrant, Gabriele B. & Maslovskaya, Olga & Sturgis, Patrick, 2024. "An assessment of the utility of a Bayesian framework to improve response propensity modes in longitudinal data," LSE Research Online Documents on Economics 126599, London School of Economics and Political Science, LSE Library.
    4. Annamaria Bianchi & Silvia Biffignandi, 2019. "Social Indicators to Explain Response in Longitudinal Studies," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(3), pages 931-957, February.
    5. Elsby, Michael W.L. & Hobijn, Bart & Şahin, Ayşegül, 2015. "On the importance of the participation margin for labor market fluctuations," Journal of Monetary Economics, Elsevier, vol. 72(C), pages 64-82.
    6. Isabel Cairó & Shigeru Fujita & Camilo Morales-Jimenez, 2020. "The Cyclicality of Labor Force Participation Flows: The Role of Labor Supply Elasticities and Wage Rigidity," Working Papers 20-23, Federal Reserve Bank of Philadelphia.
    7. Helge Braun & Reinout De Bock & Riccardo DiCecio, 2006. "Aggregate shocks and labor market fluctuations," Working Papers 2006-004, Federal Reserve Bank of St. Louis.
    8. Shigeru Fujita, 2004. "Vacancy persistence," Working Papers 04-23, Federal Reserve Bank of Philadelphia.
    9. Shigeru Fujita, 2011. "Dynamics of worker flows and vacancies: evidence from the sign restriction approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 89-121, January/F.
    10. Donald R. Williams, 1991. "A dynamic analysis of recent changes in the rate of part-time employment," Working Papers (Old Series) 9120, Federal Reserve Bank of Cleveland.
    11. Early Kirstin & Mankoff Jennifer & Fienberg Stephen E., 2017. "Dynamic Question Ordering in Online Surveys," Journal of Official Statistics, Sciendo, vol. 33(3), pages 625-657, September.
    12. Signore Marina & Scanu Mauro & Brancato Giovanna, 2015. "Statistical Metadata: a Unified Approach to Management and Dissemination," Journal of Official Statistics, Sciendo, vol. 31(2), pages 325-347, June.
    13. Borowczyk-Martins, Daniel & Lalé, Etienne, 2020. "The ins and outs of involuntary part-time employment," Labour Economics, Elsevier, vol. 67(C).
    14. Särndal Carl-Erik & Lundquist Peter, 2017. "Inconsistent Regression and Nonresponse Bias: Exploring Their Relationship as a Function of Response Imbalance," Journal of Official Statistics, Sciendo, vol. 33(3), pages 709-734, September.
    15. Robert Dixon & G. C. Lim & Jan C. van Ours, 2015. "The effect of shocks to labour market flows on unemployment and participation rates," Applied Economics, Taylor & Francis Journals, vol. 47(24), pages 2523-2539, May.
    16. Altorjai, Szilvia, 2013. "Over-qualification of immigrants in the UK," ISER Working Paper Series 2013-11, Institute for Social and Economic Research.
    17. Chun Asaph Young & Schouten Barry & Wagner James, 2017. "JOS Special Issue on Responsive and Adaptive Survey Design: Looking Back to See Forward – Editorial: In Memory of Professor Stephen E. Fienberg, 1942–2016," Journal of Official Statistics, Sciendo, vol. 33(3), pages 571-577, September.
    18. Bianchi Annamaria & Biffignandi Silvia & Lynn Peter, 2017. "Web-Face-to-Face Mixed-Mode Design in a Longitudinal Survey: Effects on Participation Rates, Sample Composition, and Costs," Journal of Official Statistics, Sciendo, vol. 33(2), pages 385-408, June.
    19. Reza C. Daniels, 2012. "A Framework for Investigating Micro Data Quality, with Application to South African Labour Market Household Surveys," SALDRU Working Papers 90, Southern Africa Labour and Development Research Unit, University of Cape Town.
    20. Robert E. Hall & Sam Schulhofer-Wohl, 2018. "Measuring Job-Finding Rates and Matching Efficiency with Heterogeneous Job-Seekers," American Economic Journal: Macroeconomics, American Economic Association, vol. 10(1), pages 1-32, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:798-821. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.