IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v185y2022i3p798-821.html
   My bibliography  Save this article

Transitioning a panel survey from in‐person to predominantly web data collection: Results and lessons learned

Author

Listed:
  • Paul P. Biemer
  • Kathleen Mullan Harris
  • Brian J. Burke
  • Dan Liao
  • Carolyn Tucker Halpern

Abstract

Over the last two decades, in‐person interviewing costs continued to increase while the data quality advantages traditionally identified with this data collection mode have faded. Consequently, some longitudinal surveys have begun transitioning from in‐person to web data collection despite risks to data quality and longitudinal comparability. This paper addresses the major issues involved in the transition process and proposes a multi‐sample, multi‐phase responsive design that attempts to minimize the data quality risks while preserving the considerable cost savings promised by the transition. The paper describes the design as it was applied to the National Longitudinal Study of Adolescent to Adult Health (Add Health)—a nationally representative panel survey of around 20,000 adolescents selected from grades 7 to 12 (typically 13 to 18 years of age) in the 1994–95 school year. Also described are key results from several experiments embedded within the design and the analysis of mode effects. Also presented are some lessons learned and recommendations for other in‐person panel surveys that may be contemplating a similar transition to web or mixed‐mode data collection.

Suggested Citation

  • Paul P. Biemer & Kathleen Mullan Harris & Brian J. Burke & Dan Liao & Carolyn Tucker Halpern, 2022. "Transitioning a panel survey from in‐person to predominantly web data collection: Results and lessons learned," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(3), pages 798-821, July.
    • Handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:798-821
    DOI: 10.1111/rssa.12750
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12750
    Download Restriction: no
    File URL: https://libkey.io/10.1111/rssa.12750?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lynn, Peter, 2009. "Sample design for Understanding Society," Understanding Society Working Paper Series 2009-01, Understanding Society at the Institute for Social and Economic Research.
    2. Robert M. Groves & Steven G. Heeringa, 2006. "Responsive design for household surveys: tools for actively controlling survey errors and costs," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(3), pages 439-457, July.
    3. Abowd, John M & Zellner, Arnold, 1985. "Estimating Gross Labor-Force Flows," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(3), pages 254-283, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kibuchi, Eliud & Durrant, Gabriele B. & Maslovskaya, Olga & Sturgis, Patrick, 2024. "An assessment of the utility of a Bayesian framework to improve response propensity modes in longitudinal data," LSE Research Online Documents on Economics 126599, London School of Economics and Political Science, LSE Library.
    2. Lagorio, Carlos, 2016. "Call and response: modelling longitudinal contact and cooperation using Wave 1 call records data," Understanding Society Working Paper Series 2016-01, Understanding Society at the Institute for Social and Economic Research.
    3. Annamaria Bianchi & Silvia Biffignandi, 2019. "Social Indicators to Explain Response in Longitudinal Studies," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(3), pages 931-957, February.
    4. Lynn, Peter, 2014. "Targeted initial letters to longitudinal survey sample members: effects on response rates, response speed, and sample composition," Understanding Society Working Paper Series 2014-08, Understanding Society at the Institute for Social and Economic Research.
    5. Shigeru Fujita, 2011. "Dynamics of worker flows and vacancies: evidence from the sign restriction approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 89-121, January/F.
    6. Borowczyk-Martins, Daniel & Lalé, Etienne, 2020. "The ins and outs of involuntary part-time employment," Labour Economics, Elsevier, vol. 67(C).
    7. Altorjai, Szilvia, 2013. "Over-qualification of immigrants in the UK," ISER Working Paper Series 2013-11, Institute for Social and Economic Research.
    8. Reza C. Daniels, 2012. "A Framework for Investigating Micro Data Quality, with Application to South African Labour Market Household Surveys," SALDRU Working Papers 90, Southern Africa Labour and Development Research Unit, University of Cape Town.
    9. Robert E. Hall & Sam Schulhofer-Wohl, 2018. "Measuring Job-Finding Rates and Matching Efficiency with Heterogeneous Job-Seekers," American Economic Journal: Macroeconomics, American Economic Association, vol. 10(1), pages 1-32, January.
    10. Reist, Benjamin M. & Rodhouse, Joseph B. & Ball, Shane T. & Young, Linda J., 2019. "Subsampling of Nonrespondents in the 2017 Census of Agriculture," NASS Research Reports 322826, United States Department of Agriculture, National Agricultural Statistics Service.
    11. Yashiv, Eran, 2007. "Labor search and matching in macroeconomics," European Economic Review, Elsevier, vol. 51(8), pages 1859-1895, November.
    12. Jiayun Jin & Caroline Vandenplas & Geert Loosveldt, 2019. "The Evaluation of Statistical Process Control Methods to Monitor Interview Duration During Survey Data Collection," SAGE Open, , vol. 9(2), pages 21582440198, June.
    13. Carlos Madeira, 2015. "Identification of Earning Dynamics using Rotating Samples over Short Periods: The Case of Chile," Working Papers Central Bank of Chile 754, Central Bank of Chile.
    14. Roger Tourangeau & J. Michael Brick & Sharon Lohr & Jane Li, 2017. "Adaptive and responsive survey designs: a review and assessment," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(1), pages 203-223, January.
    15. Kathrin Ellieroth & Amanda M. Michaud, 2024. "Quits, Layoffs, and Labor Supply," Opportunity and Inclusive Growth Institute Working Papers 094, Federal Reserve Bank of Minneapolis.
    16. Philip Jung & Moritz Kuhn, 2019. "Earnings Losses and Labor Mobility Over the Life Cycle," Journal of the European Economic Association, European Economic Association, vol. 17(3), pages 678-724.
    17. repec:iab:iabfda:201307(en is not listed on IDEAS
    18. Pietro Garibaldi & Etienne Wasmer, 2005. "Equilibrium Search Unemployment, Endogenous Participation, And Labor Market Flows," Journal of the European Economic Association, MIT Press, vol. 3(4), pages 851-882, June.
    19. Roberts Caroline & Vandenplas Caroline & Herzing Jessica M.E., 2020. "A Validation of R-Indicators as a Measure of the Risk of Bias using Data from a Nonresponse Follow-Up Survey," Journal of Official Statistics, Sciendo, vol. 36(3), pages 675-701, September.
    20. Miyamoto, Hiroaki, 2011. "Cyclical behavior of unemployment and job vacancies in Japan," Japan and the World Economy, Elsevier, vol. 23(3), pages 214-225.
    21. Böhme, Marcus & Stöhr, Tobias, 2012. "Guidelines for the use of household interview duration analysis in CAPI survey management," Kiel Working Papers 1779, Kiel Institute for the World Economy (IfW Kiel).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:185:y:2022:i:3:p:798-821. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.