IDEAS home Printed from https://ideas.repec.org/a/vrs/offsta/v38y2022i4p963-986n6.html
   My bibliography  Save this article

Testing a Planned Missing Design to Reduce Respondent Burden in Web and SMS Administrations of the CAHPS Clinician and Group Survey (CG-CAHPS)

Author

Listed:
  • Brenner Philip S.

    (Department of Methodology and Statistics, Padualaan 14, 3584 CH Utrecht, The Netherlands.)

  • Hargraves J. Lee

    (Center for Survey Research, University of Massachusetts Boston, 100 Morrissey Blvd. Boston, MA 02125 (617) 287-7200 U.S.A.)

  • Cosenza Carol

    (Center for Survey Research, University of Massachusetts Boston, 100 Morrissey Blvd. Boston, MA 02125 (617) 287-7200 U.S.A.)

Abstract

We test a planned missing design to reduce respondent burden in Web and SMS administrations of the CAHPS Clinician and Group Survey (CG-CAHPS), a survey of patient experiences widely used by health care providers. Members of an online nonprobability panel were randomly assigned to one of three invitation and data collection mode protocols: email invitation to a Web survey, SMS invitation to a Web survey, or SMS invitation to an SMS survey. Within these three mode protocols, respondents were randomly assigned to a planned missing design, which shortened the survey by about 40%, or to a control group that received the survey in its entirety. We compare survey duration, breakoff and completion rates, and five key patient experience measures across conditions to assess the effect of the planned missing design across the three modes. We found that a planned missing design worked well with our Web survey, reducing survey duration and breakoff without changing estimates relative to the full-survey control condition. However, mixed findings in the SMS survey suggest that even shortened, 15-item surveys may be too long to substantially reduce respondent burden. We conclude with recommendations for future research.

Suggested Citation

  • Brenner Philip S. & Hargraves J. Lee & Cosenza Carol, 2022. "Testing a Planned Missing Design to Reduce Respondent Burden in Web and SMS Administrations of the CAHPS Clinician and Group Survey (CG-CAHPS)," Journal of Official Statistics, Sciendo, vol. 38(4), pages 963-986, December.
    • Handle: RePEc:vrs:offsta:v:38:y:2022:i:4:p:963-986:n:6
    DOI: 10.2478/jos-2022-0042
    as

    Download full text from publisher

    File URL: https://doi.org/10.2478/jos-2022-0042
    Download Restriction: no
    File URL: https://libkey.io/10.2478/jos-2022-0042?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Philip S. Brenner & John D. DeLamater, 2013. "Paradata correlates of data quality in an SMS time use study – Evidence from a validation study," electronic International Journal of Time Use Research, Research Institute on Professions (Forschungsinstitut Freie Berufe (FFB)) and The International Association for Time Use Research (IATUR), vol. 10(1), pages 38-54, November.
    2. Toepoel, V. & Das, J.W.M. & van Soest, A.H.O., 2008. "Design Effects in Web Surveys : Comparing Trained and Fresh Respondents," Other publications TiSEM 4c8b40aa-7557-4844-9474-b, Tilburg University, School of Economics and Management.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. van der Cruijsen, Carin & de Haan, Jakob & van Rooij, Maarten, 2025. "The association of high perceived inflation with trust in national politics and central banks✰," Journal of Banking & Finance, Elsevier, vol. 171(C).
    2. repec:plo:pone00:0196020 is not listed on IDEAS
    3. Sandorf, Erlend Dancke & Persson, Lars & Broberg, Thomas, 2020. "Using an integrated choice and latent variable model to understand the impact of “professional” respondents in a stated preference survey," Resource and Energy Economics, Elsevier, vol. 61(C).
    4. Fabo, B., 2017. "Towards an understanding of job matching using web data," Other publications TiSEM b8b877f2-ae6a-495f-b6cc-9, Tilburg University, School of Economics and Management.
    5. Philip Brenner & John DeLamater, 2014. "Social Desirability Bias in Self-reports of Physical Activity: Is an Exercise Identity the Culprit?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(2), pages 489-504, June.
    6. Das, J.W.M., 2012. "Innovation in online data collection for scientific research : The Dutch MESS project," Other publications TiSEM a0b2ab31-8491-43f0-bdf6-0, Tilburg University, School of Economics and Management.
    7. repec:plo:pone00:0166858 is not listed on IDEAS

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:offsta:v:38:y:2022:i:4:p:963-986:n:6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.