IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v47y2018i2p314-348.html

The Use of a Nonprobability Internet Panel to Monitor Sexual and Reproductive Health in the General Population

Author

Listed:
  • Stéphane Legleye
  • Géraldine Charrance
  • Nicolas Razafindratsima
  • Nathalie Bajos
  • Aline Bohet
  • Caroline Moreau

Abstract

Background: Reliability of nonprobability online volunteer panels for epidemiological purposes has rarely been studied. Objectives: To assess the quality of a questionnaire on sexual and reproductive health (SRH) administered in a nonprobability Web panel and in a random telephone survey ( n = 8,992; n = 8,437, age 16–49 years). Especially, we were interested in the possible difference in the association of sociodemographic variables and some outcome variables in the two surveys that are in the reliability of analytical epidemiological studies conducted in such panels. Methods: Interventions to increase response rate were used in both surveys (four e-mail reminders, high number of call attempts and callbacks to refusals). Both were calibrated on the census population. Sociodemographic composition, effects of reminders, and prevalence were compared to their telephone counterpart. In addition, the associations of sociodemographic and sexual behaviors were compared in the two samples in multivariate logistic regressions. Results: The online survey had a lower response rate (20.0 percent vs. 44.8 percent) and a more distorted sociodemographic structure although the reminders improved the representativeness as did the analogous interventions on the telephone survey. Prevalences of SRH variables were similar for the common behaviors but higher online for the stigmatized behaviors, depending on gender. Overall, 29 percent of the 63 interactions studied were significant for males and 11 percent for women, although opposite effects of sociodemographic variables were rare (5 percent of the 171 tested for each gender). Conclusion: Nonprobability online panels are to be used with caution to monitor SRH and conduct analytical epidemiological studies, especially among men.

Suggested Citation

  • Stéphane Legleye & Géraldine Charrance & Nicolas Razafindratsima & Nathalie Bajos & Aline Bohet & Caroline Moreau, 2018. "The Use of a Nonprobability Internet Panel to Monitor Sexual and Reproductive Health in the General Population," Sociological Methods & Research, , vol. 47(2), pages 314-348, March.
    • Handle: RePEc:sae:somere:v:47:y:2018:i:2:p:314-348
    DOI: 10.1177/0049124115621333
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124115621333
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0049124115621333?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matthias Schonlau & Arthur Van Soest & Arie Kapteyn, 2007. "Are 'Webographic' or Attitudinal Questions Useful for Adjusting Estimates From Web Surveys Using Propensity Scoring?," Working Papers WR-506, RAND Corporation.
    2. Gergana Y. Nenkov & Maureen Morrin & Andrew Ward & Barry Schwartz & John Hulland, 2008. "A short form of the Maximization Scale: Factor structure, reliability and validity studies," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 3, pages 371-388, June.
    3. Matthias Schonlau & Arthur Van Soest & Arie Kapteyn, 2007. "Are 'Webographic' or Attitudinal Questions Useful for Adjusting Estimates From Web Surveys Using Propensity Scoring?," Working Papers 506, RAND Corporation.
    4. Matthias Schonlau & Arthur van Soest & Arie Kapteyn & Mick Couper, 2009. "Selection Bias in Web Surveys and the Use of Propensity Scores," Sociological Methods & Research, , vol. 37(3), pages 291-318, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard Valliant & Jill A. Dever, 2011. "Estimating Propensity Adjustments for Volunteer Web Surveys," Sociological Methods & Research, , vol. 40(1), pages 105-137, February.
    2. repec:aia:aiaswp:wp76 is not listed on IDEAS
    3. Ramón Ferri-García & María del Mar Rueda, 2022. "Variable selection in Propensity Score Adjustment to mitigate selection bias in online surveys," Statistical Papers, Springer, vol. 63(6), pages 1829-1881, December.
    4. Luis Castro-Martín & Maria del Mar Rueda & Ramón Ferri-García, 2020. "Inference from Non-Probability Surveys with Statistical Matching and Propensity Score Adjustment Using Modern Prediction Techniques," Mathematics, MDPI, vol. 8(6), pages 1-19, June.
    5. Buil-Gil, David & Solymosi, Reka & Moretti, Angelo, 2019. "Non-parametric bootstrap and small area estimation to mitigate bias in crowdsourced data. Simulation study and application to perceived safety," SocArXiv 8hgjt, Center for Open Science.
    6. Sunghee Lee & Richard Valliant, 2009. "Estimation for Volunteer Panel Web Surveys Using Propensity Score Adjustment and Calibration Adjustment," Sociological Methods & Research, , vol. 37(3), pages 319-343, February.
    7. Nathan N. Cheek & Jacob Goebel, 2020. "What does it mean to maximize? “Decision difficulty,†indecisiveness, and the jingle-jangle fallacies in the measurement of maximizing," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(1), pages 7-24, January.
    8. Guzi, Martin & de Pedraza, Pablo, 2013. "A Web Survey Analysis of the Subjective Well-being of Spanish Workers," IZA Discussion Papers 7618, Institute of Labor Economics (IZA).
    9. Dalia L. Diab & Michael A. Gillespie & Scott Highhouse, 2008. "Are maximizers really unhappy? The measurement of maximizing tendency," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 3, pages 364-370, June.
    10. Brandon M. Turner & Hye Bin Rim & Nancy E. Betz & Thomas E. Nygren, 2012. "The Maximization Inventory," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 7(1), pages 48-60, January.
    11. Maciej Berȩsewicz & Dagmara Nikulin, 2021. "Estimation of the size of informal employment based on administrative records with non‐ignorable selection mechanism," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(3), pages 667-690, June.
    12. Ana Alina Tudoran, 2022. "A machine learning approach to identifying decision-making styles for managing customer relationships," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 351-374, March.
    13. Muthaffar, Aisha & Vilches-Montero, Sonia, 2023. "Empowering retailers: A bounded rationality perspective to enhancing omnichannel journey satisfaction," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    14. Nicole M. Giacopelli & Kaila M. Simpson & Reeshad S. Dalal & Kristen L. Randolph & Samantha J. Holland, 2013. "Maximizing as a predictor of job satisfaction and performance: A tale of three scales," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 8(4), pages 448-469, July.
    15. Crossley, Thomas F. & Fisher, Paul & Low, Hamish, 2021. "The heterogeneous and regressive consequences of COVID-19: Evidence from high quality panel data," Journal of Public Economics, Elsevier, vol. 193(C).
    16. Andrew E. Reed & Joseph A. Mikels & Corinna E. Lockenhoff, 2012. "Choosing with confidence: Self-efficacy and preferences for choice," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 7(2), pages 173-180, March.
    17. Ola Andersson & Jim Ingebretsen Carlson & Erik Wengström, 2021. "Differences Attract: An Experimental Study of Focusing in Economic Choice," The Economic Journal, Royal Economic Society, vol. 131(639), pages 2671-2692.
    18. François Carrillat & Daniel Ladik & Renaud Legoux, 2011. "When the decision ball keeps rolling: An investigation of the Sisyphus effect among maximizing consumers," Marketing Letters, Springer, vol. 22(3), pages 283-296, September.
    19. Hildebrand Sean, 2015. "Coerced Confusion? Local Emergency Policy Implementation After September 11," Journal of Homeland Security and Emergency Management, De Gruyter, vol. 12(2), pages 273-298, June.
    20. Harris, Patricia & Dall’Olmo Riley, Francesca & Hand, Chris, 2021. "Multichannel shopping: The effect of decision making style on shopper journey configuration and satisfaction," Journal of Retailing and Consumer Services, Elsevier, vol. 58(C).
    21. Khare, Adwait & Chowdhury, Tilottama G. & Morgan, Jeremy, 2021. "Maximizers and Satisficers: Can’t choose and Can’t reject," Journal of Business Research, Elsevier, vol. 135(C), pages 731-748.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:47:y:2018:i:2:p:314-348. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.