IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v47y2018i2p314-348.html

The Use of a Nonprobability Internet Panel to Monitor Sexual and Reproductive Health in the General Population

Author

Listed:
  • Stéphane Legleye
  • Géraldine Charrance
  • Nicolas Razafindratsima
  • Nathalie Bajos
  • Aline Bohet
  • Caroline Moreau

Abstract

Background: Reliability of nonprobability online volunteer panels for epidemiological purposes has rarely been studied. Objectives: To assess the quality of a questionnaire on sexual and reproductive health (SRH) administered in a nonprobability Web panel and in a random telephone survey ( n = 8,992; n = 8,437, age 16–49 years). Especially, we were interested in the possible difference in the association of sociodemographic variables and some outcome variables in the two surveys that are in the reliability of analytical epidemiological studies conducted in such panels. Methods: Interventions to increase response rate were used in both surveys (four e-mail reminders, high number of call attempts and callbacks to refusals). Both were calibrated on the census population. Sociodemographic composition, effects of reminders, and prevalence were compared to their telephone counterpart. In addition, the associations of sociodemographic and sexual behaviors were compared in the two samples in multivariate logistic regressions. Results: The online survey had a lower response rate (20.0 percent vs. 44.8 percent) and a more distorted sociodemographic structure although the reminders improved the representativeness as did the analogous interventions on the telephone survey. Prevalences of SRH variables were similar for the common behaviors but higher online for the stigmatized behaviors, depending on gender. Overall, 29 percent of the 63 interactions studied were significant for males and 11 percent for women, although opposite effects of sociodemographic variables were rare (5 percent of the 171 tested for each gender). Conclusion: Nonprobability online panels are to be used with caution to monitor SRH and conduct analytical epidemiological studies, especially among men.

Suggested Citation

  • Stéphane Legleye & Géraldine Charrance & Nicolas Razafindratsima & Nathalie Bajos & Aline Bohet & Caroline Moreau, 2018. "The Use of a Nonprobability Internet Panel to Monitor Sexual and Reproductive Health in the General Population," Sociological Methods & Research, , vol. 47(2), pages 314-348, March.
    • Handle: RePEc:sae:somere:v:47:y:2018:i:2:p:314-348
    DOI: 10.1177/0049124115621333
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124115621333
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0049124115621333?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matthias Schonlau & Arthur Van Soest & Arie Kapteyn, 2007. "Are 'Webographic' or Attitudinal Questions Useful for Adjusting Estimates From Web Surveys Using Propensity Scoring?," Working Papers WR-506, RAND Corporation.
    2. Matthias Schonlau & Arthur van Soest & Arie Kapteyn & Mick Couper, 2009. "Selection Bias in Web Surveys and the Use of Propensity Scores," Sociological Methods & Research, , vol. 37(3), pages 291-318, February.
    3. Gergana Y. Nenkov & Maureen Morrin & Andrew Ward & Barry Schwartz & John Hulland, 2008. "A short form of the Maximization Scale: Factor structure, reliability and validity studies," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 3, pages 371-388, June.
    4. Matthias Schonlau & Arthur Van Soest & Arie Kapteyn, 2007. "Are 'Webographic' or Attitudinal Questions Useful for Adjusting Estimates From Web Surveys Using Propensity Scoring?," Working Papers 506, RAND Corporation.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard Valliant & Jill A. Dever, 2011. "Estimating Propensity Adjustments for Volunteer Web Surveys," Sociological Methods & Research, , vol. 40(1), pages 105-137, February.
    2. repec:aia:aiaswp:wp76 is not listed on IDEAS
    3. Ramón Ferri-García & María del Mar Rueda, 2022. "Variable selection in Propensity Score Adjustment to mitigate selection bias in online surveys," Statistical Papers, Springer, vol. 63(6), pages 1829-1881, December.
    4. Luis Castro-Martín & Maria del Mar Rueda & Ramón Ferri-García, 2020. "Inference from Non-Probability Surveys with Statistical Matching and Propensity Score Adjustment Using Modern Prediction Techniques," Mathematics, MDPI, vol. 8(6), pages 1-19, June.
    5. Buil-Gil, David & Solymosi, Reka & Moretti, Angelo, 2019. "Non-parametric bootstrap and small area estimation to mitigate bias in crowdsourced data. Simulation study and application to perceived safety," SocArXiv 8hgjt, Center for Open Science.
    6. Sunghee Lee & Richard Valliant, 2009. "Estimation for Volunteer Panel Web Surveys Using Propensity Score Adjustment and Calibration Adjustment," Sociological Methods & Research, , vol. 37(3), pages 319-343, February.
    7. Nathan N. Cheek & Jacob Goebel, 2020. "What does it mean to maximize? “Decision difficulty,†indecisiveness, and the jingle-jangle fallacies in the measurement of maximizing," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(1), pages 7-24, January.
    8. Fiore, M. & Gaviglio, A. & Demartini, E. & La Sala, P., 2018. "Sugarcoating Food Technologies and consumers’ acceptance of long-life fish," 2018 Conference, July 28-August 2, 2018, Vancouver, British Columbia 275971, International Association of Agricultural Economists.
    9. Ali Besharat & Daniel Ladik & François Carrillat, 2014. "Are maximizers blind to the future? When today’s best does not make for a better tomorrow," Marketing Letters, Springer, vol. 25(1), pages 77-91, March.
    10. Guzi, Martin & de Pedraza, Pablo, 2013. "A Web Survey Analysis of the Subjective Well-being of Spanish Workers," IZA Discussion Papers 7618, Institute of Labor Economics (IZA).
    11. Joel Martin & Michael Toczko & Emily Locke & Ryan McCarthy & Italia Milani & Nathalie Barrios & Samer Koutoubi & Jatin Ambegaonkar & Niyati Dhokai & Ali Boolani, 2022. "Influence of Grit on Physical Activity, Sitting Time and Dietary Behaviors: A Multi-Study Analysis," Sustainability, MDPI, vol. 15(1), pages 1-14, December.
    12. Ulla A. Saari & Rupert J. Baumgartner & Saku J. Mäkinen, 2017. "Eco-Friendly Brands to Drive Sustainable Development: Replication and Extension of the Brand Experience Scale in a Cross-National Context," Sustainability, MDPI, vol. 9(7), pages 1-26, July.
    13. Dalia L. Diab & Michael A. Gillespie & Scott Highhouse, 2008. "Are maximizers really unhappy? The measurement of maximizing tendency," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 3, pages 364-370, June.
    14. Dewaele Alexis & Caen Maya & Buysse Ann, 2014. "Comparing Survey and Sampling Methods for Reaching Sexual Minority Individuals in Flanders," Journal of Official Statistics, Sciendo, vol. 30(2), pages 251-251, June.
    15. Doust, Negin Ahmadi Saber & van Esch, Patrick & Kemper, Joya & Franklin, Drew & Casserly, Shane, 2021. "Marketing the use of headgear in high contact sports," Journal of Retailing and Consumer Services, Elsevier, vol. 59(C).
    16. Brandon M. Turner & Hye Bin Rim & Nancy E. Betz & Thomas E. Nygren, 2012. "The Maximization Inventory," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 7(1), pages 48-60, January.
    17. Grewenig, Elisabeth & Lergetporer, Philipp & Simon, Lisa & Werner, Katharina & Woessmann, Ludger, 2018. "Can Online Surveys Represent the Entire Population?," IZA Discussion Papers 11799, Institute of Labor Economics (IZA).
    18. Maciej Berȩsewicz & Dagmara Nikulin, 2021. "Estimation of the size of informal employment based on administrative records with non‐ignorable selection mechanism," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(3), pages 667-690, June.
    19. Arthur van Soest & Arie Kapteyn, 2009. "Mode and Context Effects in Measuring Household Assets," Working Papers 200949, Geary Institute, University College Dublin.
    20. Almut Schumann & Detlev Lück, 2023. "Better to ask online when it concerns intimate relationships? Survey mode differences in the assessment of relationship quality," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 48(22), pages 609-640.
    21. Ana Alina Tudoran, 2022. "A machine learning approach to identifying decision-making styles for managing customer relationships," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(1), pages 351-374, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:47:y:2018:i:2:p:314-348. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.