IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0282591.html
   My bibliography  Save this article

Shedding light on participant selection bias in Ecological Momentary Assessment (EMA) studies: Findings from an internet panel study

Author

Listed:
  • Arthur A Stone
  • Stefan Schneider
  • Joshua M Smyth
  • Doerte U Junghaenel
  • Cheng Wen
  • Mick P Couper
  • Sarah Goldstein

Abstract

Although the potential for participant selection bias is readily acknowledged in the momentary data collection literature, very little is known about uptake rates in these studies or about differences in the people that participate versus those who do not. This study analyzed data from an existing Internet panel of older people (age 50 and greater) who were offered participation into a momentary study (n = 3,169), which made it possible to compute uptake and to compare many characteristics of participation status. Momentary studies present participants with brief surveys multiple times a day over several days; these surveys ask about immediate or recent experiences. A 29.1% uptake rate was observed when all respondents were considered, whereas a 39.2% uptake rate was found when individuals who did not have eligible smartphones (necessary for ambulatory data collection) were eliminated from the analyses. Taking into account the participation rate for being in this Internet panel, we estimate uptake rates for the general population to be about 5%. A consistent pattern of differences emerged between those who accepted the invitation to participate versus those who did not (in univariate analyses): participants were more likely to be female, younger, have higher income, have higher levels of education, rate their health as better, be employed, not be retired, not be disabled, have better self-rated computer skills, and to have participated in more prior Internet surveys (all p

Suggested Citation

  • Arthur A Stone & Stefan Schneider & Joshua M Smyth & Doerte U Junghaenel & Cheng Wen & Mick P Couper & Sarah Goldstein, 2023. "Shedding light on participant selection bias in Ecological Momentary Assessment (EMA) studies: Findings from an internet panel study," PLOS ONE, Public Library of Science, vol. 18(3), pages 1-20, March.
  • Handle: RePEc:plo:pone00:0282591
    DOI: 10.1371/journal.pone.0282591
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0282591
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0282591&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0282591?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Katharine G. Abraham & Aaron Maitland & Suzanne M. Bianchi, 2006. "Non-response in the American Time Use Survey: Who Is Missing from the Data and How Much Does It Matter?," NBER Technical Working Papers 0328, National Bureau of Economic Research, Inc.
    2. James Heckman, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    3. Albert Cheng & Gema Zamarro & Bart Orriens, 2020. "Personality as a Predictor of Unit Nonresponse in an Internet Panel," Sociological Methods & Research, , vol. 49(3), pages 672-698, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Darima Fotheringham & Michael A. Wiles, 2023. "The effect of implementing chatbot customer service on stock returns: an event study analysis," Journal of the Academy of Marketing Science, Springer, vol. 51(4), pages 802-822, July.
    2. Song, Wei-Ling & Uzmanoglu, Cihan, 2016. "TARP announcement, bank health, and borrowers’ credit risk," Journal of Financial Stability, Elsevier, vol. 22(C), pages 22-32.
    3. Raymundo M. Campos-Vázquez, 2013. "Efectos de los ingresos no reportados en el nivel y tendencia de la pobreza laboral en México," Ensayos Revista de Economia, Universidad Autonoma de Nuevo Leon, Facultad de Economia, vol. 0(2), pages 23-54, November.
    4. Jonathan Gruber & Aaron Yelowitz, 1999. "Public Health Insurance and Private Savings," Journal of Political Economy, University of Chicago Press, vol. 107(6), pages 1249-1274, December.
    5. Campbell, Randall C. & Nagel, Gregory L., 2016. "Private information and limitations of Heckman's estimator in banking and corporate finance research," Journal of Empirical Finance, Elsevier, vol. 37(C), pages 186-195.
    6. Leye Li & Louise Yi Lu & Dongyue Wang, 2022. "External labour market competitions and stock price crash risk: evidence from exposures to competitor CEOs’ award‐winning events," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 62(S1), pages 1421-1460, April.
    7. Calcagno, R. & Renneboog, L.D.R., 2004. "Capital Structure and Managerial Compensation : The Effects of Renumeration Seniority," Discussion Paper 2004-120, Tilburg University, Center for Economic Research.
    8. Son K. Lam & Thomas E. DeCarlo & Ashish Sharma, 2019. "Salesperson ambidexterity in customer engagement: do customer base characteristics matter?," Journal of the Academy of Marketing Science, Springer, vol. 47(4), pages 659-680, July.
    9. McCausland, David & Pouliakas, Konstantinos & Theodossiou, Ioannis, 2005. "Some are Punished and Some are Rewarded: A Study of the Impact of Performance Pay on Job Satisfaction," MPRA Paper 14243, University Library of Munich, Germany.
    10. Gary F. Peters & Andrea M. Romi & Juan Manuel Sanchez, 2019. "The Influence of Corporate Sustainability Officers on Performance," Journal of Business Ethics, Springer, vol. 159(4), pages 1065-1087, November.
    11. Fossen, Frank M. & König, Johannes, 2015. "Public health insurance and entry into self-employment," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112934, Verein für Socialpolitik / German Economic Association.
    12. Li, Chunyu & Lou, Chenxin & Luo, Dan & Xing, Kai, 2021. "Chinese corporate distress prediction using LASSO: The role of earnings management," International Review of Financial Analysis, Elsevier, vol. 76(C).
    13. Fernando Rios-Avila & Gustavo J. Canavire-Bacarreza, 2017. "Standard Error Correction in Two-Stage Optimization Models: A Quasi-Maximum Likelihood Estimation Approach," Documentos de Trabajo de Valor Público 15659, Universidad EAFIT.
    14. Brian H. Boyer & Taylor D. Nadauld & Keith P. Vorkink & Michael S. Weisbach, 2023. "Discount‐Rate Risk in Private Equity: Evidence from Secondary Market Transactions," Journal of Finance, American Finance Association, vol. 78(2), pages 835-885, April.
    15. Olga Kadreva, 2016. "The influence of quantity and age of children on working women’ salaries," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 41, pages 62-77.
    16. Stolowy, Hervé & Jeanjean, Thomas & Erkens, Michael, 2011. "The economic consequences of increasing the international visibility of financial reports," HEC Research Papers Series 957, HEC Paris.
    17. Bruneel, Johan & Clarysse, Bart & Bobelyn, Annelies & Wright, Mike, 2020. "Liquidity events and VC-backed academic spin-offs: The role of search alliances," Research Policy, Elsevier, vol. 49(10).
    18. Leon Zolotoy & Don O’Sullivan & Keke Song, 2021. "The Role of Ethical Standards in the Relationship Between Religious Social Norms and M&A Announcement Returns," Journal of Business Ethics, Springer, vol. 170(4), pages 721-742, May.
    19. Christine M. Chan & Lei Shi & Jingtao Yi, 2024. "Home country’s economic and political institutions: firms’ ownership decisions in cross-border acquisitions," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 55(8), pages 1020-1037, October.
    20. Otrachshenko, Vladimir & Popova, Olga, 2024. "Environment vs. Economic Growth: Do Environmental Preferences Translate Into Support for Green Parties?," IZA Discussion Papers 17475, Institute of Labor Economics (IZA).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0282591. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.