IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v43y2018i3p354-381.html
   My bibliography  Save this article

Scaled Inverse Probability Weighting: A Method to Assess Potential Bias Due to Event Nonreporting in Ecological Momentary Assessment Studies

Author

Listed:
  • Stephanie A. Kovalchik

    (Victoria University)

  • Steven C. Martino
  • Rebecca L. Collins
  • William G. Shadel
  • Elizabeth J. D’Amico
  • Kirsten Becker

    (RAND Corporation)

Abstract

Ecological momentary assessment (EMA) is a popular assessment method in psychology that aims to capture events, emotions, and cognitions in real time, usually repeatedly throughout the day. Because EMA typically involves more intensive monitoring than traditional assessment methods, missing data are commonly an issue and this missingness may bias results. EMA can involve two types of missing data: known missingness, arising from nonresponse to scheduled prompts, and hidden missingness, arising from nonreporting of focal events (e.g., an urge to smoke or a meal). Prior research on missing data in EMA has focused almost exclusively on nonresponse to scheduled prompts. In this study, we introduce a scaled inverse probability weighting approach to assess the risk of bias due to nonreporting of events due to fatigue on estimates of exposure or correlates of exposure. In our proposed approach, the inverse probability is the estimated probability of compliance with random prompts from a model that uses participant and contextual factors to predict this compliance and a fatigue factor that adjusts for attrition in event reporting over time. We demonstrate the use and utility of our bias assessment method with the Tracking and Recording Alcohol Communications Study, an EMA study of adolescent exposure to alcohol advertising.

Suggested Citation

  • Stephanie A. Kovalchik & Steven C. Martino & Rebecca L. Collins & William G. Shadel & Elizabeth J. D’Amico & Kirsten Becker, 2018. "Scaled Inverse Probability Weighting: A Method to Assess Potential Bias Due to Event Nonreporting in Ecological Momentary Assessment Studies," Journal of Educational and Behavioral Statistics, , vol. 43(3), pages 354-381, June.
  • Handle: RePEc:sae:jedbes:v:43:y:2018:i:3:p:354-381
    DOI: 10.3102/1076998617738241
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998617738241
    Download Restriction: no

    File URL: https://libkey.io/10.3102/1076998617738241?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wooldridge, Jeffrey M., 2007. "Inverse probability weighted estimation for general missing data problems," Journal of Econometrics, Elsevier, vol. 141(2), pages 1281-1301, December.
    2. Constantine E. Frangakis & Donald B. Rubin, 2001. "Addressing an Idiosyncrasy in Estimating Survival Curves Using Double Sampling in the Presence of Self-Selected Right Censoring," Biometrics, The International Biometric Society, vol. 57(2), pages 333-342, June.
    3. Constantine E. Frangakis & Donald B. Rubin, 2001. "Rejoinder to Discussions on Addressing an Idiosyncrasy in Estimating Survival Curves Using Double Sampling in the Presence of Self-Selected Right Censoring," Biometrics, The International Biometric Society, vol. 57(2), pages 351-353, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Menggang Yu, 2016. "Improving estimation efficiency for semi-competing risks data with partially observed terminal event," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(4), pages 860-874, October.
    2. Richard J. Cook & Jerald F. Lawless, 2020. "Failure time studies with intermittent observation and losses to follow‐up," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1035-1063, December.
    3. Menggang Yu & Constantin T. Yiannoutsos, 2015. "Marginal and Conditional Distribution Estimation from Double-sampled Semi-competing Risks Data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(1), pages 87-103, March.
    4. Tianchen Qian & Constantine Frangakis & Constantin Yiannoutsos, 2020. "Deductive Semiparametric Estimation in Double-Sampling Designs with Application to PEPFAR," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 12(3), pages 417-445, December.
    5. Stuart G. Baker, 2001. "Discussion of Double Sampling for Survival Analysis," Biometrics, The International Biometric Society, vol. 57(2), pages 348-350, June.
    6. Vernon T. Farewell & Jerald F. Lawless & Dafna D. Gladman & Murray B. Urowitz, 2003. "Tracing studies and analysis of the effect of loss to follow‐up on mortality estimation from patient registry data," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 52(4), pages 445-456, October.
    7. Constantine E. Frangakis & Stuart G. Baker, 2001. "Compliance Subsampling Designs for Comparative Research: Estimation and Optimal Planning," Biometrics, The International Biometric Society, vol. 57(3), pages 899-908, September.
    8. Constantine E. Frangakis & Donald B. Rubin, 2002. "Principal Stratification in Causal Inference," Biometrics, The International Biometric Society, vol. 58(1), pages 21-29, March.
    9. Ming-Wen An & Constantine E. Frangakis & Beverly S. Musick & Constantin T. Yiannoutsos, 2009. "The Need for Double-Sampling Designs in Survival Studies: An Application to Monitor PEPFAR," Biometrics, The International Biometric Society, vol. 65(1), pages 301-306, March.
    10. Martin W G Brinkhof & Ben D Spycher & Constantin Yiannoutsos & Ralf Weigel & Robin Wood & Eugène Messou & Andrew Boulle & Matthias Egger & Jonathan A C Sterne & for the International epidemiological D, 2010. "Adjusting Mortality for Loss to Follow-Up: Analysis of Five ART Programmes in Sub-Saharan Africa," PLOS ONE, Public Library of Science, vol. 5(11), pages 1-6, November.
    11. Chih‐Yuan Hsu & Chen‐Hsin Chen & Ken‐Ning Hsu & Ya‐Hung Lu, 2019. "A useful design utilizing the information fraction in a group sequential clinical trial with censored survival data," Biometrics, The International Biometric Society, vol. 75(1), pages 133-143, March.
    12. Agnes N Kiragga & Barbara Castelnuovo & Rachel Musomba & Jonathan Levin & Andrew Kambugu & Yukari C Manabe & Constantin T Yiannoutsos & Noah Kiwanuka, 2013. "Comparison of Methods for Correction of Mortality Estimates for Loss to Follow-Up after ART Initiation: A Case of the Infectious Diseases Institute, Uganda," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-7, December.
    13. Turner, Alex J. & Fichera, Eleonora & Sutton, Matt, 2021. "The effects of in-utero exposure to influenza on mental health and mortality risk throughout the life-course," Economics & Human Biology, Elsevier, vol. 43(C).
    14. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    15. Michele Cantarella & Chiara Strozzi, 2021. "Workers in the crowd: the labor market impact of the online platform economy [An evaluation of instrumental variable strategies for estimating the effects of catholic schooling]," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 30(6), pages 1429-1458.
    16. Ruoxuan Xiong & Allison Koenecke & Michael Powell & Zhu Shen & Joshua T. Vogelstein & Susan Athey, 2021. "Federated Causal Inference in Heterogeneous Observational Data," Papers 2107.11732, arXiv.org, revised Apr 2023.
    17. N'dri, Lasme Mathieu & Kakinaka, Makoto, 2020. "Financial inclusion, mobile money, and individual welfare: The case of Burkina Faso," Telecommunications Policy, Elsevier, vol. 44(3).
    18. Mittag, Nikolas, 2016. "Correcting for Misreporting of Government Benefits," IZA Discussion Papers 10266, Institute of Labor Economics (IZA).
    19. Feld, Jan & Salamanca, Nicolás & Zölitz, Ulf, 2019. "Students are almost as effective as professors in university teaching," Economics of Education Review, Elsevier, vol. 73(C).
    20. Hector Espinoza & Stefan Speckesser, 2019. "A Comparison of Earnings Related to Higher Level Vocational/Technical and Academic Education," National Institute of Economic and Social Research (NIESR) Discussion Papers 502, National Institute of Economic and Social Research.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:43:y:2018:i:3:p:354-381. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.