IDEAS home Printed from https://ideas.repec.org/a/spr/drugsa/v47y2024i11d10.1007_s40264-024-01460-2.html
   My bibliography  Save this article

Optimal Significance Levels and Sample Sizes for Signal Detection Methods Based on Non-constant Hazards

Author

Listed:
  • Odile Sauzet

    (Bielefeld University
    Bielefeld School of Public Health (BiSPH), Bielefeld University
    Odile Sauzet Universität Bielefeld)

  • Julia Dyck

    (Bielefeld University)

  • Victoria Cornelius

    (School of Public Health, Imperial College London)

Abstract

Background and Objectives Statistical methods for signal detection of adverse drug reactions (ADRs) in electronic health records (EHRs) need information about optimal significance levels and sample sizes to achieve sufficient power. Sauzet and Cornelius proposed tests for signal detection based on the hazard functions of Weibull type distributions (WSP tests) which use the time-to-event information available in EHRs. Optimal significance levels and sample sizes for the application of the WPS tests are derived. Method A simulation study was performed with a range of scenarios for sample size, rate of event due (ADRs), and not due to the drug and random time to ADR occurrence. Based on the area under the curve of the receiver operating characteristic graph, we obtain optimal significance levels of the different WSP tests for the implementation in a hypothesis free signal detection setting and approximate sample sizes required to reach a power of 80% or 90%. Results The dWSP–pPWSP (combination of double WSP and power WSP) test with a significance level of 0.004 was recommended. Sample sizes needed for a power of 80% were found to start at 60 events for an ADR rate equal to the background rate of 0.1. The number of events required for a background rate of 0.05 and an ADR rate equal to a 20% increase of the background rate was 900. Conclusion Based on this study, it is recommended to use the dWSP–pWSP test combination for signal detection with a significance level of 0.004 when the same test is applied to all adverse events not depending on rates.

Suggested Citation

  • Odile Sauzet & Julia Dyck & Victoria Cornelius, 2024. "Optimal Significance Levels and Sample Sizes for Signal Detection Methods Based on Non-constant Hazards," Drug Safety, Springer, vol. 47(11), pages 1149-1156, November.
    • Handle: RePEc:spr:drugsa:v:47:y:2024:i:11:d:10.1007_s40264-024-01460-2
    DOI: 10.1007/s40264-024-01460-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40264-024-01460-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s40264-024-01460-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ed Whalen & Manfred Hauben & Andrew Bate, 2018. "Time Series Disturbance Detection for Hypothesis-Free Signal Detection in Longitudinal Observational Databases," Drug Safety, Springer, vol. 41(6), pages 565-577, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yiqing Zhao & Yue Yu & Hanyin Wang & Yikuan Li & Yu Deng & Guoqian Jiang & Yuan Luo, 2022. "Machine Learning in Causal Inference: Application in Pharmacovigilance," Drug Safety, Springer, vol. 45(5), pages 459-476, May.
    2. Andrew Bate & Steve F. Hobbiger, 2021. "Artificial Intelligence, Real-World Automation and the Safety of Medicines," Drug Safety, Springer, vol. 44(2), pages 125-132, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:drugsa:v:47:y:2024:i:11:d:10.1007_s40264-024-01460-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com/economics/journal/40264 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.