IDEAS home Printed from https://ideas.repec.org/h/spr/sprchp/978-3-031-25859-6_3.html
   My bibliography  Save this book chapter

Logical Fallacies and the Misuse of RCT Findings: Lessons from Diagnostic Statistics

In: A Medical Educator's Guide to Thinking Critically about Randomised Controlled Trials: Deconstructing the "Gold Standard"

Author

Listed:
  • Margaret MacDougall

    (Edinburgh Medical School, Usher Institute)

Abstract

This chapter offers an excursion through many of the important analogies encountered on comparing the conceptual frameworks for diagnostic statistics and null hypothesis significance testing (NHST). We shall meet three common logical fallacies that can prove influential in overestimating the probability of an intervention being effective, given a statistically significant outcome in favour of the intervention. In keeping with previous work, this conditional probability will be referred to as the positive predictive value (PPV) of the hypothesis test for the given study hypothesis. Relatedly, we shall see how researchers can be duped into a false reliance on statistical significance from a single randomised controlled trial (RCT) as an indicator of the reputability of the study hypothesis, while overestimating, and neglecting the importance of, the PPV. Recognition of the need for a higher PPV points to the fallibility of the RCT, in keeping with other study designs, as a source of scientific truth. In addition to training students to recognise and circumvent common misapplications of conditional probabilities in diagnostic statistics and hypothesis testing, the content of this chapter warns against some misconceptions in traditional representations of the relationships between prevalence and diagnostic statistics in medical textbooks and related expository papers. While this ought to support modern teaching on the theme of diagnostic testing, the aim in view is that of preparing the way for consideration in Chap. 4 of the parameterisation and management of the PPV using Bayes’ rule specifically within the context of NHST.

Suggested Citation

  • Margaret MacDougall, 2024. "Logical Fallacies and the Misuse of RCT Findings: Lessons from Diagnostic Statistics," Springer Books, in: Margaret MacDougall (ed.), A Medical Educator's Guide to Thinking Critically about Randomised Controlled Trials: Deconstructing the "Gold Standard", chapter 0, pages 63-88, Springer.
    • Handle: RePEc:spr:sprchp:978-3-031-25859-6_3
    DOI: 10.1007/978-3-031-25859-6_3
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a
    for a similarly titled item that would be available.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:sprchp:978-3-031-25859-6_3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.