IDEAS home Printed from
   My bibliography  Save this article

Discovering effect modification in an observational study of surgical mortality at hospitals with superior nursing


  • Kwonsang Lee
  • Dylan S. Small
  • Jesse Y. Hsu
  • Jeffrey H. Silber
  • Paul R. Rosenbaum


There is effect modification if the magnitude or stability of a treatment effect varies systematically with the level of an observed covariate. A larger or more stable treatment effect is typically less sensitive to bias from unmeasured covariates, so it is important to recognize effect modification when it is present. We illustrate a recent proposal for conducting a sensitivity analysis that empirically discovers effect modification by exploratory methods but controls the familywise error rate in discovered groups. The example concerns a study of mortality and use of intensive care units in 23715 matched pairs of two Medicare patients, one of whom underwent surgery at a hospital that had been identified for superior nursing; the other at a conventional hospital. The pairs were matched exactly for 130 four†digit ninth international classification of diseases surgical procedure codes and balanced 172 observed covariates. The pairs were then split into five groups of pairs by the classification and regression trees method in its effort to locate effect modification. The evidence of a beneficial effect of magnet hospitals on mortality is least sensitive to unmeasured biases in a large group of patients undergoing quite serious surgical procedures, but in the absence of other life†threatening conditions, such as a comorbidity of congestive heart failure or an emergency admission leading to surgery.

Suggested Citation

  • Kwonsang Lee & Dylan S. Small & Jesse Y. Hsu & Jeffrey H. Silber & Paul R. Rosenbaum, 2018. "Discovering effect modification in an observational study of surgical mortality at hospitals with superior nursing," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(2), pages 535-546, February.
  • Handle: RePEc:bla:jorssa:v:181:y:2018:i:2:p:535-546

    Download full text from publisher

    File URL:
    Download Restriction: no

    More about this item


    Access and download statistics


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:181:y:2018:i:2:p:535-546. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley Content Delivery). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.