IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this article or follow this journal

An assessment of the effectiveness of multiple hypothesis testing for geographical anomaly detection

  • Chris Brunsdon
  • Martin Charlton
Registered author(s):

    The practice of multiple significance testing is reviewed, and an alternative to the frequently used Bonferroni correction is considered. Rather than controlling the family-wise error rate (FWER)—the probability of a false positive in any of the significance tests—this alternative due to Benjamini and Hochberg controls the false discovery rate (FDR). This is the proportion of tests reporting a significant result that are actually ‘false alarms’. The methods (and some variants) are demonstrated on a procedure to detect clusters of full-time unpaid carers based on UK census data, and are also assessed using simulation. Simulation results show that the FDR-based corrections are typically more powerful than FWER-based ones, and also that the degree of conservatism in FWER-based procedures is quite extreme, to the extent that the standard Bonferroni procedure intended to constrain the FWER to be below 0.05 actually has a FWER of around 6times10 -5 . We conclude that in situations where one is scanning for anomalies, the extreme conservatism of FWER-based approaches results in a lack of power, and that FDR-based approaches are more appropriate.

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

    File URL: http://www.envplan.com/abstract.cgi?id=b36093
    File Function: abstract
    Download Restriction: Fulltext access restricted to subscribers, see http://www.envplan.co.uk/B.html for details

    File URL: http://www.envplan.com/epb/fulltext/b38/b36093.pdf
    File Function: main text
    Download Restriction: Fulltext access restricted to subscribers, see http://www.envplan.co.uk/B.html for details

    As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

    Article provided by Pion Ltd, London in its journal Environment and Planning B: Planning and Design.

    Volume (Year): 38 (2011)
    Issue (Month): 2 (March)
    Pages: 216-230

    as
    in new window

    Handle: RePEc:pio:envirb:v:38:y:2011:i:2:p:216-230
    Contact details of provider: Web page: http://www.pion.co.uk

    No references listed on IDEAS
    You can help add them by filling out this form.

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:pio:envirb:v:38:y:2011:i:2:p:216-230. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Neil Hammond)

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.