TITLE

An empirical comparison of spatial scan statistics for outbreak detection

AUTHOR(S)

Neill, Daniel B.

PUB. DATE

January 2009

SOURCE

International Journal of Health Geographics;2009, Vol. 8, p1

SOURCE TYPE

Academic Journal

DOC. TYPE

Article

ABSTRACT

Background: The spatial scan statistic is a widely used statistical method for the automatic detection of disease clusters from syndromic data. Recent work in the disease surveillance community has proposed many variants of Kulldorff's original spatial scan statistic, including expectation-based Poisson and Gaussian statistics, and incorporates a variety of time series analysis methods to obtain expected counts. We evaluate the detection performance of twelve variants of spatial scan, using synthetic outbreaks injected into four real-world public health datasets. Results: The relative performance of methods varies substantially depending on the size of the injected outbreak, the average daily count of the background data, and whether seasonal and dayof- week trends are present. The expectation-based Poisson (EBP) method achieves high performance across a wide range of datasets and outbreak sizes, making it useful in typical detection scenarios where the outbreak characteristics are not known. Kulldorff's statistic outperforms EBP for small outbreaks in datasets with high average daily counts, but has extremely poor detection power for outbreaks affecting more than 2 3 of the monitored locations. Randomization testing did not improve detection power for the four datasets considered, is computationally expensive, and can lead to high false positive rates. Conclusion: Our results suggest four main conclusions. First, spatial scan methods should be evaluated for a variety of different datasets and outbreak characteristics, since focusing only on a single scenario may give a misleading picture of which methods perform best. Second, we recommend the use of the expectation-based Poisson statistic rather than the traditional Kulldorff statistic when large outbreaks are of potential interest, or when average daily counts are low. Third, adjusting for seasonal and day-of-week trends can significantly improve performance in datasets where these trends are present. Finally, we recommend discontinuing the use of randomization testing in the spatial scan framework when sufficient historical data is available for empirical calibration of likelihood ratio scores.

ACCESSION #

42094156

Tags: EMPIRICAL research;  STATISTICS -- Research;  SURVEILLANCE detection;  PUBLIC health;  EPIDEMICS;  CALIBRATION

 

Related Articles

• Should Data from Demographic Surveillance Systems Be Made More Widely Available to Researchers. Chandramohan, Daniel; Shibuya, Kenji; Setel, Philip; Cairncross, Sandy; Lopez, Alan D.; Christopher J. L.Murray; Zaba, Basia; Snow, Robert W.; Binka, Fred // PLoS Medicine;Feb2008, Vol. 5 Issue 2, pe57 

  Chandramohan and colleagues argue that DSS data should be made available to all researchers worldwide, while aba and colleagues discuss the major obstacles to DSS sites sharing their data more widely.

• The Spread of Influenza A(H1N1)pdm09 Virus in Madagascar Described by a Sentinel Surveillance Network. Rajatonirina, Soatiana; Heraud, Jean-Michel; Orelle, Arnaud; Randrianasolo, Laurence; Razanajatovo, Norosoa; Rajaona, Yolande Raoelina; ne Randrianarivo-Solofoniaina, Armand Euge; Rakotomanana, Fanjasoa; Richard, Vincent // PLoS ONE;May2012, Vol. 7 Issue 5, p1 

  Background: The influenza A(H1N1)pdm09 virus has been a challenge for public health surveillance systems in all countries. In Antananarivo, the first imported case was reported on August 12, 2009. This work describes the spread of A(H1N1)pdm09 in Madagascar. Methods: The diffusion of influenza...

• A simulation study comparing aberration detection algorithms for syndromic surveillance. Jackson, Michael L; Baer, Atar; Painter, Ian; Duchin, Jeff // BMC Medical Informatics & Decision Making;2007, Vol. 7 Issue 1, p6 

  Background: The usefulness of syndromic surveillance for early outbreak detection depends in part on effective statistical aberration detection. However, few published studies have compared different detection algorithms on identical data. In the largest simulation study conducted to date, we...

• CHAPTER 7: EPIDEMIOLOGIC SURVEILLANCE AND DISEASE CONTROL: SETTING UP A DISEASE SURVEILLANCE SYSTEM.  // Natural Disasters: Protecting the Public's Health;2000, p44 

  Chapter 7 of the book "Natural Disasters: Protecting the Public's Health" is presented. This part of the chapter notes the need to prepare a local, syndrome-based surveillance system at the national level which should be temporarily instituted in the aftermath of a disaster. It cites the...

• Evaluating Surveillance Strategies for the Early Detection of Low Pathogenicity Avian Influenza Infections. Comin, Arianna; Stegeman, Arjan; Marangon, Stefano; Klinkenberg, Don // PLoS ONE;Apr2012, Vol. 7 Issue 4, p1 

  In recent years, the early detection of low pathogenicity avian influenza (LPAI) viruses in poultry has become increasingly important, given their potential to mutate into highly pathogenic viruses. However, evaluations of LPAI surveillance have mainly focused on prevalence and not on the...

• Evaluating Surveillance Strategies for the Early Detection of Low Pathogenicity Avian Influenza Infections. Comin, Arianna; Stegeman, Arjan; Marangon, Stefano; Klinkenberg, Don // PLoS ONE;Apr2012, Vol. 7 Issue 4, p1 

  In recent years, the early detection of low pathogenicity avian influenza (LPAI) viruses in poultry has become increasingly important, given their potential to mutate into highly pathogenic viruses. However, evaluations of LPAI surveillance have mainly focused on prevalence and not on the...

• METHODS AND PROCEDURES FOR DATA ADJUSTMENT, BASED ON CHRONOLOGICAL SERIES USED IN THE ANALYSIS OF DEVELOPMENT TREND FOR VARIOUS SOCIAL - ECONOMIC DOMAINS. ANGHELACHE, Constantin; ANGHELACHE, Gabriela-Victoria; LILEA, Florin Paul Costel; BALTAC, Andreea Gabriela // Romanian Statistical Review;2012, Issue 8, p16 

  By specific methods, statistics studies including the tendency of development, designed by the specific literature as the trend and, meantime, by trying to separate the influence of the major factors (with a systematic action), from the influence of the casual factors, which involve deviations...

• California Gonorrhea Surveillance System: Methodologic Aspects and Key Results of a Sample-Based System. Samuel, Michael C.; Mocello, A. Rain; Gilson, Denise; Bradbury, K. Jayne; Bolan, Gail // Public Health Reports;Nov/Dec2009 Supplement 2, Vol. 124, p87 

  Objectives. This article describes findings from the California Gonorrhea Surveillance System (CGSS), developed in response to the need for detailed risk behavior data and clinical data required to control increasing gonorrhea (GC) infections in California. Methods. CGSS is a sample-based...

• Communicable Disease Surveillance during Gujarat, India Earthquake, 2001: A Survey. Tiwari, Rajnarayan R.; Bhatia, Kesari R.; Lakkad, B. C. // Open Public Health Journal;Jan2009, Vol. 2, p7 

  During Gujarat earthquake in 2001, to keep a watch on the health problems and for effective control measures, disease surveillance activities were carried out. Every day different teams were sent to the field to collect the information about the morbidity and creating awareness about personal...

Read the Article