Approaches to the evaluation of outbreak detection methods

Watkins, Rochelle E.; Eagleson, Serryn; Hall, Robert G.; Dailey, Lynne; Plant, Aileen J.
January 2006
BMC Public Health;2006, Vol. 6 Issue 1, p263
Academic Journal
Background: An increasing number of methods are being developed for the early detection of infectious disease outbreaks which could be naturally occurring or as a result of bioterrorism; however, no standardised framework for examining the usefulness of various outbreak detection methods exists. To promote comparability between studies, it is essential that standardised methods are developed for the evaluation of outbreak detection methods. Methods: This analysis aims to review approaches used to evaluate outbreak detection methods and provide a conceptual framework upon which recommendations for standardised evaluation methods can be based. We reviewed the recently published literature for reports which evaluated methods for the detection of infectious disease outbreaks in public health surveillance data. Evaluation methods identified in the recent literature were categorised according to the presence of common features to provide a conceptual basis within which to understand current approaches to evaluation. Results: There was considerable variation in the approaches used for the evaluation of methods for the detection of outbreaks in public health surveillance data, and appeared to be no single approach of choice. Four main approaches were used to evaluate performance, and these were labelled the Descriptive, Derived, Epidemiological and Simulation approaches. Based on the approaches identified, we propose a basic framework for evaluation and recommend the use of multiple approaches to evaluation to enable a comprehensive and contextualised description of outbreak detection performance. Conclusion: The varied nature of performance evaluation demonstrated in this review supports the need for further development of evaluation methods to improve comparability between studies. Our findings indicate that no single approach can fulfil all evaluation requirements. We propose that the cornerstone approaches to evaluation identified provide key contributions to support internal and external validity and comparability of study findings, and suggest these be incorporated into future recommendations for performance assessment.


Related Articles

  • Liberty to Decide on Dual Use Biomedical Research: An Acknowledged Necessity. Keuleyan, Emma // Science & Engineering Ethics;Mar2010, Vol. 16 Issue 1, p43 

    Humanity entered the twenty-first century with revolutionary achievements in biomedical research. At the same time multiple “dual-use” results have been published. The battle against infectious diseases is meeting new challenges, with newly emerging and re-emerging infections. Both...

  • A European centre to respond to threats of bioterrorism and major epidemics. Tibayrenc, Michel // Bulletin of the World Health Organization;2001, Vol. 79 Issue 12, p1094 

    Comments on the importance of establishing infectious diseases center to respond to bioterrorism and epidemics in Europe. Research on epidemiology of infectious diseases; Comparison of the center with the National Center for Infectious Diseases of the United States; responsibilities of the center.

  • Mathematicians' Role in War on Terror, Epidemics Explored in International Conference at Rutgers, June 28 - July 2.  // Ascribe Newswire: Medicine;6/26/2002, p4 

    A comprehensive five-year program to explore scientists' ability to use mathematical modeling and computer science to understand and control epidemics, including those related to bioterrorism will officially begin at Rutgers University of New Jersey during the DIMACS International Conference on...

  • The Bioterrorism Scare. Alcabes, Philip // American Scholar;Spring2004, Vol. 73 Issue 2, p35 

    This article deals with the bioterrorism scare around the world. Historical background of the spread of communicable diseases; Views of U.S. citizens on infectious diseases as a result of the bioterrorism scare; Overview of the SARS epidemic in China in 2002.

  • Finding Leading Indicators for Disease Outbreaks: Filtering, Cross-correlation, and Caveats. Bloom, Ronald M.; Buckeridge, David L.; Cheng, Karen E. // Journal of the American Medical Informatics Association;Jan/Feb2007, Vol. 14 Issue 1, p76 

    Bioterrorism and emerging infectious diseases such as influenza have spurred research into rapid outbreak detection. One primary thrust of this research has been to identify data sources that provide early indication of a disease outbreak by being leading indicators relative to other established...

  • Policies for biodefense revisited: The prioritized vaccination process for smallpox. Kress, Moshe // Annals of Operations Research;Nov2006, Vol. 148 Issue 1, p5 

    Handling bioterror events that involve contagious agents is a major concern for authorities and a cause for debate among policymakers about the best response policy. At the core of this debate stands the question which of the two post-event policies to adopt: mass vaccination or trace (also...

  • Researcher models non-communicable ailments and epidemics with inference technique.  // Scientific Computing World;Oct/Nov2008, Issue 102, p6 

    The article reports that Sandia researcher Jaideep Ray has developed a model that can determine how fast an epidemic will spread and how many people may be infected. The model will help in determining the number of people likely to be infected and die from non-communicable illnesses like...

  • Bioterror Response Criticized. Mitka, Mike // JAMA: Journal of the American Medical Association;12/8/2004, Vol. 292 Issue 22, p2714 

    Reports that the majority of state and local governments in the United States are unprepared for a major bioterror attack or infectious disease outbreak. Creation of national stockpiles of supplies for use following a biological attack or disease outbreak; Results of a survey of 63 local health...

  • Innovative Surveillance Methods for Rapid Detection of Disease Outbreaks and Bioterrorism: Results of an Interagency Workshop on Health Indicator Surveillance. Pavlin, Julie A.; Mostashari, Farzad; Kortepeter, Mark G.; Hynes, Noreen A.; Chotani, Rashid A.; Mikol, Yves B.; Ryan, Margaret A. K.; Neville, James S.; Gantz, Donald T.; Writer, James V.; Florance, Jared E.; Culpepper, Randall C.; Henretig, Fred M.; Kelley, Patrick W. // American Journal of Public Health;Aug2003, Vol. 93 Issue 8, p1230 

    A system designed to rapidly identify an infectious disease out-break or bioterrorism attack and provide important demographic and geographic information is lacking in most health departments nationwide. The Department of Defense Global Emerging Infections System sponsored a meeting and workshop...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics