Validation of population-based disease simulation models: a review of concepts and methods

Kopec, Jacek A.; Fin├Ęs, Philippe; Manuel, Douglas G.; Buckeridge, David L.; Flanagan, William M; Oderkirk, Jillian; Abrahamowicz, Michal; Harper, Samuel; Sharif, Behnam; Okhmatovskaia, Anya; Sayre, Eric C.; Rahman, M Mushfiqur; Wolfson, Michael C.
January 2010
BMC Public Health;2010, Vol. 10 Issue 1, p710
Academic Journal
Background: Computer simulation models are used increasingly to support public health research and policy, but questions about their quality persist. The purpose of this article is to review the principles and methods for validation of population-based disease simulation models. Methods: We developed a comprehensive framework for validating population-based chronic disease simulation models and used this framework in a review of published model validation guidelines. Based on the review, we formulated a set of recommendations for gathering evidence of model credibility. Results: Evidence of model credibility derives from examining: 1) the process of model development, 2) the performance of a model, and 3) the quality of decisions based on the model. Many important issues in model validation are insufficiently addressed by current guidelines. These issues include a detailed evaluation of different data sources, graphical representation of models, computer programming, model calibration, between-model comparisons, sensitivity analysis, and predictive validity. The role of external data in model validation depends on the purpose of the model (e.g., decision analysis versus prediction). More research is needed on the methods of comparing the quality of decisions based on different models. Conclusion: As the role of simulation modeling in population health is increasing and models are becoming more complex, there is a need for further improvements in model validation methodology and common standards for evaluating model credibility.


Related Articles

  • Change Rates and Prevalence of a Dichotomous Variable: Simulations and Applications. Brinks, Ralph; Landwehr, Sandra // PLoS ONE;Mar2015, Vol. 10 Issue 3, p1 

    A common modelling approach in public health and epidemiology divides the population under study into compartments containing persons that share the same status. Here we consider a three-state model with the compartments: A, B and Dead. States A and B may be the states of any dichotomous...

  • Sensitivity analysis of water quality for Delhi stretch of the River Yamuna, India. Parmar, D.; Keshari, Ashok // Environmental Monitoring & Assessment;Mar2012, Vol. 184 Issue 3, p1487 

    Simulation models are used to aid the decision makers about water pollution control and management in river systems. However, uncertainty of model parameters affects the model predictions and hence the pollution control decision. Therefore, it often is necessary to identify the model parameters...

  • Influences on influenza transmission within terminal based on hierarchical structure of personal contact network. Quan Shao; Meng Jia // BMC Public Health;2015, Vol. 15 Issue 1, p1 

    Background: Since the outbreak of pandemics, influenza has caused extensive attention in the field of public health. It is actually hard to distinguish what is the most effective method to control the influenza transmission within airport terminal. The purpose of this study was to quantitatively...

  • The impact of mass gatherings and holiday traveling on the course of an influenza pandemic: a computational model. Pengyi Shi; Keskinocak, Pinar; Swann, Julie L.; Lee, Bruce Y. // BMC Public Health;2010, Vol. 10 Issue 1, p778 

    Background: During the 2009 H1N1 influenza pandemic, concerns arose about the potential negative effects of mass public gatherings and travel on the course of the pandemic. Better understanding the potential effects of temporal changes in social mixing patterns could help public officials...

  • Canadian Valuation of EQ-5D Health States: Preliminary Value Set and Considerations for Future Valuation Studies. Bansback, Nick; Tsuchiya, Aki; Brazier, John; Anis, Aslam // PLoS ONE;Feb2012, Vol. 7 Issue 2, p1 

    Background: The EQ-5D is a preference based instrument which provides a description of a respondent's health status, and an empirically derived value for that health state often from a representative sample of the general population. It is commonly used to derive Quality Adjusted Life Year...

  • A generalized tagging method. Grewe, V. // Geoscientific Model Development;2013, Vol. 6 Issue 1, p247 

    The understanding of causes of changes in climate-chemistry simulations is an important, but often challenging task. In atmospheric chemistry, one approach is to tag species according to their origin (e.g. emission categories) and to inherit these tags to other species during subsequent...

  • Hydrological Modeling Studies with HEC-HMS for Damodar Basin, India. Chatterjee, Mangolika; De, Rumpa; Roy, Debasri; Das, Subhasish; Mazumdar, Asis // World Applied Sciences Journal;2014, Vol. 31 Issue 12, p2148 

    The HEC-HMS model (Hydrologic Modeling System), developed by the Hydrologic Engineering Center, USA (HEC) was evaluated for its applicability for the Damodar river basin in eastern India. Sensitivity analysis of the model was carried out for the input parameters. The study revealed that both the...

  • A population model for predicting the successful establishment of introduced bird species. Cassey, Phillip; Prowse, Thomas; Blackburn, Tim // Oecologia;May2014, Vol. 175 Issue 1, p417 

    One of the strongest generalities in invasion biology is the positive relationship between probability of establishment and the numbers of individuals introduced. Nevertheless, a number of significant questions remain regarding: (1) the relative importance of different processes during...

  • Arguments on the Imminence of Global Collapse Are Premature when Based on Simulation Models. Castro, Rodrigo // GAIA: Ecological Perspectives for Science & Society;2012, Vol. 21 Issue 4, p271 

    The author discusses the article of Graham M. Turner entitled "Imminence of Global Collapse are Premature When Based on Simulation Models." The author argues that the mathematical gap in Turner's argument is rooted from an incomplete sensitivity analysis for the standard run scenario of Meadow's...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics