TITLE

A Generic Forecast Verification Framework for Administrative Purposes

AUTHOR(S)
Mason, Simon J.; Weigel, Andreas P.
PUB. DATE
January 2009
SOURCE
Monthly Weather Review;Jan2009, Vol. 137 Issue 1, p331
SOURCE TYPE
Academic Journal
DOC. TYPE
Article
ABSTRACT
There are numerous reasons for calculating forecast verification scores, and considerable attention has been given to designing and analyzing the properties of scores that can be used for scientific purposes. Much less attention has been given to scores that may be useful for administrative reasons, such as communicating changes in forecast quality to bureaucrats and providing indications of forecast quality to the general public. The two-alternative forced choice (2AFC) test is proposed as a scoring procedure that is sufficiently generic to be usable on forecasts ranging from simple yes–no forecasts of dichotomous outcomes to forecasts of continuous variables, and can be used with deterministic or probabilistic forecasts without seriously reducing the more complex information when available. Although, as with any single verification score, the proposed test has limitations, it does have broad intuitive appeal in that the expected score of an unskilled set of forecasts (random guessing or perpetually identical forecasts) is 50%, and is interpretable as an indication of how often the forecasts are correct, even when the forecasts are expressed probabilistically and/or the observations are not discrete.
ACCESSION #
36435562

 

Related Articles

  • Note on the influence of distribution shape on nonparametric tests. Zimmerman, Donald W. // Perceptual & Motor Skills;Dec94, Vol. 79 Issue 3, p1160 

    Studies the influence of distribution shape on nonparametric tests. Distinction from parametric tests; Wilcoxon-Mann-Whitney test; Probability of type-I and type-II errors; Distribution of rank randomization.

  • A possibilistic approach to the modeling and resolution of uncertain closed-loop logistics. Wang, Hsiao-Fan; Hsu, Hsin-Wei // Fuzzy Optimization & Decision Making; 

    Closed-loop logistics planning is an important tactic for the achievement of sustainable development. However, the correlation among the demand, recovery, and landfilling makes the estimation of their rates uncertain and difficult. Although the fuzzy numbers can present such kinds of overlapping...

  • CHALLENGES IN SEEING DATA AS USEFUL EVIDENCE IN MAKING PREDICTIONS ON THE PROBABILITY OF A REAL-WORLD PHENOMENON. NILSSON, PER // Statistics Education Research Journal;Nov2013, Vol. 12 Issue 2, p71 

    This study investigates the relationship between deterministic and probabilistic reasoning when students experiment on a real-world situation involving uncertainty. Twelve students, aged eight to nine years, participated in an outdoor teaching activity that called for reflection on the growth of...

  • Development of the analogue-dynamical method for error correction of numerical forecasts. Yu, Haipeng; Huang, Jianping; Li, Weijing; Feng, Guolin // Journal of Meteorological Research;Oct2014, Vol. 28 Issue 5, p934 

    Due to the increasing requirement for high-level weather and climate forecasting accuracy, it is necessary to exploit a strategy for model error correction while developing numerical modeling and data assimilation techniques. This study classifies the correction strategies according to the types...

  • LETTER FROM THE EDITOR: BETTING ON MATHEMATICS. Rosenfeld, Jeff // Bulletin of the American Meteorological Society;Feb2009, Vol. 90 Issue 2, p164 

    The article focuses on the probabilistic reasoning. It reveals the answer of columnist Marilyn vos Savant to the "Monty Hall" problem using the Bayesian reasoning. It says that probabilities are used by meteorologists to improve the presentation of important probabilities in weather forecasting....

  • ESTIMATING POTENTIAL SEVERE WEATHER IMPACTS ON SOCIETY. Schneider, Russell S. // Bulletin of the American Meteorological Society;Oct2009, Vol. 90 Issue 10, p1440 

    The article reports on the methods being explored by the National Oceanic and Atmospheric Administration (NOAA) Storm Prediction Center (SPC) to explore the societal impacts of severe weather in the U.S. It states that SPC is using a combination of probabilistic forecasts and high-resolution...

  • Learning Module Networks. Segal, Eran; Pe'er, Dana; Regev, Aviv; Koller, Daphne; Friedman, Nir; Jaakkola, Tommi // Journal of Machine Learning Research;4/1/2005, Vol. 6 Issue 4, p557 

    Methods for learning Bayesian networks can discover dependency structure between observed variables. Although these methods are useful in many applications, they run into computational and statistical problems in domains that involve a large number of variables. In this paper, we consider a...

  • SHRINKAGE PRE-TEST ESTIMATOR OF THE UNIVARIATE NORMAL MEAN. Yüksel, Güzin; Billor, Nedret; Ünal, Deniz // Pakistan Journal of Statistics;2010, Vol. 26 Issue 3, p461 

    Estimation of the mean of a univariate normal population with unknown variance is a well-known problem in the presence of an uncertain prior information. In this study, we propose a new estimator, shrinkage pre-test estimator, which is a combination of pre-test and shrinkage estimators. The mean...

  • Dominating Scale-Free Networks Using Generalized Probabilistic Methods. Molnár Jr., F.; Derzsy, N.; Czabarka, É.; Székely, L.; Szymanski, B. K.; Korniss, G. // Scientific Reports;9/12/2014, p1 

    We study ensemble-based graph-theoretical methods aiming to approximate the size of the minimum dominating set (MDS) in scale-free networks. We analyze both analytical upper bounds of dominating sets and numerical realizations for applications. We propose two novel probabilistic dominating set...

Share

Read the Article

Courtesy of THE LIBRARY OF VIRGINIA

Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics