Explicitly Accounting for Observation Error in Categorical Verification of Forecasts

Bowler, Neill E.
June 2006
Monthly Weather Review;Jun2006, Vol. 134 Issue 6, p1600
Academic Journal
Given an accurate representation of errors in observations it is possible to remove the effect of those errors from categorical verification scores. The errors in the observations are treated as additive white noise that is statistically independent of the true value of the quantity being observed. This method can be applied to both probabilistic and deterministic verification where the verification method uses a categorical approach. In general this improves the apparent performance of a forecasting system, indicating that forecasting systems are often performing better than they might first appear.


Related Articles

  • Getting past the statistical referee: moving away from P -values and towards interval estimation. Rigby, Alan S. // Health Education Research;Dec1999, Vol. 14 Issue 6, p713 

    Editorial. Discusses the importance of a statement of the effect size in a statistical analysis rather than an overemphasis on P-values. P-values as error probability; Advocacy of interval estimation.

  • APPENDIX III.  // Retail Trade;Jul2001, Vol. 73 Issue 7, p37 

    Provides information on the types of sampling and non-sampling error in statistical estimates. Differences among the types of errors; Factors that result to statistical errors.

  • Population forecast accuracy: does the choice of summary measure of error matter? Rayer, Stefan // Population Research & Policy Review;Apr2007, Vol. 26 Issue 2, p163 

    Population projections are judged primarily by their accuracy. The most commonly used measure for the precision component of accuracy is the mean absolute percent error (MAPE). Recently, the MAPE has been criticized for overstating forecast error and other error measures have been proposed. This...

  • A Reduced Rank Estimate of Forecast Error Variance Changes due to Intermittent Modifications of the Observing Network. Leutbecher, Martin // Journal of the Atmospheric Sciences;3/1/2003, Vol. 60 Issue 5, p729 

    A new tool for planning adaptive observations is introduced. Different modifications of the observing network can be compared prior to the time of modification. The method predicts the variance of forecast errors projected into a low-dimensional subspace. Tangent-linear error evolution is...

  • Decomposition of earnings forecast errors. Magiera, Frank T. // Journal of Business Forecasting Methods & Systems;Fall95, Vol. 14 Issue 3, p11 

    Discusses the minimization of forecasting errors in earnings per share through the minimization of errors in forecasting components using steel industry as example. Link of earnings and common stock prices; Equation measurement and decomposition of forecast error.

  • Judging Appraisal Bias. Ferguson, Jerry T. // Appraisal Journal;Jan1985, Vol. 53 Issue 1, p66 

    Explains three statistical tests appraisers can use to check for nonrandom error or appraisal bias. Nonparametric or distribution-free tests; 'Sign' and 'runs' method; Conditions under which the tests should be used.

  • Measurement error and correlation coefficients. Bland, J. Martin; Altman, Douglas G. // BMJ: British Medical Journal (International Edition);07/16/96, Vol. 313 Issue 7048, p41 

    Considers the use of correlation coefficients to quantify measurement error. Common design for the investigation of measurement error; Problems with the use of the correlation coefficient; Preference for within subjects standard deviation as an index of measurement error.

  • The Optimality of General-Order Exponential Smoothing. Cogger, K. O. // Operations Research;Jul/Aug74, Vol. 22 Issue 4, p858 

    This paper derives the class of nonstationary time-series representations for which exponential smoothing of arbitrary order minimizes mean-square forecast error. It points out that these representations are included in the class of integrated moving averages developed by BOX AND JENKINS,...

  • Accounting for Model Error in Ensemble-Based State Estimation and Forecasting. Hansen, James A. // Monthly Weather Review;Oct2002, Vol. 130 Issue 10, p2373 

    Accurate forecasts require accurate initial conditions. For systems of interest, even given a perfect model and an infinitely long time series of observations, it is impossible to determine a system's exact initial state. This motivates a probabilistic approach to both state estimation and...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics