A New Measure of Ensemble Performance: Perturbation versus Error Correlation Analysis (PECA)

Wei, Mozheng; Toth, Zoltan
August 2003
Monthly Weather Review;Aug2003 Parts 1 and 2, Vol. 131 Issue 8, p1549
Academic Journal
Most existing ensemble forecast verification statistics are influenced by the quality of not only the ensemble generation scheme, but also the forecast model and the analysis scheme. In this study, a new tool called perturbation versus error correlation analysis (PECA) is introduced that lessens the influence of the initial errors that affect the quality of the analysis. PECA evaluates the ensemble perturbations, instead of the forecasts themselves, by measuring their ability to explain forecast error variance. As such, PECA offers a more appropriate tool for the comparison of ensembles generated by using different analysis schemes. Ensemble perturbations from both the National Centers for Environmental Prediction (NCEP) and the European Centre for Medium-Range Weather Forecasts (ECMWF) were evaluated and found to perform similarly. The error variance explained by either ensemble increases with the number of members and the lead time. The dynamically conditioned NCEP and ECMWF perturbations outperform both randomly chosen perturbations and differences between lagged forecasts [used in the “NMC” (for National Meteorological Center, the former name of NCEP) method for defining forecast error covariance matrices]. Therefore ensemble forecasts potentially could be used to construct flow-dependent short-range forecast error covariance matrices for use in data assimilation schemes. It is well understood that in a perfectly reliable ensemble the spread of ensemble members around the ensemble mean forecast equals the root-mean-square (rms) error of the mean. Adequate rms spread, however, does not guarantee sufficient variability among the ensemble forecast patterns. A comparison between PECA values and pattern anomaly correlation (PAC) values among the ensemble members reveals that the perturbations in the NCEP ensemble exhibit too much similarity, especially on the smaller scales. Hence a regional orthogonalization of the perturbations may improve ensemble performance.


Related Articles

  • Two Techniques to Process Conflicting Subjective Probabilities in Individual Decision Making. Kobashikawa, Carlos; Dong, Fangyan; Hirota, Kaoru // International Journal of Fuzzy Systems;Jun2009, Vol. 11 Issue 2, p87 

    Two techniques for resolving conflicts in elicited subjective probabilities for individual decision making are proposed. The first one adjusts the fuzzy sets that represent the subjective probabilities in order to eliminate the conflicting parts, whereas the second one accomplishes the same task...

  • Correlation Kernels for Discrete Symplectic and Orthogonal Ensembles. Borodin, Alexei; Strahov, Eugene // Communications in Mathematical Physics;Mar2009, Vol. 286 Issue 3, p933 

    In [49] H. Widom derived formulae expressing correlation functions of orthogonal and symplectic ensembles of random matrices in terms of orthogonal polynomials. We obtain similar results for discrete ensembles with rational discrete logarithmic derivative, and compute explicitly correlation...

  • An illumination problem: optimal apex and optimal orientation for a cone of light. Astorino, Annabella; Gaudioso, Manlio; Seeger, Alberto // Journal of Global Optimization;Apr2014, Vol. 58 Issue 4, p729 

    Let $$\{a_i:i\in I\}$$ be a finite set in $$\mathbb R ^n$$. The illumination problem addressed in this work is about selecting an apex $$z$$ in a prescribed set $$Z\subseteq \mathbb R ^n$$ and a unit vector $$y\in \mathbb R ^n$$ so that the conic light beam captures every $$a_i$$ and, at the...

  • Gene set analysis for self-contained tests: complex null and specific alternative hypotheses. Rahmatallah, Y.; Emmert-Streib, F.; Glazko, G. // Bioinformatics;Dec2012, Vol. 28 Issue 23, p3073 

    Motivation: The analysis of differentially expressed gene sets became a routine in the analyses of gene expression data. There is a multitude of tests available, ranging from aggregation tests that summarize gene-level statistics for a gene set to true multivariate tests, accounting for...

  • A note on the undercut procedure. Aziz, Haris // Social Choice & Welfare;Dec2015, Vol. 45 Issue 4, p723 

    The undercut procedure was presented by Brams et al. (Soc Choice Welf 39:615-631, ) as a procedure for identifying an envy-free allocation when agents have preferences over sets of objects. We point out some shortcomings of the undercut procedure. We then simplify the undercut procedure of Brams...

  • Alarm Correlation Analysis Method based on Fuzzy Immune Evolution. Yongwei Wang; Huifang Su; Wei Qiu // Applied Mechanics & Materials;2014, Issue 556-562, p6191 

    This paper proposes a correlation analysis method based on fuzzy rules and artificial immune. Firstly, we adopt the alarms selection algorithm based on a sliding time window to improve the efficiency of selected alarm. Secondly, the analysis method based on fuzzy correlation rules is used to...

  • Minimum norm solutions for cooperative games. Kultti, Klaus; Salonen, Hannu // International Journal of Game Theory;2007, Vol. 35 Issue 4, p591 

    A solution f for cooperative games is a minimum norm solution, if the space of games has a norm such that f( v) minimizes the distance (induced by the norm) between the game v and the set of additive games. We show that each linear solution having the inessential game property is a minimum norm...

  • Connections between Classical and Parametric Network Entropies. Dehmer, Matthias; Mowshowitz, Abbe; Emmert-Streib, Frank // PLoS ONE;2011, Vol. 6 Issue 1, p1 

    This paper explores relationships between classical and parametric measures of graph (or network) complexity. Classical measures are based on vertex decompositions induced by equivalence relations. Parametric measures, on the other hand, are constructed by using information functions to assign...

  • Cooperative Laser-Electron-Nuclear Processes: QED Calculation of Electron Satellites Spectra for Multi-Charged Ion in Laser Field. Glushkov, Alexander V.; Malinovskaya, Svetlana V.; Chernyakova, Yulia G.; Svinarenko, Andrey A. // International Journal of Quantum Chemistry;2004, Vol. 99 Issue 6, p889 

    A consistent quantum electrodynamics (QED) perturbation theory approach is developed and applied to calculation of the electron-nuclear γ-transition spectra of nucleus in the multi-charged ion. The intensities of satellites are defined in the relativistic version of the energy approach...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics