Ensemble Forecasting - Probability Assessment

Probability Assessment

When ensemble spread is small and the forecast solutions are consistent within multiple model runs, forecasters perceive more confidence in the ensemble mean, and the forecast in general. A spread-skill relationship sometimes exists, as spread-error correlations are normally less than 0.6. The relationship between ensemble spread and skill varies substantially depending on such factors as the forecast model and the region for which the forecast is made.

Ideally, the relative frequency of events from the ensemble could be used directly to estimate the probability of a given weather event. For example, if 30 of 50 members indicated greater than 1 cm rainfall during the next 24 h, the probability of exceeding 1 cm could be estimated to be 60%. The forecast would be considered reliable if, considering all the situations in the past when a 60% probability was forecast, on 60% of those occasions did the rainfall actually exceed 1 cm. This is known as reliability or calibration. In practice, the probabilities generated from operational weather ensemble forecasts are not highly reliable, though with a set of past forecasts (reforecasts or hindcasts) and observations, the probability estimates from the ensemble can be adjusted to ensure greater reliability. Another desirable property of ensemble forecasts is sharpness. Provided that the ensemble is reliable, the more an ensemble forecast deviates from the climatological event frequency and issues 0% or 100% forecasts of an event, the more useful the forecast will be. However, sharp forecasts that are unaccompanied by high reliability will generally not be useful. Forecasts at long leads will inevitably not be particularly sharp, for the inevitable (albeit usually small) errors in the initial condition will grow with increasing forecast lead until the expected difference between two model states is as large as the difference between two random states from the forecast model's climatology.