Automatic verification set up for HWFWS

Our intern Ivan Vorobevskii did a great job in crunching Early Warning System output and putting it together with regionally observed flood/warning levels. Typical scores like POD, FAR, AUC are also calculated. The plot below gives an idea on the verification problem, which is kind of fuzzy, rather than really being crisp/dichotomous. We have to put some more effort in the specific verification approach (preferably, thinking the problem a bit from the perspective of warning product users, which typically do some sort of fuzzy decision making, too!)

Forecasts_vs_daily_obs
Some output of the early warning system (forecast mode) vs. daily reference data (specifically for the warning region “Weisse Elster/Bergland”). Mind the increase in production frequency from 8/d to 24/d on June 5, 2018.

Besides the forecasts, the Early Warning System operationally also runs in hindcast mode (driven only with QPE data), delivering some possibility to separate input parameter (i.e., QPF data) uncertainty from model uncertainty, by using hindcast data for verification.

Advertisement

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s