solarforecastarbiter.metrics.probabilistic.reliability¶
-
solarforecastarbiter.metrics.probabilistic.
reliability
(obs, fx, fx_prob)[source]¶ Reliability (REL) of the forecast.
REL = 1/n sum_{i=1}^I N_i (f_i - o_{i,avg})^2where n is the total number of forecasts, I is the number of unique forecasts (f_1, f_2, …, f_I), N_i is the number of times each unique forecast occurs, o_{i,avg} is the average of the observed events during which the forecast was f_i.
Parameters: - obs ((n,) array_like) – Observations (physical unit).
- fx ((n,) array_like) – Forecasts (physical units) of the right-hand-side of a CDF interval, e.g., fx = 10 MW is interpreted as forecasting <= 10 MW.
- fx_prob ((n,) array_like) – Probability [%] associated with the forecasts.
Returns: rel (float) – The reliability of the forecast [unitless], where a perfectly reliable forecast has value of 0.
See also
brier_decomposition()
- 3-component decomposition of the Brier Score