A Set of New Tools to Measure the Effective Value of Probabilistic Forecasts of Continuous Variables

In recent years, the prominence of probabilistic forecasting has risen among numerous research fields (finance, meteorology, banking, etc.). Best practices on using such forecasts are, however, neither well explained nor well understood. The question of the benefits derived from these forecasts is of primary interest, especially for the industrial sector. A sound methodology already exists to evaluate the value of probabilistic forecasts of binary events. In this paper, we introduce a comprehensive methodology for assessing the value of probabilistic forecasts of continuous variables, which is valid for a specific class of problems where the cost functions are piecewise linear. The proposed methodology is based on a set of visual diagnostic tools. In particular, we propose a new diagram called EVC (“Effective economic Value of a forecast of Continuous variable”) which provides the effective value of a forecast. Using simple case studies, we show that the value of probabilistic forecasts of continuous variables is strongly dependent on a key variable that we call the risk ratio. It leads to a quantitative metric of a value called the OEV (“Overall Effective Value”). The preliminary results suggest that typical OEVs demonstrate the benefits of probabilistic forecasting over a deterministic approach.