Brier Score
The Brier score measures the accuracy of probabilistic forecasts as the mean squared difference between predicted probabilities and actual outcomes; lower is better, and 0 is perfect. It is closely related to Calibrated Confidence, Reliability Diagram (Calibration Curve) and Hit Rate (Directional Accuracy), each defined in the hedgewing.ai glossary.
The Brier score is the standard way to grade a forecast that is expressed as a probability rather than a yes-or-no call. For a binary event such as 'the stock closes higher in five days', you take the predicted probability (say 0.65), subtract the outcome (1 if it happened, 0 if not), square the difference, and average over all forecasts. A model that always says 50% scores 0.25; a perfect model scores 0; a confidently wrong model can score close to 1.
What makes the Brier score useful is that it rewards two things at once: discrimination (assigning higher probabilities to events that happen) and calibration (having the probabilities match observed frequencies). It can be decomposed into those components, so a researcher can see whether a model is bad because it cannot tell outcomes apart or because its confidence is systematically too high or too low.
For investors, the practical lesson is that a stock-forecasting tool should be judged on probability quality, not just on how often its direction was right. Two models with the same hit rate can have very different Brier scores if one is honest about uncertainty and the other claims 90% confidence on every call. hedgewing.ai reports calibrated confidence on every forecast horizon precisely so that its probabilities can be scored this way rather than treated as decoration.
FAQ
What is Brier Score?
The Brier score measures the accuracy of probabilistic forecasts as the mean squared difference between predicted probabilities and actual outcomes; lower is better, and 0 is perfect.
Which terms are related to Brier Score?
Brier Score is closely related to Calibrated Confidence, Reliability Diagram (Calibration Curve) and Hit Rate (Directional Accuracy). Each has its own entry in the hedgewing.ai glossary.
Is this definition of Brier Score investment advice?
No. This glossary entry explains what Brier Score means. It is educational reference material, not personalised investment advice and not a recommendation to buy or sell any security.
Create a free Hedgewing account to try hedgewing.ai yourself.