Calibrated Confidence
Calibrated Confidence: A confidence score is calibrated when its stated probability matches the observed frequency — 70% confident predictions should be right about 70% of the time. It is closely related to Ensemble Model and Overfitting, each defined in the hedgewing.ai glossary.
Most models output a confidence or probability, but raw model scores are usually poorly calibrated — a model claiming 90% confidence might only be right 60% of the time. Calibration corrects this so the numbers mean what they say.
Calibration is essential when sizing positions by conviction. hedgewing.ai calibrates ensemble confidence on held-out data using isotonic and Platt-style methods, so a high-confidence prediction is genuinely more reliable than a low-confidence one.
FAQ
Which terms are related to Calibrated Confidence?
Calibrated Confidence is closely related to Ensemble Model and Overfitting. Each has its own entry in the hedgewing.ai glossary.
Is this definition of Calibrated Confidence investment advice?
No. This glossary entry explains what Calibrated Confidence means. It is educational reference material, not personalised investment advice and not a recommendation to buy or sell any security.
Create a free Hedgewing account to try hedgewing.ai yourself.