02 / CALIBRATION DASHBOARD 🔒 ADMIN VIEW

System calibration

When the AI says it is 80% confident, is it actually right 80% of the time? Anything above a 15% gap gets the model adjusted automatically.

Avg calibration gap
10.8%
−3.8 pts vs 30d
Escalation rate
14.2%
−1.2 pts vs 30d
Total overrides
412
Last 30 days
Categories above threshold
01
Auto-action triggered
Calibration by category THRESHOLD · 15%
CategoryStatusCalibration gapAction
Contractor risk evaluation
Threshold auto-tightened by 5% on July 14 · 142 verified decisions
Over threshold 18% Auto-action taken
Scheduling risk
Within threshold · 318 verified decisions
Healthy 12% No action
Capital allocation
Within threshold · 891 verified decisions
Healthy 4% No action
Permit assessment
Fewer than 30 verified decisions — no gap shown · 22 verified decisions
N < 30 Collecting data —
Why humans override
Reason codes logged — last 30 days
Model misunderstanding
38%
Data quality issue
27%
Edge case
18%
Policy exception
12%
Other
5%
Trend
Average calibration gap is closing
30 days ago
14.6%
14 days ago
12.1%
↓ 2.5 pts
Today
10.8%
↓ 1.3 pts