RESOLVED · INC-0017 · P0
Toast darkness exceeded threshold (darkness=6). Bread blackened. Smoke detected by plate-svc. MTTR: 4 minutes.
Incident postmortem — INC-0017
Root cause: toaster-svc accepted darkness=6 without validation. No upper bound enforced in v2.1.3.
Timeline:
07:34:00 — TOAST-0036 inserted, darkness=6
07:36:12 — plate-svc smoke sensor threshold breached
07:36:14 — P0 declared, PagerDuty fired, 3 engineers woken
07:38:00 — bread ejected manually
07:40:02 — incident resolved, windows opened
Action items:
(1) Add darkness validator, max=5 — owner: @breadops
(2) Implement smoke-based circuit breaker — owner: @toaster-platform
(3) Add "sniff test" step to runbook — owner: @on-call-rotation
MTTR: 4 minutes. Severity: P0. Slices lost: 1.