Benchcraft / Release room
Change rehearsal   /   Release engineer

Canary Error Gap

Compare failure rates of a canary cohort and its concurrent control.

01 / Inputs

Working sheet

Edit any cell to recalculate. Use anonymous references. Data stays in this browser tab and clears when you reload.

FeatureTest requestsTest errorsControl requestsControl errorsTrigger ppRow
02 / Review

Decision sheet

FeatureCanaryControlGap ppAction
Search4%1%3Pause
Export0%0.83%-0.83Observe
How the rule works

The trigger is the configured absolute percentage-point increase, not statistical significance. A decision requires traffic in both groups.

Read the worked example

Optional paid service

Request a custom workflow

€149 one-time pilot after written scope agreement. JB Codex adapts one repeated job with a worked example and owner review.

The free tool runs independently on your device.