Regression Comparator
Compare two test runs by stable case ID to isolate new failures from known ones.
Prepare your sheet
Use one row per test case observation. Enter Before, After. Check that every row belongs to the same review scope.
Decision rule
Each ID appears once. Skipped after-runs need a separate review and are not counted as passes.
Worked result
The fictional example contains 4 input rows. Its result is 1 new failure · 1 recovery.
| Case | Before | After | Change |
|---|---|---|---|
| Login | pass | fail | Regression |
| Export | fail | pass | Recovered |
| Search | fail | fail | Known failure |
| Archive | pass | skip | Unchecked |
Run it on your own inputs
- Open the tool and choose Start empty or edit the example.
- Enter the inputs, resolve validation messages and review the decision sheet.
- Download the text report or print the summary for the responsible person.
Source and support
Compare two test runs by stable case ID to isolate new failures from known ones. The demonstration requires actual execution before work can be marked complete. Benchcraft designed this tool’s inputs, decision rule and example for this office task. Reviewed source · Nate Herk | AI Automation.
Request a custom workflow. €149 one-time pilot after written scope agreement. JB Codex adapts one repeated job with a worked example and owner review.