One harness, three evals
Same five-piece harness, three runs. Pick a run, then drag the release bar and watch the SHIP / HOLD verdict react to the bootstrap CI, not the mean.
gate() in the harness.
Summary, all three runs at their own release bar (the row matching your current tab is highlighted):
| eval | mean | 95% CI | bar | verdict |
|---|
The gate never looks at the mean alone: ship = ci_lo >= bar. Runs 1 and 2 share the exact same 10-item QA dataset and the exact same 0.35 bar; only the scorer changes (strict string match vs. a lenient judge), and that alone moves the CI floor from 0.30 to 0.40 and flips HOLD into SHIP.