feat(competition): round-1 challenger kit restoring the auto backend - #566
Conversation
the reigning round-1 canary runs the substring backend, which scores ~0.2-0.4 composite below auto on any seed. restoring auto clears the dethrone band on the day's paired seeds.
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. 🗂️ Base branches to auto review (2)
Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Plus Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
koth ladder - dethroned {
"date": "2026-07-27",
"base_sha": "0ee9c5bd95c42d4e252673973821bc0f77c311c0",
"seeds": [
159638922805791,
63915481777079,
111542822922051,
101949209528365,
112935885919949,
50507605821269,
120837154012398,
39444906556475,
181417274873639,
130345037020083,
167615437404411,
240019499830169
],
"lane": "kit",
"champion": {
"scores": [
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2
],
"mean": 0.2
},
"challenger": {
"scores": [
0.7,
0.5,
0.5,
0.3,
0.5,
0.5,
0.6,
0.6,
0.5,
0.5,
0.6,
0.6
],
"mean": 0.5333333333333333
},
"mean_diff": 0.3333333333333333,
"se": 0.028426762180748057,
"band": 0.05571645387426619,
"dethroned": true
}auto-merge on dethrone (provisional ladder branch). seeds derive from base sha + utc date; rerun locally with |
… events round 1 (pr #566) proved the gap live: the gate arms auto-merge with the workflow GITHUB_TOKEN, and github suppresses workflow triggers for pushes caused by that token, so the merge push never reached the ledger. the workflow now sweeps recently merged ladder prs (schedule + manual dispatch + the still-working push path for human merges); the appender stays idempotent per pr, so overlapping sweeps converge.
… events round 1 (pr #566) proved the gap live: the gate arms auto-merge with the workflow GITHUB_TOKEN, and github suppresses workflow triggers for pushes caused by that token, so the merge push never reached the ledger. the workflow now sweeps recently merged ladder prs (schedule + manual dispatch + the still-working push path for human merges); the appender stays idempotent per pr, so overlapping sweeps converge.
round-1 ladder entry: restores
backend: autoover the reigning canary'ssubstring.the substring backend scores ~0.2-0.4 composite below auto on any seed (verified locally over the day's paired seeds), so this should clear the dethrone band decisively. kit-only change; the gate scores it and, on a dethrone against the ladder branch, arms auto-merge — this pr is the live round-1 test of that full chain, including the koth-ledger row append after the merge.
reproduce:
python .github/scripts/koth_score.py --champion <ladder kit> --challenger <this kit> --base-sha <ladder sha>