Skip to content

feat(competition): round-1 challenger kit restoring the auto backend - #566

Merged
github-actions[bot] merged 1 commit into
koth-ladderfrom
kit/round1-restore-auto
Jul 27, 2026
Merged

feat(competition): round-1 challenger kit restoring the auto backend#566
github-actions[bot] merged 1 commit into
koth-ladderfrom
kit/round1-restore-auto

Conversation

@plind-junior

Copy link
Copy Markdown
Member

round-1 ladder entry: restores backend: auto over the reigning canary's substring.

the substring backend scores ~0.2-0.4 composite below auto on any seed (verified locally over the day's paired seeds), so this should clear the dethrone band decisively. kit-only change; the gate scores it and, on a dethrone against the ladder branch, arms auto-merge — this pr is the live round-1 test of that full chain, including the koth-ledger row append after the merge.

reproduce: python .github/scripts/koth_score.py --champion <ladder kit> --challenger <this kit> --base-sha <ladder sha>

the reigning round-1 canary runs the substring backend, which scores
~0.2-0.4 composite below auto on any seed. restoring auto clears the
dethrone band on the day's paired seeds.
@coderabbitai

coderabbitai Bot commented Jul 27, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

🗂️ Base branches to auto review (2)
  • test
  • main

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: 343c433b-f275-4e56-b492-9ff552fa1aca

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch kit/round1-restore-auto

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions github-actions Bot added size: XS less than 50 changed non-doc lines ci: passing ci is green labels Jul 27, 2026
@github-actions

Copy link
Copy Markdown
Contributor

koth ladder - dethroned

{
 "date": "2026-07-27",
 "base_sha": "0ee9c5bd95c42d4e252673973821bc0f77c311c0",
 "seeds": [
  159638922805791,
  63915481777079,
  111542822922051,
  101949209528365,
  112935885919949,
  50507605821269,
  120837154012398,
  39444906556475,
  181417274873639,
  130345037020083,
  167615437404411,
  240019499830169
 ],
 "lane": "kit",
 "champion": {
  "scores": [
   0.2,
   0.2,
   0.2,
   0.2,
   0.2,
   0.2,
   0.2,
   0.2,
   0.2,
   0.2,
   0.2,
   0.2
  ],
  "mean": 0.2
 },
 "challenger": {
  "scores": [
   0.7,
   0.5,
   0.5,
   0.3,
   0.5,
   0.5,
   0.6,
   0.6,
   0.5,
   0.5,
   0.6,
   0.6
  ],
  "mean": 0.5333333333333333
 },
 "mean_diff": 0.3333333333333333,
 "se": 0.028426762180748057,
 "band": 0.05571645387426619,
 "dethroned": true
}

auto-merge on dethrone (provisional ladder branch).

seeds derive from base sha + utc date; rerun locally with
python .github/scripts/koth_score.py --date <utc-date> to reproduce.
the daily result is provisional and overfittable - payout rank is
settled monthly on sealed commit-reveal seeds (docs/vouchbench-seasons.md).

@github-actions
github-actions Bot enabled auto-merge (squash) July 27, 2026 23:45
@github-actions
github-actions Bot merged commit 02fa528 into koth-ladder Jul 27, 2026
14 of 15 checks passed
plind-junior added a commit that referenced this pull request Jul 27, 2026
… events

round 1 (pr #566) proved the gap live: the gate arms auto-merge with the
workflow GITHUB_TOKEN, and github suppresses workflow triggers for
pushes caused by that token, so the merge push never reached the ledger.
the workflow now sweeps recently merged ladder prs (schedule + manual
dispatch + the still-working push path for human merges); the appender
stays idempotent per pr, so overlapping sweeps converge.
plind-junior added a commit that referenced this pull request Jul 28, 2026
… events

round 1 (pr #566) proved the gap live: the gate arms auto-merge with the
workflow GITHUB_TOKEN, and github suppresses workflow triggers for
pushes caused by that token, so the merge push never reached the ledger.
the workflow now sweeps recently merged ladder prs (schedule + manual
dispatch + the still-working push path for human merges); the appender
stays idempotent per pr, so overlapping sweeps converge.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci: passing ci is green size: XS less than 50 changed non-doc lines

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant