Repository navigation
Commit 8b41012
* Update Weave Router scores to v0.62
Weave Router v0.62 submission re-took #1 on the leaderboard. Updated
the headline leaderboard entry with the new RouterArena eval results:
- Arena Score: 74.61 → 76.09
- Accuracy: 78.43 → 79.32
- Cost per 1k: $0.92 → $0.61
- Robustness Score: 79.05 → 79.76
- Opt. Selection: 1.27 → 5.60
- Opt. Cost: 12.10 → 17.19
- Opt. Accuracy: 89.56 → 89.21
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
* Update Weave Router metadata to v0.62 (modelPool + description)
Mirrors the v0.62 submission config (RouterArena PR #102):
- 12-model pool -> 7 models (drops claude-sonnet/haiku-4-5, gpt-5.4-mini,
gpt-4.1, qwen3.5-flash-02-23, kimi-k2.5; adds qwen3-235b-a22b-2507)
- description updated to mention v0.62 specifics: Jina v2 INT8 ONNX
(768-dim) embeddings, top-p=4 cluster sum, k=160 clusters, alpha=0.25
Category scores and flip labels are intentionally left at v0.27-derived
values for this PR; can be refreshed in a follow-up once v0.62 predictions
are available locally.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: yl231 <yl231@users.noreply.github.com>
1 parent d028d27 commit 8b41012
3 files changed
Lines changed: 11 additions & 21 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
20 | 20 | | |
21 | | - | |
22 | | - | |
| 21 | + | |
| 22 | + | |
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
22 | | - | |
23 | | - | |
24 | 22 | | |
25 | | - | |
26 | | - | |
27 | 23 | | |
28 | 24 | | |
29 | 25 | | |
30 | 26 | | |
31 | | - | |
32 | | - | |
| 27 | + | |
33 | 28 | | |
34 | 29 | | |
35 | 30 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
4 | | - | |
| 4 | + | |
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | | - | |
9 | | - | |
10 | 8 | | |
11 | | - | |
12 | | - | |
13 | 9 | | |
14 | 10 | | |
15 | 11 | | |
16 | 12 | | |
17 | | - | |
18 | | - | |
| 13 | + | |
19 | 14 | | |
20 | 15 | | |
21 | 16 | | |
| |||
0 commit comments