Repository navigation
Commit 9023c53
committed
feat(site): derive what the rig can RESOLVE, so a tie is not published as a ranking
The board can rank two gateways 1.2% apart. It could not say whether that 1.2% was a finding or which
box each landed on. This derives the answer from the board itself.
MEASURED, NOT CHOSEN. Every box runs the same qualification before it measures anything, and
`box_qualify.drift_pct` records how far it landed from the shared baseline. Those boxes are identical
by construction - same instance type, same image, same mock - so the spread between the luckiest and
unluckiest box IS what the rig cannot tell apart. On the 2026-07-30 field that is 8.27%
(-6.22% to +2.05% across 13 boxes).
A hard-coded 1% or 2% would have been an undeclared rule deciding which published comparisons count,
and this project's position is that no undeclared rule may author a number. The figure also moves with
the fleet: a tighter fleet resolves finer, and a noisier one honestly admits it resolves less.
WHAT IT SAYS ABOUT TONIGHT'S BOARD, and it is uncomfortable: busbar 46,031 vs litellm-rust 48,394 is
4.9% apart on the one cell both serve, and the rig resolved 8.27%. That comparison did not
demonstrate a difference. The wider gaps still stand - 25,101 vs 48,394 is far outside it.
Relative to the LARGER value, so the rule means the same at the bottom of the board as at the top:
19 vs 20 is 5% and 49,000 vs 50,000 is 2%, both correctly tied, while their ABSOLUTE gaps differ by
three orders of magnitude - which is precisely why an absolute threshold could not serve this board.
Null with fewer than two boxes: with one sample there is no spread to observe, and inventing a floor
from it would be the magic number this exists to avoid. Nothing may be called indistinguishable
without a resolution, since that would assert a tie on a figure we just said we could not derive.
One test bug caught writing these: I asserted 19 vs 20 was resolvable, reasoning 1/19 = 5.3%. It is
5% of the larger value, inside the rig's 8.27%, so the code was right and the expectation was wrong.
206 site tests, 0 failures.1 parent 26c7436 commit 9023c53
2 files changed
Lines changed: 81 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1071 | 1071 | | |
1072 | 1072 | | |
1073 | 1073 | | |
| 1074 | + | |
| 1075 | + | |
| 1076 | + | |
| 1077 | + | |
| 1078 | + | |
| 1079 | + | |
| 1080 | + | |
| 1081 | + | |
| 1082 | + | |
| 1083 | + | |
| 1084 | + | |
| 1085 | + | |
| 1086 | + | |
| 1087 | + | |
| 1088 | + | |
| 1089 | + | |
| 1090 | + | |
| 1091 | + | |
| 1092 | + | |
| 1093 | + | |
| 1094 | + | |
| 1095 | + | |
| 1096 | + | |
| 1097 | + | |
| 1098 | + | |
| 1099 | + | |
| 1100 | + | |
| 1101 | + | |
| 1102 | + | |
| 1103 | + | |
| 1104 | + | |
| 1105 | + | |
| 1106 | + | |
| 1107 | + | |
| 1108 | + | |
| 1109 | + | |
| 1110 | + | |
| 1111 | + | |
1074 | 1112 | | |
1075 | 1113 | | |
1076 | 1114 | | |
| |||
4887 | 4925 | | |
4888 | 4926 | | |
4889 | 4927 | | |
4890 | | - | |
| 4928 | + | |
4891 | 4929 | | |
4892 | 4930 | | |
4893 | 4931 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2246 | 2246 | | |
2247 | 2247 | | |
2248 | 2248 | | |
| 2249 | + | |
| 2250 | + | |
| 2251 | + | |
| 2252 | + | |
| 2253 | + | |
| 2254 | + | |
| 2255 | + | |
| 2256 | + | |
| 2257 | + | |
| 2258 | + | |
| 2259 | + | |
| 2260 | + | |
| 2261 | + | |
| 2262 | + | |
| 2263 | + | |
| 2264 | + | |
| 2265 | + | |
| 2266 | + | |
| 2267 | + | |
| 2268 | + | |
| 2269 | + | |
| 2270 | + | |
| 2271 | + | |
| 2272 | + | |
| 2273 | + | |
| 2274 | + | |
| 2275 | + | |
| 2276 | + | |
| 2277 | + | |
| 2278 | + | |
| 2279 | + | |
| 2280 | + | |
| 2281 | + | |
| 2282 | + | |
| 2283 | + | |
| 2284 | + | |
| 2285 | + | |
| 2286 | + | |
| 2287 | + | |
| 2288 | + | |
| 2289 | + | |
| 2290 | + | |
2249 | 2291 | | |
2250 | 2292 | | |
2251 | 2293 | | |
| |||
0 commit comments