Repository navigation
Commit 8e89300
committed
docs(gomodel): its perf drop is our dropped feature strip, not a regression
GoModel's 2026-07-25 numbers collapsed (rps_max_proxy 16000 -> 2576, added p99
306 -> 2552us) while the rig floor barely moved (direct_c1_p99 74 -> 81us). It is
neither a GoModel regression nor box noise:
- the image never changed — results/history/gomodel.jsonl records the identical
enterpilot/gomodel:0.1.55 @sha256:606151f9...b562ac on both sides;
- the last good run was 2026-07-24T01:20Z; commit 2951b97, later that same day,
removed `-e LOGGING_ENABLED=false` from gw_launch as part of the OOTB
no-feature-strips pass;
- GoModel ships audit logging ON (LOGGING_ENABLED, LOGGING_LOG_BODIES and
LOGGING_LOG_HEADERS all default true, .env.template:275-281 — "all requests
and responses are logged to the configured storage"), so with the default
sqlite backend every call now captures request + response bodies and headers on
the request path;
- the load sweep agrees: throughput pins at ~2500rps flat from c=32 to c=512, a
saturation ceiling rather than a scheduling artefact.
So the pre-07-24 numbers were the flattering ones, taken with a strip no other
gateway received. Removing it was correct and it stays removed — same posture,
and same disclosure, One-API already carries for its per-request quota writes.
Document it in the manifest instead: a NOTE ON ITS NUMBERS block, and a warning
on the env list so nobody re-adds LOGGING_ENABLED=false and silently re-inflates
throughput ~6x.
Also flagged, NOT root-caused: openai-responses->openai-responses measured ~100rps
with p50 added ~10.09ms, ~25x worse than the other served cells and flat across
concurrency — a second, distinct serialization. That one cell's perf is suspect
until a targeted re-measure explains it.
Run-over-run comparisons for gomodel across the 2026-07-24 boundary are invalid
and must not be published as a GoModel regression.1 parent 07232d3 commit 8e89300
1 file changed
Lines changed: 32 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
9 | 37 | | |
10 | 38 | | |
11 | 39 | | |
| |||
75 | 103 | | |
76 | 104 | | |
77 | 105 | | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
78 | 110 | | |
79 | 111 | | |
80 | 112 | | |
| |||
0 commit comments