Skip to content

Commit 67b1df7

Browse files
MattJacksonMattJackson
committed
bench: publish run history + regenerated charts/reports
Field-wide artifacts produced after all boxes finished (append-only history + charts.py output).
1 parent 80030c2 commit 67b1df7

7 files changed

Lines changed: 7 additions & 0 deletions

File tree

‎results/history/agentgateway.jsonl‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,3 +10,4 @@
1010
{"suite":"matrix","measured_at":"2026-07-30T20:01:28Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"ghcr.io/agentgateway/agentgateway:v1.4.0"}
1111
{"suite":"matrix","measured_at":"2026-07-31T10:27:21Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"ghcr.io/agentgateway/agentgateway:v1.4.0"}
1212
{"suite":"matrix","measured_at":"2026-08-01T16:29:39Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"ghcr.io/agentgateway/agentgateway:v1.4.0"}
13+
{"suite":"matrix","measured_at":"2026-08-02T15:57:43Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"ghcr.io/agentgateway/agentgateway:v1.4.0"}

‎results/history/busbar-150.jsonl‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"suite":"matrix","measured_at":"2026-08-03T04:13:01Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"getbusbar/busbar:1.5.0"}

‎results/history/helicone.jsonl‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,3 +11,4 @@
1111
{"suite":"matrix","measured_at":"2026-07-30T20:01:44Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"target/release/ai-gateway"}
1212
{"suite":"matrix","measured_at":"2026-07-31T10:27:34Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"target/release/ai-gateway"}
1313
{"suite":"matrix","measured_at":"2026-08-01T16:29:55Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"target/release/ai-gateway"}
14+
{"suite":"matrix","measured_at":"2026-08-02T15:57:56Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"target/release/ai-gateway"}

‎results/history/kong.jsonl‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,3 +10,4 @@
1010
{"suite":"matrix","measured_at":"2026-07-30T20:01:49Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"kong:3.9.3"}
1111
{"suite":"matrix","measured_at":"2026-07-31T10:27:34Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"kong:3.9.3"}
1212
{"suite":"matrix","measured_at":"2026-08-01T16:30:00Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"kong:3.9.3"}
13+
{"suite":"matrix","measured_at":"2026-08-02T15:57:48Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"kong:3.9.3"}

‎results/history/litellm-rust.jsonl‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,3 +13,4 @@
1313
{"suite":"matrix","measured_at":"2026-07-30T20:01:54Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"litellm-ai-gateway"}
1414
{"suite":"matrix","measured_at":"2026-07-31T10:27:43Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"litellm-ai-gateway"}
1515
{"suite":"matrix","measured_at":"2026-08-01T16:30:11Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"litellm-ai-gateway"}
16+
{"suite":"matrix","measured_at":"2026-08-02T15:57:52Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"litellm-ai-gateway"}

‎results/history/one-api.jsonl‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,3 +15,4 @@
1515
{"suite":"matrix","measured_at":"2026-07-30T20:02:00Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"justsong/one-api:v0.6.10"}
1616
{"suite":"matrix","measured_at":"2026-07-31T10:28:08Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"justsong/one-api:v0.6.10"}
1717
{"suite":"matrix","measured_at":"2026-08-01T16:30:12Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"justsong/one-api:v0.6.10"}
18+
{"suite":"matrix","measured_at":"2026-08-02T15:57:55Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"justsong/one-api:v0.6.10"}

‎results/history/plano.jsonl‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,3 +9,4 @@
99
{"suite":"matrix","measured_at":"2026-07-30T20:02:01Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"katanemo/plano:0.4.29"}
1010
{"suite":"matrix","measured_at":"2026-07-31T10:27:54Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"katanemo/plano:0.4.29"}
1111
{"suite":"matrix","measured_at":"2026-08-01T16:30:13Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"katanemo/plano:0.4.29"}
12+
{"suite":"matrix","measured_at":"2026-08-02T15:57:58Z","arch":"arm64","hardware":"AWS m7g.4xlarge (Graviton3, 16 cores / 64 GB). Gateway-under-test pinned to 4 cores (the comparable basis); mock and load generator on 6 cores each so the mock never bottlenecks the streaming sweep. Ubuntu 24.04. One dedicated box per gateway.","build":"katanemo/plano:0.4.29"}

0 commit comments

Comments
 (0)