Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 29, 2025

Note

Mend has cancelled the proposed renaming of the Renovate GitHub app being renamed to mend[bot].

This notice will be removed on 2025-10-07.


This PR contains the following updates:

Package Change Age Confidence
@graphql-hive/gateway (source) 2.1.7 -> 2.1.9 age confidence

Release Notes

graphql-hive/gateway (@​graphql-hive/gateway)

v2.1.9

Compare Source

Patch Changes

v2.1.8

Compare Source

Patch Changes

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 29, 2025
Copy link

github-actions bot commented Sep 29, 2025

💻 Website Preview

The latest changes are available as preview in: https://21b501af.federation-gateway-benchmark.pages.dev

Copy link

github-actions bot commented Sep 29, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1851 111516 total, 0 failed avg: 27ms, p95: 48ms
grafbase 1524 92080 total, 0 failed avg: 32ms, p95: 57ms
cosmo 655 39627 total, 0 failed avg: 75ms, p95: 110ms
apollo-router 336 20458 total, 0 failed avg: 146ms, p95: 189ms
hive-gateway 299 18258 total, 0 failed avg: 164ms, p95: 222ms
hive-gateway-bun 290 17690 total, 0 failed avg: 169ms, p95: 221ms
apollo-gateway 119 7332 total, 0 failed avg: 410ms, p95: 481ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 334248      ✗ 0     
     data_received..................: 9.8 GB  162 MB/s
     data_sent......................: 130 MB  2.2 MB/s
     http_req_blocked...............: avg=4.85µs  min=1.13µs med=2.41µs  max=8.83ms   p(90)=3.42µs  p(95)=3.93µs   p(99.9)=77.28µs
     http_req_connecting............: avg=2.01µs  min=0s     med=0s      max=8.8ms    p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.66ms min=1.86ms med=24.06ms max=426.14ms p(90)=41.62ms p(95)=47.97ms  p(99.9)=82.03ms
       { expected_response:true }...: avg=26.66ms min=1.86ms med=24.06ms max=426.14ms p(90)=41.62ms p(95)=47.97ms  p(99.9)=82.03ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 111516
     http_req_receiving.............: avg=115µs   min=22.8µs med=39.6µs  max=48.31ms  p(90)=97.82µs p(95)=313.92µs p(99.9)=13.68ms
     http_req_sending...............: avg=99.78µs min=4.91µs med=9.51µs  max=257.51ms p(90)=28.1µs  p(95)=116.81µs p(99.9)=14.58ms
     http_req_tls_handshaking.......: avg=0s      min=0s     med=0s      max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.44ms min=1.8ms  med=23.9ms  max=424.66ms p(90)=41.22ms p(95)=47.5ms   p(99.9)=79.87ms
     http_reqs......................: 111516  1851.351678/s
     iteration_duration.............: avg=26.91ms min=4.65ms med=24.29ms max=441.32ms p(90)=41.86ms p(95)=48.21ms  p(99.9)=82.91ms
     iterations.....................: 111416  1849.691511/s
     success_rate...................: 100.00% ✓ 111416      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 275940      ✗ 0    
     data_received..................: 8.1 GB  134 MB/s
     data_sent......................: 107 MB  1.8 MB/s
     http_req_blocked...............: avg=6.27µs   min=1.21µs  med=2.99µs  max=9.97ms   p(90)=4.33µs   p(95)=5.3µs    p(99.9)=124.17µs
     http_req_connecting............: avg=2.61µs   min=0s      med=0s      max=9.93ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=32.26ms  min=2.99ms  med=28.74ms max=596.57ms p(90)=50.08ms  p(95)=57.42ms  p(99.9)=88.6ms  
       { expected_response:true }...: avg=32.26ms  min=2.99ms  med=28.74ms max=596.57ms p(90)=50.08ms  p(95)=57.42ms  p(99.9)=88.6ms  
     http_req_failed................: 0.00%   ✓ 0           ✗ 92080
     http_req_receiving.............: avg=155.86µs min=25.96µs med=49.99µs max=113.9ms  p(90)=138.17µs p(95)=411.65µs p(99.9)=16.75ms 
     http_req_sending...............: avg=136.1µs  min=5.73µs  med=12.06µs max=532.73ms p(90)=37.37µs  p(95)=146.69µs p(99.9)=19.27ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=31.97ms  min=2.95ms  med=28.54ms max=568.83ms p(90)=49.52ms  p(95)=56.83ms  p(99.9)=87.52ms 
     http_reqs......................: 92080   1524.309225/s
     iteration_duration.............: avg=32.61ms  min=8.07ms  med=29.03ms max=632.13ms p(90)=50.39ms  p(95)=57.73ms  p(99.9)=89.79ms 
     iterations.....................: 91980   1522.653807/s
     success_rate...................: 100.00% ✓ 91980       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 118581     ✗ 0    
     data_received..................: 3.5 GB  58 MB/s
     data_sent......................: 46 MB   763 kB/s
     http_req_blocked...............: avg=8.16µs   min=1.09µs  med=2.98µs  max=7.08ms   p(90)=4.75µs   p(95)=5.64µs   p(99.9)=1.46ms  
     http_req_connecting............: avg=4.56µs   min=0s      med=0s      max=7.05ms   p(90)=0s       p(95)=0s       p(99.9)=1.45ms  
     http_req_duration..............: avg=75.44ms  min=2.87ms  med=74.72ms max=475.57ms p(90)=101.59ms p(95)=110.07ms p(99.9)=269.81ms
       { expected_response:true }...: avg=75.44ms  min=2.87ms  med=74.72ms max=475.57ms p(90)=101.59ms p(95)=110.07ms p(99.9)=269.81ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 39627
     http_req_receiving.............: avg=163.02µs min=27.77µs med=62.52µs max=39.57ms  p(90)=129.42µs p(95)=356.94µs p(99.9)=18.29ms 
     http_req_sending...............: avg=65.19µs  min=5.09µs  med=11.01µs max=209.44ms p(90)=22.26µs  p(95)=121.75µs p(99.9)=3.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=75.21ms  min=2.78ms  med=74.54ms max=474.8ms  p(90)=101.36ms p(95)=109.77ms p(99.9)=254.08ms
     http_reqs......................: 39627   655.783405/s
     iteration_duration.............: avg=75.91ms  min=6.59ms  med=75.03ms max=539.87ms p(90)=101.86ms p(95)=110.34ms p(99.9)=293.51ms
     iterations.....................: 39527   654.128515/s
     success_rate...................: 100.00% ✓ 39527      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 61074      ✗ 0    
     data_received..................: 1.8 GB  30 MB/s
     data_sent......................: 24 MB   391 kB/s
     http_req_blocked...............: avg=15.4µs   min=1.98µs  med=3.2µs    max=9.88ms   p(90)=5.26µs   p(95)=6.17µs   p(99.9)=5.4ms   
     http_req_connecting............: avg=11.39µs  min=0s      med=0s       max=9.82ms   p(90)=0s       p(95)=0s       p(99.9)=5.38ms  
     http_req_duration..............: avg=146.36ms min=6.36ms  med=146.03ms max=614.79ms p(90)=179.04ms p(95)=189.24ms p(99.9)=440.22ms
       { expected_response:true }...: avg=146.36ms min=6.36ms  med=146.03ms max=614.79ms p(90)=179.04ms p(95)=189.24ms p(99.9)=440.22ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 20458
     http_req_receiving.............: avg=103.51µs min=39.22µs med=61.63µs  max=300.35ms p(90)=120.89µs p(95)=154µs    p(99.9)=1.59ms  
     http_req_sending...............: avg=66.41µs  min=8.72µs  med=12.75µs  max=362.54ms p(90)=24.33µs  p(95)=40.49µs  p(99.9)=2.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=146.19ms min=6.2ms   med=145.9ms  max=597.86ms p(90)=178.91ms p(95)=189.05ms p(99.9)=426.36ms
     http_reqs......................: 20458   336.426956/s
     iteration_duration.............: avg=147.47ms min=24.37ms med=146.45ms max=660.11ms p(90)=179.39ms p(95)=189.58ms p(99.9)=476.37ms
     iterations.....................: 20358   334.782479/s
     success_rate...................: 100.00% ✓ 20358      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54474      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   348 kB/s
     http_req_blocked...............: avg=19.29µs  min=1.25µs  med=2.82µs   max=11.1ms   p(90)=4.68µs   p(95)=5.87µs   p(99.9)=7ms   
     http_req_connecting............: avg=15.06µs  min=0s      med=0s       max=11.04ms  p(90)=0s       p(95)=0s       p(99.9)=6.96ms
     http_req_duration..............: avg=163.97ms min=6.98ms  med=151.47ms max=1.08s    p(90)=188.31ms p(95)=222.26ms p(99.9)=1.05s 
       { expected_response:true }...: avg=163.97ms min=6.98ms  med=151.47ms max=1.08s    p(90)=188.31ms p(95)=222.26ms p(99.9)=1.05s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 18258
     http_req_receiving.............: avg=115.55µs min=26.15µs med=51.58µs  max=304.61ms p(90)=114.25µs p(95)=220.97µs p(99.9)=4.86ms
     http_req_sending...............: avg=68.96µs  min=5.67µs  med=11.47µs  max=134.65ms p(90)=33.34µs  p(95)=130.87µs p(99.9)=5.88ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=163.79ms min=6.91ms  med=151.31ms max=1.08s    p(90)=188.12ms p(95)=222.09ms p(99.9)=1.05s 
     http_reqs......................: 18258   299.598548/s
     iteration_duration.............: avg=165.31ms min=37.33ms med=151.96ms max=1.08s    p(90)=188.85ms p(95)=223.77ms p(99.9)=1.05s 
     iterations.....................: 18158   297.957631/s
     success_rate...................: 100.00% ✓ 18158      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52770      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   337 kB/s
     http_req_blocked...............: avg=20.27µs  min=1.18µs  med=2.87µs   max=11.77ms  p(90)=4.81µs   p(95)=6.09µs   p(99.9)=7.49ms
     http_req_connecting............: avg=16.33µs  min=0s      med=0s       max=11.73ms  p(90)=0s       p(95)=0s       p(99.9)=7.42ms
     http_req_duration..............: avg=169.39ms min=7.02ms  med=155.05ms max=1.14s    p(90)=185.61ms p(95)=220.79ms p(99.9)=1.12s 
       { expected_response:true }...: avg=169.39ms min=7.02ms  med=155.05ms max=1.14s    p(90)=185.61ms p(95)=220.79ms p(99.9)=1.12s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 17690
     http_req_receiving.............: avg=109.54µs min=27.11µs med=50.94µs  max=115.12ms p(90)=108.93µs p(95)=239.06µs p(99.9)=5.4ms 
     http_req_sending...............: avg=79.52µs  min=5.71µs  med=11.47µs  max=188.91ms p(90)=33.04µs  p(95)=132.26µs p(99.9)=5.01ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=169.2ms  min=6.96ms  med=154.89ms max=1.14s    p(90)=185.34ms p(95)=220.45ms p(99.9)=1.12s 
     http_reqs......................: 17690   290.011486/s
     iteration_duration.............: avg=170.71ms min=40.73ms med=155.46ms max=1.14s    p(90)=186.05ms p(95)=221.55ms p(99.9)=1.12s 
     iterations.....................: 17590   288.372077/s
     success_rate...................: 100.00% ✓ 17590      ✗ 0    
     vus............................: 13      min=13       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21696      ✗ 0   
     data_received..................: 644 MB  11 MB/s
     data_sent......................: 8.5 MB  139 kB/s
     http_req_blocked...............: avg=45.67µs  min=1.37µs   med=2.9µs    max=11.94ms  p(90)=4.65µs   p(95)=5.35µs   p(99.9)=10.29ms 
     http_req_connecting............: avg=42.19µs  min=0s       med=0s       max=11.91ms  p(90)=0s       p(95)=0s       p(99.9)=10.27ms 
     http_req_duration..............: avg=410.26ms min=7.38ms   med=410.56ms max=757.31ms p(90)=464.12ms p(95)=481.48ms p(99.9)=696.92ms
       { expected_response:true }...: avg=410.26ms min=7.38ms   med=410.56ms max=757.31ms p(90)=464.12ms p(95)=481.48ms p(99.9)=696.92ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7332
     http_req_receiving.............: avg=73.44µs  min=29.37µs  med=51.79µs  max=66.03ms  p(90)=96.46µs  p(95)=111.12µs p(99.9)=704.89µs
     http_req_sending...............: avg=81.37µs  min=6.45µs   med=12.18µs  max=130.72ms p(90)=20.32µs  p(95)=23.96µs  p(99.9)=5.2ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=410.1ms  min=7.31ms   med=410.42ms max=740.72ms p(90)=464.02ms p(95)=481.38ms p(99.9)=691.38ms
     http_reqs......................: 7332    119.863863/s
     iteration_duration.............: avg=416.23ms min=180.53ms med=411.08ms max=773.77ms p(90)=465.14ms p(95)=482.2ms  p(99.9)=721.77ms
     iterations.....................: 7232    118.229058/s
     success_rate...................: 100.00% ✓ 7232       ✗ 0   
     vus............................: 42      min=42       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 29, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1846 114745 total, 0 failed avg: 121ms, p95: 292ms
grafbase 1533 96862 total, 0 failed avg: 144ms, p95: 334ms
cosmo 707 45105 total, 0 failed avg: 311ms, p95: 689ms
apollo-router 381 25755 total, 0 failed avg: 547ms, p95: 1222ms ❌ 16 unexpected GraphQL errors
hive-gateway-bun 276 19120 total, 0 failed avg: 733ms, p95: 1630ms
hive-gateway 269 18696 total, 0 failed avg: 751ms, p95: 1619ms
apollo-gateway 156 10719 total, 0 failed avg: 1213ms, p95: 2577ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 341235      ✗ 0     
     data_received..................: 10 GB   162 MB/s
     data_sent......................: 134 MB  2.1 MB/s
     http_req_blocked...............: avg=516.28µs min=1.15µs  med=2.55µs   max=354.63ms p(90)=3.87µs   p(95)=4.54µs   p(99.9)=180.73ms
     http_req_connecting............: avg=512.66µs min=0s      med=0s       max=354.56ms p(90)=0s       p(95)=0s       p(99.9)=180.5ms 
     http_req_duration..............: avg=121.31ms min=1.74ms  med=110.31ms max=417.56ms p(90)=246.33ms p(95)=291.72ms p(99.9)=378.57ms
       { expected_response:true }...: avg=121.31ms min=1.74ms  med=110.31ms max=417.56ms p(90)=246.33ms p(95)=291.72ms p(99.9)=378.57ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 114745
     http_req_receiving.............: avg=547.79µs min=22.27µs med=41.34µs  max=137.76ms p(90)=98.89µs  p(95)=393.4µs  p(99.9)=77.12ms 
     http_req_sending...............: avg=444.81µs min=4.9µs   med=9.92µs   max=133.86ms p(90)=22.99µs  p(95)=126.96µs p(99.9)=70.19ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=120.32ms min=1.7ms   med=109.37ms max=387.61ms p(90)=244.32ms p(95)=289.72ms p(99.9)=376.17ms
     http_reqs......................: 114745  1846.106651/s
     iteration_duration.............: avg=123.18ms min=1.97ms  med=111.9ms  max=750.65ms p(90)=248.72ms p(95)=294.18ms p(99.9)=420.18ms
     iterations.....................: 113745  1830.017875/s
     success_rate...................: 100.00% ✓ 113745      ✗ 0     
     vus............................: 67      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 287586      ✗ 0    
     data_received..................: 8.5 GB  135 MB/s
     data_sent......................: 113 MB  1.8 MB/s
     http_req_blocked...............: avg=699.51µs min=1.17µs  med=2.93µs   max=407.54ms p(90)=4.29µs   p(95)=5.25µs   p(99.9)=222.86ms
     http_req_connecting............: avg=693.98µs min=0s      med=0s       max=407.46ms p(90)=0s       p(95)=0s       p(99.9)=222.8ms 
     http_req_duration..............: avg=143.54ms min=2.56ms  med=133.2ms  max=473.84ms p(90)=282.22ms p(95)=333.94ms p(99.9)=426.09ms
       { expected_response:true }...: avg=143.54ms min=2.56ms  med=133.2ms  max=473.84ms p(90)=282.22ms p(95)=333.94ms p(99.9)=426.09ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 96862
     http_req_receiving.............: avg=633.49µs min=24.26µs med=46.91µs  max=153.5ms  p(90)=108.5µs  p(95)=432.57µs p(99.9)=84.78ms 
     http_req_sending...............: avg=590.86µs min=5.17µs  med=11.52µs  max=156.09ms p(90)=30.27µs  p(95)=139.5µs  p(99.9)=84.73ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=142.31ms min=2.51ms  med=132.1ms  max=440.92ms p(90)=279.32ms p(95)=331.41ms p(99.9)=422.23ms
     http_reqs......................: 96862   1533.743002/s
     iteration_duration.............: avg=146.21ms min=2.81ms  med=135.78ms max=882.47ms p(90)=285.54ms p(95)=338.21ms p(99.9)=510.87ms
     iterations.....................: 95862   1517.908692/s
     success_rate...................: 100.00% ✓ 95862       ✗ 0    
     vus............................: 68      min=0         max=496
     vus_max........................: 500     min=500       max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 132315     ✗ 0    
     data_received..................: 4.0 GB  62 MB/s
     data_sent......................: 53 MB   824 kB/s
     http_req_blocked...............: avg=103.25µs min=1.24µs  med=2.84µs   max=144.5ms  p(90)=4.11µs   p(95)=5.27µs   p(99.9)=35.97ms 
     http_req_connecting............: avg=98.76µs  min=0s      med=0s       max=144.42ms p(90)=0s       p(95)=0s       p(99.9)=35.92ms 
     http_req_duration..............: avg=311.28ms min=2.82ms  med=295.76ms max=1.13s    p(90)=605.24ms p(95)=689.11ms p(99.9)=992.21ms
       { expected_response:true }...: avg=311.28ms min=2.82ms  med=295.76ms max=1.13s    p(90)=605.24ms p(95)=689.11ms p(99.9)=992.21ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 45105
     http_req_receiving.............: avg=459.1µs  min=27.58µs med=57.83µs  max=140.16ms p(90)=179.27µs p(95)=480.66µs p(99.9)=66.08ms 
     http_req_sending...............: avg=162.09µs min=5.77µs  med=11.18µs  max=91.61ms  p(90)=30.65µs  p(95)=129.83µs p(99.9)=33.11ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=310.66ms min=2.75ms  med=294.79ms max=1.13s    p(90)=604.24ms p(95)=688.33ms p(99.9)=992.05ms
     http_reqs......................: 45105   707.835565/s
     iteration_duration.............: avg=318.86ms min=3.08ms  med=303.87ms max=1.13s    p(90)=608.84ms p(95)=692.05ms p(99.9)=999.68ms
     iterations.....................: 44105   692.142503/s
     success_rate...................: 100.00% ✓ 44105      ✗ 0    
     vus............................: 92      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 24739 / ✗ 16
     ✓ valid response structure

     checks.........................: 99.97% ✓ 74249      ✗ 16   
     data_received..................: 2.3 GB 34 MB/s
     data_sent......................: 30 MB  446 kB/s
     http_req_blocked...............: avg=91.27µs  min=1.52µs  med=3.17µs   max=133.93ms p(90)=5.47µs   p(95)=8.5µs    p(99.9)=24.44ms
     http_req_connecting............: avg=85.64µs  min=0s      med=0s       max=133.88ms p(90)=0s       p(95)=0s       p(99.9)=24.38ms
     http_req_duration..............: avg=547.34ms min=6.2ms   med=511.95ms max=1.76s    p(90)=1.09s    p(95)=1.22s    p(99.9)=1.65s  
       { expected_response:true }...: avg=547.34ms min=6.2ms   med=511.95ms max=1.76s    p(90)=1.09s    p(95)=1.22s    p(99.9)=1.65s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 25755
     http_req_receiving.............: avg=121.14µs min=31.53µs med=55.65µs  max=74.12ms  p(90)=110.39µs p(95)=176.03µs p(99.9)=6.72ms 
     http_req_sending...............: avg=115.99µs min=6.37µs  med=12.15µs  max=102.33ms p(90)=31.49µs  p(95)=120.05µs p(99.9)=16.7ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=547.11ms min=6.15ms  med=511.7ms  max=1.76s    p(90)=1.09s    p(95)=1.22s    p(99.9)=1.65s  
     http_reqs......................: 25755  381.982251/s
     iteration_duration.............: avg=569.91ms min=6.54ms  med=540.6ms  max=1.76s    p(90)=1.1s     p(95)=1.22s    p(99.9)=1.65s  
     iterations.....................: 24755  367.150869/s
     success_rate...................: 99.93% ✓ 24739      ✗ 16   
     vus............................: 84     min=0        max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54360      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   324 kB/s
     http_req_blocked...............: avg=119.22µs min=1.24µs  med=2.83µs   max=153.04ms p(90)=4.82µs  p(95)=7.71µs   p(99.9)=37.81ms
     http_req_connecting............: avg=113.73µs min=0s      med=0s       max=153ms    p(90)=0s      p(95)=0s       p(99.9)=37.73ms
     http_req_duration..............: avg=733.42ms min=6.63ms  med=671.89ms max=4.78s    p(90)=1.46s   p(95)=1.63s    p(99.9)=3.77s  
       { expected_response:true }...: avg=733.42ms min=6.63ms  med=671.89ms max=4.78s    p(90)=1.46s   p(95)=1.63s    p(99.9)=3.77s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 19120
     http_req_receiving.............: avg=194.75µs min=27.26µs med=45.98µs  max=116.16ms p(90)=96.6µs  p(95)=159.92µs p(99.9)=31.31ms
     http_req_sending...............: avg=184.13µs min=5.7µs   med=11.11µs  max=98.02ms  p(90)=30.68µs p(95)=116.75µs p(99.9)=33.21ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=733.04ms min=6.58ms  med=671.63ms max=4.78s    p(90)=1.46s   p(95)=1.62s    p(99.9)=3.77s  
     http_reqs......................: 19120   276.315372/s
     iteration_duration.............: avg=774.3ms  min=7.73ms  med=724.42ms max=4.79s    p(90)=1.48s   p(95)=1.63s    p(99.9)=3.79s  
     iterations.....................: 18120   261.863731/s
     success_rate...................: 100.00% ✓ 18120      ✗ 0    
     vus............................: 79      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53088      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   315 kB/s
     http_req_blocked...............: avg=101.63µs min=1.28µs  med=2.91µs   max=105.26ms p(90)=4.83µs  p(95)=7.34µs   p(99.9)=27.11ms
     http_req_connecting............: avg=95.92µs  min=0s      med=0s       max=105.21ms p(90)=0s      p(95)=0s       p(99.9)=27.06ms
     http_req_duration..............: avg=750.8ms  min=6.6ms   med=689.87ms max=4.5s     p(90)=1.46s   p(95)=1.61s    p(99.9)=3.67s  
       { expected_response:true }...: avg=750.8ms  min=6.6ms   med=689.87ms max=4.5s     p(90)=1.46s   p(95)=1.61s    p(99.9)=3.67s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18696
     http_req_receiving.............: avg=162.06µs min=26.88µs med=45µs     max=118.6ms  p(90)=92.06µs p(95)=162.49µs p(99.9)=29.11ms
     http_req_sending...............: avg=192.22µs min=5.97µs  med=11.23µs  max=118.69ms p(90)=29.84µs p(95)=112.63µs p(99.9)=32.59ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=750.44ms min=6.55ms  med=689.57ms max=4.5s     p(90)=1.46s   p(95)=1.61s    p(99.9)=3.64s  
     http_reqs......................: 18696   269.000187/s
     iteration_duration.............: avg=793.55ms min=6.77ms  med=746.93ms max=4.51s    p(90)=1.47s   p(95)=1.62s    p(99.9)=3.78s  
     iterations.....................: 17696   254.612072/s
     success_rate...................: 100.00% ✓ 17696      ✗ 0    
     vus............................: 85      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29157      ✗ 0    
     data_received..................: 941 MB  14 MB/s
     data_sent......................: 13 MB   187 kB/s
     http_req_blocked...............: avg=32.21µs min=1.27µs  med=3.17µs  max=27.52ms p(90)=5.27µs  p(95)=9.94µs   p(99.9)=5.03ms
     http_req_connecting............: avg=26.23µs min=0s      med=0s      max=27.44ms p(90)=0s      p(95)=0s       p(99.9)=4.97ms
     http_req_duration..............: avg=1.21s   min=7.33ms  med=1.19s   max=15.15s  p(90)=2.2s    p(95)=2.57s    p(99.9)=13.87s
       { expected_response:true }...: avg=1.21s   min=7.33ms  med=1.19s   max=15.15s  p(90)=2.2s    p(95)=2.57s    p(99.9)=13.87s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10719
     http_req_receiving.............: avg=72.61µs min=28.99µs med=52.85µs max=6.01ms  p(90)=97.52µs p(95)=123.49µs p(99.9)=1.23ms
     http_req_sending...............: avg=40.69µs min=6.05µs  med=12.45µs max=12.63ms p(90)=29.65µs p(95)=46.1µs   p(99.9)=6.96ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.21s   min=7.28ms  med=1.19s   max=15.15s  p(90)=2.2s    p(95)=2.57s    p(99.9)=13.87s
     http_reqs......................: 10719   156.491036/s
     iteration_duration.............: avg=1.33s   min=7.67ms  med=1.31s   max=15.18s  p(90)=2.24s   p(95)=2.64s    p(99.9)=14.13s
     iterations.....................: 9719    141.891629/s
     success_rate...................: 100.00% ✓ 9719       ✗ 0    
     vus............................: 99      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 29, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13947 total, 0 failed avg: 216ms, p95: 228ms
hive-router 169 13690 total, 0 failed avg: 221ms, p95: 230ms
cosmo 166 13495 total, 0 failed avg: 224ms, p95: 247ms
hive-gateway 163 12483 total, 0 failed avg: 242ms, p95: 267ms
hive-gateway-bun 159 12161 total, 0 failed avg: 248ms, p95: 290ms
apollo-router 138 11256 total, 0 failed avg: 269ms, p95: 314ms ❌ 1 unexpected GraphQL errors
apollo-gateway 123 10068 total, 0 failed avg: 300ms, p95: 330ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41541      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=21.4µs   min=1.25µs   med=2.09µs   max=10.39ms  p(90)=3.74µs   p(95)=5.49µs   p(99.9)=7.6ms   
     http_req_connecting............: avg=18.48µs  min=0s       med=0s       max=10.34ms  p(90)=0s       p(95)=0s       p(99.9)=7.58ms  
     http_req_duration..............: avg=216.35ms min=155.62ms med=215.42ms max=606.07ms p(90)=225.24ms p(95)=228.13ms p(99.9)=519.88ms
       { expected_response:true }...: avg=216.35ms min=155.62ms med=215.42ms max=606.07ms p(90)=225.24ms p(95)=228.13ms p(99.9)=519.88ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13947
     http_req_receiving.............: avg=87.9µs   min=28.53µs  med=49.14µs  max=16.01ms  p(90)=102.68µs p(95)=263.59µs p(99.9)=5.31ms  
     http_req_sending...............: avg=93.02µs  min=5.63µs   med=8.68µs   max=371.66ms p(90)=27.45µs  p(95)=104.84µs p(99.9)=8.17ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.17ms min=155.56ms med=215.3ms  max=605ms    p(90)=225.09ms p(95)=227.95ms p(99.9)=506.09ms
     http_reqs......................: 13947   172.33245/s
     iteration_duration.............: avg=216.65ms min=155.84ms med=215.68ms max=626.63ms p(90)=225.45ms p(95)=228.37ms p(99.9)=533.83ms
     iterations.....................: 13847   171.096826/s
     success_rate...................: 100.00% ✓ 13847      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40770      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=14.62µs  min=1.01µs   med=1.82µs   max=6.69ms   p(90)=3.25µs   p(95)=4.56µs   p(99.9)=4.87ms  
     http_req_connecting............: avg=12.33µs  min=0s       med=0s       max=6.66ms   p(90)=0s       p(95)=0s       p(99.9)=4.85ms  
     http_req_duration..............: avg=220.53ms min=114.04ms med=219.62ms max=610ms    p(90)=227.34ms p(95)=229.96ms p(99.9)=519.37ms
       { expected_response:true }...: avg=220.53ms min=114.04ms med=219.62ms max=610ms    p(90)=227.34ms p(95)=229.96ms p(99.9)=519.37ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13690
     http_req_receiving.............: avg=95.37µs  min=23.2µs   med=39.34µs  max=343.32ms p(90)=85.64µs  p(95)=247.57µs p(99.9)=1.96ms  
     http_req_sending...............: avg=140.63µs min=4.31µs   med=6.85µs   max=359.53ms p(90)=20.5µs   p(95)=93.35µs  p(99.9)=6.29ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.29ms min=109.17ms med=219.53ms max=598.17ms p(90)=227.2ms  p(95)=229.78ms p(99.9)=491.46ms
     http_reqs......................: 13690   169.319077/s
     iteration_duration.............: avg=220.85ms min=114.22ms med=219.83ms max=620.41ms p(90)=227.53ms p(95)=230.17ms p(99.9)=532.42ms
     iterations.....................: 13590   168.082269/s
     success_rate...................: 100.00% ✓ 13590      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40185      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=21.11µs  min=1.32µs   med=2.61µs   max=9.53ms   p(90)=3.61µs   p(95)=4.5µs    p(99.9)=7.07ms  
     http_req_connecting............: avg=17.77µs  min=0s       med=0s       max=9.49ms   p(90)=0s       p(95)=0s       p(99.9)=7.05ms  
     http_req_duration..............: avg=223.68ms min=159.26ms med=222.38ms max=621.22ms p(90)=241.86ms p(95)=247.03ms p(99.9)=512.54ms
       { expected_response:true }...: avg=223.68ms min=159.26ms med=222.38ms max=621.22ms p(90)=241.86ms p(95)=247.03ms p(99.9)=512.54ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13495
     http_req_receiving.............: avg=488.03µs min=30.17µs  med=58.2µs   max=37.24ms  p(90)=310.63µs p(95)=888.74µs p(99.9)=24.65ms 
     http_req_sending...............: avg=110.77µs min=5.77µs   med=10.55µs  max=313.46ms p(90)=29.64µs  p(95)=118.36µs p(99.9)=4.05ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.08ms min=158.5ms  med=221.86ms max=620.32ms p(90)=241.12ms p(95)=246.52ms p(99.9)=511.38ms
     http_reqs......................: 13495   166.759761/s
     iteration_duration.............: avg=224.14ms min=159.63ms med=222.75ms max=653.49ms p(90)=242.22ms p(95)=247.36ms p(99.9)=537.47ms
     iterations.....................: 13395   165.524046/s
     success_rate...................: 100.00% ✓ 13395      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37149      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   190 kB/s
     http_req_blocked...............: avg=23.16µs  min=1.21µs   med=2.71µs   max=10.19ms  p(90)=4.17µs   p(95)=5.5µs    p(99.9)=7.5ms 
     http_req_connecting............: avg=19.62µs  min=0s       med=0s       max=10.15ms  p(90)=0s       p(95)=0s       p(99.9)=7.46ms
     http_req_duration..............: avg=241.52ms min=150.3ms  med=231.63ms max=1.3s     p(90)=254.94ms p(95)=266.73ms p(99.9)=1.29s 
       { expected_response:true }...: avg=241.52ms min=150.3ms  med=231.63ms max=1.3s     p(90)=254.94ms p(95)=266.73ms p(99.9)=1.29s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 12483
     http_req_receiving.............: avg=85.47µs  min=25.68µs  med=45.11µs  max=14.17ms  p(90)=99.06µs  p(95)=201.95µs p(99.9)=3.74ms
     http_req_sending...............: avg=115.4µs  min=5.33µs   med=10.8µs   max=291.93ms p(90)=33.38µs  p(95)=124.87µs p(99.9)=4.62ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=241.32ms min=146.35ms med=231.51ms max=1.3s     p(90)=254.75ms p(95)=266.26ms p(99.9)=1.29s 
     http_reqs......................: 12483   163.545117/s
     iteration_duration.............: avg=242.51ms min=150.57ms med=232.04ms max=1.3s     p(90)=255.34ms p(95)=267.08ms p(99.9)=1.29s 
     iterations.....................: 12383   162.234974/s
     success_rate...................: 100.00% ✓ 12383      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36183      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   185 kB/s
     http_req_blocked...............: avg=27.37µs  min=1.12µs   med=2.55µs   max=11.18ms  p(90)=4.17µs   p(95)=5.47µs   p(99.9)=8.8ms   
     http_req_connecting............: avg=23.92µs  min=0s       med=0s       max=11.14ms  p(90)=0s       p(95)=0s       p(99.9)=8.77ms  
     http_req_duration..............: avg=248.16ms min=160.38ms med=244.63ms max=781.53ms p(90)=274.27ms p(95)=289.52ms p(99.9)=681.39ms
       { expected_response:true }...: avg=248.16ms min=160.38ms med=244.63ms max=781.53ms p(90)=274.27ms p(95)=289.52ms p(99.9)=681.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12161
     http_req_receiving.............: avg=83.35µs  min=24.84µs  med=44.92µs  max=20.44ms  p(90)=101.59µs p(95)=200.89µs p(99.9)=2.27ms  
     http_req_sending...............: avg=88.6µs   min=5.39µs   med=10.69µs  max=297.76ms p(90)=32.52µs  p(95)=118.35µs p(99.9)=5.31ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=247.99ms min=160.3ms  med=244.53ms max=780.45ms p(90)=274.07ms p(95)=288.96ms p(99.9)=679.96ms
     http_reqs......................: 12161   159.017801/s
     iteration_duration.............: avg=249.29ms min=165.85ms med=245.12ms max=831.35ms p(90)=274.68ms p(95)=290.12ms p(99.9)=719.22ms
     iterations.....................: 12061   157.710196/s
     success_rate...................: 100.00% ✓ 12061      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 11155 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 33467      ✗ 1    
     data_received..................: 988 MB 12 MB/s
     data_sent......................: 13 MB  161 kB/s
     http_req_blocked...............: avg=19.89µs  min=1.21µs   med=2.89µs   max=7.11ms   p(90)=4.34µs   p(95)=5.41µs   p(99.9)=5.44ms  
     http_req_connecting............: avg=16.02µs  min=0s       med=0s       max=7.08ms   p(90)=0s       p(95)=0s       p(99.9)=5.42ms  
     http_req_duration..............: avg=268.58ms min=154.94ms med=267.3ms  max=675.54ms p(90)=304.74ms p(95)=314.24ms p(99.9)=591.78ms
       { expected_response:true }...: avg=268.58ms min=154.94ms med=267.3ms  max=675.54ms p(90)=304.74ms p(95)=314.24ms p(99.9)=591.78ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 11256
     http_req_receiving.............: avg=110.38µs min=26.14µs  med=50.41µs  max=80.93ms  p(90)=129.94µs p(95)=364.82µs p(99.9)=4.13ms  
     http_req_sending...............: avg=107.27µs min=5.21µs   med=10.61µs  max=198.99ms p(90)=24.7µs   p(95)=135.34µs p(99.9)=4.33ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=268.36ms min=151.21ms med=267.08ms max=659.73ms p(90)=304.48ms p(95)=313.83ms p(99.9)=590.87ms
     http_reqs......................: 11256  138.062234/s
     iteration_duration.............: avg=269.42ms min=155.15ms med=267.83ms max=690.16ms p(90)=305.09ms p(95)=314.61ms p(99.9)=615.25ms
     iterations.....................: 11156  136.835668/s
     success_rate...................: 99.99% ✓ 11155      ✗ 1    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29904      ✗ 0    
     data_received..................: 884 MB  11 MB/s
     data_sent......................: 12 MB   143 kB/s
     http_req_blocked...............: avg=32.06µs  min=1.38µs   med=3.23µs   max=10.78ms  p(90)=4.84µs   p(95)=5.84µs   p(99.9)=8.69ms  
     http_req_connecting............: avg=27.62µs  min=0s       med=0s       max=10.74ms  p(90)=0s       p(95)=0s       p(99.9)=8.66ms  
     http_req_duration..............: avg=300.42ms min=211.31ms med=298.16ms max=776.97ms p(90)=323.46ms p(95)=330.45ms p(99.9)=696.94ms
       { expected_response:true }...: avg=300.42ms min=211.31ms med=298.16ms max=776.97ms p(90)=323.46ms p(95)=330.45ms p(99.9)=696.94ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10068
     http_req_receiving.............: avg=80.6µs   min=30.17µs  med=57.85µs  max=14.68ms  p(90)=108.27µs p(95)=130.25µs p(99.9)=1.91ms  
     http_req_sending...............: avg=94.36µs  min=6.31µs   med=12.66µs  max=318.16ms p(90)=22.94µs  p(95)=37.96µs  p(99.9)=3.62ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=300.25ms min=211.24ms med=298.06ms max=769ms    p(90)=323.35ms p(95)=330.27ms p(99.9)=695.79ms
     http_reqs......................: 10068   123.267282/s
     iteration_duration.............: avg=301.76ms min=220.41ms med=298.74ms max=807.85ms p(90)=323.9ms  p(95)=330.9ms  p(99.9)=731.65ms
     iterations.....................: 9968    122.042935/s
     success_rate...................: 100.00% ✓ 9968       ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 29, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 171 13939 total, 0 failed avg: 217ms, p95: 229ms
hive-router 166 13493 total, 0 failed avg: 224ms, p95: 236ms
cosmo 159 12896 total, 0 failed avg: 234ms, p95: 258ms
hive-gateway 149 11429 total, 0 failed avg: 264ms, p95: 389ms
hive-gateway-bun 148 11344 total, 0 failed avg: 266ms, p95: 327ms
apollo-router 124 10125 total, 0 failed avg: 299ms, p95: 345ms
apollo-gateway 86 7052 total, 0 failed avg: 429ms, p95: 472ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41517      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=21.7µs   min=1.16µs   med=1.96µs   max=10.6ms   p(90)=3.63µs   p(95)=5.11µs   p(99.9)=7.68ms  
     http_req_connecting............: avg=18.99µs  min=0s       med=0s       max=10.55ms  p(90)=0s       p(95)=0s       p(99.9)=7.64ms  
     http_req_duration..............: avg=216.97ms min=160.64ms med=216.02ms max=605.5ms  p(90)=226.26ms p(95)=229.09ms p(99.9)=513.21ms
       { expected_response:true }...: avg=216.97ms min=160.64ms med=216.02ms max=605.5ms  p(90)=226.26ms p(95)=229.09ms p(99.9)=513.21ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13939
     http_req_receiving.............: avg=86.85µs  min=26.47µs  med=48.19µs  max=9.86ms   p(90)=104.09µs p(95)=279.85µs p(99.9)=4.7ms   
     http_req_sending...............: avg=124.77µs min=5.63µs   med=8.69µs   max=366.23ms p(90)=33.87µs  p(95)=101.12µs p(99.9)=6.79ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.76ms min=160.59ms med=215.91ms max=604.18ms p(90)=226.09ms p(95)=228.94ms p(99.9)=490.83ms
     http_reqs......................: 13939   171.951543/s
     iteration_duration.............: avg=217.3ms  min=160.88ms med=216.31ms max=622.04ms p(90)=226.48ms p(95)=229.32ms p(99.9)=531.5ms 
     iterations.....................: 13839   170.717943/s
     success_rate...................: 100.00% ✓ 13839      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40179      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=20.3µs   min=1.21µs   med=2.25µs   max=9.37ms   p(90)=3.43µs   p(95)=4.74µs   p(99.9)=6.97ms  
     http_req_connecting............: avg=17.61µs  min=0s       med=0s       max=9.33ms   p(90)=0s       p(95)=0s       p(99.9)=6.95ms  
     http_req_duration..............: avg=224.16ms min=124.24ms med=222.91ms max=652.47ms p(90)=233.29ms p(95)=236.4ms  p(99.9)=554.61ms
       { expected_response:true }...: avg=224.16ms min=124.24ms med=222.91ms max=652.47ms p(90)=233.29ms p(95)=236.4ms  p(99.9)=554.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13493
     http_req_receiving.............: avg=91.33µs  min=26.4µs   med=45.53µs  max=109.39ms p(90)=95.83µs  p(95)=256.5µs  p(99.9)=4.09ms  
     http_req_sending...............: avg=125.38µs min=5.7µs    med=9.53µs   max=422.97ms p(90)=28.65µs  p(95)=105.9µs  p(99.9)=5.61ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.95ms min=120.3ms  med=222.82ms max=636.11ms p(90)=233.1ms  p(95)=236.23ms p(99.9)=535.84ms
     http_reqs......................: 13493   166.547059/s
     iteration_duration.............: avg=224.57ms min=124.54ms med=223.18ms max=674.67ms p(90)=233.49ms p(95)=236.59ms p(99.9)=565.16ms
     iterations.....................: 13393   165.312737/s
     success_rate...................: 100.00% ✓ 13393      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38388      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   185 kB/s
     http_req_blocked...............: avg=21.79µs  min=1.41µs   med=2.64µs   max=9.47ms   p(90)=3.78µs   p(95)=4.72µs   p(99.9)=7.11ms  
     http_req_connecting............: avg=18.53µs  min=0s       med=0s       max=9.44ms   p(90)=0s       p(95)=0s       p(99.9)=7.1ms   
     http_req_duration..............: avg=234.2ms  min=111.17ms med=233.52ms max=635.3ms  p(90)=252.27ms p(95)=257.91ms p(99.9)=529.01ms
       { expected_response:true }...: avg=234.2ms  min=111.17ms med=233.52ms max=635.3ms  p(90)=252.27ms p(95)=257.91ms p(99.9)=529.01ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12896
     http_req_receiving.............: avg=296.83µs min=32.09µs  med=60.7µs   max=33.48ms  p(90)=169.02µs p(95)=483.87µs p(99.9)=26.45ms 
     http_req_sending...............: avg=108.99µs min=6.35µs   med=10.73µs  max=240.92ms p(90)=27.96µs  p(95)=118.12µs p(99.9)=4.66ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=233.79ms min=109.95ms med=233.23ms max=634.45ms p(90)=251.88ms p(95)=257.28ms p(99.9)=528.18ms
     http_reqs......................: 12896   159.286223/s
     iteration_duration.............: avg=234.73ms min=111.43ms med=233.92ms max=645.59ms p(90)=252.62ms p(95)=258.27ms p(99.9)=544.53ms
     iterations.....................: 12796   158.051063/s
     success_rate...................: 100.00% ✓ 12796      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33987      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   174 kB/s
     http_req_blocked...............: avg=28.54µs  min=1.18µs   med=2.63µs   max=11.02ms  p(90)=4.17µs   p(95)=5.51µs   p(99.9)=8.78ms  
     http_req_connecting............: avg=25.09µs  min=0s       med=0s       max=10.97ms  p(90)=0s       p(95)=0s       p(99.9)=8.75ms  
     http_req_duration..............: avg=264.12ms min=154.83ms med=263.95ms max=683.96ms p(90)=291.3ms  p(95)=389.37ms p(99.9)=586.34ms
       { expected_response:true }...: avg=264.12ms min=154.83ms med=263.95ms max=683.96ms p(90)=291.3ms  p(95)=389.37ms p(99.9)=586.34ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11429
     http_req_receiving.............: avg=93.18µs  min=24.89µs  med=45.68µs  max=14.92ms  p(90)=103.21µs p(95)=299.84µs p(99.9)=4.72ms  
     http_req_sending...............: avg=128.98µs min=5.66µs   med=11.07µs  max=258.58ms p(90)=34.89µs  p(95)=137.98µs p(99.9)=6.48ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=263.9ms  min=154.75ms med=263.73ms max=682.73ms p(90)=290.99ms p(95)=387.92ms p(99.9)=585.09ms
     http_reqs......................: 11429   149.150543/s
     iteration_duration.............: avg=265.36ms min=155.07ms med=264.61ms max=715.31ms p(90)=291.79ms p(95)=394.15ms p(99.9)=617.78ms
     iterations.....................: 11329   147.845524/s
     success_rate...................: 100.00% ✓ 11329      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33732      ✗ 0    
     data_received..................: 996 MB  13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=29.64µs  min=1.14µs   med=2.61µs   max=11.68ms  p(90)=4.09µs   p(95)=5.68µs   p(99.9)=9.05ms  
     http_req_connecting............: avg=26.19µs  min=0s       med=0s       max=11.65ms  p(90)=0s       p(95)=0s       p(99.9)=9.01ms  
     http_req_duration..............: avg=265.67ms min=143.08ms med=256.68ms max=721.1ms  p(90)=273.84ms p(95)=327.38ms p(99.9)=598.2ms 
       { expected_response:true }...: avg=265.67ms min=143.08ms med=256.68ms max=721.1ms  p(90)=273.84ms p(95)=327.38ms p(99.9)=598.2ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11344
     http_req_receiving.............: avg=97.75µs  min=27.3µs   med=47.1µs   max=16.83ms  p(90)=106.27µs p(95)=359.27µs p(99.9)=5.66ms  
     http_req_sending...............: avg=114.37µs min=5.52µs   med=11.19µs  max=204.75ms p(90)=35.83µs  p(95)=145.1µs  p(99.9)=7.09ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=265.46ms min=143.03ms med=256.55ms max=720.43ms p(90)=273.64ms p(95)=317.14ms p(99.9)=597.23ms
     http_reqs......................: 11344   148.442806/s
     iteration_duration.............: avg=266.96ms min=143.28ms med=257.04ms max=736.34ms p(90)=274.23ms p(95)=347.45ms p(99.9)=638.64ms
     iterations.....................: 11244   147.134248/s
     success_rate...................: 100.00% ✓ 11244      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30075      ✗ 0    
     data_received..................: 888 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=27.38µs  min=1.74µs   med=2.94µs   max=9.54ms   p(90)=4.4µs    p(95)=5.4µs    p(99.9)=7.73ms  
     http_req_connecting............: avg=23.41µs  min=0s       med=0s       max=9.51ms   p(90)=0s       p(95)=0s       p(99.9)=7.71ms  
     http_req_duration..............: avg=298.5ms  min=172.62ms med=299.6ms  max=729.6ms  p(90)=334.86ms p(95)=344.79ms p(99.9)=641.01ms
       { expected_response:true }...: avg=298.5ms  min=172.62ms med=299.6ms  max=729.6ms  p(90)=334.86ms p(95)=344.79ms p(99.9)=641.01ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10125
     http_req_receiving.............: avg=121.85µs min=35.83µs  med=54.91µs  max=333.72ms p(90)=109µs    p(95)=239.78µs p(99.9)=1.7ms   
     http_req_sending...............: avg=88.65µs  min=7.84µs   med=11.53µs  max=294.89ms p(90)=26.4µs   p(95)=139.09µs p(99.9)=3.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=298.29ms min=168.81ms med=299.46ms max=715.53ms p(90)=334.69ms p(95)=344.47ms p(99.9)=634.29ms
     http_reqs......................: 10125   124.271297/s
     iteration_duration.............: avg=299.84ms min=172.86ms med=300.21ms max=766.34ms p(90)=335.35ms p(95)=345.37ms p(99.9)=679.23ms
     iterations.....................: 10025   123.043926/s
     success_rate...................: 100.00% ✓ 10025      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20856     ✗ 0   
     data_received..................: 619 MB  7.6 MB/s
     data_sent......................: 8.2 MB  101 kB/s
     http_req_blocked...............: avg=45.06µs  min=1.45µs   med=3.12µs   max=11.64ms  p(90)=4.77µs   p(95)=5.58µs   p(99.9)=10.14ms 
     http_req_connecting............: avg=41.42µs  min=0s       med=0s       max=11.61ms  p(90)=0s       p(95)=0s       p(99.9)=10.11ms 
     http_req_duration..............: avg=429.21ms min=211.73ms med=431.93ms max=841.63ms p(90)=460.21ms p(95)=472.49ms p(99.9)=773.36ms
       { expected_response:true }...: avg=429.21ms min=211.73ms med=431.93ms max=841.63ms p(90)=460.21ms p(95)=472.49ms p(99.9)=773.36ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7052
     http_req_receiving.............: avg=85.09µs  min=31.76µs  med=53.71µs  max=137.49ms p(90)=95.64µs  p(95)=111.66µs p(99.9)=493.13µs
     http_req_sending...............: avg=99.29µs  min=6.67µs   med=12.7µs   max=183.95ms p(90)=20.15µs  p(95)=25.95µs  p(99.9)=5.9ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=429.02ms min=211.63ms med=431.8ms  max=840.71ms p(90)=459.95ms p(95)=472.11ms p(99.9)=772.54ms
     http_reqs......................: 7052    86.415359/s
     iteration_duration.............: avg=432.74ms min=272.32ms med=432.46ms max=877.92ms p(90)=460.7ms  p(95)=472.95ms p(99.9)=801.56ms
     iterations.....................: 6952    85.189957/s
     success_rate...................: 100.00% ✓ 6952      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@renovate renovate bot force-pushed the renovate/graphql-hive-gateway-monorepo branch from 9863c9b to c3a405b Compare October 2, 2025 14:04
@renovate renovate bot changed the title Update dependency @graphql-hive/gateway to v2.1.8 Update dependency @graphql-hive/gateway to v2.1.9 Oct 2, 2025
@enisdenjo enisdenjo merged commit ac479c2 into main Oct 2, 2025
34 checks passed
@enisdenjo enisdenjo deleted the renovate/graphql-hive-gateway-monorepo branch October 2, 2025 14:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant