Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 29, 2025

Note

Mend has cancelled the proposed renaming of the Renovate GitHub app being renamed to mend[bot].

This notice will be removed on 2025-10-07.


This PR contains the following updates:

Package Change Age Confidence
patch-package 8.0.0 -> 8.0.1 age confidence

Release Notes

ds300/patch-package (patch-package)

v8.0.1

Compare Source

  • Update tmp to fix security alert. #​578

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 29, 2025
Copy link

💻 Website Preview

The latest changes are available as preview in: https://8d350764.federation-gateway-benchmark.pages.dev

Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1814 109308 total, 0 failed avg: 27ms, p95: 49ms
grafbase 1564 94456 total, 0 failed avg: 31ms, p95: 56ms
cosmo 636 38480 total, 0 failed avg: 78ms, p95: 113ms
apollo-router 376 22886 total, 0 failed avg: 131ms, p95: 170ms
hive-gateway-bun 320 19542 total, 0 failed avg: 153ms, p95: 199ms
hive-gateway 298 18252 total, 0 failed avg: 164ms, p95: 220ms
apollo-gateway 117 7165 total, 0 failed avg: 419ms, p95: 494ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 327624      ✗ 0     
     data_received..................: 9.6 GB  159 MB/s
     data_sent......................: 127 MB  2.1 MB/s
     http_req_blocked...............: avg=5.08µs   min=1.14µs  med=2.49µs  max=10.95ms  p(90)=3.59µs   p(95)=4.17µs   p(99.9)=85.23µs
     http_req_connecting............: avg=2.13µs   min=0s      med=0s      max=9.16ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=27.2ms   min=1.89ms  med=24.58ms max=439ms    p(90)=42.3ms   p(95)=48.58ms  p(99.9)=86.87ms
       { expected_response:true }...: avg=27.2ms   min=1.89ms  med=24.58ms max=439ms    p(90)=42.3ms   p(95)=48.58ms  p(99.9)=86.87ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 109308
     http_req_receiving.............: avg=120.01µs min=22.68µs med=41.93µs max=347.66ms p(90)=105.06µs p(95)=330.66µs p(99.9)=12.44ms
     http_req_sending...............: avg=102.52µs min=5.09µs  med=9.91µs  max=357.06ms p(90)=29.95µs  p(95)=121.66µs p(99.9)=13.4ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.98ms  min=1.83ms  med=24.41ms max=437.91ms p(90)=41.9ms   p(95)=48.13ms  p(99.9)=85ms   
     http_reqs......................: 109308  1814.592711/s
     iteration_duration.............: avg=27.46ms  min=4.9ms   med=24.82ms max=458.29ms p(90)=42.55ms  p(95)=48.85ms  p(99.9)=87.44ms
     iterations.....................: 109208  1812.932638/s
     success_rate...................: 100.00% ✓ 109208      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 283068      ✗ 0    
     data_received..................: 8.3 GB  137 MB/s
     data_sent......................: 110 MB  1.8 MB/s
     http_req_blocked...............: avg=6.38µs   min=1.24µs  med=3.09µs  max=10.15ms  p(90)=4.3µs    p(95)=5.11µs   p(99.9)=122.97µs
     http_req_connecting............: avg=2.63µs   min=0s      med=0s      max=10.11ms  p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=31.47ms  min=2.85ms  med=28.17ms max=485.27ms p(90)=48.65ms  p(95)=55.62ms  p(99.9)=94.59ms 
       { expected_response:true }...: avg=31.47ms  min=2.85ms  med=28.17ms max=485.27ms p(90)=48.65ms  p(95)=55.62ms  p(99.9)=94.59ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 94456
     http_req_receiving.............: avg=159.09µs min=24.98µs med=48.69µs max=273ms    p(90)=143.36µs p(95)=407.11µs p(99.9)=17.33ms 
     http_req_sending...............: avg=130.09µs min=5.56µs  med=11.85µs max=435.99ms p(90)=37.57µs  p(95)=141.66µs p(99.9)=17.45ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=31.18ms  min=2.8ms   med=27.96ms max=471.15ms p(90)=48.14ms  p(95)=55.11ms  p(99.9)=92.17ms 
     http_reqs......................: 94456   1564.048929/s
     iteration_duration.............: avg=31.78ms  min=5.9ms   med=28.45ms max=518.15ms p(90)=48.95ms  p(95)=55.9ms   p(99.9)=94.98ms 
     iterations.....................: 94356   1562.39308/s
     success_rate...................: 100.00% ✓ 94356       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 115140     ✗ 0    
     data_received..................: 3.4 GB  56 MB/s
     data_sent......................: 45 MB   741 kB/s
     http_req_blocked...............: avg=10.38µs  min=1.28µs  med=2.89µs  max=9.94ms   p(90)=4.33µs   p(95)=5.31µs   p(99.9)=2.4ms   
     http_req_connecting............: avg=6.75µs   min=0s      med=0s      max=9.91ms   p(90)=0s       p(95)=0s       p(99.9)=2.38ms  
     http_req_duration..............: avg=77.68ms  min=2.92ms  med=76.61ms max=523.98ms p(90)=105ms    p(95)=113.31ms p(99.9)=310.32ms
       { expected_response:true }...: avg=77.68ms  min=2.92ms  med=76.61ms max=523.98ms p(90)=105ms    p(95)=113.31ms p(99.9)=310.32ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 38480
     http_req_receiving.............: avg=159.93µs min=32.53µs med=75.81µs max=76.61ms  p(90)=149.02µs p(95)=369.9µs  p(99.9)=15.89ms 
     http_req_sending...............: avg=54.53µs  min=6.02µs  med=11.62µs max=342.59ms p(90)=29.43µs  p(95)=125.56µs p(99.9)=3.08ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=77.47ms  min=2.82ms  med=76.4ms  max=523.03ms p(90)=104.78ms p(95)=113ms    p(99.9)=306.69ms
     http_reqs......................: 38480   636.703514/s
     iteration_duration.............: avg=78.2ms   min=7.64ms  med=76.96ms max=563.42ms p(90)=105.33ms p(95)=113.65ms p(99.9)=331.95ms
     iterations.....................: 38380   635.048879/s
     success_rate...................: 100.00% ✓ 38380      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 68358      ✗ 0    
     data_received..................: 2.0 GB  33 MB/s
     data_sent......................: 27 MB   438 kB/s
     http_req_blocked...............: avg=12.39µs  min=1.56µs  med=2.95µs   max=7.85ms   p(90)=4.29µs   p(95)=5.03µs   p(99.9)=4.42ms  
     http_req_connecting............: avg=8.81µs   min=0s      med=0s       max=7.82ms   p(90)=0s       p(95)=0s       p(99.9)=4.38ms  
     http_req_duration..............: avg=130.85ms min=5.91ms  med=129.69ms max=600.63ms p(90)=160.97ms p(95)=169.93ms p(99.9)=415.22ms
       { expected_response:true }...: avg=130.85ms min=5.91ms  med=129.69ms max=600.63ms p(90)=160.97ms p(95)=169.93ms p(99.9)=415.22ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22886
     http_req_receiving.............: avg=83.6µs   min=37.76µs med=54.31µs  max=57.76ms  p(90)=107.22µs p(95)=141.78µs p(99.9)=1.39ms  
     http_req_sending...............: avg=55.65µs  min=7.02µs  med=11.64µs  max=329.18ms p(90)=20.11µs  p(95)=45.84µs  p(99.9)=2.51ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=130.71ms min=5.86ms  med=129.58ms max=599.29ms p(90)=160.8ms  p(95)=169.78ms p(99.9)=414.92ms
     http_reqs......................: 22886   376.549196/s
     iteration_duration.............: avg=131.75ms min=26.07ms med=130.11ms max=641.52ms p(90)=161.36ms p(95)=170.32ms p(99.9)=449.08ms
     iterations.....................: 22786   374.903871/s
     success_rate...................: 100.00% ✓ 22786      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 58326      ✗ 0    
     data_received..................: 1.7 GB  28 MB/s
     data_sent......................: 23 MB   373 kB/s
     http_req_blocked...............: avg=18.16µs  min=1.19µs  med=2.69µs   max=11.07ms  p(90)=4.3µs    p(95)=5.31µs   p(99.9)=6.81ms
     http_req_connecting............: avg=14.36µs  min=0s      med=0s       max=11.03ms  p(90)=0s       p(95)=0s       p(99.9)=6.78ms
     http_req_duration..............: avg=153.31ms min=6.51ms  med=140.68ms max=1.06s    p(90)=171.04ms p(95)=198.59ms p(99.9)=1.06s 
       { expected_response:true }...: avg=153.31ms min=6.51ms  med=140.68ms max=1.06s    p(90)=171.04ms p(95)=198.59ms p(99.9)=1.06s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 19542
     http_req_receiving.............: avg=90.92µs  min=25.27µs med=44.25µs  max=19.25ms  p(90)=98.93µs  p(95)=207.24µs p(99.9)=3.66ms
     http_req_sending...............: avg=76.71µs  min=5.22µs  med=10.83µs  max=280.75ms p(90)=31.13µs  p(95)=125.26µs p(99.9)=4.66ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=153.14ms min=6.46ms  med=140.54ms max=1.06s    p(90)=170.88ms p(95)=198.23ms p(99.9)=1.06s 
     http_reqs......................: 19542   320.737327/s
     iteration_duration.............: avg=154.46ms min=37.38ms med=141.1ms  max=1.06s    p(90)=171.47ms p(95)=199.22ms p(99.9)=1.06s 
     iterations.....................: 19442   319.096055/s
     success_rate...................: 100.00% ✓ 19442      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54456      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   347 kB/s
     http_req_blocked...............: avg=24.08µs  min=1.14µs  med=2.8µs    max=13.95ms  p(90)=4.73µs   p(95)=6.16µs   p(99.9)=9.22ms
     http_req_connecting............: avg=20.15µs  min=0s      med=0s       max=13.91ms  p(90)=0s       p(95)=0s       p(99.9)=9.18ms
     http_req_duration..............: avg=164.18ms min=6.5ms   med=151.54ms max=1.07s    p(90)=182ms    p(95)=219.85ms p(99.9)=1.01s 
       { expected_response:true }...: avg=164.18ms min=6.5ms   med=151.54ms max=1.07s    p(90)=182ms    p(95)=219.85ms p(99.9)=1.01s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 18252
     http_req_receiving.............: avg=101.74µs min=26.74µs med=51.91µs  max=40.75ms  p(90)=114.82µs p(95)=184.62µs p(99.9)=5.56ms
     http_req_sending...............: avg=94.26µs  min=5.86µs  med=11.42µs  max=223.88ms p(90)=32.69µs  p(95)=125.64µs p(99.9)=5.19ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=163.99ms min=6.43ms  med=151.4ms  max=1.07s    p(90)=181.86ms p(95)=219.78ms p(99.9)=1.01s 
     http_reqs......................: 18252   298.479654/s
     iteration_duration.............: avg=165.43ms min=35.63ms med=152ms    max=1.07s    p(90)=182.5ms  p(95)=221.44ms p(99.9)=1.01s 
     iterations.....................: 18152   296.844328/s
     success_rate...................: 100.00% ✓ 18152      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21195      ✗ 0   
     data_received..................: 629 MB  10 MB/s
     data_sent......................: 8.3 MB  136 kB/s
     http_req_blocked...............: avg=43.01µs  min=1.33µs   med=2.89µs   max=11.24ms  p(90)=4.38µs   p(95)=5.1µs    p(99.9)=9.69ms  
     http_req_connecting............: avg=39.66µs  min=0s       med=0s       max=11.2ms   p(90)=0s       p(95)=0s       p(99.9)=9.66ms  
     http_req_duration..............: avg=419.3ms  min=7.58ms   med=418.05ms max=888.93ms p(90)=475.45ms p(95)=494.38ms p(99.9)=797.67ms
       { expected_response:true }...: avg=419.3ms  min=7.58ms   med=418.05ms max=888.93ms p(90)=475.45ms p(95)=494.38ms p(99.9)=797.67ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7165
     http_req_receiving.............: avg=68.36µs  min=30.88µs  med=50.93µs  max=50.36ms  p(90)=90.32µs  p(95)=104.93µs p(99.9)=486.82µs
     http_req_sending...............: avg=121.4µs  min=6.27µs   med=12.18µs  max=219.54ms p(90)=19.02µs  p(95)=23.72µs  p(99.9)=5.17ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=419.11ms min=7.49ms   med=417.92ms max=887.34ms p(90)=475.25ms p(95)=494.01ms p(99.9)=796.41ms
     http_reqs......................: 7165    117.117784/s
     iteration_duration.............: avg=425.84ms min=127.21ms med=418.66ms max=970.25ms p(90)=476.11ms p(95)=495.65ms p(99.9)=915.59ms
     iterations.....................: 7065    115.483203/s
     success_rate...................: 100.00% ✓ 7065       ✗ 0   
     vus............................: 35      min=35       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14045 total, 0 failed avg: 215ms, p95: 227ms
hive-router 169 13740 total, 0 failed avg: 220ms, p95: 231ms
cosmo 168 13647 total, 0 failed avg: 222ms, p95: 242ms
hive-gateway 167 12771 total, 0 failed avg: 236ms, p95: 264ms
hive-gateway-bun 160 12274 total, 0 failed avg: 246ms, p95: 290ms
apollo-router 138 11327 total, 0 failed avg: 267ms, p95: 314ms
apollo-gateway 125 10209 total, 0 failed avg: 296ms, p95: 329ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41835      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=19.42µs  min=1.15µs   med=1.91µs   max=9.42ms   p(90)=3.37µs   p(95)=4.94µs   p(99.9)=6.91ms  
     http_req_connecting............: avg=16.84µs  min=0s       med=0s       max=9.39ms   p(90)=0s       p(95)=0s       p(99.9)=6.87ms  
     http_req_duration..............: avg=215.35ms min=156.05ms med=214.49ms max=606.21ms p(90)=224.16ms p(95)=227.12ms p(99.9)=508.73ms
       { expected_response:true }...: avg=215.35ms min=156.05ms med=214.49ms max=606.21ms p(90)=224.16ms p(95)=227.12ms p(99.9)=508.73ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14045
     http_req_receiving.............: avg=112.8µs  min=26.58µs  med=46.61µs  max=365.63ms p(90)=95.02µs  p(95)=279.18µs p(99.9)=5.56ms  
     http_req_sending...............: avg=87.15µs  min=5.66µs   med=8.56µs   max=368.71ms p(90)=29.42µs  p(95)=102.19µs p(99.9)=6.99ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.15ms min=156ms    med=214.38ms max=589.59ms p(90)=224.04ms p(95)=226.91ms p(99.9)=480.08ms
     http_reqs......................: 14045   173.382376/s
     iteration_duration.............: avg=215.68ms min=156.25ms med=214.74ms max=627.22ms p(90)=224.4ms  p(95)=227.34ms p(99.9)=539.14ms
     iterations.....................: 13945   172.147899/s
     success_rate...................: 100.00% ✓ 13945      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40920      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=18.69µs  min=1.25µs   med=1.99µs   max=8.76ms   p(90)=3.26µs   p(95)=4.58µs   p(99.9)=6.5ms   
     http_req_connecting............: avg=16.11µs  min=0s       med=0s       max=8.73ms   p(90)=0s       p(95)=0s       p(99.9)=6.47ms  
     http_req_duration..............: avg=220.23ms min=159.84ms med=219.33ms max=606.2ms  p(90)=227.89ms p(95)=230.62ms p(99.9)=516.31ms
       { expected_response:true }...: avg=220.23ms min=159.84ms med=219.33ms max=606.2ms  p(90)=227.89ms p(95)=230.62ms p(99.9)=516.31ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13740
     http_req_receiving.............: avg=82.82µs  min=25.87µs  med=42.79µs  max=16.68ms  p(90)=87.28µs  p(95)=248.65µs p(99.9)=7.35ms  
     http_req_sending...............: avg=160.37µs min=5.38µs   med=8.18µs   max=381.6ms  p(90)=28.52µs  p(95)=93.41µs  p(99.9)=8.69ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.99ms min=159.79ms med=219.23ms max=605.52ms p(90)=227.72ms p(95)=230.41ms p(99.9)=500.29ms
     http_reqs......................: 13740   169.696339/s
     iteration_duration.............: avg=220.57ms min=160.02ms med=219.57ms max=626.02ms p(90)=228.08ms p(95)=230.83ms p(99.9)=529.79ms
     iterations.....................: 13640   168.461286/s
     success_rate...................: 100.00% ✓ 13640      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40641      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=20.64µs  min=1.25µs   med=2.68µs   max=9.12ms   p(90)=3.81µs   p(95)=4.74µs   p(99.9)=6.81ms  
     http_req_connecting............: avg=17.12µs  min=0s       med=0s       max=9.09ms   p(90)=0s       p(95)=0s       p(99.9)=6.79ms  
     http_req_duration..............: avg=221.59ms min=158.86ms med=220.38ms max=633.66ms p(90)=236.3ms  p(95)=241.69ms p(99.9)=515.43ms
       { expected_response:true }...: avg=221.59ms min=158.86ms med=220.38ms max=633.66ms p(90)=236.3ms  p(95)=241.69ms p(99.9)=515.43ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13647
     http_req_receiving.............: avg=440.14µs min=26.72µs  med=61.16µs  max=125.54ms p(90)=367.96µs p(95)=963.47µs p(99.9)=23.34ms 
     http_req_sending...............: avg=93.7µs   min=6.03µs   med=11.1µs   max=304.67ms p(90)=31.2µs   p(95)=124.21µs p(99.9)=4.51ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.05ms min=158.31ms med=220.02ms max=632.56ms p(90)=235.73ms p(95)=241.03ms p(99.9)=501.53ms
     http_reqs......................: 13647   168.321185/s
     iteration_duration.............: avg=221.99ms min=159.13ms med=220.76ms max=644.39ms p(90)=236.63ms p(95)=242.02ms p(99.9)=529.76ms
     iterations.....................: 13547   167.087792/s
     success_rate...................: 100.00% ✓ 13547      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38013      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   195 kB/s
     http_req_blocked...............: avg=25.33µs  min=1.13µs   med=2.5µs    max=10.9ms   p(90)=3.99µs   p(95)=5.27µs   p(99.9)=8.39ms  
     http_req_connecting............: avg=21.87µs  min=0s       med=0s       max=10.86ms  p(90)=0s       p(95)=0s       p(99.9)=8.37ms  
     http_req_duration..............: avg=236.25ms min=158.92ms med=228.27ms max=755.19ms p(90)=250.64ms p(95)=263.62ms p(99.9)=643.38ms
       { expected_response:true }...: avg=236.25ms min=158.92ms med=228.27ms max=755.19ms p(90)=250.64ms p(95)=263.62ms p(99.9)=643.38ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12771
     http_req_receiving.............: avg=87.4µs   min=24.18µs  med=44.38µs  max=13.06ms  p(90)=102.03µs p(95)=194.45µs p(99.9)=3.78ms  
     http_req_sending...............: avg=87.41µs  min=5.26µs   med=10.5µs   max=112.45ms p(90)=32.9µs   p(95)=121.98µs p(99.9)=7.15ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.08ms min=158.81ms med=228.11ms max=754.29ms p(90)=250.41ms p(95)=263.16ms p(99.9)=641.98ms
     http_reqs......................: 12771   167.359055/s
     iteration_duration.............: avg=237.2ms  min=166.5ms  med=228.66ms max=761.9ms  p(90)=251.01ms p(95)=264.16ms p(99.9)=670.55ms
     iterations.....................: 12671   166.048593/s
     success_rate...................: 100.00% ✓ 12671      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36522      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   187 kB/s
     http_req_blocked...............: avg=25.57µs  min=1.12µs   med=2.53µs   max=10.61ms  p(90)=4.21µs   p(95)=5.53µs   p(99.9)=8.1ms 
     http_req_connecting............: avg=21.99µs  min=0s       med=0s       max=10.56ms  p(90)=0s       p(95)=0s       p(99.9)=8.08ms
     http_req_duration..............: avg=245.73ms min=147.11ms med=236.21ms max=1.14s    p(90)=274.93ms p(95)=289.83ms p(99.9)=1.13s 
       { expected_response:true }...: avg=245.73ms min=147.11ms med=236.21ms max=1.14s    p(90)=274.93ms p(95)=289.83ms p(99.9)=1.13s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 12274
     http_req_receiving.............: avg=88.2µs   min=24.11µs  med=45.36µs  max=13.22ms  p(90)=108.61µs p(95)=269.98µs p(99.9)=3.8ms 
     http_req_sending...............: avg=114.55µs min=5.24µs   med=10.53µs  max=185.06ms p(90)=32.9µs   p(95)=131.32µs p(99.9)=5.76ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=245.52ms min=147.06ms med=236.11ms max=1.14s    p(90)=274.69ms p(95)=289.59ms p(99.9)=1.13s 
     http_reqs......................: 12274   160.348803/s
     iteration_duration.............: avg=246.72ms min=147.35ms med=236.86ms max=1.14s    p(90)=275.36ms p(95)=290.35ms p(99.9)=1.13s 
     iterations.....................: 12174   159.042392/s
     success_rate...................: 100.00% ✓ 12174      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33681      ✗ 0    
     data_received..................: 994 MB  12 MB/s
     data_sent......................: 13 MB   162 kB/s
     http_req_blocked...............: avg=22.15µs  min=1.28µs   med=2.95µs   max=7.89ms   p(90)=4.41µs   p(95)=5.69µs   p(99.9)=6.14ms  
     http_req_connecting............: avg=17.49µs  min=0s       med=0s       max=7.85ms   p(90)=0s       p(95)=0s       p(99.9)=6.12ms  
     http_req_duration..............: avg=267.08ms min=139.81ms med=265.14ms max=697.07ms p(90)=303.12ms p(95)=313.77ms p(99.9)=607.14ms
       { expected_response:true }...: avg=267.08ms min=139.81ms med=265.14ms max=697.07ms p(90)=303.12ms p(95)=313.77ms p(99.9)=607.14ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11327
     http_req_receiving.............: avg=120.74µs min=32.02µs  med=53.84µs  max=30.38ms  p(90)=151.78µs p(95)=423.35µs p(99.9)=4.07ms  
     http_req_sending...............: avg=90.03µs  min=6.23µs   med=11.42µs  max=233.14ms p(90)=38.71µs  p(95)=144.67µs p(99.9)=4.46ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=266.87ms min=134.33ms med=264.93ms max=695.93ms p(90)=302.87ms p(95)=313.43ms p(99.9)=605.88ms
     http_reqs......................: 11327   138.982911/s
     iteration_duration.............: avg=268.02ms min=140.06ms med=265.82ms max=729.42ms p(90)=303.64ms p(95)=314.11ms p(99.9)=638.12ms
     iterations.....................: 11227   137.755905/s
     success_rate...................: 100.00% ✓ 11227      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30327      ✗ 0    
     data_received..................: 897 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=32.48µs  min=1.32µs   med=3.28µs   max=11.51ms  p(90)=5.09µs   p(95)=6.03µs   p(99.9)=9.34ms  
     http_req_connecting............: avg=27.88µs  min=0s       med=0s       max=11.47ms  p(90)=0s       p(95)=0s       p(99.9)=9.31ms  
     http_req_duration..............: avg=296.01ms min=209.93ms med=293.32ms max=797.03ms p(90)=319.43ms p(95)=329.48ms p(99.9)=705.16ms
       { expected_response:true }...: avg=296.01ms min=209.93ms med=293.32ms max=797.03ms p(90)=319.43ms p(95)=329.48ms p(99.9)=705.16ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10209
     http_req_receiving.............: avg=86.48µs  min=30µs     med=66.95µs  max=3.54ms   p(90)=121.4µs  p(95)=158.15µs p(99.9)=1.65ms  
     http_req_sending...............: avg=119.23µs min=6.62µs   med=13.3µs   max=337.38ms p(90)=24.2µs   p(95)=41.18µs  p(99.9)=3.91ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=295.8ms  min=209.83ms med=293.17ms max=795.85ms p(90)=319.3ms  p(95)=329.29ms p(99.9)=703.96ms
     http_reqs......................: 10209   125.118778/s
     iteration_duration.............: avg=297.38ms min=225.95ms med=293.83ms max=851.6ms  p(90)=319.95ms p(95)=330.27ms p(99.9)=755.89ms
     iterations.....................: 10109   123.893204/s
     success_rate...................: 100.00% ✓ 10109      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1802 112216 total, 0 failed avg: 124ms, p95: 302ms
grafbase 1692 106907 total, 0 failed avg: 130ms, p95: 310ms
cosmo 711 45353 total, 0 failed avg: 310ms, p95: 687ms
apollo-router 393 26420 total, 0 failed avg: 534ms, p95: 1205ms ❌ 18 unexpected GraphQL errors
hive-gateway-bun 261 18159 total, 0 failed avg: 771ms, p95: 1631ms
hive-gateway 258 18198 total, 0 failed avg: 769ms, p95: 1677ms
apollo-gateway 155 10717 total, 0 failed avg: 1220ms, p95: 2617ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 333648      ✗ 0     
     data_received..................: 9.8 GB  158 MB/s
     data_sent......................: 131 MB  2.1 MB/s
     http_req_blocked...............: avg=508.67µs min=1.13µs  med=2.48µs   max=352.2ms  p(90)=3.85µs   p(95)=4.61µs   p(99.9)=172.02ms
     http_req_connecting............: avg=504.82µs min=0s      med=0s       max=352.12ms p(90)=0s       p(95)=0s       p(99.9)=171.98ms
     http_req_duration..............: avg=124.05ms min=1.65ms  med=111.56ms max=465.21ms p(90)=257.48ms p(95)=301.85ms p(99.9)=406.92ms
       { expected_response:true }...: avg=124.05ms min=1.65ms  med=111.56ms max=465.21ms p(90)=257.48ms p(95)=301.85ms p(99.9)=406.92ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 112216
     http_req_receiving.............: avg=537.03µs min=22.66µs med=42.51µs  max=138.95ms p(90)=106.95µs p(95)=402.31µs p(99.9)=75.06ms 
     http_req_sending...............: avg=455.89µs min=5.15µs  med=10.12µs  max=149.61ms p(90)=25.66µs  p(95)=131.14µs p(99.9)=72.79ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=123.05ms min=1.6ms   med=110.46ms max=435.28ms p(90)=255.63ms p(95)=299.73ms p(99.9)=405.27ms
     http_reqs......................: 112216  1802.766963/s
     iteration_duration.............: avg=125.97ms min=1.83ms  med=113.26ms max=742.92ms p(90)=259.61ms p(95)=304.74ms p(99.9)=432.81ms
     iterations.....................: 111216  1786.701812/s
     success_rate...................: 100.00% ✓ 111216      ✗ 0     
     vus............................: 71      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 317721      ✗ 0     
     data_received..................: 9.4 GB  149 MB/s
     data_sent......................: 124 MB  2.0 MB/s
     http_req_blocked...............: avg=456.52µs min=1.01µs  med=2.73µs   max=316.47ms p(90)=4.22µs   p(95)=4.95µs   p(99.9)=157.36ms
     http_req_connecting............: avg=452.05µs min=0s      med=0s       max=316.3ms  p(90)=0s       p(95)=0s       p(99.9)=157.27ms
     http_req_duration..............: avg=130.32ms min=2.48ms  med=119.21ms max=467.33ms p(90)=261.4ms  p(95)=309.63ms p(99.9)=407.34ms
       { expected_response:true }...: avg=130.32ms min=2.48ms  med=119.21ms max=467.33ms p(90)=261.4ms  p(95)=309.63ms p(99.9)=407.34ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 106907
     http_req_receiving.............: avg=515.49µs min=21.68µs med=45.03µs  max=144.07ms p(90)=139.39µs p(95)=413.5µs  p(99.9)=75.52ms 
     http_req_sending...............: avg=447.36µs min=4.01µs  med=10.07µs  max=153.56ms p(90)=23.09µs  p(95)=132.12µs p(99.9)=75.07ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=129.36ms min=2.44ms  med=118.47ms max=467.27ms p(90)=259.15ms p(95)=307.39ms p(99.9)=402.09ms
     http_reqs......................: 106907  1692.153858/s
     iteration_duration.............: avg=132.32ms min=2.73ms  med=120.87ms max=761.97ms p(90)=263.6ms  p(95)=312.23ms p(99.9)=438.8ms 
     iterations.....................: 105907  1676.325579/s
     success_rate...................: 100.00% ✓ 105907      ✗ 0     
     vus............................: 68      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 133059     ✗ 0    
     data_received..................: 4.0 GB  63 MB/s
     data_sent......................: 53 MB   829 kB/s
     http_req_blocked...............: avg=109.4µs  min=1.25µs  med=2.83µs   max=173ms    p(90)=4.03µs   p(95)=5.23µs   p(99.9)=34.78ms 
     http_req_connecting............: avg=104.86µs min=0s      med=0s       max=172.81ms p(90)=0s       p(95)=0s       p(99.9)=34.7ms  
     http_req_duration..............: avg=309.56ms min=2.79ms  med=294.09ms max=1.11s    p(90)=608.2ms  p(95)=686.99ms p(99.9)=964.5ms 
       { expected_response:true }...: avg=309.56ms min=2.79ms  med=294.09ms max=1.11s    p(90)=608.2ms  p(95)=686.99ms p(99.9)=964.5ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 45353
     http_req_receiving.............: avg=585.92µs min=27.22µs med=57.29µs  max=292.54ms p(90)=175.94µs p(95)=478.47µs p(99.9)=90.21ms 
     http_req_sending...............: avg=174.93µs min=5.44µs  med=11.13µs  max=168.71ms p(90)=30.62µs  p(95)=129.52µs p(99.9)=34.05ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=308.8ms  min=2.74ms  med=293.51ms max=1.11s    p(90)=606.37ms p(95)=684.9ms  p(99.9)=962.11ms
     http_reqs......................: 45353   711.992147/s
     iteration_duration.............: avg=317.07ms min=3.1ms   med=302.07ms max=1.15s    p(90)=611.34ms p(95)=690.06ms p(99.9)=968.94ms
     iterations.....................: 44353   696.293248/s
     success_rate...................: 100.00% ✓ 44353      ✗ 0    
     vus............................: 94      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25402 / ✗ 18
     ✓ valid response structure

     checks.........................: 99.97% ✓ 76241      ✗ 18   
     data_received..................: 2.3 GB 35 MB/s
     data_sent......................: 31 MB  459 kB/s
     http_req_blocked...............: avg=97.14µs  min=1.54µs  med=3.06µs   max=142.96ms p(90)=4.81µs  p(95)=6.95µs   p(99.9)=25.55ms
     http_req_connecting............: avg=91.65µs  min=0s      med=0s       max=142.78ms p(90)=0s      p(95)=0s       p(99.9)=25.49ms
     http_req_duration..............: avg=533.72ms min=6.16ms  med=502.79ms max=2.05s    p(90)=1.06s   p(95)=1.2s     p(99.9)=1.73s  
       { expected_response:true }...: avg=533.72ms min=6.16ms  med=502.79ms max=2.05s    p(90)=1.06s   p(95)=1.2s     p(99.9)=1.73s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26420
     http_req_receiving.............: avg=142.03µs min=31.63µs med=52.38µs  max=117.01ms p(90)=103.9µs p(95)=185.82µs p(99.9)=16.38ms
     http_req_sending...............: avg=137.25µs min=6.64µs  med=11.64µs  max=111.12ms p(90)=30.32µs p(95)=118.37µs p(99.9)=27.94ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=533.44ms min=6.1ms   med=502.48ms max=2.05s    p(90)=1.06s   p(95)=1.2s     p(99.9)=1.73s  
     http_reqs......................: 26420  393.795216/s
     iteration_duration.............: avg=555.22ms min=6.56ms  med=527.67ms max=2.05s    p(90)=1.07s   p(95)=1.21s    p(99.9)=1.74s  
     iterations.....................: 25419  378.875117/s
     success_rate...................: 99.92% ✓ 25401      ✗ 18   
     vus............................: 68     min=0        max=496
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51477      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   306 kB/s
     http_req_blocked...............: avg=115.99µs min=1.18µs  med=2.76µs   max=178.88ms p(90)=4.73µs   p(95)=7.58µs   p(99.9)=28.05ms
     http_req_connecting............: avg=110.74µs min=0s      med=0s       max=178.72ms p(90)=0s       p(95)=0s       p(99.9)=28ms   
     http_req_duration..............: avg=771.3ms  min=6.81ms  med=718.57ms max=5.1s     p(90)=1.52s    p(95)=1.63s    p(99.9)=4.27s  
       { expected_response:true }...: avg=771.3ms  min=6.81ms  med=718.57ms max=5.1s     p(90)=1.52s    p(95)=1.63s    p(99.9)=4.27s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18159
     http_req_receiving.............: avg=217.39µs min=27.54µs med=45.66µs  max=128.36ms p(90)=100.48µs p(95)=316.82µs p(99.9)=31.18ms
     http_req_sending...............: avg=231.04µs min=5.6µs   med=11.34µs  max=167.55ms p(90)=33.98µs  p(95)=134.99µs p(99.9)=34.33ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=770.85ms min=6.76ms  med=718.32ms max=5.1s     p(90)=1.52s    p(95)=1.63s    p(99.9)=4.27s  
     http_reqs......................: 18159   261.008641/s
     iteration_duration.............: avg=816.61ms min=7.66ms  med=771.33ms max=5.12s    p(90)=1.53s    p(95)=1.64s    p(99.9)=4.38s  
     iterations.....................: 17159   246.635127/s
     success_rate...................: 100.00% ✓ 17159      ✗ 0    
     vus............................: 95      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51594      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   303 kB/s
     http_req_blocked...............: avg=137.25µs min=1.28µs med=2.94µs   max=206.15ms p(90)=5.49µs   p(95)=8.83µs   p(99.9)=40.85ms
     http_req_connecting............: avg=130.52µs min=0s     med=0s       max=206.08ms p(90)=0s       p(95)=0s       p(99.9)=40.8ms 
     http_req_duration..............: avg=769.32ms min=7.04ms med=713.17ms max=5.41s    p(90)=1.5s     p(95)=1.67s    p(99.9)=4.28s  
       { expected_response:true }...: avg=769.32ms min=7.04ms med=713.17ms max=5.41s    p(90)=1.5s     p(95)=1.67s    p(99.9)=4.28s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18198
     http_req_receiving.............: avg=188.79µs min=28.9µs med=49.16µs  max=97.57ms  p(90)=107.28µs p(95)=188.31µs p(99.9)=23.38ms
     http_req_sending...............: avg=236.44µs min=5.71µs med=11.64µs  max=117.51ms p(90)=33.19µs  p(95)=126.37µs p(99.9)=38.07ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=768.9ms  min=6.94ms med=712.85ms max=5.41s    p(90)=1.5s     p(95)=1.67s    p(99.9)=4.28s  
     http_reqs......................: 18198   258.724036/s
     iteration_duration.............: avg=814.45ms min=7.59ms med=786.81ms max=5.42s    p(90)=1.51s    p(95)=1.69s    p(99.9)=4.34s  
     iterations.....................: 17198   244.506867/s
     success_rate...................: 100.00% ✓ 17198      ✗ 0    
     vus............................: 79      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29151     ✗ 0    
     data_received..................: 941 MB  14 MB/s
     data_sent......................: 13 MB   186 kB/s
     http_req_blocked...............: avg=47.18µs min=1.23µs  med=3.01µs  max=33.16ms p(90)=4.94µs  p(95)=10.82µs  p(99.9)=13.29ms
     http_req_connecting............: avg=39.63µs min=0s      med=0s      max=33.06ms p(90)=0s      p(95)=0s       p(99.9)=12.27ms
     http_req_duration..............: avg=1.21s   min=7.29ms  med=1.17s   max=15.87s  p(90)=2.13s   p(95)=2.61s    p(99.9)=14.51s 
       { expected_response:true }...: avg=1.21s   min=7.29ms  med=1.17s   max=15.87s  p(90)=2.13s   p(95)=2.61s    p(99.9)=14.51s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 10717
     http_req_receiving.............: avg=72.23µs min=28.22µs med=50.62µs max=10.53ms p(90)=96.65µs p(95)=121.61µs p(99.9)=1.16ms 
     http_req_sending...............: avg=48.94µs min=5.98µs  med=12.19µs max=24.25ms p(90)=30µs    p(95)=46.26µs  p(99.9)=7.3ms  
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.21s   min=7.25ms  med=1.17s   max=15.87s  p(90)=2.13s   p(95)=2.61s    p(99.9)=14.51s 
     http_reqs......................: 10717   155.95089/s
     iteration_duration.............: avg=1.34s   min=7.74ms  med=1.32s   max=15.88s  p(90)=2.19s   p(95)=2.68s    p(99.9)=14.59s 
     iterations.....................: 9717    141.39916/s
     success_rate...................: 100.00% ✓ 9717      ✗ 0    
     vus............................: 105     min=0       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13937 total, 0 failed avg: 217ms, p95: 229ms
hive-router 167 13538 total, 0 failed avg: 223ms, p95: 235ms
cosmo 156 12740 total, 0 failed avg: 238ms, p95: 263ms
hive-gateway-bun 146 11243 total, 0 failed avg: 268ms, p95: 429ms
hive-gateway 140 10783 total, 0 failed avg: 280ms, p95: 321ms
apollo-router 126 10272 total, 0 failed avg: 294ms, p95: 338ms
apollo-gateway 90 7345 total, 0 failed avg: 412ms, p95: 454ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41511      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=19.64µs  min=1.19µs   med=1.97µs   max=9.37ms   p(90)=3.62µs   p(95)=5.13µs   p(99.9)=6.89ms  
     http_req_connecting............: avg=16.92µs  min=0s       med=0s       max=9.34ms   p(90)=0s       p(95)=0s       p(99.9)=6.87ms  
     http_req_duration..............: avg=216.99ms min=140.77ms med=216.03ms max=598.8ms  p(90)=226.46ms p(95)=229.47ms p(99.9)=520.96ms
       { expected_response:true }...: avg=216.99ms min=140.77ms med=216.03ms max=598.8ms  p(90)=226.46ms p(95)=229.47ms p(99.9)=520.96ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13937
     http_req_receiving.............: avg=89.45µs  min=27.6µs   med=48.19µs  max=14.39ms  p(90)=103.94µs p(95)=283.64µs p(99.9)=4.35ms  
     http_req_sending...............: avg=133.42µs min=6.39µs   med=8.75µs   max=355.89ms p(90)=35.32µs  p(95)=107.11µs p(99.9)=8.05ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.77ms min=140.43ms med=215.9ms  max=597.64ms p(90)=226.3ms  p(95)=229.22ms p(99.9)=488.83ms
     http_reqs......................: 13937   172.00278/s
     iteration_duration.............: avg=217.33ms min=141.01ms med=216.29ms max=616.94ms p(90)=226.66ms p(95)=229.66ms p(99.9)=543.68ms
     iterations.....................: 13837   170.768635/s
     success_rate...................: 100.00% ✓ 13837      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40314      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=20.07µs  min=1.21µs   med=2.17µs   max=9.26ms   p(90)=3.12µs   p(95)=4.39µs   p(99.9)=6.85ms  
     http_req_connecting............: avg=16.88µs  min=0s       med=0s       max=9.22ms   p(90)=0s       p(95)=0s       p(99.9)=6.83ms  
     http_req_duration..............: avg=223.12ms min=159.46ms med=222.19ms max=597.68ms p(90)=231.92ms p(95)=235.09ms p(99.9)=501.86ms
       { expected_response:true }...: avg=223.12ms min=159.46ms med=222.19ms max=597.68ms p(90)=231.92ms p(95)=235.09ms p(99.9)=501.86ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13538
     http_req_receiving.............: avg=77.54µs  min=24.28µs  med=42.9µs   max=13.83ms  p(90)=87.89µs  p(95)=245.61µs p(99.9)=3.2ms   
     http_req_sending...............: avg=84.26µs  min=5.52µs   med=9.18µs   max=349.22ms p(90)=28.15µs  p(95)=97.48µs  p(99.9)=5.27ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.95ms min=159.42ms med=222.08ms max=596.99ms p(90)=231.77ms p(95)=234.89ms p(99.9)=490.68ms
     http_reqs......................: 13538   167.412292/s
     iteration_duration.............: avg=223.54ms min=159.62ms med=222.44ms max=621.84ms p(90)=232.11ms p(95)=235.31ms p(99.9)=553.71ms
     iterations.....................: 13438   166.175682/s
     success_rate...................: 100.00% ✓ 13438      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37920      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   183 kB/s
     http_req_blocked...............: avg=23.26µs  min=1.44µs   med=2.75µs   max=9.87ms   p(90)=4.16µs   p(95)=5.22µs   p(99.9)=7.51ms  
     http_req_connecting............: avg=19.8µs   min=0s       med=0s       max=9.83ms   p(90)=0s       p(95)=0s       p(99.9)=7.49ms  
     http_req_duration..............: avg=237.52ms min=167.67ms med=236.59ms max=678.95ms p(90)=257.08ms p(95)=263.37ms p(99.9)=565.79ms
       { expected_response:true }...: avg=237.52ms min=167.67ms med=236.59ms max=678.95ms p(90)=257.08ms p(95)=263.37ms p(99.9)=565.79ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12740
     http_req_receiving.............: avg=340.7µs  min=31.98µs  med=63.46µs  max=261.32ms p(90)=162.2µs  p(95)=468.56µs p(99.9)=28.79ms 
     http_req_sending...............: avg=116.17µs min=7.15µs   med=11.31µs  max=260.54ms p(90)=28.96µs  p(95)=123.39µs p(99.9)=3.5ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=237.07ms min=167.61ms med=236.25ms max=659.03ms p(90)=256.52ms p(95)=262.88ms p(99.9)=552.29ms
     http_reqs......................: 12740   156.951447/s
     iteration_duration.............: avg=238.12ms min=167.92ms med=236.98ms max=708.43ms p(90)=257.45ms p(95)=263.67ms p(99.9)=592ms   
     iterations.....................: 12640   155.719489/s
     success_rate...................: 100.00% ✓ 12640      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33429      ✗ 0    
     data_received..................: 987 MB  13 MB/s
     data_sent......................: 13 MB   170 kB/s
     http_req_blocked...............: avg=30.13µs  min=1.17µs   med=2.67µs   max=11.83ms  p(90)=4.24µs   p(95)=5.72µs   p(99.9)=9.53ms  
     http_req_connecting............: avg=26.67µs  min=0s       med=0s       max=11.8ms   p(90)=0s       p(95)=0s       p(99.9)=9.49ms  
     http_req_duration..............: avg=268.42ms min=160.92ms med=257.17ms max=785.6ms  p(90)=275.74ms p(95)=428.53ms p(99.9)=685.23ms
       { expected_response:true }...: avg=268.42ms min=160.92ms med=257.17ms max=785.6ms  p(90)=275.74ms p(95)=428.53ms p(99.9)=685.23ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11243
     http_req_receiving.............: avg=98.72µs  min=24.41µs  med=48.09µs  max=19.93ms  p(90)=110.38µs p(95)=382.22µs p(99.9)=4.29ms  
     http_req_sending...............: avg=132.39µs min=5.54µs   med=11.13µs  max=259.24ms p(90)=37.07µs  p(95)=157.06µs p(99.9)=7ms     
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=268.19ms min=160.81ms med=257.01ms max=784.83ms p(90)=275.45ms p(95)=426.74ms p(99.9)=684.07ms
     http_reqs......................: 11243   146.443571/s
     iteration_duration.............: avg=269.77ms min=172.4ms  med=257.54ms max=827.43ms p(90)=276.11ms p(95)=431.21ms p(99.9)=716.76ms
     iterations.....................: 11143   145.14104/s
     success_rate...................: 100.00% ✓ 11143      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32049      ✗ 0    
     data_received..................: 947 MB  12 MB/s
     data_sent......................: 13 MB   164 kB/s
     http_req_blocked...............: avg=30.69µs  min=1.15µs   med=2.71µs   max=11.59ms  p(90)=4.63µs   p(95)=6.46µs   p(99.9)=9.12ms  
     http_req_connecting............: avg=27.09µs  min=0s       med=0s       max=11.55ms  p(90)=0s       p(95)=0s       p(99.9)=9.09ms  
     http_req_duration..............: avg=279.91ms min=145.9ms  med=267.07ms max=963.88ms p(90)=290.62ms p(95)=320.6ms  p(99.9)=959.11ms
       { expected_response:true }...: avg=279.91ms min=145.9ms  med=267.07ms max=963.88ms p(90)=290.62ms p(95)=320.6ms  p(99.9)=959.11ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10783
     http_req_receiving.............: avg=109.82µs min=26.95µs  med=50.15µs  max=12.52ms  p(90)=128.76µs p(95)=409.72µs p(99.9)=7.54ms  
     http_req_sending...............: avg=181.18µs min=5.58µs   med=11.34µs  max=451.49ms p(90)=42.57µs  p(95)=167.03µs p(99.9)=7.46ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=279.62ms min=139.42ms med=266.91ms max=963.82ms p(90)=290.45ms p(95)=317.6ms  p(99.9)=958.55ms
     http_reqs......................: 10783   140.616225/s
     iteration_duration.............: avg=281.42ms min=146.17ms med=267.43ms max=964.12ms p(90)=291.07ms p(95)=334.69ms p(99.9)=959.46ms
     iterations.....................: 10683   139.31217/s
     success_rate...................: 100.00% ✓ 10683      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30516      ✗ 0    
     data_received..................: 901 MB  11 MB/s
     data_sent......................: 12 MB   147 kB/s
     http_req_blocked...............: avg=40.94µs  min=1.64µs   med=2.75µs   max=147.65ms p(90)=4.05µs   p(95)=4.94µs   p(99.9)=7.68ms  
     http_req_connecting............: avg=23.16µs  min=0s       med=0s       max=9.38ms   p(90)=0s       p(95)=0s       p(99.9)=7.5ms   
     http_req_duration..............: avg=293.93ms min=179.68ms med=295.19ms max=723.69ms p(90)=328.05ms p(95)=337.94ms p(99.9)=626.08ms
       { expected_response:true }...: avg=293.93ms min=179.68ms med=295.19ms max=723.69ms p(90)=328.05ms p(95)=337.94ms p(99.9)=626.08ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10272
     http_req_receiving.............: avg=97.77µs  min=35.81µs  med=50.62µs  max=43.92ms  p(90)=103.81µs p(95)=307.37µs p(99.9)=2.18ms  
     http_req_sending...............: avg=141.44µs min=7.25µs   med=10.89µs  max=294.58ms p(90)=30.5µs   p(95)=141.48µs p(99.9)=3.79ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=293.69ms min=177.4ms  med=295ms    max=705.47ms p(90)=327.92ms p(95)=337.61ms p(99.9)=624.93ms
     http_reqs......................: 10272   126.399869/s
     iteration_duration.............: avg=295.11ms min=179.92ms med=295.79ms max=745.08ms p(90)=328.59ms p(95)=338.29ms p(99.9)=643.03ms
     iterations.....................: 10172   125.169341/s
     success_rate...................: 100.00% ✓ 10172      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21735     ✗ 0   
     data_received..................: 645 MB  7.9 MB/s
     data_sent......................: 8.5 MB  105 kB/s
     http_req_blocked...............: avg=36.36µs  min=1.21µs   med=3.38µs   max=9.37ms   p(90)=4.9µs    p(95)=5.71µs   p(99.9)=8.03ms  
     http_req_connecting............: avg=32.64µs  min=0s       med=0s       max=9.34ms   p(90)=0s       p(95)=0s       p(99.9)=8ms     
     http_req_duration..............: avg=411.59ms min=210.98ms med=411.36ms max=933.17ms p(90)=441.51ms p(95)=454.45ms p(99.9)=817.36ms
       { expected_response:true }...: avg=411.59ms min=210.98ms med=411.36ms max=933.17ms p(90)=441.51ms p(95)=454.45ms p(99.9)=817.36ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7345
     http_req_receiving.............: avg=62.48µs  min=26.9µs   med=54.51µs  max=1.77ms   p(90)=89.62µs  p(95)=101.84µs p(99.9)=557.63µs
     http_req_sending...............: avg=78.3µs   min=5.47µs   med=12.71µs  max=285.09ms p(90)=18.68µs  p(95)=22.82µs  p(99.9)=1.66ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=411.45ms min=210.88ms med=411.27ms max=932.36ms p(90)=441.39ms p(95)=454.23ms p(99.9)=816.67ms
     http_reqs......................: 7345    90.032981/s
     iteration_duration.............: avg=414.85ms min=288.67ms med=411.86ms max=977.42ms p(90)=442.03ms p(95)=454.8ms  p(99.9)=958.95ms
     iterations.....................: 7245    88.807209/s
     success_rate...................: 100.00% ✓ 7245      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants