Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Apr 30, 2025

This PR contains the following updates:

Package Update Change
ghcr.io/graphql-hive/gateway minor 1.13.6 -> 1.14.0
ghcr.io/graphql-hive/gateway minor 1.13.6-bun -> 1.14.0-bun

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Apr 30, 2025
Copy link

github-actions bot commented Apr 30, 2025

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 182 5651 total, 0 failed avg: 835ms, p95: 2215ms
grafbase 163 5074 total, 0 failed avg: 958ms, p95: 2724ms
apollo-router 156 4858 total, 2 failed avg: 1041ms, p95: 3205ms ❌ 2 failed requests, 2 non-200 responses, 2 unexpected GraphQL errors
hive-gateway-bun 90 2978 total, 0 failed avg: 3125ms, p95: 5357ms
hive-gateway 85 2844 total, 0 failed avg: 3296ms, p95: 17575ms
apollo-server 84 2832 total, 0 failed avg: 3338ms, p95: 29203ms
mercurius 77 2475 total, 0 failed avg: 3727ms, p95: 5776ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16893      ✗ 0    
     data_received..................: 496 MB  16 MB/s
     data_sent......................: 6.7 MB  217 kB/s
     http_req_blocked...............: avg=1.65ms   min=1.4µs   med=3.47µs   max=1.11s p(90)=5.93µs   p(95)=346.35µs
     http_req_connecting............: avg=1.51ms   min=0s      med=0s       max=1.11s p(90)=0s       p(95)=100.81µs
     http_req_duration..............: avg=835.22ms min=3.67ms  med=686.01ms max=5.37s p(90)=1.81s    p(95)=2.21s   
       { expected_response:true }...: avg=835.22ms min=3.67ms  med=686.01ms max=5.37s p(90)=1.81s    p(95)=2.21s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5651 
     http_req_receiving.............: avg=342.87ms min=34.49µs med=105.97µs max=4.48s p(90)=1.17s    p(95)=1.75s   
     http_req_sending...............: avg=16.84ms  min=8.37µs  med=15.81µs  max=2.35s p(90)=225.54µs p(95)=13.59ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=475.5ms  min=3.57ms  med=422.53ms max=2.37s p(90)=909.79ms p(95)=997.83ms
     http_reqs......................: 5651    182.650974/s
     iteration_duration.............: avg=1.6s     min=17.58ms med=1.31s    max=9.35s p(90)=3.3s     p(95)=4.03s   
     iterations.....................: 5631    182.004536/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15162      ✗ 0    
     data_received..................: 446 MB  14 MB/s
     data_sent......................: 6.0 MB  194 kB/s
     http_req_blocked...............: avg=791.53µs min=1.51µs  med=3.67µs   max=1.43s    p(90)=6.47µs   p(95)=970.41µs
     http_req_connecting............: avg=622.89µs min=0s      med=0s       max=663.21ms p(90)=0s       p(95)=712.25µs
     http_req_duration..............: avg=958.08ms min=3.06ms  med=703.78ms max=7.55s    p(90)=2.09s    p(95)=2.72s   
       { expected_response:true }...: avg=958.08ms min=3.06ms  med=703.78ms max=7.55s    p(90)=2.09s    p(95)=2.72s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5074 
     http_req_receiving.............: avg=357.86ms min=36.46µs med=113.1µs  max=4.62s    p(90)=1.22s    p(95)=1.92s   
     http_req_sending...............: avg=20.59ms  min=8µs     med=16.94µs  max=3.58s    p(90)=358.02µs p(95)=12.08ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=579.62ms min=2.99ms  med=471.71ms max=2.71s    p(90)=1.23s    p(95)=1.53s   
     http_reqs......................: 5074    163.305176/s
     iteration_duration.............: avg=1.8s     min=28.03ms med=1.44s    max=12.08s   p(90)=3.75s    p(95)=4.48s   
     iterations.....................: 5054    162.661482/s
     vus............................: 64      min=64       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4836 / ✗ 2
     ✗ no graphql errors
      ↳  99% — ✓ 4836 / ✗ 2
     ✓ valid response structure

     █ setup

     checks.........................: 99.97% ✓ 14508      ✗ 4    
     data_received..................: 426 MB 14 MB/s
     data_sent......................: 5.8 MB 186 kB/s
     http_req_blocked...............: avg=1.53ms   min=1.69µs med=3.67µs   max=1.53s  p(90)=6.16µs   p(95)=998.27µs
     http_req_connecting............: avg=1.26ms   min=0s     med=0s       max=1.53s  p(90)=0s       p(95)=794.73µs
     http_req_duration..............: avg=1.04s    min=7.44ms med=619.24ms max=8.47s  p(90)=2.49s    p(95)=3.2s    
       { expected_response:true }...: avg=1.04s    min=7.44ms med=619.1ms  max=8.47s  p(90)=2.49s    p(95)=3.2s    
     http_req_failed................: 0.04%  ✓ 2          ✗ 4856 
     http_req_receiving.............: avg=520.9ms  min=0s     med=103µs    max=8.42s  p(90)=1.9s     p(95)=2.56s   
     http_req_sending...............: avg=19.3ms   min=8.64µs med=18.61µs  max=4.82s  p(90)=261.95µs p(95)=15.24ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=501.07ms min=7.36ms med=450.01ms max=2.44s  p(90)=930.51ms p(95)=1.1s    
     http_reqs......................: 4858   156.58231/s
     iteration_duration.............: avg=1.88s    min=38.9ms med=1.31s    max=11.82s p(90)=4.2s     p(95)=5.39s   
     iterations.....................: 4838   155.937673/s
     vus............................: 25     min=25       max=300
     vus_max........................: 300    min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8874      ✗ 0    
     data_received..................: 261 MB  7.9 MB/s
     data_sent......................: 3.5 MB  108 kB/s
     http_req_blocked...............: avg=849.04µs min=1.63µs   med=3.63µs  max=24.75ms p(90)=109.76µs p(95)=8.74ms  
     http_req_connecting............: avg=825.61µs min=0s       med=0s      max=24.72ms p(90)=68.99µs  p(95)=8.52ms  
     http_req_duration..............: avg=3.12s    min=16.88ms  med=2.88s   max=6.63s   p(90)=4.75s    p(95)=5.35s   
       { expected_response:true }...: avg=3.12s    min=16.88ms  med=2.88s   max=6.63s   p(90)=4.75s    p(95)=5.35s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2978 
     http_req_receiving.............: avg=46.25ms  min=39.45µs  med=302.6µs max=1.82s   p(90)=3.98ms   p(95)=261.48ms
     http_req_sending...............: avg=457.37µs min=8.82µs   med=20.4µs  max=230ms   p(90)=174.46µs p(95)=477.64µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.07s    min=16.69ms  med=2.86s   max=6.63s   p(90)=4.75s    p(95)=5.33s   
     http_reqs......................: 2978    90.525056/s
     iteration_duration.............: avg=3.18s    min=417.76ms med=2.91s   max=6.7s    p(90)=4.8s     p(95)=5.42s   
     iterations.....................: 2958    89.917097/s
     vus............................: 165     min=165     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8472      ✗ 0    
     data_received..................: 250 MB  7.5 MB/s
     data_sent......................: 3.4 MB  101 kB/s
     http_req_blocked...............: avg=649.26µs min=1.68µs   med=3.65µs   max=13.18ms p(90)=102.05µs p(95)=5.82ms  
     http_req_connecting............: avg=618.86µs min=0s       med=0s       max=13.14ms p(90)=69.56µs  p(95)=5.49ms  
     http_req_duration..............: avg=3.29s    min=13.95ms  med=1.78s    max=32.86s  p(90)=3.26s    p(95)=17.57s  
       { expected_response:true }...: avg=3.29s    min=13.95ms  med=1.78s    max=32.86s  p(90)=3.26s    p(95)=17.57s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2844 
     http_req_receiving.............: avg=341.01µs min=42.73µs  med=104.64µs max=54.27ms p(90)=374.28µs p(95)=907.4µs 
     http_req_sending...............: avg=129.92µs min=9.15µs   med=20.69µs  max=31.29ms p(90)=137.21µs p(95)=380.53µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.29s    min=13.77ms  med=1.78s    max=32.86s  p(90)=3.26s    p(95)=17.57s  
     http_reqs......................: 2844    85.201135/s
     iteration_duration.............: avg=3.33s    min=292.75ms med=1.8s     max=32.87s  p(90)=3.3s     p(95)=17.71s  
     iterations.....................: 2824    84.601971/s
     vus............................: 37      min=37      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8436      ✗ 0    
     data_received..................: 249 MB  7.4 MB/s
     data_sent......................: 3.4 MB  100 kB/s
     http_req_blocked...............: avg=776.19µs min=1.55µs   med=3.46µs   max=52.16ms  p(90)=306.7µs  p(95)=6.43ms 
     http_req_connecting............: avg=729.4µs  min=0s       med=0s       max=28.42ms  p(90)=207.29µs p(95)=6.32ms 
     http_req_duration..............: avg=3.33s    min=10.73ms  med=1.37s    max=33.26s   p(90)=2.34s    p(95)=29.2s  
       { expected_response:true }...: avg=3.33s    min=10.73ms  med=1.37s    max=33.26s   p(90)=2.34s    p(95)=29.2s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2832 
     http_req_receiving.............: avg=295.54µs min=38.35µs  med=105.34µs max=141.84ms p(90)=190.62µs p(95)=288.3µs
     http_req_sending...............: avg=565.7µs  min=8.96µs   med=17.55µs  max=40.39ms  p(90)=113.18µs p(95)=1.24ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.33s    min=10.67ms  med=1.37s    max=33.26s   p(90)=2.33s    p(95)=29.2s  
     http_reqs......................: 2832    84.046272/s
     iteration_duration.............: avg=3.37s    min=171.25ms med=1.39s    max=33.27s   p(90)=2.45s    p(95)=29.68s 
     iterations.....................: 2812    83.452725/s
     vus............................: 65      min=65      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7365      ✗ 0    
     data_received..................: 217 MB  6.8 MB/s
     data_sent......................: 2.9 MB  91 kB/s
     http_req_blocked...............: avg=736.53µs min=1.68µs   med=3.55µs   max=21.09ms  p(90)=1.15ms   p(95)=7.37ms  
     http_req_connecting............: avg=693.49µs min=0s       med=0s       max=19.85ms  p(90)=951.55µs p(95)=7.24ms  
     http_req_duration..............: avg=3.72s    min=11.48ms  med=3.7s     max=8.44s    p(90)=4.67s    p(95)=5.77s   
       { expected_response:true }...: avg=3.72s    min=11.48ms  med=3.7s     max=8.44s    p(90)=4.67s    p(95)=5.77s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2475 
     http_req_receiving.............: avg=2.1ms    min=38.3µs   med=100.14µs max=201.45ms p(90)=267.9µs  p(95)=731.09µs
     http_req_sending...............: avg=225.77µs min=9.09µs   med=19.16µs  max=19.16ms  p(90)=217.19µs p(95)=820.3µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.72s    min=11.39ms  med=3.7s     max=8.44s    p(90)=4.67s    p(95)=5.77s   
     http_reqs......................: 2475    77.012383/s
     iteration_duration.............: avg=3.77s    min=235.21ms med=3.72s    max=8.47s    p(90)=4.71s    p(95)=5.86s   
     iterations.....................: 2455    76.390061/s
     vus............................: 57      min=57      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Apr 30, 2025

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 184 5768 total, 0 failed avg: 1470ms, p95: 3575ms
grafbase 170 5364 total, 0 failed avg: 1338ms, p95: 3302ms
apollo-router 151 4788 total, 22 failed avg: 1564ms, p95: 4689ms ❌ 22 failed requests, 22 non-200 responses, 22 unexpected GraphQL errors
hive-gateway-bun 88 3076 total, 0 failed avg: 5120ms, p95: 7847ms
apollo-server 84 3043 total, 0 failed avg: 5381ms, p95: 33877ms
hive-gateway 84 3006 total, 0 failed avg: 5374ms, p95: 33356ms
mercurius 71 2360 total, 0 failed avg: 6635ms, p95: 11195ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17244      ✗ 0    
     data_received..................: 506 MB  16 MB/s
     data_sent......................: 6.8 MB  219 kB/s
     http_req_blocked...............: avg=6.73ms   min=1.52µs  med=3.19µs   max=3.3s   p(90)=13.4µs p(95)=20.96ms
     http_req_connecting............: avg=5.72ms   min=0s      med=0s       max=3.3s   p(90)=0s     p(95)=20.04ms
     http_req_duration..............: avg=1.47s    min=3.1ms   med=1.26s    max=6.08s  p(90)=2.84s  p(95)=3.57s  
       { expected_response:true }...: avg=1.47s    min=3.1ms   med=1.26s    max=6.08s  p(90)=2.84s  p(95)=3.57s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5768 
     http_req_receiving.............: avg=417.42ms min=31.88µs med=87.17µs  max=5.5s   p(90)=1.55s  p(95)=2.74s  
     http_req_sending...............: avg=24.87ms  min=7.93µs  med=14.64µs  max=4.13s  p(90)=2.66ms p(95)=26.23ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s     p(95)=0s     
     http_req_waiting...............: avg=1.02s    min=3ms     med=984.29ms max=4.44s  p(90)=1.73s  p(95)=1.97s  
     http_reqs......................: 5768    184.160681/s
     iteration_duration.............: avg=2.59s    min=19.29ms med=2.36s    max=10.89s p(90)=4.71s  p(95)=5.6s   
     iterations.....................: 5748    183.522121/s
     vus............................: 125     min=125      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16032      ✗ 0    
     data_received..................: 471 MB  15 MB/s
     data_sent......................: 6.4 MB  202 kB/s
     http_req_blocked...............: avg=1.3ms    min=1.44µs  med=3.34µs   max=39.45ms p(90)=21.97µs  p(95)=14.38ms
     http_req_connecting............: avg=1.26ms   min=0s      med=0s       max=38.52ms p(90)=0s       p(95)=14.1ms 
     http_req_duration..............: avg=1.33s    min=3.1ms   med=1.19s    max=7.32s   p(90)=2.76s    p(95)=3.3s   
       { expected_response:true }...: avg=1.33s    min=3.1ms   med=1.19s    max=7.32s   p(90)=2.76s    p(95)=3.3s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5364 
     http_req_receiving.............: avg=364.2ms  min=33.23µs med=88.76µs  max=4.58s   p(90)=1.53s    p(95)=2.06s  
     http_req_sending...............: avg=27.47ms  min=7.55µs  med=14.97µs  max=5.47s   p(90)=521.13µs p(95)=8.84ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=946.34ms min=3.03ms  med=813.32ms max=5.17s   p(90)=2.03s    p(95)=2.17s  
     http_reqs......................: 5364    170.138972/s
     iteration_duration.............: avg=2.8s     min=22.39ms med=2.51s    max=12.23s  p(90)=5.15s    p(95)=6.27s  
     iterations.....................: 5344    169.504599/s
     vus............................: 240     min=240      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4746 / ✗ 22
     ✗ no graphql errors
      ↳  99% — ✓ 4746 / ✗ 22
     ✓ valid response structure

     █ setup

     checks.........................: 99.69% ✓ 14238      ✗ 44   
     data_received..................: 418 MB 13 MB/s
     data_sent......................: 5.7 MB 180 kB/s
     http_req_blocked...............: avg=14.2ms   min=1.57µs  med=3.83µs   max=4.4s   p(90)=2.51ms  p(95)=47.36ms
     http_req_connecting............: avg=13.09ms  min=0s      med=0s       max=4.4s   p(90)=1.43ms  p(95)=46.09ms
     http_req_duration..............: avg=1.56s    min=6.93ms  med=1.08s    max=8.63s  p(90)=3.67s   p(95)=4.68s  
       { expected_response:true }...: avg=1.56s    min=6.93ms  med=1.08s    max=8.63s  p(90)=3.67s   p(95)=4.68s  
     http_req_failed................: 0.45%  ✓ 22         ✗ 4766 
     http_req_receiving.............: avg=579.04ms min=0s      med=102.9µs  max=8.31s  p(90)=2.72s   p(95)=3.59s  
     http_req_sending...............: avg=36.54ms  min=8.25µs  med=19.8µs   max=5.17s  p(90)=28.39ms p(95)=35.83ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=948.3ms  min=6.83ms  med=849.18ms max=2.61s  p(90)=1.81s   p(95)=2.23s  
     http_reqs......................: 4788   151.846872/s
     iteration_duration.............: avg=3.2s     min=47.17ms med=2.44s    max=13.34s p(90)=6.67s   p(95)=8.56s  
     iterations.....................: 4768   151.212591/s
     vus............................: 300    min=300      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9168      ✗ 0    
     data_received..................: 270 MB  7.8 MB/s
     data_sent......................: 3.7 MB  105 kB/s
     http_req_blocked...............: avg=2.96ms  min=1.87µs   med=3.99µs   max=62.64ms p(90)=15.99ms  p(95)=25.37ms 
     http_req_connecting............: avg=2.85ms  min=0s       med=0s       max=40.48ms p(90)=15.07ms  p(95)=25.28ms 
     http_req_duration..............: avg=5.11s   min=14.73ms  med=5.08s    max=12.86s  p(90)=7.13s    p(95)=7.84s   
       { expected_response:true }...: avg=5.11s   min=14.73ms  med=5.08s    max=12.86s  p(90)=7.13s    p(95)=7.84s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3076 
     http_req_receiving.............: avg=75.89ms min=36.23µs  med=122.84µs max=3.43s   p(90)=24.33ms  p(95)=416.05ms
     http_req_sending...............: avg=2.49ms  min=8.89µs   med=21.88µs  max=1.09s   p(90)=949.18µs p(95)=5.02ms  
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.04s   min=14.61ms  med=4.99s    max=12.86s  p(90)=7.09s    p(95)=7.82s   
     http_reqs......................: 3076    88.680043/s
     iteration_duration.............: avg=5.28s   min=217.81ms med=5.15s    max=12.87s  p(90)=7.35s    p(95)=7.92s   
     iterations.....................: 3056    88.103449/s
     vus............................: 114     min=114     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9069      ✗ 0    
     data_received..................: 268 MB  7.4 MB/s
     data_sent......................: 3.6 MB  100 kB/s
     http_req_blocked...............: avg=2.03ms   min=1.56µs   med=3.17µs   max=36.25ms p(90)=9.24ms   p(95)=18.35ms 
     http_req_connecting............: avg=1.98ms   min=0s       med=0s       max=27.15ms p(90)=9.11ms   p(95)=18.06ms 
     http_req_duration..............: avg=5.38s    min=11.08ms  med=1.6s     max=35.7s   p(90)=32.12s   p(95)=33.87s  
       { expected_response:true }...: avg=5.38s    min=11.08ms  med=1.6s     max=35.7s   p(90)=32.12s   p(95)=33.87s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 3043 
     http_req_receiving.............: avg=293.45µs min=42.83µs  med=104.94µs max=75.99ms p(90)=224.87µs p(95)=407.53µs
     http_req_sending...............: avg=347.37µs min=8.33µs   med=16.6µs   max=35.39ms p(90)=767.44µs p(95)=2.74ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.38s    min=11ms     med=1.6s     max=35.7s   p(90)=32.11s   p(95)=33.87s  
     http_reqs......................: 3043    84.253094/s
     iteration_duration.............: avg=5.43s    min=360.25ms med=1.62s    max=35.71s  p(90)=32.17s   p(95)=33.97s  
     iterations.....................: 3023    83.699344/s
     vus............................: 20      min=20      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8958      ✗ 0    
     data_received..................: 264 MB  7.4 MB/s
     data_sent......................: 3.6 MB  101 kB/s
     http_req_blocked...............: avg=4.26ms   min=1.87µs   med=3.77µs   max=54.99ms  p(90)=23.64ms p(95)=28.16ms
     http_req_connecting............: avg=4.2ms    min=0s       med=0s       max=54.96ms  p(90)=23.35ms p(95)=28.01ms
     http_req_duration..............: avg=5.37s    min=13.1ms   med=2.29s    max=34.99s   p(90)=16.1s   p(95)=33.35s 
       { expected_response:true }...: avg=5.37s    min=13.1ms   med=2.29s    max=34.99s   p(90)=16.1s   p(95)=33.35s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 3006 
     http_req_receiving.............: avg=959.91µs min=39.86µs  med=100.72µs max=143.11ms p(90)=1.13ms  p(95)=2.8ms  
     http_req_sending...............: avg=713.89µs min=9.62µs   med=21.53µs  max=87.11ms  p(90)=2.47ms  p(95)=3.6ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=5.37s    min=13.01ms  med=2.29s    max=34.99s   p(90)=16.09s  p(95)=33.35s 
     http_reqs......................: 3006    84.63658/s
     iteration_duration.............: avg=5.44s    min=458.38ms med=2.32s    max=35.01s   p(90)=16.84s  p(95)=33.4s  
     iterations.....................: 2986    84.073462/s
     vus............................: 51      min=51      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7020      ✗ 0    
     data_received..................: 207 MB  6.3 MB/s
     data_sent......................: 2.8 MB  85 kB/s
     http_req_blocked...............: avg=2.76ms   min=1.73µs   med=4.53µs   max=34.06ms  p(90)=14.9ms   p(95)=20.75ms
     http_req_connecting............: avg=2.7ms    min=0s       med=0s       max=26.14ms  p(90)=14.71ms  p(95)=20.48ms
     http_req_duration..............: avg=6.63s    min=11.89ms  med=6.79s    max=13.04s   p(90)=8.41s    p(95)=11.19s 
       { expected_response:true }...: avg=6.63s    min=11.89ms  med=6.79s    max=13.04s   p(90)=8.41s    p(95)=11.19s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2360 
     http_req_receiving.............: avg=7.85ms   min=37.45µs  med=106.23µs max=643.06ms p(90)=379.3µs  p(95)=1.3ms  
     http_req_sending...............: avg=248.86µs min=9.82µs   med=27.42µs  max=12.05ms  p(90)=717.43µs p(95)=1.43ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=6.62s    min=11.78ms  med=6.79s    max=13.04s   p(90)=8.41s    p(95)=11.19s 
     http_reqs......................: 2360    71.357346/s
     iteration_duration.............: avg=6.73s    min=480.37ms med=6.85s    max=13.05s   p(90)=8.43s    p(95)=11.22s 
     iterations.....................: 2340    70.752623/s
     vus............................: 45      min=45      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Apr 30, 2025

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 183 5683 total, 0 failed avg: 818ms, p95: 2247ms
grafbase 167 5179 total, 0 failed avg: 842ms, p95: 2198ms
apollo-router 164 5141 total, 0 failed avg: 894ms, p95: 2232ms
hive-gateway-bun 86 2896 total, 0 failed avg: 3240ms, p95: 5693ms
apollo-server 85 2831 total, 0 failed avg: 3311ms, p95: 27470ms
hive-gateway 83 2807 total, 0 failed avg: 3335ms, p95: 18520ms
mercurius 75 2434 total, 0 failed avg: 3776ms, p95: 5669ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16989      ✗ 0    
     data_received..................: 499 MB  16 MB/s
     data_sent......................: 6.7 MB  218 kB/s
     http_req_blocked...............: avg=1.57ms   min=1.71µs  med=3.25µs   max=2.2s  p(90)=5.49µs   p(95)=624.04µs
     http_req_connecting............: avg=1.34ms   min=0s      med=0s       max=1.31s p(90)=0s       p(95)=267.31µs
     http_req_duration..............: avg=817.53ms min=3.72ms  med=634.94ms max=5.37s p(90)=1.71s    p(95)=2.24s   
       { expected_response:true }...: avg=817.53ms min=3.72ms  med=634.94ms max=5.37s p(90)=1.71s    p(95)=2.24s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5683 
     http_req_receiving.............: avg=314.3ms  min=32.37µs med=83.25µs  max=4.61s p(90)=1.26s    p(95)=1.63s   
     http_req_sending...............: avg=14.39ms  min=8.45µs  med=14.91µs  max=3.29s p(90)=135.55µs p(95)=1.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=488.83ms min=3.63ms  med=447.76ms max=2.45s p(90)=914.16ms p(95)=1.08s   
     http_reqs......................: 5683    183.780178/s
     iteration_duration.............: avg=1.59s    min=20.38ms med=1.3s     max=8.95s p(90)=3.41s    p(95)=4.15s   
     iterations.....................: 5663    183.133406/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15477      ✗ 0    
     data_received..................: 455 MB  15 MB/s
     data_sent......................: 6.1 MB  199 kB/s
     http_req_blocked...............: avg=1.27ms   min=1.36µs  med=3.27µs   max=1.2s  p(90)=5.66µs   p(95)=228.8µs 
     http_req_connecting............: avg=1.07ms   min=0s      med=0s       max=1.2s  p(90)=0s       p(95)=172.35µs
     http_req_duration..............: avg=841.9ms  min=3.09ms  med=685.44ms max=4.82s p(90)=1.66s    p(95)=2.19s   
       { expected_response:true }...: avg=841.9ms  min=3.09ms  med=685.44ms max=4.82s p(90)=1.66s    p(95)=2.19s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5179 
     http_req_receiving.............: avg=283.09ms min=31.91µs med=86.21µs  max=4.13s p(90)=1s       p(95)=1.56s   
     http_req_sending...............: avg=19.59ms  min=7.77µs  med=15.37µs  max=3.28s p(90)=351.51µs p(95)=21.52ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=539.21ms min=3ms     med=482.08ms max=2.41s p(90)=997.52ms p(95)=1.14s   
     http_reqs......................: 5179    167.559125/s
     iteration_duration.............: avg=1.74s    min=28.28ms med=1.41s    max=8.87s p(90)=3.57s    p(95)=4.39s   
     iterations.....................: 5159    166.912054/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15363      ✗ 0    
     data_received..................: 451 MB  14 MB/s
     data_sent......................: 6.1 MB  195 kB/s
     http_req_blocked...............: avg=1.81ms   min=1.45µs  med=3.32µs   max=2s     p(90)=5.75µs   p(95)=2.35ms 
     http_req_connecting............: avg=1.39ms   min=0s      med=0s       max=2s     p(90)=0s       p(95)=1.76ms 
     http_req_duration..............: avg=894.06ms min=6.63ms  med=709.88ms max=5.34s  p(90)=1.82s    p(95)=2.23s  
       { expected_response:true }...: avg=894.06ms min=6.63ms  med=709.88ms max=5.34s  p(90)=1.82s    p(95)=2.23s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5141 
     http_req_receiving.............: avg=296.69ms min=35.83µs med=93.55µs  max=5.05s  p(90)=1.06s    p(95)=1.45s  
     http_req_sending...............: avg=21.79ms  min=8.56µs  med=14.86µs  max=2.13s  p(90)=211.33µs p(95)=30.21ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=575.56ms min=6.55ms  med=536.33ms max=2.54s  p(90)=1.07s    p(95)=1.24s  
     http_reqs......................: 5141    164.037588/s
     iteration_duration.............: avg=1.76s    min=29.54ms med=1.43s    max=10.35s p(90)=3.71s    p(95)=4.49s  
     iterations.....................: 5121    163.399434/s
     vus............................: 66      min=66       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8628      ✗ 0    
     data_received..................: 254 MB  7.6 MB/s
     data_sent......................: 3.4 MB  102 kB/s
     http_req_blocked...............: avg=812.35µs min=1.85µs  med=4.56µs   max=31.39ms  p(90)=225.86µs p(95)=8.26ms  
     http_req_connecting............: avg=785.85µs min=0s      med=0s       max=20.51ms  p(90)=127.34µs p(95)=8.08ms  
     http_req_duration..............: avg=3.24s    min=16.71ms med=3.14s    max=7.54s    p(90)=4.56s    p(95)=5.69s   
       { expected_response:true }...: avg=3.24s    min=16.71ms med=3.14s    max=7.54s    p(90)=4.56s    p(95)=5.69s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2896 
     http_req_receiving.............: avg=63.74ms  min=39.52µs med=165.98µs max=1.9s     p(90)=20.03ms  p(95)=488.18ms
     http_req_sending...............: avg=1.04ms   min=8.96µs  med=25.53µs  max=280.24ms p(90)=209.93µs p(95)=3.93ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.17s    min=16.55ms med=3.09s    max=7.31s    p(90)=4.34s    p(95)=5.68s   
     http_reqs......................: 2896    86.205891/s
     iteration_duration.............: avg=3.32s    min=270ms   med=3.2s     max=7.58s    p(90)=4.64s    p(95)=5.72s   
     iterations.....................: 2876    85.610546/s
     vus............................: 109     min=109     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8433      ✗ 0    
     data_received..................: 249 MB  7.5 MB/s
     data_sent......................: 3.4 MB  101 kB/s
     http_req_blocked...............: avg=2.36ms   min=1.54µs   med=3.64µs   max=50.16ms  p(90)=973.58µs p(95)=23.29ms 
     http_req_connecting............: avg=2.29ms   min=0s       med=0s       max=46.6ms   p(90)=701.83µs p(95)=22.94ms 
     http_req_duration..............: avg=3.31s    min=11.73ms  med=1.4s     max=32.74s   p(90)=2.13s    p(95)=27.46s  
       { expected_response:true }...: avg=3.31s    min=11.73ms  med=1.4s     max=32.74s   p(90)=2.13s    p(95)=27.46s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2831 
     http_req_receiving.............: avg=288.26µs min=43.25µs  med=106.44µs max=103.82ms p(90)=189.59µs p(95)=306.02µs
     http_req_sending...............: avg=733.93µs min=8.84µs   med=18.86µs  max=48.34ms  p(90)=343.76µs p(95)=7.29ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.31s    min=11.63ms  med=1.4s     max=32.74s   p(90)=2.13s    p(95)=27.46s  
     http_reqs......................: 2831    85.309511/s
     iteration_duration.............: avg=3.35s    min=306.09ms med=1.42s    max=32.75s   p(90)=2.14s    p(95)=27.97s  
     iterations.....................: 2811    84.70683/s
     vus............................: 20      min=20      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8361      ✗ 0    
     data_received..................: 247 MB  7.4 MB/s
     data_sent......................: 3.3 MB  100 kB/s
     http_req_blocked...............: avg=687.64µs min=1.77µs   med=4.27µs   max=17.21ms p(90)=151.42µs p(95)=6.26ms  
     http_req_connecting............: avg=660.56µs min=0s       med=0s       max=17.18ms p(90)=113.8µs  p(95)=5.72ms  
     http_req_duration..............: avg=3.33s    min=15.15ms  med=1.75s    max=32.84s  p(90)=3.18s    p(95)=18.52s  
       { expected_response:true }...: avg=3.33s    min=15.15ms  med=1.75s    max=32.84s  p(90)=3.18s    p(95)=18.52s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2807 
     http_req_receiving.............: avg=503.32µs min=43.19µs  med=115.25µs max=82.57ms p(90)=455.47µs p(95)=1.27ms  
     http_req_sending...............: avg=128.53µs min=10.69µs  med=25.01µs  max=15.15ms p(90)=108.71µs p(95)=293.07µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.33s    min=14.98ms  med=1.75s    max=32.84s  p(90)=3.18s    p(95)=18.51s  
     http_reqs......................: 2807    83.80243/s
     iteration_duration.............: avg=3.37s    min=102.04ms med=1.78s    max=32.86s  p(90)=3.2s     p(95)=18.67s  
     iterations.....................: 2787    83.205334/s
     vus............................: 44      min=44      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7242      ✗ 0    
     data_received..................: 214 MB  6.7 MB/s
     data_sent......................: 2.9 MB  90 kB/s
     http_req_blocked...............: avg=540.53µs min=1.82µs   med=4.17µs   max=33.65ms  p(90)=919.13µs p(95)=5.01ms
     http_req_connecting............: avg=504.69µs min=0s       med=0s       max=10.57ms  p(90)=812.73µs p(95)=4.8ms 
     http_req_duration..............: avg=3.77s    min=11.69ms  med=3.74s    max=8.58s    p(90)=4.89s    p(95)=5.66s 
       { expected_response:true }...: avg=3.77s    min=11.69ms  med=3.74s    max=8.58s    p(90)=4.89s    p(95)=5.66s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2434 
     http_req_receiving.............: avg=8.47ms   min=38.8µs   med=105.89µs max=454.89ms p(90)=356.31µs p(95)=3.03ms
     http_req_sending...............: avg=391.08µs min=10.14µs  med=23.27µs  max=33.57ms  p(90)=167.41µs p(95)=3.65ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.76s    min=11.58ms  med=3.74s    max=8.58s    p(90)=4.89s    p(95)=5.66s 
     http_reqs......................: 2434    75.951132/s
     iteration_duration.............: avg=3.83s    min=278.99ms med=3.76s    max=8.6s     p(90)=4.92s    p(95)=5.73s 
     iterations.....................: 2414    75.327047/s
     vus............................: 13      min=13      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Apr 30, 2025

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 6772ms 181 12714 total, 0 failed avg: 2575ms, p95: 6773ms, max: 15672ms, med: 2161ms
grafbase 9754ms 167 11866 total, 0 failed avg: 2876ms, p95: 9755ms, max: 16936ms, med: 2085ms
apollo-router 9968ms 119 9459 total, 450 failed avg: 3541ms, p95: 9968ms, max: 24880ms, med: 2709ms ❌ 450 failed requests, 450 non-200 responses, 450 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway-bun 28459ms 92 7502 total, 0 failed avg: 11377ms, p95: 28460ms, max: 36024ms, med: 9816ms
mercurius 41624ms 54 5000 total, 0 failed avg: 21288ms, p95: 41625ms, max: 42422ms, med: 19445ms
hive-gateway 51497ms 86 7552 total, 0 failed avg: 12255ms, p95: 51498ms, max: 58475ms, med: 3365ms
apollo-server 59999ms 82 7666 total, 506 failed avg: 11920ms, p95: 60000ms, max: 60055ms, med: 2181ms ❌ 506 failed requests, 506 non-200 responses, 506 unexpected GraphQL errors
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 38082     ✗ 0     
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   215 kB/s
     http_req_blocked...............: avg=290.06ms min=1.52µs  med=3.55µs  max=15.45s p(90)=932.87ms p(95)=2.1s    
     http_req_connecting............: avg=280.36ms min=0s      med=0s      max=15.45s p(90)=828.74ms p(95)=1.95s   
     http_req_duration..............: avg=2.57s    min=3.22ms  med=2.16s   max=15.67s p(90)=5.29s    p(95)=6.77s   
       { expected_response:true }...: avg=2.57s    min=3.22ms  med=2.16s   max=15.67s p(90)=5.29s    p(95)=6.77s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 12714 
     http_req_receiving.............: avg=377.18ms min=31.55µs med=79.31µs max=9.3s   p(90)=1.22s    p(95)=2.95s   
     http_req_sending...............: avg=124.5ms  min=7.69µs  med=17.14µs max=9.2s   p(90)=268.86ms p(95)=782.57ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.07s    min=3.07ms  med=1.77s   max=9.28s  p(90)=4.17s    p(95)=4.77s   
     http_reqs......................: 12714   181.33992/s
     iteration_duration.............: avg=5.54s    min=8.69ms  med=4.44s   max=30.1s  p(90)=11.6s    p(95)=13.93s  
     iterations.....................: 12694   181.05466/s
     vus............................: 4       min=4       max=1999
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 35538      ✗ 0     
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   198 kB/s
     http_req_blocked...............: avg=316.14ms min=1.44µs  med=3.65µs   max=13.95s p(90)=1.03s    p(95)=2.31s   
     http_req_connecting............: avg=312.94ms min=0s      med=0s       max=13.95s p(90)=1.02s    p(95)=2.31s   
     http_req_duration..............: avg=2.87s    min=3.15ms  med=2.08s    max=16.93s p(90)=6.21s    p(95)=9.75s   
       { expected_response:true }...: avg=2.87s    min=3.15ms  med=2.08s    max=16.93s p(90)=6.21s    p(95)=9.75s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11866 
     http_req_receiving.............: avg=1.06s    min=31.36µs med=170.43µs max=10.74s p(90)=3.79s    p(95)=5.89s   
     http_req_sending...............: avg=163.56ms min=7.97µs  med=17.02µs  max=10.06s p(90)=298.23ms p(95)=848.45ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.65s    min=3.07ms  med=1.3s     max=7.31s  p(90)=3.87s    p(95)=4.69s   
     http_reqs......................: 11866   167.163413/s
     iteration_duration.............: avg=6.03s    min=18.84ms med=4.75s    max=31.68s p(90)=13.17s   p(95)=15.84s  
     iterations.....................: 11846   166.881662/s
     vus............................: 74      min=71       max=1960
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  95% — ✓ 8989 / ✗ 450
     ✗ no graphql errors
      ↳  95% — ✓ 8989 / ✗ 450
     ✗ valid response structure
      ↳  99% — ✓ 8989 / ✗ 1

     █ setup

     checks.........................: 96.76% ✓ 26967      ✗ 901   
     data_received..................: 791 MB 10 MB/s
     data_sent......................: 11 MB  142 kB/s
     http_req_blocked...............: avg=677.34ms min=2.15µs  med=7.9µs    max=19.4s  p(90)=2.68s    p(95)=3.88s 
     http_req_connecting............: avg=662.04ms min=0s      med=0s       max=17.83s p(90)=2.65s    p(95)=3.83s 
     http_req_duration..............: avg=3.54s    min=7.61ms  med=2.7s     max=24.88s p(90)=7.45s    p(95)=9.96s 
       { expected_response:true }...: avg=3.55s    min=7.61ms  med=2.72s    max=24.88s p(90)=7.48s    p(95)=10.01s
     http_req_failed................: 4.75%  ✓ 450        ✗ 9009  
     http_req_receiving.............: avg=902.05ms min=0s      med=228.83µs max=21.34s p(90)=3.18s    p(95)=4.91s 
     http_req_sending...............: avg=426.2ms  min=9.4µs   med=52.97µs  max=19.09s p(90)=865.64ms p(95)=3.33s 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=2.21s    min=7.52ms  med=1.92s    max=17s    p(90)=4.55s    p(95)=5.01s 
     http_reqs......................: 9459   119.416213/s
     iteration_duration.............: avg=8.97s    min=52.38ms med=7.58s    max=45.7s  p(90)=18.5s    p(95)=22.83s
     iterations.....................: 9439   119.163721/s
     vus............................: 124    min=75       max=1895
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 22446     ✗ 0     
     data_received..................: 659 MB  8.1 MB/s
     data_sent......................: 8.9 MB  110 kB/s
     http_req_blocked...............: avg=8.94ms   min=1.65µs   med=4.12µs   max=528.04ms p(90)=3.42ms   p(95)=59.03ms 
     http_req_connecting............: avg=8.78ms   min=0s       med=0s       max=527.98ms p(90)=3.18ms   p(95)=55.25ms 
     http_req_duration..............: avg=11.37s   min=17.93ms  med=9.81s    max=36.02s   p(90)=24.76s   p(95)=28.45s  
       { expected_response:true }...: avg=11.37s   min=17.93ms  med=9.81s    max=36.02s   p(90)=24.76s   p(95)=28.45s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7502  
     http_req_receiving.............: avg=106.59ms min=36.7µs   med=159.13µs max=8.6s     p(90)=6.21ms   p(95)=376.94ms
     http_req_sending...............: avg=5.38ms   min=9.46µs   med=24.05µs  max=1.94s    p(90)=822.02µs p(95)=22.61ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.26s   min=17.72ms  med=9.74s    max=36.02s   p(90)=24.69s   p(95)=28.19s  
     http_reqs......................: 7502    92.401731/s
     iteration_duration.............: avg=11.57s   min=187.85ms med=10.1s    max=37.26s   p(90)=25.14s   p(95)=29.09s  
     iterations.....................: 7482    92.155392/s
     vus............................: 90      min=55      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14908     ✗ 0     
     data_received..................: 439 MB  4.8 MB/s
     data_sent......................: 6.1 MB  66 kB/s
     http_req_blocked...............: avg=188.7µs  min=1.56µs   med=4.13µs   max=16.73ms p(90)=433.18µs p(95)=609.53µs
     http_req_connecting............: avg=157.48µs min=0s       med=0s       max=16.61ms p(90)=365.18µs p(95)=513.6µs 
     http_req_duration..............: avg=21.28s   min=10.5ms   med=19.44s   max=42.42s  p(90)=40.11s   p(95)=41.62s  
       { expected_response:true }...: avg=21.28s   min=10.5ms   med=19.44s   max=42.42s  p(90)=40.11s   p(95)=41.62s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 5000  
     http_req_receiving.............: avg=13.11ms  min=37.15µs  med=101.51µs max=1.01s   p(90)=522.45µs p(95)=2.5ms   
     http_req_sending...............: avg=48.25µs  min=8.8µs    med=25.62µs  max=8.42ms  p(90)=61.67µs  p(95)=79.19µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=21.27s   min=10.42ms  med=19.44s   max=42.42s  p(90)=40s      p(95)=41.62s  
     http_reqs......................: 5000    54.628571/s
     iteration_duration.............: avg=21.34s   min=235.75ms med=19.33s   max=42.43s  p(90)=40.5s    p(95)=41.66s  
     iterations.....................: 4948    54.060433/s
     vus............................: 375     min=57      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 22596     ✗ 0     
     data_received..................: 663 MB  7.6 MB/s
     data_sent......................: 9.0 MB  103 kB/s
     http_req_blocked...............: avg=2.27ms   min=2.02µs   med=4.71µs   max=189.76ms p(90)=881.03µs p(95)=9.95ms
     http_req_connecting............: avg=2.18ms   min=0s       med=0s       max=189.59ms p(90)=736.48µs p(95)=9.8ms 
     http_req_duration..............: avg=12.25s   min=12.62ms  med=3.36s    max=58.47s   p(90)=44.71s   p(95)=51.49s
       { expected_response:true }...: avg=12.25s   min=12.62ms  med=3.36s    max=58.47s   p(90)=44.71s   p(95)=51.49s
     http_req_failed................: 0.00%   ✓ 0         ✗ 7552  
     http_req_receiving.............: avg=980.24µs min=41.48µs  med=112.91µs max=293.88ms p(90)=980.39µs p(95)=2.78ms
     http_req_sending...............: avg=804.69µs min=8.98µs   med=28.5µs   max=115.33ms p(90)=143.91µs p(95)=1.29ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=12.25s   min=12.47ms  med=3.36s    max=58.31s   p(90)=44.71s   p(95)=51.49s
     http_reqs......................: 7552    86.700637/s
     iteration_duration.............: avg=12.32s   min=103.41ms med=3.4s     max=58.5s    p(90)=44.76s   p(95)=51.56s
     iterations.....................: 7532    86.471027/s
     vus............................: 40      min=40      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  93% — ✓ 7140 / ✗ 506
     ✗ no graphql errors
      ↳  93% — ✓ 7140 / ✗ 506
     ✓ valid response structure

     █ setup

     checks.........................: 95.48% ✓ 21420     ✗ 1012  
     data_received..................: 629 MB 6.8 MB/s
     data_sent......................: 9.2 MB 99 kB/s
     http_req_blocked...............: avg=678.39µs min=1.43µs  med=3.43µs   max=110.97ms p(90)=345.87µs p(95)=610.91µs
     http_req_connecting............: avg=649.19µs min=0s      med=0s       max=110.91ms p(90)=277.68µs p(95)=509.13µs
     http_req_duration..............: avg=11.92s   min=11.13ms med=2.18s    max=1m0s     p(90)=55.69s   p(95)=59.99s  
       { expected_response:true }...: avg=8.52s    min=11.13ms med=2.12s    max=59.96s   p(90)=36.44s   p(95)=46.31s  
     http_req_failed................: 6.60%  ✓ 506       ✗ 7160  
     http_req_receiving.............: avg=284.13µs min=0s      med=103.94µs max=170.45ms p(90)=214.9µs  p(95)=377.27µs
     http_req_sending...............: avg=292.74µs min=8.5µs   med=18.42µs  max=60.67ms  p(90)=63.47µs  p(95)=134.74µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.91s   min=11.02ms med=2.18s    max=1m0s     p(90)=55.69s   p(95)=59.99s  
     http_reqs......................: 7666   82.667689/s
     iteration_duration.............: avg=11.96s   min=57.74ms med=2.2s     max=1m0s     p(90)=55.75s   p(95)=1m0s    
     iterations.....................: 7646   82.452016/s
     vus............................: 83     min=60      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link
Contributor Author

renovate bot commented Apr 30, 2025

Edited/Blocked Notification

Renovate will not automatically rebase this PR, because it does not recognize the last commit author and assumes somebody else may have edited the PR.

You can manually request rebase by checking the rebase/retry box above.

⚠️ Warning: custom changes will be lost.

@ardatan ardatan merged commit 541a6ad into main May 1, 2025
34 checks passed
@ardatan ardatan deleted the renovate/ghcr.io-graphql-hive-gateway-1.x branch May 1, 2025 00:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant