Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented May 14, 2025

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@types/node (source) 22.15.17 -> 22.15.18 age adoption passing confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label May 14, 2025
Copy link

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 184 5686 total, 0 failed avg: 766ms, p95: 2002ms
grafbase 170 5387 total, 0 failed avg: 914ms, p95: 2252ms
apollo-router 157 4907 total, 0 failed avg: 963ms, p95: 2301ms ❌ 3 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway-bun 92 3068 total, 0 failed avg: 2998ms, p95: 5083ms
apollo-server 86 2870 total, 0 failed avg: 3264ms, p95: 27596ms
hive-gateway 85 2888 total, 0 failed avg: 3276ms, p95: 16823ms
mercurius 75 2423 total, 0 failed avg: 3797ms, p95: 4934ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16998      ✗ 0    
     data_received..................: 499 MB  16 MB/s
     data_sent......................: 6.7 MB  219 kB/s
     http_req_blocked...............: avg=924.73µs min=1.34µs  med=3.14µs   max=704.07ms p(90)=5.29µs   p(95)=173.18µs
     http_req_connecting............: avg=582.56µs min=0s      med=0s       max=665.79ms p(90)=0s       p(95)=116.32µs
     http_req_duration..............: avg=765.84ms min=3.21ms  med=595.71ms max=4.7s     p(90)=1.53s    p(95)=2s      
       { expected_response:true }...: avg=765.84ms min=3.21ms  med=595.71ms max=4.7s     p(90)=1.53s    p(95)=2s      
     http_req_failed................: 0.00%   ✓ 0          ✗ 5686 
     http_req_receiving.............: avg=252.41ms min=33.55µs med=91.25µs  max=4.3s     p(90)=957.22ms p(95)=1.34s   
     http_req_sending...............: avg=19.76ms  min=8.45µs  med=14.68µs  max=3.06s    p(90)=293.95µs p(95)=21.82ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=493.65ms min=3.05ms  med=440.79ms max=2.27s    p(90)=895.4ms  p(95)=1.1s    
     http_reqs......................: 5686    184.26393/s
     iteration_duration.............: avg=1.58s    min=23.86ms med=1.31s    max=9.42s    p(90)=3.18s    p(95)=3.96s   
     iterations.....................: 5666    183.615798/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16101      ✗ 0    
     data_received..................: 473 MB  15 MB/s
     data_sent......................: 6.4 MB  202 kB/s
     http_req_blocked...............: avg=2.28ms   min=1.56µs  med=3.27µs   max=2.91s p(90)=5.53µs   p(95)=2.34ms 
     http_req_connecting............: avg=2.1ms    min=0s      med=0s       max=2.91s p(90)=0s       p(95)=1.88ms 
     http_req_duration..............: avg=913.78ms min=3.56ms  med=770.7ms  max=5.38s p(90)=1.78s    p(95)=2.25s  
       { expected_response:true }...: avg=913.78ms min=3.56ms  med=770.7ms  max=5.38s p(90)=1.78s    p(95)=2.25s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5387 
     http_req_receiving.............: avg=259.99ms min=28.57µs med=79.31µs  max=4.33s p(90)=1.1s     p(95)=1.52s  
     http_req_sending...............: avg=23.92ms  min=7.78µs  med=14.74µs  max=2.08s p(90)=470.09µs p(95)=28.83ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=629.86ms min=3.49ms  med=598.92ms max=2.22s p(90)=1.14s    p(95)=1.51s  
     http_reqs......................: 5387    170.074506/s
     iteration_duration.............: avg=1.7s     min=30.74ms med=1.53s    max=8.37s p(90)=3.28s    p(95)=3.96s  
     iterations.....................: 5367    169.44308/s
     vus............................: 219     min=219      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 4884 / ✗ 3
     ✗ valid response structure
      ↳  99% — ✓ 4886 / ✗ 1

     █ setup

     checks.........................: 99.97% ✓ 14657      ✗ 4    
     data_received..................: 431 MB 14 MB/s
     data_sent......................: 5.8 MB 187 kB/s
     http_req_blocked...............: avg=3.55ms   min=1.51µs  med=3.25µs   max=1.68s p(90)=7.99µs   p(95)=11.34ms
     http_req_connecting............: avg=3.23ms   min=0s      med=0s       max=1.68s p(90)=0s       p(95)=10.32ms
     http_req_duration..............: avg=963.36ms min=7.14ms  med=841.22ms max=5.06s p(90)=1.86s    p(95)=2.3s   
       { expected_response:true }...: avg=963.36ms min=7.14ms  med=841.22ms max=5.06s p(90)=1.86s    p(95)=2.3s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 4907 
     http_req_receiving.............: avg=272.71ms min=34.29µs med=87.52µs  max=3.82s p(90)=1.12s    p(95)=1.52s  
     http_req_sending...............: avg=18.77ms  min=8.23µs  med=15.11µs  max=2.46s p(90)=596.63µs p(95)=16.81ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=671.87ms min=7.07ms  med=612.08ms max=2.48s p(90)=1.21s    p(95)=1.43s  
     http_reqs......................: 4907   157.727339/s
     iteration_duration.............: avg=1.86s    min=43.17ms med=1.57s    max=9.67s p(90)=3.6s     p(95)=4.38s  
     iterations.....................: 4887   157.084473/s
     vus............................: 71     min=71       max=300
     vus_max........................: 300    min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9144      ✗ 0    
     data_received..................: 269 MB  8.2 MB/s
     data_sent......................: 3.6 MB  110 kB/s
     http_req_blocked...............: avg=5.04ms  min=1.61µs  med=3.63µs   max=129.38ms p(90)=103.21µs p(95)=51.27ms 
     http_req_connecting............: avg=4.93ms  min=0s      med=0s       max=129.34ms p(90)=0s       p(95)=49.89ms 
     http_req_duration..............: avg=2.99s   min=15.81ms med=2.72s    max=6.99s    p(90)=4.59s    p(95)=5.08s   
       { expected_response:true }...: avg=2.99s   min=15.81ms med=2.72s    max=6.99s    p(90)=4.59s    p(95)=5.08s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3068 
     http_req_receiving.............: avg=58.88ms min=39.22µs med=103.46µs max=1.48s    p(90)=14.31ms  p(95)=503.34ms
     http_req_sending...............: avg=2.79ms  min=9.16µs  med=18.2µs   max=225.66ms p(90)=1.58ms   p(95)=15.67ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.93s   min=15.73ms med=2.67s    max=6.99s    p(90)=4.54s    p(95)=5.07s   
     http_reqs......................: 3068    92.974156/s
     iteration_duration.............: avg=3.09s   min=173.9ms med=2.8s     max=7.08s    p(90)=4.73s    p(95)=5.12s   
     iterations.....................: 3048    92.368066/s
     vus............................: 2       min=2       max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8550      ✗ 0    
     data_received..................: 252 MB  7.6 MB/s
     data_sent......................: 3.4 MB  103 kB/s
     http_req_blocked...............: avg=565.41µs min=1.53µs   med=3.69µs   max=24.48ms p(90)=152.47µs p(95)=6.32ms  
     http_req_connecting............: avg=541.33µs min=0s       med=0s       max=13.84ms p(90)=114.05µs p(95)=5.97ms  
     http_req_duration..............: avg=3.26s    min=10.18ms  med=1.35s    max=32.69s  p(90)=2.1s     p(95)=27.59s  
       { expected_response:true }...: avg=3.26s    min=10.18ms  med=1.35s    max=32.69s  p(90)=2.1s     p(95)=27.59s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2870 
     http_req_receiving.............: avg=184.19µs min=45.88µs  med=110.25µs max=50ms    p(90)=192.47µs p(95)=298.71µs
     http_req_sending...............: avg=304.89µs min=8.85µs   med=19.54µs  max=24.06ms p(90)=126.5µs  p(95)=803.39µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.26s    min=10.09ms  med=1.35s    max=32.68s  p(90)=2.1s     p(95)=27.59s  
     http_reqs......................: 2870    86.772389/s
     iteration_duration.............: avg=3.3s     min=241.72ms med=1.38s    max=32.69s  p(90)=2.14s    p(95)=28.07s  
     iterations.....................: 2850    86.167704/s
     vus............................: 13      min=13      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8604      ✗ 0    
     data_received..................: 254 MB  7.5 MB/s
     data_sent......................: 3.4 MB  101 kB/s
     http_req_blocked...............: avg=911.9µs  min=1.72µs  med=3.49µs  max=25.51ms p(90)=162.33µs p(95)=8.99ms  
     http_req_connecting............: avg=875.48µs min=0s      med=0s      max=24.74ms p(90)=95.48µs  p(95)=7.79ms  
     http_req_duration..............: avg=3.27s    min=13.11ms med=1.79s   max=33.22s  p(90)=3.03s    p(95)=16.82s  
       { expected_response:true }...: avg=3.27s    min=13.11ms med=1.79s   max=33.22s  p(90)=3.03s    p(95)=16.82s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2888 
     http_req_receiving.............: avg=858.66µs min=40.61µs med=97.11µs max=244.6ms p(90)=384.21µs p(95)=1.03ms  
     http_req_sending...............: avg=158.32µs min=9.24µs  med=19.62µs max=50.4ms  p(90)=122.66µs p(95)=308.68µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.27s    min=12.97ms med=1.79s   max=33.22s  p(90)=3.03s    p(95)=16.82s  
     http_reqs......................: 2888    85.357281/s
     iteration_duration.............: avg=3.32s    min=181.3ms med=1.81s   max=33.23s  p(90)=3.07s    p(95)=17.04s  
     iterations.....................: 2868    84.766164/s
     vus............................: 91      min=91      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7209      ✗ 0    
     data_received..................: 213 MB  6.7 MB/s
     data_sent......................: 2.9 MB  90 kB/s
     http_req_blocked...............: avg=940.58µs min=1.59µs   med=3.52µs  max=21.59ms  p(90)=1.47ms   p(95)=8.59ms  
     http_req_connecting............: avg=906.43µs min=0s       med=0s      max=17.55ms  p(90)=1.16ms   p(95)=8.39ms  
     http_req_duration..............: avg=3.79s    min=10.9ms   med=3.81s   max=7.39s    p(90)=4.59s    p(95)=4.93s   
       { expected_response:true }...: avg=3.79s    min=10.9ms   med=3.81s   max=7.39s    p(90)=4.59s    p(95)=4.93s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2423 
     http_req_receiving.............: avg=3.27ms   min=36.5µs   med=94.84µs max=541.21ms p(90)=290.58µs p(95)=806.51µs
     http_req_sending...............: avg=149.79µs min=8.98µs   med=19.34µs max=10.18ms  p(90)=202.46µs p(95)=791.7µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.79s    min=10.81ms  med=3.81s   max=7.39s    p(90)=4.59s    p(95)=4.93s   
     http_reqs......................: 2423    75.763902/s
     iteration_duration.............: avg=3.85s    min=411.98ms med=3.84s   max=7.4s     p(90)=4.6s     p(95)=4.95s   
     iterations.....................: 2403    75.138529/s
     vus............................: 3       min=3       max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 185 5754 total, 0 failed avg: 746ms, p95: 2107ms
grafbase 171 5293 total, 0 failed avg: 851ms, p95: 2354ms
apollo-router 155 4821 total, 0 failed avg: 1047ms, p95: 2568ms ❌ 2 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway-bun 92 3004 total, 0 failed avg: 3046ms, p95: 5071ms
apollo-server 84 2813 total, 0 failed avg: 3354ms, p95: 28496ms
hive-gateway 84 2830 total, 0 failed avg: 3306ms, p95: 16907ms
mercurius 75 2407 total, 0 failed avg: 3815ms, p95: 5716ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17202      ✗ 0    
     data_received..................: 505 MB  16 MB/s
     data_sent......................: 6.8 MB  221 kB/s
     http_req_blocked...............: avg=1.29ms   min=1.65µs  med=3.25µs   max=1.71s    p(90)=5.38µs   p(95)=347.86µs
     http_req_connecting............: avg=645.74µs min=0s      med=0s       max=653.67ms p(90)=0s       p(95)=161.24µs
     http_req_duration..............: avg=746.11ms min=3.69ms  med=544.1ms  max=4.79s    p(90)=1.68s    p(95)=2.1s    
       { expected_response:true }...: avg=746.11ms min=3.69ms  med=544.1ms  max=4.79s    p(90)=1.68s    p(95)=2.1s    
     http_req_failed................: 0.00%   ✓ 0          ✗ 5754 
     http_req_receiving.............: avg=309.79ms min=33.06µs med=90.01µs  max=4.05s    p(90)=1.06s    p(95)=1.63s   
     http_req_sending...............: avg=19.25ms  min=8.85µs  med=14.71µs  max=2.7s     p(90)=180.15µs p(95)=2.99ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=417.06ms min=3.45ms  med=346.01ms max=2.15s    p(90)=814.9ms  p(95)=953.06ms
     http_reqs......................: 5754    185.996616/s
     iteration_duration.............: avg=1.56s    min=23.83ms med=1.23s    max=8.76s    p(90)=3.52s    p(95)=4.21s   
     iterations.....................: 5734    185.350121/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15819      ✗ 0    
     data_received..................: 465 MB  15 MB/s
     data_sent......................: 6.3 MB  204 kB/s
     http_req_blocked...............: avg=548.23µs min=1.62µs  med=3.18µs   max=692.82ms p(90)=5.27µs   p(95)=1.83ms 
     http_req_connecting............: avg=482.94µs min=0s      med=0s       max=692.75ms p(90)=0s       p(95)=1.05ms 
     http_req_duration..............: avg=850.84ms min=3.02ms  med=643.82ms max=5.71s    p(90)=1.89s    p(95)=2.35s  
       { expected_response:true }...: avg=850.84ms min=3.02ms  med=643.82ms max=5.71s    p(90)=1.89s    p(95)=2.35s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5293 
     http_req_receiving.............: avg=338.23ms min=34.55µs med=86.82µs  max=4.79s    p(90)=1.25s    p(95)=1.73s  
     http_req_sending...............: avg=21.22ms  min=7.99µs  med=14.66µs  max=3.3s     p(90)=657.61µs p(95)=16.57ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=491.39ms min=2.95ms  med=417.73ms max=2.87s    p(90)=996.78ms p(95)=1.12s  
     http_reqs......................: 5293    171.697989/s
     iteration_duration.............: avg=1.71s    min=22.21ms med=1.36s    max=10.41s   p(90)=3.68s    p(95)=4.54s  
     iterations.....................: 5273    171.049215/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 4799 / ✗ 2
     ✗ valid response structure
      ↳  99% — ✓ 4800 / ✗ 1

     █ setup

     checks.........................: 99.97% ✓ 14400      ✗ 3    
     data_received..................: 423 MB 14 MB/s
     data_sent......................: 5.7 MB 184 kB/s
     http_req_blocked...............: avg=1.93ms   min=1.47µs  med=3.45µs   max=895.85ms p(90)=7.27µs   p(95)=5.29ms
     http_req_connecting............: avg=1.66ms   min=0s      med=0s       max=895.78ms p(90)=0s       p(95)=4.91ms
     http_req_duration..............: avg=1.04s    min=7.08ms  med=851.38ms max=5.1s     p(90)=2.11s    p(95)=2.56s 
       { expected_response:true }...: avg=1.04s    min=7.08ms  med=851.38ms max=5.1s     p(90)=2.11s    p(95)=2.56s 
     http_req_failed................: 0.00%  ✓ 0          ✗ 4821 
     http_req_receiving.............: avg=306.15ms min=36.18µs med=90.78µs  max=3.93s    p(90)=1.26s    p(95)=1.96s 
     http_req_sending...............: avg=17.65ms  min=8.29µs  med=15.23µs  max=2.33s    p(90)=208.92µs p(95)=5.89ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=722.7ms  min=6.98ms  med=689.93ms max=2.58s    p(90)=1.19s    p(95)=1.49s 
     http_reqs......................: 4821   155.269632/s
     iteration_duration.............: avg=1.89s    min=45.47ms med=1.67s    max=8.8s     p(90)=3.62s    p(95)=4.27s 
     iterations.....................: 4801   154.625494/s
     vus............................: 56     min=56       max=300
     vus_max........................: 300    min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8952      ✗ 0    
     data_received..................: 264 MB  8.1 MB/s
     data_sent......................: 3.6 MB  109 kB/s
     http_req_blocked...............: avg=866.01µs min=1.65µs   med=3.32µs   max=192.47ms p(90)=121.02µs p(95)=7.94ms  
     http_req_connecting............: avg=748.67µs min=0s       med=0s       max=18.24ms  p(90)=43.88µs  p(95)=7.67ms  
     http_req_duration..............: avg=3.04s    min=13.77ms  med=2.75s    max=7.7s     p(90)=4.72s    p(95)=5.07s   
       { expected_response:true }...: avg=3.04s    min=13.77ms  med=2.75s    max=7.7s     p(90)=4.72s    p(95)=5.07s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3004 
     http_req_receiving.............: avg=66.19ms  min=38.25µs  med=120.45µs max=2.04s    p(90)=51.96ms  p(95)=535.69ms
     http_req_sending...............: avg=763.53µs min=8.99µs   med=16.01µs  max=331.8ms  p(90)=197.24µs p(95)=1.91ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.97s    min=13.56ms  med=2.7s     max=7.61s    p(90)=4.64s    p(95)=5.04s   
     http_reqs......................: 3004    92.1321/s
     iteration_duration.............: avg=3.12s    min=241.95ms med=2.81s    max=7.72s    p(90)=4.85s    p(95)=5.17s   
     iterations.....................: 2984    91.518704/s
     vus............................: 105     min=105     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8379      ✗ 0    
     data_received..................: 247 MB  7.4 MB/s
     data_sent......................: 3.3 MB  100 kB/s
     http_req_blocked...............: avg=1.21ms   min=1.46µs   med=3.45µs   max=39.58ms  p(90)=1.96ms   p(95)=10.47ms
     http_req_connecting............: avg=1.19ms   min=0s       med=0s       max=39.54ms  p(90)=1.67ms   p(95)=10.42ms
     http_req_duration..............: avg=3.35s    min=10.4ms   med=1.41s    max=32.95s   p(90)=2.32s    p(95)=28.49s 
       { expected_response:true }...: avg=3.35s    min=10.4ms   med=1.41s    max=32.95s   p(90)=2.32s    p(95)=28.49s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2813 
     http_req_receiving.............: avg=344.63µs min=45.51µs  med=104.95µs max=111.57ms p(90)=199.88µs p(95)=311.9µs
     http_req_sending...............: avg=1.53ms   min=8.81µs   med=18.42µs  max=41.5ms   p(90)=273.43µs p(95)=12.52ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.35s    min=10.32ms  med=1.41s    max=32.95s   p(90)=2.32s    p(95)=28.44s 
     http_reqs......................: 2813    84.263983/s
     iteration_duration.............: avg=3.39s    min=241.52ms med=1.43s    max=32.96s   p(90)=2.36s    p(95)=28.96s 
     iterations.....................: 2793    83.664879/s
     vus............................: 41      min=41      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8430      ✗ 0    
     data_received..................: 249 MB  7.4 MB/s
     data_sent......................: 3.4 MB  100 kB/s
     http_req_blocked...............: avg=2.13ms min=1.81µs   med=3.55µs  max=89.49ms  p(90)=1.91ms   p(95)=19.1ms 
     http_req_connecting............: avg=2.01ms min=0s       med=0s      max=64.18ms  p(90)=1.4ms    p(95)=17.57ms
     http_req_duration..............: avg=3.3s   min=13.56ms  med=1.84s   max=32.92s   p(90)=3.2s     p(95)=16.9s  
       { expected_response:true }...: avg=3.3s   min=13.56ms  med=1.84s   max=32.92s   p(90)=3.2s     p(95)=16.9s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2830 
     http_req_receiving.............: avg=1.05ms min=42.28µs  med=99.56µs max=310.12ms p(90)=494.59µs p(95)=1.35ms 
     http_req_sending...............: avg=1.45ms min=9.26µs   med=19.88µs max=56.16ms  p(90)=372.75µs p(95)=9.88ms 
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.3s   min=13.43ms  med=1.84s   max=32.92s   p(90)=3.19s    p(95)=16.87s 
     http_reqs......................: 2830    84.462767/s
     iteration_duration.............: avg=3.35s  min=361.73ms med=1.87s   max=32.93s   p(90)=3.25s    p(95)=17.38s 
     iterations.....................: 2810    83.865857/s
     vus............................: 43      min=43      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7161      ✗ 0    
     data_received..................: 211 MB  6.6 MB/s
     data_sent......................: 2.9 MB  89 kB/s
     http_req_blocked...............: avg=1.04ms   min=1.68µs   med=3.84µs  max=21.09ms  p(90)=4.23ms   p(95)=10.2ms  
     http_req_connecting............: avg=1ms      min=0s       med=0s      max=17.52ms  p(90)=4.12ms   p(95)=10.08ms 
     http_req_duration..............: avg=3.81s    min=11.89ms  med=3.83s   max=8.12s    p(90)=4.72s    p(95)=5.71s   
       { expected_response:true }...: avg=3.81s    min=11.89ms  med=3.83s   max=8.12s    p(90)=4.72s    p(95)=5.71s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2407 
     http_req_receiving.............: avg=3.36ms   min=38.2µs   med=99.48µs max=499.07ms p(90)=288.53µs p(95)=865.57µs
     http_req_sending...............: avg=175.64µs min=8.18µs   med=21.6µs  max=10.96ms  p(90)=238.89µs p(95)=843.37µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.81s    min=11.78ms  med=3.83s   max=8.12s    p(90)=4.72s    p(95)=5.71s   
     http_reqs......................: 2407    75.17708/s
     iteration_duration.............: avg=3.87s    min=451.89ms med=3.85s   max=8.12s    p(90)=4.74s    p(95)=5.79s   
     iterations.....................: 2387    74.552426/s
     vus............................: 28      min=28      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 183 5760 total, 0 failed avg: 1253ms, p95: 3301ms
grafbase 168 5277 total, 0 failed avg: 1375ms, p95: 3530ms
apollo-router 154 4879 total, 6 failed avg: 1669ms, p95: 4599ms ❌ 6 failed requests, 6 non-200 responses, 15 unexpected GraphQL errors, non-compatible response structure (8)
hive-gateway-bun 89 3059 total, 0 failed avg: 5107ms, p95: 8403ms
hive-gateway 84 3008 total, 0 failed avg: 5360ms, p95: 33199ms
mercurius 74 2431 total, 0 failed avg: 6411ms, p95: 10648ms
apollo-server 67 2483 total, 0 failed avg: 6662ms, p95: 34675ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17220      ✗ 0    
     data_received..................: 506 MB  16 MB/s
     data_sent......................: 6.8 MB  218 kB/s
     http_req_blocked...............: avg=2.93ms   min=1.52µs  med=3.25µs   max=1.32s  p(90)=16.64µs  p(95)=14.34ms
     http_req_connecting............: avg=2.57ms   min=0s      med=0s       max=1.32s  p(90)=0s       p(95)=13.72ms
     http_req_duration..............: avg=1.25s    min=3.25ms  med=1s       max=6.83s  p(90)=2.53s    p(95)=3.3s   
       { expected_response:true }...: avg=1.25s    min=3.25ms  med=1s       max=6.83s  p(90)=2.53s    p(95)=3.3s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5760 
     http_req_receiving.............: avg=436.84ms min=32.36µs med=94.66µs  max=6.73s  p(90)=1.75s    p(95)=2.43s  
     http_req_sending...............: avg=28.18ms  min=7.76µs  med=14.99µs  max=4.31s  p(90)=460.86µs p(95)=5.59ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=788.2ms  min=3.11ms  med=794.67ms max=3.25s  p(90)=1.33s    p(95)=1.49s  
     http_reqs......................: 5760    183.805172/s
     iteration_duration.............: avg=2.63s    min=30.41ms med=2.16s    max=13.87s p(90)=5.38s    p(95)=6.38s  
     iterations.....................: 5740    183.166959/s
     vus............................: 212     min=212      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15771      ✗ 0    
     data_received..................: 464 MB  15 MB/s
     data_sent......................: 6.3 MB  200 kB/s
     http_req_blocked...............: avg=5ms      min=1.56µs  med=3.54µs   max=3.84s  p(90)=29.28µs p(95)=28.42ms
     http_req_connecting............: avg=4.47ms   min=0s      med=0s       max=2.08s  p(90)=0s      p(95)=27.67ms
     http_req_duration..............: avg=1.37s    min=3.51ms  med=1.17s    max=5.51s  p(90)=2.72s   p(95)=3.52s  
       { expected_response:true }...: avg=1.37s    min=3.51ms  med=1.17s    max=5.51s  p(90)=2.72s   p(95)=3.52s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5277 
     http_req_receiving.............: avg=334.71ms min=31.94µs med=85.6µs   max=4.43s  p(90)=1.61s   p(95)=2.04s  
     http_req_sending...............: avg=28.48ms  min=8.52µs  med=16.15µs  max=3.55s  p(90)=1.71ms  p(95)=11.43ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=1.01s    min=3.45ms  med=909.17ms max=3.49s  p(90)=1.85s   p(95)=2.43s  
     http_reqs......................: 5277    168.785723/s
     iteration_duration.............: avg=2.88s    min=27.67ms med=2.5s     max=14.63s p(90)=5.55s   p(95)=6.5s   
     iterations.....................: 5257    168.14602/s
     vus............................: 186     min=186      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4853 / ✗ 6
     ✗ no graphql errors
      ↳  99% — ✓ 4844 / ✗ 15
     ✗ valid response structure
      ↳  99% — ✓ 4845 / ✗ 8

     █ setup

     checks.........................: 99.80% ✓ 14542      ✗ 29   
     data_received..................: 428 MB 14 MB/s
     data_sent......................: 5.8 MB 183 kB/s
     http_req_blocked...............: avg=8.49ms   min=1.47µs med=3.49µs   max=4.39s  p(90)=427.97µs p(95)=16.05ms
     http_req_connecting............: avg=5.9ms    min=0s     med=0s       max=3.42s  p(90)=242.64µs p(95)=15.44ms
     http_req_duration..............: avg=1.66s    min=6.78ms med=1.31s    max=8.95s  p(90)=3.77s    p(95)=4.59s  
       { expected_response:true }...: avg=1.66s    min=6.78ms med=1.31s    max=8.95s  p(90)=3.76s    p(95)=4.59s  
     http_req_failed................: 0.12%  ✓ 6          ✗ 4873 
     http_req_receiving.............: avg=655.07ms min=0s     med=95.88µs  max=8.22s  p(90)=2.83s    p(95)=3.48s  
     http_req_sending...............: avg=25.38ms  min=7.88µs med=16.51µs  max=4.1s   p(90)=1.16ms   p(95)=2.94ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=988.61ms min=6.7ms  med=899.35ms max=7.61s  p(90)=1.84s    p(95)=1.98s  
     http_reqs......................: 4879   154.311204/s
     iteration_duration.............: avg=3.15s    min=39.3ms med=2.74s    max=13.71s p(90)=6.31s    p(95)=7.56s  
     iterations.....................: 4859   153.678652/s
     vus............................: 253    min=253      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9117      ✗ 0    
     data_received..................: 269 MB  7.8 MB/s
     data_sent......................: 3.6 MB  106 kB/s
     http_req_blocked...............: avg=2.75ms  min=1.95µs   med=4.1µs    max=134.3ms  p(90)=12.59ms  p(95)=24.85ms 
     http_req_connecting............: avg=2.66ms  min=0s       med=0s       max=37.4ms   p(90)=11.78ms  p(95)=24.6ms  
     http_req_duration..............: avg=5.1s    min=13.31ms  med=4.89s    max=10.79s   p(90)=6.96s    p(95)=8.4s    
       { expected_response:true }...: avg=5.1s    min=13.31ms  med=4.89s    max=10.79s   p(90)=6.96s    p(95)=8.4s    
     http_req_failed................: 0.00%   ✓ 0         ✗ 3059 
     http_req_receiving.............: avg=61.96ms min=36.79µs  med=142.28µs max=3.69s    p(90)=10.13ms  p(95)=300.41ms
     http_req_sending...............: avg=1.78ms  min=9.76µs   med=22.19µs  max=864.34ms p(90)=730.01µs p(95)=3.67ms  
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.04s   min=13.19ms  med=4.85s    max=10.79s   p(90)=6.74s    p(95)=8.4s    
     http_reqs......................: 3059    89.023106/s
     iteration_duration.............: avg=5.26s   min=191.94ms med=4.98s    max=10.93s   p(90)=7.42s    p(95)=8.42s   
     iterations.....................: 3039    88.441066/s
     vus............................: 78      min=78      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8964      ✗ 0    
     data_received..................: 264 MB  7.4 MB/s
     data_sent......................: 3.6 MB  101 kB/s
     http_req_blocked...............: avg=3.44ms   min=1.88µs   med=3.9µs   max=49.74ms  p(90)=15.29ms  p(95)=30.97ms
     http_req_connecting............: avg=3.37ms   min=0s       med=0s      max=37.73ms  p(90)=15.04ms  p(95)=30.56ms
     http_req_duration..............: avg=5.35s    min=13.87ms  med=2.33s   max=34.92s   p(90)=16.11s   p(95)=33.19s 
       { expected_response:true }...: avg=5.35s    min=13.87ms  med=2.33s   max=34.92s   p(90)=16.11s   p(95)=33.19s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 3008 
     http_req_receiving.............: avg=1.02ms   min=40.72µs  med=91.95µs max=250.45ms p(90)=974.57µs p(95)=2.87ms 
     http_req_sending...............: avg=558.19µs min=9.01µs   med=20.97µs max=56.34ms  p(90)=1.43ms   p(95)=3.24ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=5.35s    min=13.73ms  med=2.33s   max=34.92s   p(90)=16.11s   p(95)=33.19s 
     http_reqs......................: 3008    84.80196/s
     iteration_duration.............: avg=5.43s    min=222.46ms med=2.37s   max=34.93s   p(90)=16.34s   p(95)=33.24s 
     iterations.....................: 2988    84.238118/s
     vus............................: 53      min=53      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7233      ✗ 0    
     data_received..................: 213 MB  6.5 MB/s
     data_sent......................: 2.9 MB  88 kB/s
     http_req_blocked...............: avg=4.16ms   min=1.6µs    med=3.77µs  max=43.13ms  p(90)=21.38ms  p(95)=27.02ms 
     http_req_connecting............: avg=4.09ms   min=0s       med=0s      max=43.1ms   p(90)=21.09ms  p(95)=26.61ms 
     http_req_duration..............: avg=6.41s    min=10.7ms   med=6.57s   max=12.46s   p(90)=8.05s    p(95)=10.64s  
       { expected_response:true }...: avg=6.41s    min=10.7ms   med=6.57s   max=12.46s   p(90)=8.05s    p(95)=10.64s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2431 
     http_req_receiving.............: avg=39.55ms  min=37.16µs  med=99.62µs max=959.94ms p(90)=778.35µs p(95)=321.46ms
     http_req_sending...............: avg=426.87µs min=8.63µs   med=21.71µs max=21.63ms  p(90)=2.19ms   p(95)=2.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=6.37s    min=10.64ms  med=6.56s   max=12.46s   p(90)=8.05s    p(95)=10.64s  
     http_reqs......................: 2431    74.103535/s
     iteration_duration.............: avg=6.51s    min=404.31ms med=6.61s   max=12.48s   p(90)=8.06s    p(95)=10.69s  
     iterations.....................: 2411    73.49388/s
     vus............................: 276     min=276     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7389      ✗ 0    
     data_received..................: 218 MB  5.9 MB/s
     data_sent......................: 2.9 MB  80 kB/s
     http_req_blocked...............: avg=4.41ms   min=1.66µs   med=4.65µs   max=50.86ms p(90)=24.21ms  p(95)=31.19ms 
     http_req_connecting............: avg=4.32ms   min=0s       med=0s       max=49.11ms p(90)=23.9ms   p(95)=30.91ms 
     http_req_duration..............: avg=6.66s    min=12.96ms  med=2.66s    max=36.19s  p(90)=33.03s   p(95)=34.67s  
       { expected_response:true }...: avg=6.66s    min=12.96ms  med=2.66s    max=36.19s  p(90)=33.03s   p(95)=34.67s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2483 
     http_req_receiving.............: avg=473.42µs min=57.66µs  med=138.56µs max=79.22ms p(90)=284.99µs p(95)=568.51µs
     http_req_sending...............: avg=808.34µs min=10.57µs  med=25.11µs  max=93.51ms p(90)=1.91ms   p(95)=4.46ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=6.66s    min=12.75ms  med=2.66s    max=36.19s  p(90)=33.03s   p(95)=34.67s  
     http_reqs......................: 2483    67.643947/s
     iteration_duration.............: avg=6.73s    min=433.69ms med=2.69s    max=36.2s   p(90)=33.07s   p(95)=34.73s  
     iterations.....................: 2463    67.09909/s
     vus............................: 61      min=61      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 5598ms 179 12590 total, 0 failed avg: 2544ms, p95: 5599ms, max: 16512ms, med: 2067ms
apollo-router 5756ms 162 11395 total, 582 failed avg: 2470ms, p95: 5756ms, max: 13002ms, med: 2035ms ❌ 582 failed requests, 582 non-200 responses, 614 unexpected GraphQL errors, non-compatible response structure (14)
grafbase 6292ms 170 11923 total, 0 failed avg: 2365ms, p95: 6292ms, max: 10806ms, med: 1837ms
hive-gateway-bun 28388ms 93 7512 total, 0 failed avg: 11348ms, p95: 28388ms, max: 35346ms, med: 9899ms
mercurius 42649ms 54 4993 total, 0 failed avg: 21340ms, p95: 42649ms, max: 43359ms, med: 18982ms
hive-gateway 51215ms 89 7797 total, 0 failed avg: 11856ms, p95: 51215ms, max: 57818ms, med: 3369ms
apollo-server 60000ms 78 7317 total, 552 failed avg: 12602ms, p95: 60000ms, max: 60025ms, med: 2300ms ❌ 552 failed requests, 552 non-200 responses, 552 unexpected GraphQL errors
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 37710      ✗ 0     
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   213 kB/s
     http_req_blocked...............: avg=359.81ms min=1.53µs  med=3.76µs  max=10.15s p(90)=1.12s    p(95)=3.32s   
     http_req_connecting............: avg=353.3ms  min=0s      med=0s      max=10.15s p(90)=1.12s    p(95)=3.24s   
     http_req_duration..............: avg=2.54s    min=3.38ms  med=2.06s   max=16.51s p(90)=5.01s    p(95)=5.59s   
       { expected_response:true }...: avg=2.54s    min=3.38ms  med=2.06s   max=16.51s p(90)=5.01s    p(95)=5.59s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12590 
     http_req_receiving.............: avg=242.3ms  min=27.99µs med=80.21µs max=9.78s  p(90)=740.93ms p(95)=2.64s   
     http_req_sending...............: avg=117.93ms min=8.33µs  med=18.44µs max=6.75s  p(90)=260.33ms p(95)=746.88ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.18s    min=3.29ms  med=1.62s   max=10.12s p(90)=4.71s    p(95)=5.15s   
     http_reqs......................: 12590   179.554262/s
     iteration_duration.............: avg=5.58s    min=9.01ms  med=4.74s   max=26.47s p(90)=11.6s    p(95)=13.65s  
     iterations.....................: 12570   179.269028/s
     vus............................: 5       min=5        max=2000
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  94% — ✓ 10793 / ✗ 582
     ✗ no graphql errors
      ↳  94% — ✓ 10761 / ✗ 614
     ✗ valid response structure
      ↳  99% — ✓ 10779 / ✗ 14

     █ setup

     checks.........................: 96.39% ✓ 32333      ✗ 1210  
     data_received..................: 949 MB 14 MB/s
     data_sent......................: 14 MB  193 kB/s
     http_req_blocked...............: avg=438.6ms  min=1.66µs  med=4.26µs  max=9.02s  p(90)=1.94s    p(95)=3.39s   
     http_req_connecting............: avg=433.85ms min=0s      med=0s      max=9.02s  p(90)=1.93s    p(95)=3.38s   
     http_req_duration..............: avg=2.47s    min=7.3ms   med=2.03s   max=13s    p(90)=4.97s    p(95)=5.75s   
       { expected_response:true }...: avg=2.47s    min=7.3ms   med=2.02s   max=13s    p(90)=5s       p(95)=5.83s   
     http_req_failed................: 5.10%  ✓ 582        ✗ 10813 
     http_req_receiving.............: avg=397.59ms min=0s      med=93.2µs  max=9.58s  p(90)=1.29s    p(95)=2.62s   
     http_req_sending...............: avg=171.35ms min=7.81µs  med=22.96µs max=7.93s  p(90)=370.78ms p(95)=954.62ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.9s     min=7.23ms  med=1.53s   max=8.53s  p(90)=4.44s    p(95)=4.93s   
     http_reqs......................: 11395  162.357491/s
     iteration_duration.............: avg=6.07s    min=13.69ms med=5.34s   max=25.26s p(90)=12.56s   p(95)=14.25s  
     iterations.....................: 11375  162.072528/s
     vus............................: 6      min=6        max=1996
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 35709      ✗ 0     
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   202 kB/s
     http_req_blocked...............: avg=267.57ms min=1.41µs  med=3.51µs  max=9.58s  p(90)=964.95ms p(95)=2s      
     http_req_connecting............: avg=264.9ms  min=0s      med=0s      max=9.17s  p(90)=953.75ms p(95)=1.99s   
     http_req_duration..............: avg=2.36s    min=2.98ms  med=1.83s   max=10.8s  p(90)=5.26s    p(95)=6.29s   
       { expected_response:true }...: avg=2.36s    min=2.98ms  med=1.83s   max=10.8s  p(90)=5.26s    p(95)=6.29s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11923 
     http_req_receiving.............: avg=340.62ms min=32.29µs med=75.37µs max=9.23s  p(90)=640.35ms p(95)=1.74s   
     http_req_sending...............: avg=112.2ms  min=7.52µs  med=15.86µs max=9s     p(90)=295.85ms p(95)=728.88ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.91s    min=2.93ms  med=1.42s   max=10.28s p(90)=4.52s    p(95)=5.32s   
     http_reqs......................: 11923   170.121858/s
     iteration_duration.............: avg=5.69s    min=12.35ms med=4.75s   max=26.47s p(90)=11.91s   p(95)=13.71s  
     iterations.....................: 11903   169.83649/s
     vus............................: 11      min=11       max=1989
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 22476    ✗ 0     
     data_received..................: 659 MB  8.2 MB/s
     data_sent......................: 8.9 MB  111 kB/s
     http_req_blocked...............: avg=9.12ms   min=1.78µs  med=4.22µs   max=846.23ms p(90)=4.45ms   p(95)=44.34ms 
     http_req_connecting............: avg=8.79ms   min=0s      med=0s       max=758.93ms p(90)=4.03ms   p(95)=43.03ms 
     http_req_duration..............: avg=11.34s   min=13.93ms med=9.89s    max=35.34s   p(90)=24.31s   p(95)=28.38s  
       { expected_response:true }...: avg=11.34s   min=13.93ms med=9.89s    max=35.34s   p(90)=24.31s   p(95)=28.38s  
     http_req_failed................: 0.00%   ✓ 0        ✗ 7512  
     http_req_receiving.............: avg=116.49ms min=39.5µs  med=138.52µs max=7.97s    p(90)=6.08ms   p(95)=339.87ms
     http_req_sending...............: avg=6.83ms   min=9.23µs  med=25.28µs  max=998.44ms p(90)=795.57µs p(95)=20.67ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.22s   min=13.67ms med=9.79s    max=35.34s   p(90)=24.24s   p(95)=28.33s  
     http_reqs......................: 7512    93.25017/s
     iteration_duration.............: avg=11.53s   min=51.25ms med=9.98s    max=35.92s   p(90)=24.47s   p(95)=29.12s  
     iterations.....................: 7492    93.0019/s
     vus............................: 236     min=58     max=2000
     vus_max........................: 2000    min=2000   max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14900     ✗ 0     
     data_received..................: 438 MB  4.8 MB/s
     data_sent......................: 6.1 MB  66 kB/s
     http_req_blocked...............: avg=195.21µs min=1.69µs   med=3.83µs  max=20.66ms  p(90)=449.97µs p(95)=601.17µs
     http_req_connecting............: avg=165.4µs  min=0s       med=0s      max=20.59ms  p(90)=383.42µs p(95)=519.97µs
     http_req_duration..............: avg=21.34s   min=12.54ms  med=18.98s  max=43.35s   p(90)=41.15s   p(95)=42.64s  
       { expected_response:true }...: avg=21.34s   min=12.54ms  med=18.98s  max=43.35s   p(90)=41.15s   p(95)=42.64s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 4993  
     http_req_receiving.............: avg=16.74ms  min=35.97µs  med=97.29µs max=998.05ms p(90)=451.17µs p(95)=2.13ms  
     http_req_sending...............: avg=56.82µs  min=8.76µs   med=24.09µs max=16.07ms  p(90)=59.89µs  p(95)=78.36µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=21.32s   min=12.41ms  med=18.98s  max=43.35s   p(90)=41.14s   p(95)=42.64s  
     http_reqs......................: 4993    54.326024/s
     iteration_duration.............: avg=21.44s   min=149.53ms med=18.99s  max=43.39s   p(90)=41.43s   p(95)=42.68s  
     iterations.....................: 4954    53.901687/s
     vus............................: 92      min=60      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 23331     ✗ 0     
     data_received..................: 685 MB  7.8 MB/s
     data_sent......................: 9.3 MB  106 kB/s
     http_req_blocked...............: avg=2ms      min=2.08µs  med=4.49µs  max=139.18ms p(90)=648.38µs p(95)=7.04ms
     http_req_connecting............: avg=1.96ms   min=0s      med=0s      max=139.11ms p(90)=529.35µs p(95)=6.55ms
     http_req_duration..............: avg=11.85s   min=14.01ms med=3.36s   max=57.81s   p(90)=43.88s   p(95)=51.21s
       { expected_response:true }...: avg=11.85s   min=14.01ms med=3.36s   max=57.81s   p(90)=43.88s   p(95)=51.21s
     http_req_failed................: 0.00%   ✓ 0         ✗ 7797  
     http_req_receiving.............: avg=916.13µs min=41.52µs med=109.5µs max=748.26ms p(90)=772.79µs p(95)=2.46ms
     http_req_sending...............: avg=934.15µs min=9.33µs  med=27.09µs max=148.53ms p(90)=124.08µs p(95)=1.1ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=11.85s   min=13.89ms med=3.36s   max=57.81s   p(90)=43.88s   p(95)=51.21s
     http_reqs......................: 7797    89.379948/s
     iteration_duration.............: avg=11.92s   min=117.6ms med=3.41s   max=57.83s   p(90)=43.95s   p(95)=51.25s
     iterations.....................: 7777    89.15068/s
     vus............................: 73      min=54      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  92% — ✓ 6745 / ✗ 552
     ✗ no graphql errors
      ↳  92% — ✓ 6745 / ✗ 552
     ✓ valid response structure

     █ setup

     checks.........................: 94.82% ✓ 20235     ✗ 1104  
     data_received..................: 595 MB 6.4 MB/s
     data_sent......................: 8.8 MB 95 kB/s
     http_req_blocked...............: avg=474µs    min=2.05µs  med=4.99µs   max=99.78ms  p(90)=386.96µs p(95)=660.48µs
     http_req_connecting............: avg=446.19µs min=0s      med=0s       max=99.59ms  p(90)=308.87µs p(95)=560.63µs
     http_req_duration..............: avg=12.6s    min=11.92ms med=2.3s     max=1m0s     p(90)=57.03s   p(95)=1m0s    
       { expected_response:true }...: avg=8.73s    min=11.92ms med=2.22s    max=59.99s   p(90)=37.34s   p(95)=45.25s  
     http_req_failed................: 7.54%  ✓ 552       ✗ 6765  
     http_req_receiving.............: avg=290.44µs min=0s      med=118.52µs max=195.67ms p(90)=228.31µs p(95)=355.93µs
     http_req_sending...............: avg=179.03µs min=9.74µs  med=28.74µs  max=60.93ms  p(90)=70.51µs  p(95)=117.74µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=12.6s    min=11.79ms med=2.3s     max=1m0s     p(90)=57.03s   p(95)=59.99s  
     http_reqs......................: 7317   78.898949/s
     iteration_duration.............: avg=12.64s   min=65.43ms med=2.31s    max=1m0s     p(90)=57.07s   p(95)=1m0s    
     iterations.....................: 7297   78.68329/s
     vus............................: 103    min=60      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 3edae4a into main May 14, 2025
34 checks passed
@ardatan ardatan deleted the renovate/node-22.x branch May 14, 2025 12:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant