Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Jul 2, 2025

This PR contains the following updates:

Package Type Update Change
tokio (source) dependencies minor 1.45.1 -> 1.46.1

Release Notes

tokio-rs/tokio (tokio)

v1.46.1: Tokio v1.46.1

Compare Source

1.46.1 (July 4th, 2025)

This release fixes incorrect spawn locations in runtime task hooks for tasks
spawned using tokio::spawn rather than Runtime::spawn. This issue only
effected the spawn location in TaskMeta::spawned_at, and did not effect task
locations in Tracing events.

Unstable

  • runtime: add TaskMeta::spawn_location tracking where a task was spawned
    (#​7440)

v1.46.0: Tokio v1.46.0

Compare Source

1.46.0 (July 2nd, 2025)

Fixed
  • net: fixed TcpStream::shutdown incorrectly returning an error on macOS (#​7290)

Added

  • sync: mpsc::OwnedPermit::{same_channel, same_channel_as_sender} methods (#​7389)
  • macros: biased option for join! and try_join!, similar to select! (#​7307)
  • net: support for cygwin (#​7393)
  • net: support pope::OpenOptions::read_write on Android (#​7426)
  • net: add Clone implementation for net::unix::SocketAddr (#​7422)

Changed

  • runtime: eliminate unnecessary lfence while operating on queue::Local<T> (#​7340)
  • task: disallow blocking in LocalSet::{poll,drop} (#​7372)

Unstable

  • runtime: add TaskMeta::spawn_location tracking where a task was spawned (#​7417)
  • runtime: removed borrow from LocalOptions parameter to runtime::Builder::build_local (#​7346)

Documented

  • io: clarify behavior of seeking when start_seek is not used (#​7366)
  • io: document cancellation safety of AsyncWriteExt::flush (#​7364)
  • net: fix docs for recv_buffer_size method (#​7336)
  • net: fix broken link of RawFd in TcpSocket docs (#​7416)
  • net: update AsRawFd doc link to current Rust stdlib location (#​7429)
  • readme: fix double period in reactor description (#​7363)
  • runtime: add doc note that on_*_task_poll is unstable (#​7311)
  • sync: update broadcast docs on allocation failure (#​7352)
  • time: add a missing panic scenario of time::advance (#​7394)

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Jul 2, 2025
Copy link

github-actions bot commented Jul 2, 2025

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 182 5653 total, 0 failed avg: 836ms, p95: 2594ms
grafbase 170 5251 total, 0 failed avg: 834ms, p95: 2324ms
apollo-router 156 4878 total, 0 failed avg: 933ms, p95: 2612ms
hive-gateway-bun 91 3024 total, 0 failed avg: 3053ms, p95: 5194ms
apollo-server 87 2908 total, 0 failed avg: 3224ms, p95: 21398ms
hive-gateway 85 2845 total, 0 failed avg: 3287ms, p95: 17228ms
mercurius 78 2505 total, 0 failed avg: 3672ms, p95: 5632ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16899      ✗ 0    
     data_received..................: 496 MB  16 MB/s
     data_sent......................: 6.7 MB  217 kB/s
     http_req_blocked...............: avg=1.3ms    min=1.36µs  med=3.11µs   max=1.63s  p(90)=5.21µs   p(95)=479.7µs 
     http_req_connecting............: avg=842.63µs min=0s      med=0s       max=1.63s  p(90)=0s       p(95)=238.18µs
     http_req_duration..............: avg=835.64ms min=3.42ms  med=589ms    max=6.31s  p(90)=2.01s    p(95)=2.59s   
       { expected_response:true }...: avg=835.64ms min=3.42ms  med=589ms    max=6.31s  p(90)=2.01s    p(95)=2.59s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5653 
     http_req_receiving.............: avg=361.06ms min=34.48µs med=87.31µs  max=5.15s  p(90)=1.57s    p(95)=1.9s    
     http_req_sending...............: avg=27.25ms  min=8.6µs   med=14.12µs  max=2.95s  p(90)=173.19µs p(95)=8.43ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=447.32ms min=3.3ms   med=411.72ms max=2.09s  p(90)=865.69ms p(95)=1.05s   
     http_reqs......................: 5653    182.955365/s
     iteration_duration.............: avg=1.61s    min=21.11ms med=1.23s    max=10.87s p(90)=3.53s    p(95)=4.42s   
     iterations.....................: 5633    182.308079/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15693      ✗ 0    
     data_received..................: 461 MB  15 MB/s
     data_sent......................: 6.2 MB  203 kB/s
     http_req_blocked...............: avg=1.32ms   min=1.42µs  med=3.26µs   max=1.09s p(90)=5.38µs   p(95)=393.12µs
     http_req_connecting............: avg=1.14ms   min=0s      med=0s       max=1.09s p(90)=0s       p(95)=211.52µs
     http_req_duration..............: avg=834.47ms min=3.02ms  med=652.32ms max=5.79s p(90)=1.89s    p(95)=2.32s   
       { expected_response:true }...: avg=834.47ms min=3.02ms  med=652.32ms max=5.79s p(90)=1.89s    p(95)=2.32s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5251 
     http_req_receiving.............: avg=334.5ms  min=36.55µs med=90.1µs   max=5.29s p(90)=1.18s    p(95)=1.81s   
     http_req_sending...............: avg=20.98ms  min=8.06µs  med=14.9µs   max=3.8s  p(90)=237.1µs  p(95)=9.68ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=478.98ms min=2.96ms  med=407.6ms  max=2.23s p(90)=967.28ms p(95)=1.15s   
     http_reqs......................: 5251    170.599019/s
     iteration_duration.............: avg=1.72s    min=20.98ms med=1.42s    max=9.98s p(90)=3.62s    p(95)=4.45s   
     iterations.....................: 5231    169.949242/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14574      ✗ 0    
     data_received..................: 428 MB  14 MB/s
     data_sent......................: 5.8 MB  186 kB/s
     http_req_blocked...............: avg=1.68ms   min=1.76µs  med=3.67µs   max=1.16s  p(90)=6.56µs   p(95)=2.24ms
     http_req_connecting............: avg=1.61ms   min=0s      med=0s       max=1.16s  p(90)=0s       p(95)=2.02ms
     http_req_duration..............: avg=933.36ms min=6.7ms   med=697.77ms max=4.89s  p(90)=2.15s    p(95)=2.61s 
       { expected_response:true }...: avg=933.36ms min=6.7ms   med=697.77ms max=4.89s  p(90)=2.15s    p(95)=2.61s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 4878 
     http_req_receiving.............: avg=363.56ms min=33.25µs med=89.95µs  max=4.67s  p(90)=1.52s    p(95)=1.95s 
     http_req_sending...............: avg=34.36ms  min=8.17µs  med=17.87µs  max=4.19s  p(90)=381.81µs p(95)=8.26ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=535.43ms min=6.56ms  med=466.72ms max=2.35s  p(90)=1.09s    p(95)=1.29s 
     http_reqs......................: 4878    156.930487/s
     iteration_duration.............: avg=1.86s    min=32.55ms med=1.55s    max=12.46s p(90)=3.73s    p(95)=4.64s 
     iterations.....................: 4858    156.287066/s
     vus............................: 72      min=72       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9012      ✗ 0    
     data_received..................: 265 MB  8.0 MB/s
     data_sent......................: 3.6 MB  109 kB/s
     http_req_blocked...............: avg=451.19µs min=1.98µs   med=4.08µs   max=14.34ms  p(90)=119.17µs p(95)=4.21ms  
     http_req_connecting............: avg=434.38µs min=0s       med=0s       max=13.3ms   p(90)=0s       p(95)=4.16ms  
     http_req_duration..............: avg=3.05s    min=15.24ms  med=2.75s    max=6.06s    p(90)=4.75s    p(95)=5.19s   
       { expected_response:true }...: avg=3.05s    min=15.24ms  med=2.75s    max=6.06s    p(90)=4.75s    p(95)=5.19s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3024 
     http_req_receiving.............: avg=58.79ms  min=40.98µs  med=138.28µs max=2.33s    p(90)=29.78ms  p(95)=487.05ms
     http_req_sending...............: avg=1.03ms   min=10.1µs   med=22.34µs  max=336.11ms p(90)=383.4µs  p(95)=1.29ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.99s    min=15.02ms  med=2.71s    max=6.01s    p(90)=4.74s    p(95)=5.18s   
     http_reqs......................: 3024    91.418923/s
     iteration_duration.............: avg=3.15s    min=362.07ms med=2.8s     max=6.2s     p(90)=4.92s    p(95)=5.32s   
     iterations.....................: 3004    90.814301/s
     vus............................: 27      min=27      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8664      ✗ 0    
     data_received..................: 256 MB  7.7 MB/s
     data_sent......................: 3.5 MB  104 kB/s
     http_req_blocked...............: avg=811.42µs min=1.41µs   med=3.03µs  max=26.9ms   p(90)=386.15µs p(95)=8.02ms  
     http_req_connecting............: avg=734.14µs min=0s       med=0s      max=18.21ms  p(90)=112.7µs  p(95)=7.56ms  
     http_req_duration..............: avg=3.22s    min=12.19ms  med=1.54s   max=32.78s   p(90)=2.14s    p(95)=21.39s  
       { expected_response:true }...: avg=3.22s    min=12.19ms  med=1.54s   max=32.78s   p(90)=2.14s    p(95)=21.39s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2908 
     http_req_receiving.............: avg=349.94µs min=43.03µs  med=99.3µs  max=134.84ms p(90)=193.21µs p(95)=299.03µs
     http_req_sending...............: avg=119.48µs min=8.84µs   med=15.31µs max=34.53ms  p(90)=116.58µs p(95)=467.28µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.22s    min=12.09ms  med=1.54s   max=32.78s   p(90)=2.14s    p(95)=21.39s  
     http_reqs......................: 2908    87.540298/s
     iteration_duration.............: avg=3.26s    min=396.95ms med=1.56s   max=32.79s   p(90)=2.16s    p(95)=21.76s  
     iterations.....................: 2888    86.938232/s
     vus............................: 28      min=28      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8475      ✗ 0    
     data_received..................: 250 MB  7.5 MB/s
     data_sent......................: 3.4 MB  101 kB/s
     http_req_blocked...............: avg=713.02µs min=1.69µs  med=4.38µs   max=33.02ms  p(90)=347.53µs p(95)=6.66ms
     http_req_connecting............: avg=680.79µs min=0s      med=0s       max=19.96ms  p(90)=175.49µs p(95)=6.46ms
     http_req_duration..............: avg=3.28s    min=15.27ms med=1.74s    max=32.86s   p(90)=3.01s    p(95)=17.22s
       { expected_response:true }...: avg=3.28s    min=15.27ms med=1.74s    max=32.86s   p(90)=3.01s    p(95)=17.22s
     http_req_failed................: 0.00%   ✓ 0         ✗ 2845 
     http_req_receiving.............: avg=1.02ms   min=44.76µs med=106.54µs max=209.02ms p(90)=559.3µs  p(95)=1.51ms
     http_req_sending...............: avg=555.16µs min=9.77µs  med=24.24µs  max=161.64ms p(90)=344.04µs p(95)=1.18ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.28s    min=15.15ms med=1.74s    max=32.86s   p(90)=3.01s    p(95)=17.22s
     http_reqs......................: 2845    85.291373/s
     iteration_duration.............: avg=3.34s    min=71.48ms med=1.78s    max=32.87s   p(90)=3.08s    p(95)=17.94s
     iterations.....................: 2825    84.691785/s
     vus............................: 40      min=40      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7455      ✗ 0    
     data_received..................: 220 MB  6.9 MB/s
     data_sent......................: 3.0 MB  93 kB/s
     http_req_blocked...............: avg=665.58µs min=1.7µs    med=3.57µs   max=23.71ms  p(90)=941.91µs p(95)=6.42ms
     http_req_connecting............: avg=633.67µs min=0s       med=0s       max=12.94ms  p(90)=728.92µs p(95)=6.26ms
     http_req_duration..............: avg=3.67s    min=10.62ms  med=3.66s    max=8.16s    p(90)=4.64s    p(95)=5.63s 
       { expected_response:true }...: avg=3.67s    min=10.62ms  med=3.66s    max=8.16s    p(90)=4.64s    p(95)=5.63s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2505 
     http_req_receiving.............: avg=19.32ms  min=40.07µs  med=101.28µs max=907.13ms p(90)=338.4µs  p(95)=1.91ms
     http_req_sending...............: avg=145.29µs min=9.13µs   med=20.57µs  max=30.15ms  p(90)=193.19µs p(95)=1.17ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.65s    min=10.55ms  med=3.66s    max=8.16s    p(90)=4.64s    p(95)=5.63s 
     http_reqs......................: 2505    78.497119/s
     iteration_duration.............: avg=3.72s    min=411.17ms med=3.68s    max=8.17s    p(90)=4.68s    p(95)=5.65s 
     iterations.....................: 2485    77.870395/s
     vus............................: 233     min=233     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Jul 2, 2025

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 176 5476 total, 0 failed avg: 1506ms, p95: 3261ms
grafbase 167 5278 total, 0 failed avg: 1461ms, p95: 3572ms
apollo-router 163 5121 total, 7 failed avg: 1495ms, p95: 3441ms ❌ 7 failed requests, 7 non-200 responses, 8 unexpected GraphQL errors, non-compatible response structure (3)
hive-gateway-bun 88 3021 total, 0 failed avg: 5107ms, p95: 9346ms
apollo-server 87 3079 total, 0 failed avg: 5250ms, p95: 33307ms
hive-gateway 85 3034 total, 0 failed avg: 5279ms, p95: 33182ms
mercurius 76 2527 total, 0 failed avg: 6161ms, p95: 9913ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16368      ✗ 0    
     data_received..................: 481 MB  16 MB/s
     data_sent......................: 6.5 MB  209 kB/s
     http_req_blocked...............: avg=5.4ms    min=1.5µs   med=3.51µs  max=3.61s  p(90)=27.75µs  p(95)=15.88ms
     http_req_connecting............: avg=5.19ms   min=0s      med=0s      max=3.61s  p(90)=0s       p(95)=15.7ms 
     http_req_duration..............: avg=1.5s     min=3.21ms  med=1.35s   max=7.78s  p(90)=2.57s    p(95)=3.26s  
       { expected_response:true }...: avg=1.5s     min=3.21ms  med=1.35s   max=7.78s  p(90)=2.57s    p(95)=3.26s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5476 
     http_req_receiving.............: avg=217.62ms min=34.83µs med=85.12µs max=5.66s  p(90)=785.89ms p(95)=1.35s  
     http_req_sending...............: avg=32.47ms  min=9µs     med=15.95µs max=3.15s  p(90)=534.87µs p(95)=14.14ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.25s    min=3.1ms   med=1.18s   max=5.75s  p(90)=2.12s    p(95)=2.71s  
     http_reqs......................: 5476    176.358625/s
     iteration_duration.............: avg=2.77s    min=16.56ms med=2.56s   max=11.73s p(90)=4.79s    p(95)=5.78s  
     iterations.....................: 5456    175.71451/s
     vus............................: 66      min=66       max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15774      ✗ 0    
     data_received..................: 464 MB  15 MB/s
     data_sent......................: 6.3 MB  199 kB/s
     http_req_blocked...............: avg=2.79ms  min=1.48µs  med=3.45µs   max=2.78s  p(90)=31.25µs  p(95)=13.73ms
     http_req_connecting............: avg=2.21ms  min=0s      med=0s       max=2.78s  p(90)=0s       p(95)=13.18ms
     http_req_duration..............: avg=1.46s   min=2.93ms  med=1.17s    max=6.3s   p(90)=3.03s    p(95)=3.57s  
       { expected_response:true }...: avg=1.46s   min=2.93ms  med=1.17s    max=6.3s   p(90)=3.03s    p(95)=3.57s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5278 
     http_req_receiving.............: avg=494ms   min=33.08µs med=91.77µs  max=5.28s  p(90)=1.91s    p(95)=2.52s  
     http_req_sending...............: avg=34.12ms min=7.76µs  med=15.63µs  max=4.13s  p(90)=940.34µs p(95)=13.51ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=933.3ms min=2.86ms  med=811.52ms max=3.52s  p(90)=1.81s    p(95)=2.11s  
     http_reqs......................: 5278    167.726684/s
     iteration_duration.............: avg=2.85s   min=25.22ms med=2.55s    max=12.45s p(90)=5.46s    p(95)=6.44s  
     iterations.....................: 5258    167.091115/s
     vus............................: 221     min=221      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 5094 / ✗ 7
     ✗ no graphql errors
      ↳  99% — ✓ 5093 / ✗ 8
     ✗ valid response structure
      ↳  99% — ✓ 5093 / ✗ 3

     █ setup

     checks.........................: 99.88% ✓ 15280      ✗ 18   
     data_received..................: 449 MB 14 MB/s
     data_sent......................: 6.1 MB 194 kB/s
     http_req_blocked...............: avg=5.77ms   min=1.46µs  med=3.37µs   max=1.97s  p(90)=392.33µs p(95)=17.7ms 
     http_req_connecting............: avg=5.37ms   min=0s      med=0s       max=1.97s  p(90)=193.63µs p(95)=16.68ms
     http_req_duration..............: avg=1.49s    min=6.41ms  med=1.28s    max=7.34s  p(90)=2.94s    p(95)=3.44s  
       { expected_response:true }...: avg=1.49s    min=6.41ms  med=1.28s    max=7.34s  p(90)=2.94s    p(95)=3.44s  
     http_req_failed................: 0.13%  ✓ 7          ✗ 5114 
     http_req_receiving.............: avg=432.35ms min=0s      med=82.32µs  max=5.86s  p(90)=1.97s    p(95)=2.61s  
     http_req_sending...............: avg=36.88ms  min=8.03µs  med=15.99µs  max=4.85s  p(90)=1.35ms   p(95)=22.3ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.02s    min=6.33ms  med=996.41ms max=3.74s  p(90)=1.77s    p(95)=1.99s  
     http_reqs......................: 5121   163.314051/s
     iteration_duration.............: avg=2.96s    min=25.11ms med=2.69s    max=12.45s p(90)=5.66s    p(95)=6.65s  
     iterations.....................: 5101   162.67623/s
     vus............................: 168    min=168      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9003      ✗ 0    
     data_received..................: 265 MB  7.7 MB/s
     data_sent......................: 3.6 MB  105 kB/s
     http_req_blocked...............: avg=4.5ms    min=1.82µs   med=3.98µs   max=130.37ms p(90)=25.79ms  p(95)=38.34ms 
     http_req_connecting............: avg=4.36ms   min=0s       med=0s       max=80.03ms  p(90)=25.24ms  p(95)=38.12ms 
     http_req_duration..............: avg=5.1s     min=16.69ms  med=4.7s     max=12.09s   p(90)=8.11s    p(95)=9.34s   
       { expected_response:true }...: avg=5.1s     min=16.69ms  med=4.7s     max=12.09s   p(90)=8.11s    p(95)=9.34s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3021 
     http_req_receiving.............: avg=109.39ms min=38.47µs  med=119.37µs max=2.84s    p(90)=170.72ms p(95)=955.01ms
     http_req_sending...............: avg=5.04ms   min=9.35µs   med=22.2µs   max=737.93ms p(90)=12.2ms   p(95)=34.56ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.99s    min=16.4ms   med=4.61s    max=12.09s   p(90)=8.11s    p(95)=9.33s   
     http_reqs......................: 3021    88.288925/s
     iteration_duration.............: avg=5.33s    min=539.96ms med=4.87s    max=12.11s   p(90)=8.36s    p(95)=9.71s   
     iterations.....................: 3001    87.704423/s
     vus............................: 85      min=85      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9177      ✗ 0    
     data_received..................: 271 MB  7.7 MB/s
     data_sent......................: 3.7 MB  103 kB/s
     http_req_blocked...............: avg=2.66ms   min=1.57µs   med=3.1µs    max=37.49ms  p(90)=10.43ms  p(95)=27.13ms 
     http_req_connecting............: avg=2.62ms   min=0s       med=0s       max=32.81ms  p(90)=10.22ms  p(95)=27.01ms 
     http_req_duration..............: avg=5.25s    min=10.6ms   med=1.9s     max=34.89s   p(90)=27.29s   p(95)=33.3s   
       { expected_response:true }...: avg=5.25s    min=10.6ms   med=1.9s     max=34.89s   p(90)=27.29s   p(95)=33.3s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3079 
     http_req_receiving.............: avg=331.68µs min=40.02µs  med=100.05µs max=105.51ms p(90)=206.82µs p(95)=324.21µs
     http_req_sending...............: avg=225.87µs min=8.91µs   med=15.37µs  max=39.53ms  p(90)=564.97µs p(95)=1.22ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.24s    min=10.5ms   med=1.9s     max=34.89s   p(90)=27.29s   p(95)=33.3s   
     http_reqs......................: 3079    87.148103/s
     iteration_duration.............: avg=5.3s     min=363.32ms med=1.92s    max=34.9s    p(90)=28.67s   p(95)=33.34s  
     iterations.....................: 3059    86.582023/s
     vus............................: 30      min=30      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9042      ✗ 0    
     data_received..................: 267 MB  7.5 MB/s
     data_sent......................: 3.6 MB  102 kB/s
     http_req_blocked...............: avg=2.32ms   min=1.81µs   med=4.16µs  max=37.04ms  p(90)=12.48ms  p(95)=21.67ms
     http_req_connecting............: avg=2.28ms   min=0s       med=0s      max=31.52ms  p(90)=11.19ms  p(95)=21.6ms 
     http_req_duration..............: avg=5.27s    min=13.47ms  med=2.4s    max=34.76s   p(90)=13.46s   p(95)=33.18s 
       { expected_response:true }...: avg=5.27s    min=13.47ms  med=2.4s    max=34.76s   p(90)=13.46s   p(95)=33.18s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 3034 
     http_req_receiving.............: avg=2.51ms   min=41.72µs  med=92.53µs max=240.68ms p(90)=969.59µs p(95)=6.05ms 
     http_req_sending...............: avg=852.07µs min=9.59µs   med=22.71µs max=207.84ms p(90)=1.06ms   p(95)=3.13ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=5.27s    min=13.32ms  med=2.4s    max=34.75s   p(90)=13.46s   p(95)=33.18s 
     http_reqs......................: 3034    85.857182/s
     iteration_duration.............: avg=5.38s    min=396.51ms med=2.47s   max=34.78s   p(90)=13.92s   p(95)=33.25s 
     iterations.....................: 3014    85.291215/s
     vus............................: 35      min=35      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7521      ✗ 0    
     data_received..................: 222 MB  6.7 MB/s
     data_sent......................: 3.0 MB  91 kB/s
     http_req_blocked...............: avg=5.61ms   min=1.71µs   med=3.6µs   max=67.88ms p(90)=27.43ms  p(95)=37.38ms
     http_req_connecting............: avg=5.51ms   min=0s       med=0s      max=67.86ms p(90)=26.85ms  p(95)=36.21ms
     http_req_duration..............: avg=6.16s    min=13.09ms  med=6.17s   max=11.99s  p(90)=7.67s    p(95)=9.91s  
       { expected_response:true }...: avg=6.16s    min=13.09ms  med=6.17s   max=11.99s  p(90)=7.67s    p(95)=9.91s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2527 
     http_req_receiving.............: avg=31.89ms  min=38.94µs  med=95.85µs max=1.54s   p(90)=298.84µs p(95)=1.61ms 
     http_req_sending...............: avg=824.68µs min=8.73µs   med=19.81µs max=35.11ms p(90)=1.93ms   p(95)=4.92ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=6.12s    min=12.98ms  med=6.17s   max=11.99s  p(90)=7.67s    p(95)=9.91s  
     http_reqs......................: 2527    76.780993/s
     iteration_duration.............: avg=6.27s    min=458.08ms med=6.2s    max=12.01s  p(90)=7.69s    p(95)=9.96s  
     iterations.....................: 2507    76.173308/s
     vus............................: 286     min=286     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Jul 2, 2025

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 5256ms 179 12591 total, 0 failed avg: 2081ms, p95: 5257ms, max: 9770ms, med: 1799ms
apollo-router 6476ms 163 11474 total, 467 failed avg: 2649ms, p95: 6476ms, max: 15182ms, med: 2177ms ❌ 467 failed requests, 467 non-200 responses, 467 unexpected GraphQL errors
grafbase 7668ms 170 11980 total, 0 failed avg: 2740ms, p95: 7669ms, max: 18754ms, med: 2088ms
hive-gateway-bun 27536ms 91 7453 total, 0 failed avg: 11462ms, p95: 27537ms, max: 37377ms, med: 9796ms
mercurius 43625ms 38 3647 total, 33 failed avg: 15856ms, p95: 43625ms, max: 53713ms, med: 12667ms ❌ 33 failed requests, 33 non-200 responses, 33 unexpected GraphQL errors
hive-gateway 51341ms 87 7654 total, 0 failed avg: 12064ms, p95: 51342ms, max: 58065ms, med: 3359ms
apollo-server 59999ms 81 7538 total, 540 failed avg: 12250ms, p95: 60000ms, max: 60150ms, med: 2239ms ❌ 540 failed requests, 540 non-200 responses, 540 unexpected GraphQL errors
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 37713      ✗ 0     
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   213 kB/s
     http_req_blocked...............: avg=236.32ms min=1.54µs  med=3.44µs  max=7.49s  p(90)=1s       p(95)=1.85s   
     http_req_connecting............: avg=234.63ms min=0s      med=0s      max=7.49s  p(90)=989.96ms p(95)=1.85s   
     http_req_duration..............: avg=2.08s    min=3.18ms  med=1.79s   max=9.77s  p(90)=4.09s    p(95)=5.25s   
       { expected_response:true }...: avg=2.08s    min=3.18ms  med=1.79s   max=9.77s  p(90)=4.09s    p(95)=5.25s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12591 
     http_req_receiving.............: avg=242.65ms min=31.85µs med=71.5µs  max=5.61s  p(90)=893.95ms p(95)=1.77s   
     http_req_sending...............: avg=162.31ms min=7.8µs   med=15.82µs max=5.66s  p(90)=312.32ms p(95)=793.78ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.67s    min=2.98ms  med=1.55s   max=9.4s   p(90)=3.1s     p(95)=3.72s   
     http_reqs......................: 12591   179.538278/s
     iteration_duration.............: avg=5.43s    min=8.8ms   med=4.51s   max=23.53s p(90)=11.39s   p(95)=13.67s  
     iterations.....................: 12571   179.253093/s
     vus............................: 4       min=4        max=1919
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  95% — ✓ 10987 / ✗ 467
     ✗ no graphql errors
      ↳  95% — ✓ 10987 / ✗ 467
     ✓ valid response structure

     █ setup

     checks.........................: 97.24% ✓ 32961      ✗ 934   
     data_received..................: 966 MB 14 MB/s
     data_sent......................: 14 MB  194 kB/s
     http_req_blocked...............: avg=542.49ms min=1.51µs  med=3.92µs  max=10.83s p(90)=2.67s    p(95)=4.01s   
     http_req_connecting............: avg=535ms    min=0s      med=0s      max=10.57s p(90)=2.6s     p(95)=4.01s   
     http_req_duration..............: avg=2.64s    min=6.45ms  med=2.17s   max=15.18s p(90)=4.9s     p(95)=6.47s   
       { expected_response:true }...: avg=2.62s    min=6.45ms  med=2.14s   max=15.18s p(90)=4.89s    p(95)=6.33s   
     http_req_failed................: 4.07%  ✓ 467        ✗ 11007 
     http_req_receiving.............: avg=331.74ms min=0s      med=83.7µs  max=8.58s  p(90)=708.59ms p(95)=2.05s   
     http_req_sending...............: avg=156.51ms min=7.85µs  med=19.89µs max=11.05s p(90)=451.15ms p(95)=912.45ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.16s    min=6.38ms  med=1.81s   max=12.89s p(90)=4.34s    p(95)=4.68s   
     http_reqs......................: 11474  163.532265/s
     iteration_duration.............: avg=6.12s    min=15.69ms med=5.27s   max=28.74s p(90)=12.24s   p(95)=14.26s  
     iterations.....................: 11454  163.247217/s
     vus............................: 5      min=5        max=1983
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 35880      ✗ 0     
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 14 MB   203 kB/s
     http_req_blocked...............: avg=297.86ms min=1.46µs  med=3.63µs  max=12.72s p(90)=1.44s    p(95)=2.42s  
     http_req_connecting............: avg=295.57ms min=0s      med=0s      max=12.72s p(90)=1.44s    p(95)=2.4s   
     http_req_duration..............: avg=2.74s    min=3.17ms  med=2.08s   max=18.75s p(90)=4.85s    p(95)=7.66s  
       { expected_response:true }...: avg=2.74s    min=3.17ms  med=2.08s   max=18.75s p(90)=4.85s    p(95)=7.66s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 11980 
     http_req_receiving.............: avg=667.31ms min=32.41µs med=79.88µs max=16.9s  p(90)=1.08s    p(95)=3.57s  
     http_req_sending...............: avg=127.48ms min=8.12µs  med=17.12µs max=16.64s p(90)=303.37ms p(95)=818.3ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.94s    min=3.1ms   med=1.74s   max=9.42s  p(90)=3.78s    p(95)=4.35s  
     http_reqs......................: 11980   170.938717/s
     iteration_duration.............: avg=5.82s    min=14.07ms med=4.25s   max=32.61s p(90)=13.32s   p(95)=17.28s 
     iterations.....................: 11960   170.653344/s
     vus............................: 4       min=4        max=1996
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 22299     ✗ 0     
     data_received..................: 654 MB  8.0 MB/s
     data_sent......................: 8.8 MB  109 kB/s
     http_req_blocked...............: avg=21.12ms  min=1.92µs  med=4.6µs    max=1.58s    p(90)=21.29ms p(95)=137.32ms
     http_req_connecting............: avg=20.91ms  min=0s      med=0s       max=1.58s    p(90)=20.76ms p(95)=136.35ms
     http_req_duration..............: avg=11.46s   min=15.69ms med=9.79s    max=37.37s   p(90)=25.03s  p(95)=27.53s  
       { expected_response:true }...: avg=11.46s   min=15.69ms med=9.79s    max=37.37s   p(90)=25.03s  p(95)=27.53s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7453  
     http_req_receiving.............: avg=137.45ms min=40.03µs med=118.37µs max=8.63s    p(90)=15.02ms p(95)=791.15ms
     http_req_sending...............: avg=11.54ms  min=9.56µs  med=27.01µs  max=901.72ms p(90)=13.56ms p(95)=61.76ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=11.31s   min=15.49ms med=9.73s    max=37.33s   p(90)=24.92s  p(95)=27.45s  
     http_reqs......................: 7453    91.607406/s
     iteration_duration.............: avg=11.9s    min=47.07ms med=10.18s   max=41.49s   p(90)=26.02s  p(95)=28.82s  
     iterations.....................: 7433    91.361579/s
     vus............................: 398     min=51      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 3594 / ✗ 33
     ✗ no graphql errors
      ↳  99% — ✓ 3594 / ✗ 33
     ✓ valid response structure

     █ setup

     checks.........................: 99.39% ✓ 10782     ✗ 66    
     data_received..................: 317 MB 3.3 MB/s
     data_sent......................: 6.0 MB 63 kB/s
     http_req_blocked...............: avg=221.03µs min=1.81µs   med=4.33µs   max=23.68ms  p(90)=494.68µs p(95)=703.27µs
     http_req_connecting............: avg=186.61µs min=0s       med=0s       max=23.62ms  p(90)=420.76µs p(95)=606.21µs
     http_req_duration..............: avg=15.85s   min=12.49ms  med=12.66s   max=53.71s   p(90)=34.46s   p(95)=43.62s  
       { expected_response:true }...: avg=15.6s    min=12.49ms  med=12.56s   max=44.61s   p(90)=34.14s   p(95)=43.42s  
     http_req_failed................: 0.90%  ✓ 33        ✗ 3614  
     http_req_receiving.............: avg=360.54µs min=0s       med=105.58µs max=241.03ms p(90)=272.65µs p(95)=492.64µs
     http_req_sending...............: avg=105.03µs min=8.23µs   med=27.1µs   max=14.43ms  p(90)=68.01µs  p(95)=88.36µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=15.85s   min=12.38ms  med=12.66s   max=53.71s   p(90)=34.45s   p(95)=43.61s  
     http_reqs......................: 3647   38.116996/s
     iteration_duration.............: avg=15.95s   min=237.45ms med=12.72s   max=53.71s   p(90)=34.53s   p(95)=43.69s  
     iterations.....................: 3627   37.907964/s
     vus............................: 243    min=56      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 22902     ✗ 0     
     data_received..................: 672 MB  7.7 MB/s
     data_sent......................: 9.1 MB  104 kB/s
     http_req_blocked...............: avg=7.66ms min=2.06µs  med=4.53µs  max=329.98ms p(90)=19.33ms  p(95)=58.33ms
     http_req_connecting............: avg=7.51ms min=0s      med=0s      max=296.01ms p(90)=18.87ms  p(95)=57.46ms
     http_req_duration..............: avg=12.06s min=13.35ms med=3.35s   max=58.06s   p(90)=44.32s   p(95)=51.34s 
       { expected_response:true }...: avg=12.06s min=13.35ms med=3.35s   max=58.06s   p(90)=44.32s   p(95)=51.34s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 7654  
     http_req_receiving.............: avg=1.67ms min=40.74µs med=96.09µs max=430.3ms  p(90)=721.67µs p(95)=3.08ms 
     http_req_sending...............: avg=3.1ms  min=9.9µs   med=27.23µs max=288.84ms p(90)=4.38ms   p(95)=20.28ms
     http_req_tls_handshaking.......: avg=0s     min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=12.05s min=13.19ms med=3.35s   max=58.06s   p(90)=44.3s    p(95)=51.33s 
     http_reqs......................: 7654    87.87727/s
     iteration_duration.............: avg=12.17s min=89.86ms med=3.43s   max=58.87s   p(90)=44.39s   p(95)=51.38s 
     iterations.....................: 7634    87.647646/s
     vus............................: 38      min=38      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  92% — ✓ 6978 / ✗ 540
     ✗ no graphql errors
      ↳  92% — ✓ 6978 / ✗ 540
     ✓ valid response structure

     █ setup

     checks.........................: 95.09% ✓ 20934     ✗ 1080  
     data_received..................: 615 MB 6.6 MB/s
     data_sent......................: 9.0 MB 97 kB/s
     http_req_blocked...............: avg=570.22µs min=1.85µs  med=4.48µs   max=175.93ms p(90)=385.33µs p(95)=715.36µs
     http_req_connecting............: avg=540.04µs min=0s      med=0s       max=175.83ms p(90)=311.28µs p(95)=588.54µs
     http_req_duration..............: avg=12.24s   min=11.06ms med=2.23s    max=1m0s     p(90)=56.5s    p(95)=59.99s  
       { expected_response:true }...: avg=8.56s    min=11.06ms med=2.14s    max=59.98s   p(90)=37.48s   p(95)=43.98s  
     http_req_failed................: 7.16%  ✓ 540       ✗ 6998  
     http_req_receiving.............: avg=219.14µs min=0s      med=113.19µs max=115.46ms p(90)=222.98µs p(95)=321.65µs
     http_req_sending...............: avg=210.43µs min=9.76µs  med=25.12µs  max=85.35ms  p(90)=69.4µs   p(95)=120.27µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=12.24s   min=10.96ms med=2.23s    max=1m0s     p(90)=56.5s    p(95)=59.99s  
     http_reqs......................: 7538   81.322646/s
     iteration_duration.............: avg=12.29s   min=66.5ms  med=2.25s    max=1m0s     p(90)=56.55s   p(95)=1m0s    
     iterations.....................: 7518   81.106879/s
     vus............................: 78     min=61      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Jul 2, 2025

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 178 5513 total, 0 failed avg: 829ms, p95: 2159ms
grafbase 171 5290 total, 0 failed avg: 922ms, p95: 2212ms
apollo-router 157 4889 total, 0 failed avg: 909ms, p95: 2081ms
hive-gateway-bun 90 3020 total, 0 failed avg: 3058ms, p95: 4876ms
hive-gateway 87 2905 total, 0 failed avg: 3204ms, p95: 16747ms
apollo-server 83 2784 total, 0 failed avg: 3380ms, p95: 26396ms
mercurius 76 2431 total, 0 failed avg: 3781ms, p95: 5830ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16479      ✗ 0    
     data_received..................: 484 MB  16 MB/s
     data_sent......................: 6.5 MB  212 kB/s
     http_req_blocked...............: avg=1.6ms    min=1.47µs  med=3.29µs   max=2.31s  p(90)=5.54µs   p(95)=1.13ms  
     http_req_connecting............: avg=1.31ms   min=0s      med=0s       max=2.31s  p(90)=0s       p(95)=775.57µs
     http_req_duration..............: avg=828.78ms min=3.18ms  med=678.01ms max=4.84s  p(90)=1.74s    p(95)=2.15s   
       { expected_response:true }...: avg=828.78ms min=3.18ms  med=678.01ms max=4.84s  p(90)=1.74s    p(95)=2.15s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5513 
     http_req_receiving.............: avg=287.81ms min=35.07µs med=89.72µs  max=3.1s   p(90)=1.13s    p(95)=1.68s   
     http_req_sending...............: avg=19.09ms  min=8.43µs  med=15.36µs  max=2.52s  p(90)=172.92µs p(95)=1.95ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=521.86ms min=3.11ms  med=485.56ms max=2.7s   p(90)=957.49ms p(95)=1.09s   
     http_reqs......................: 5513    178.449765/s
     iteration_duration.............: avg=1.64s    min=21.24ms med=1.31s    max=10.35s p(90)=3.42s    p(95)=4.24s   
     iterations.....................: 5493    177.802387/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15810      ✗ 0    
     data_received..................: 465 MB  15 MB/s
     data_sent......................: 6.3 MB  204 kB/s
     http_req_blocked...............: avg=2.03ms   min=1.28µs  med=3.28µs   max=975.88ms p(90)=5.75µs p(95)=4.77ms 
     http_req_connecting............: avg=1.43ms   min=0s      med=0s       max=975.79ms p(90)=0s     p(95)=3.63ms 
     http_req_duration..............: avg=921.73ms min=3.07ms  med=792.55ms max=5.4s     p(90)=1.73s  p(95)=2.21s  
       { expected_response:true }...: avg=921.73ms min=3.07ms  med=792.55ms max=5.4s     p(90)=1.73s  p(95)=2.21s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5290 
     http_req_receiving.............: avg=238.77ms min=33.12µs med=79.05µs  max=5.05s    p(90)=1s     p(95)=1.41s  
     http_req_sending...............: avg=27.71ms  min=7.44µs  med=15.67µs  max=4.23s    p(90)=4.79ms p(95)=48.93ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s     p(95)=0s     
     http_req_waiting...............: avg=655.25ms min=2.99ms  med=642.35ms max=2.41s    p(90)=1.06s  p(95)=1.27s  
     http_reqs......................: 5290    171.691259/s
     iteration_duration.............: avg=1.71s    min=21.34ms med=1.5s     max=7.36s    p(90)=3.27s  p(95)=3.89s  
     iterations.....................: 5270    171.042142/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14607      ✗ 0    
     data_received..................: 429 MB  14 MB/s
     data_sent......................: 5.8 MB  187 kB/s
     http_req_blocked...............: avg=5.08ms   min=1.42µs  med=3.3µs    max=2.23s p(90)=6.14µs   p(95)=19.48ms
     http_req_connecting............: avg=4.62ms   min=0s      med=0s       max=2.23s p(90)=0s       p(95)=18.63ms
     http_req_duration..............: avg=909.19ms min=6.38ms  med=798.04ms max=4.75s p(90)=1.77s    p(95)=2.08s  
       { expected_response:true }...: avg=909.19ms min=6.38ms  med=798.04ms max=4.75s p(90)=1.77s    p(95)=2.08s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4889 
     http_req_receiving.............: avg=198.65ms min=33.1µs  med=82.49µs  max=3.29s p(90)=804.62ms p(95)=1.41s  
     http_req_sending...............: avg=21.61ms  min=8.27µs  med=15.02µs  max=3.78s p(90)=1.18ms   p(95)=13.62ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=688.92ms min=6.31ms  med=665.16ms max=2.73s p(90)=1.18s    p(95)=1.44s  
     http_reqs......................: 4889    157.614821/s
     iteration_duration.............: avg=1.86s    min=29.81ms med=1.61s    max=7.38s p(90)=3.55s    p(95)=4.33s  
     iterations.....................: 4869    156.970048/s
     vus............................: 2       min=2        max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9000      ✗ 0    
     data_received..................: 265 MB  8.0 MB/s
     data_sent......................: 3.6 MB  108 kB/s
     http_req_blocked...............: avg=597.07µs min=1.73µs   med=3.99µs   max=23.04ms  p(90)=97.93µs  p(95)=5.54ms  
     http_req_connecting............: avg=572.51µs min=0s       med=0s       max=17.03ms  p(90)=0s       p(95)=5.36ms  
     http_req_duration..............: avg=3.05s    min=15.13ms  med=2.78s    max=6.52s    p(90)=4.46s    p(95)=4.87s   
       { expected_response:true }...: avg=3.05s    min=15.13ms  med=2.78s    max=6.52s    p(90)=4.46s    p(95)=4.87s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3020 
     http_req_receiving.............: avg=57.13ms  min=40.12µs  med=181.51µs max=1.64s    p(90)=12.57ms  p(95)=454.77ms
     http_req_sending...............: avg=910.69µs min=8.53µs   med=21.41µs  max=457.02ms p(90)=205.76µs p(95)=2.1ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.99s    min=15.03ms  med=2.75s    max=6.51s    p(90)=4.43s    p(95)=4.84s   
     http_reqs......................: 3020    90.972286/s
     iteration_duration.............: avg=3.14s    min=534.93ms med=2.84s    max=6.55s    p(90)=4.62s    p(95)=4.96s   
     iterations.....................: 3000    90.36982/s
     vus............................: 24      min=24      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8655      ✗ 0    
     data_received..................: 255 MB  7.7 MB/s
     data_sent......................: 3.4 MB  104 kB/s
     http_req_blocked...............: avg=830.59µs min=1.5µs   med=3.92µs   max=21.79ms  p(90)=127.04µs p(95)=7.91ms  
     http_req_connecting............: avg=800.79µs min=0s      med=0s       max=21.73ms  p(90)=82.3µs   p(95)=7.68ms  
     http_req_duration..............: avg=3.2s     min=14.96ms med=1.67s    max=32.76s   p(90)=2.97s    p(95)=16.74s  
       { expected_response:true }...: avg=3.2s     min=14.96ms med=1.67s    max=32.76s   p(90)=2.97s    p(95)=16.74s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2905 
     http_req_receiving.............: avg=2.28ms   min=42.91µs med=102.82µs max=375.33ms p(90)=614.29µs p(95)=2.36ms  
     http_req_sending...............: avg=249.98µs min=9.25µs  med=21.96µs  max=71.76ms  p(90)=172.93µs p(95)=533.07µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.2s     min=14.82ms med=1.67s    max=32.76s   p(90)=2.97s    p(95)=16.74s  
     http_reqs......................: 2905    87.229452/s
     iteration_duration.............: avg=3.26s    min=87.54ms med=1.71s    max=32.77s   p(90)=3.03s    p(95)=16.81s  
     iterations.....................: 2885    86.628905/s
     vus............................: 48      min=48      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8292      ✗ 0    
     data_received..................: 245 MB  7.3 MB/s
     data_sent......................: 3.3 MB  99 kB/s
     http_req_blocked...............: avg=517.21µs min=1.63µs   med=3.82µs   max=12.66ms p(90)=253.19µs p(95)=4.96ms  
     http_req_connecting............: avg=503.56µs min=0s       med=0s       max=12.6ms  p(90)=194.21µs p(95)=4.83ms  
     http_req_duration..............: avg=3.38s    min=11.87ms  med=1.55s    max=32.93s  p(90)=2.09s    p(95)=26.39s  
       { expected_response:true }...: avg=3.38s    min=11.87ms  med=1.55s    max=32.93s  p(90)=2.09s    p(95)=26.39s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2784 
     http_req_receiving.............: avg=304.93µs min=44.91µs  med=106.85µs max=79.42ms p(90)=210.63µs p(95)=324.14µs
     http_req_sending...............: avg=141.09µs min=9.21µs   med=20.14µs  max=44.27ms p(90)=155.61µs p(95)=588.17µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.37s    min=11.75ms  med=1.55s    max=32.93s  p(90)=2.09s    p(95)=26.39s  
     http_reqs......................: 2784    83.440626/s
     iteration_duration.............: avg=3.42s    min=391.67ms med=1.58s    max=32.94s  p(90)=2.1s     p(95)=26.65s  
     iterations.....................: 2764    82.841196/s
     vus............................: 39      min=39      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7233      ✗ 0    
     data_received..................: 213 MB  6.7 MB/s
     data_sent......................: 2.9 MB  90 kB/s
     http_req_blocked...............: avg=1.72ms   min=1.91µs   med=4.44µs   max=27.8ms  p(90)=3.24ms   p(95)=18.86ms
     http_req_connecting............: avg=1.69ms   min=0s       med=0s       max=27.77ms p(90)=3.06ms   p(95)=18.8ms 
     http_req_duration..............: avg=3.78s    min=12.41ms  med=3.74s    max=8.6s    p(90)=4.85s    p(95)=5.83s  
       { expected_response:true }...: avg=3.78s    min=12.41ms  med=3.74s    max=8.6s    p(90)=4.85s    p(95)=5.83s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2431 
     http_req_receiving.............: avg=6.37ms   min=39.97µs  med=107.26µs max=680.7ms p(90)=319.37µs p(95)=1.44ms 
     http_req_sending...............: avg=155.79µs min=10.05µs  med=25.59µs  max=9.97ms  p(90)=273.29µs p(95)=1.26ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.77s    min=12.29ms  med=3.74s    max=8.6s    p(90)=4.85s    p(95)=5.82s  
     http_reqs......................: 2431    76.048537/s
     iteration_duration.............: avg=3.84s    min=284.51ms med=3.76s    max=8.64s   p(90)=4.89s    p(95)=5.9s   
     iterations.....................: 2411    75.422881/s
     vus............................: 217     min=217     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@renovate renovate bot force-pushed the renovate/tokio-1.x-lockfile branch from f089ece to a9fe98e Compare July 4, 2025 23:07
@renovate renovate bot changed the title Update Rust crate tokio to v1.46.0 Update Rust crate tokio to v1.46.1 Jul 4, 2025
@ardatan ardatan merged commit ebf79f7 into main Jul 24, 2025
34 checks passed
@ardatan ardatan deleted the renovate/tokio-1.x-lockfile branch July 24, 2025 00:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant