Skip to content

Crashtracker: dual ship to error tracking #10000

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 2 commits into
base: master
Choose a base branch
from
Draft

Crashtracker: dual ship to error tracking #10000

wants to merge 2 commits into from
+567 −111

Conversation

@amarziali
Copy link
Contributor

@amarziali amarziali commented Nov 19, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Nov 19, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/dualship
git_commit_date 1763731854 1763738977
git_commit_sha 614cc72 0882768
release_version 1.57.0-SNAPSHOT~614cc721f6 1.57.0-SNAPSHOT~0882768757
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763741382 1763741382
ci_job_id 1251009321 1251009321
ci_pipeline_id 83610917 83610917
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-13cl40xc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-13cl40xc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~0882768757, baseline=1.57.0-SNAPSHOT~614cc721f6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.115 s) : 0, 1114803
Total [baseline] (10.832 s) : 0, 10832193
Agent [candidate] (1.119 s) : 0, 1119030
Total [candidate] (10.887 s) : 0, 10886871
section appsec
Agent [baseline] (1.284 s) : 0, 1283722
Total [baseline] (11.136 s) : 0, 11136183
Agent [candidate] (1.282 s) : 0, 1281695
Total [candidate] (11.09 s) : 0, 11089883
section iast
Agent [baseline] (1.243 s) : 0, 1242902
Total [baseline] (11.312 s) : 0, 11312276
Agent [candidate] (1.24 s) : 0, 1240419
Total [candidate] (11.267 s) : 0, 11267274
section profiling
Agent [baseline] (1.233 s) : 0, 1232833
Total [baseline] (11.134 s) : 0, 11134368
Agent [candidate] (1.235 s) : 0, 1235237
Total [candidate] (11.166 s) : 0, 11165579
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.115 s -
Agent appsec 1.284 s 168.919 ms (15.2%)
Agent iast 1.243 s 128.099 ms (11.5%)
Agent profiling 1.233 s 118.031 ms (10.6%)
Total tracing 10.832 s -
Total appsec 11.136 s 303.99 ms (2.8%)
Total iast 11.312 s 480.083 ms (4.4%)
Total profiling 11.134 s 302.175 ms (2.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.119 s -
Agent appsec 1.282 s 162.665 ms (14.5%)
Agent iast 1.24 s 121.389 ms (10.8%)
Agent profiling 1.235 s 116.207 ms (10.4%)
Total tracing 10.887 s -
Total appsec 11.09 s 203.012 ms (1.9%)
Total iast 11.267 s 380.404 ms (3.5%)
Total profiling 11.166 s 278.708 ms (2.6%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~0882768757, baseline=1.57.0-SNAPSHOT~614cc721f6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.504 ms) : 0, 1504
crashtracking [candidate] (1.509 ms) : 0, 1509
BytebuddyAgent [baseline] (717.63 ms) : 0, 717630
BytebuddyAgent [candidate] (719.399 ms) : 0, 719399
GlobalTracer [baseline] (251.167 ms) : 0, 251167
GlobalTracer [candidate] (252.354 ms) : 0, 252354
AppSec [baseline] (32.313 ms) : 0, 32313
AppSec [candidate] (32.872 ms) : 0, 32872
Debugger [baseline] (64.455 ms) : 0, 64455
Debugger [candidate] (64.979 ms) : 0, 64979
Remote Config [baseline] (633.581 µs) : 0, 634
Remote Config [candidate] (647.382 µs) : 0, 647
Telemetry [baseline] (8.326 ms) : 0, 8326
Telemetry [candidate] (8.356 ms) : 0, 8356
Flare Poller [baseline] (3.76 ms) : 0, 3760
Flare Poller [candidate] (3.815 ms) : 0, 3815
section appsec
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.499 ms) : 0, 1499
BytebuddyAgent [baseline] (732.727 ms) : 0, 732727
BytebuddyAgent [candidate] (731.93 ms) : 0, 731930
GlobalTracer [baseline] (241.058 ms) : 0, 241058
GlobalTracer [candidate] (240.519 ms) : 0, 240519
AppSec [baseline] (173.99 ms) : 0, 173990
AppSec [candidate] (174.071 ms) : 0, 174071
Debugger [baseline] (61.989 ms) : 0, 61989
Debugger [candidate] (61.178 ms) : 0, 61178
Remote Config [baseline] (670.196 µs) : 0, 670
Remote Config [candidate] (678.861 µs) : 0, 679
Telemetry [baseline] (8.245 ms) : 0, 8245
Telemetry [candidate] (8.199 ms) : 0, 8199
Flare Poller [baseline] (3.91 ms) : 0, 3910
Flare Poller [candidate] (3.987 ms) : 0, 3987
IAST [baseline] (24.707 ms) : 0, 24707
IAST [candidate] (24.782 ms) : 0, 24782
section iast
crashtracking [baseline] (1.48 ms) : 0, 1480
crashtracking [candidate] (1.488 ms) : 0, 1488
BytebuddyAgent [baseline] (833.971 ms) : 0, 833971
BytebuddyAgent [candidate] (833.183 ms) : 0, 833183
GlobalTracer [baseline] (237.935 ms) : 0, 237935
GlobalTracer [candidate] (237.3 ms) : 0, 237300
AppSec [baseline] (34.677 ms) : 0, 34677
AppSec [candidate] (32.98 ms) : 0, 32980
Debugger [baseline] (61.623 ms) : 0, 61623
Debugger [candidate] (60.545 ms) : 0, 60545
Remote Config [baseline] (546.469 µs) : 0, 546
Remote Config [candidate] (535.101 µs) : 0, 535
Telemetry [baseline] (7.646 ms) : 0, 7646
Telemetry [candidate] (7.604 ms) : 0, 7604
Flare Poller [baseline] (3.564 ms) : 0, 3564
Flare Poller [candidate] (3.481 ms) : 0, 3481
IAST [baseline] (26.658 ms) : 0, 26658
IAST [candidate] (28.419 ms) : 0, 28419
section profiling
ProfilingAgent [baseline] (96.957 ms) : 0, 96957
ProfilingAgent [candidate] (97.574 ms) : 0, 97574
crashtracking [baseline] (1.438 ms) : 0, 1438
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (734.476 ms) : 0, 734476
BytebuddyAgent [candidate] (736.325 ms) : 0, 736325
GlobalTracer [baseline] (222.837 ms) : 0, 222837
GlobalTracer [candidate] (222.501 ms) : 0, 222501
AppSec [baseline] (32.373 ms) : 0, 32373
AppSec [candidate] (32.242 ms) : 0, 32242
Debugger [baseline] (63.325 ms) : 0, 63325
Debugger [candidate] (63.438 ms) : 0, 63438
Remote Config [baseline] (663.698 µs) : 0, 664
Remote Config [candidate] (650.901 µs) : 0, 651
Telemetry [baseline] (7.951 ms) : 0, 7951
Telemetry [candidate] (8.056 ms) : 0, 8056
Flare Poller [baseline] (3.778 ms) : 0, 3778
Flare Poller [candidate] (3.849 ms) : 0, 3849
Profiling [baseline] (97.545 ms) : 0, 97545
Profiling [candidate] (98.171 ms) : 0, 98171
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~0882768757, baseline=1.57.0-SNAPSHOT~614cc721f6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.101 s) : 0, 1100752
Total [baseline] (8.859 s) : 0, 8859041
Agent [candidate] (1.108 s) : 0, 1108075
Total [candidate] (8.894 s) : 0, 8894413
section iast
Agent [baseline] (1.239 s) : 0, 1239156
Total [baseline] (9.583 s) : 0, 9582977
Agent [candidate] (1.238 s) : 0, 1237648
Total [candidate] (9.558 s) : 0, 9557556
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.101 s -
Agent iast 1.239 s 138.404 ms (12.6%)
Total tracing 8.859 s -
Total iast 9.583 s 723.936 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.108 s -
Agent iast 1.238 s 129.573 ms (11.7%)
Total tracing 8.894 s -
Total iast 9.558 s 663.144 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~0882768757, baseline=1.57.0-SNAPSHOT~614cc721f6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.481 ms) : 0, 1481
crashtracking [candidate] (1.494 ms) : 0, 1494
BytebuddyAgent [baseline] (707.394 ms) : 0, 707394
BytebuddyAgent [candidate] (713.306 ms) : 0, 713306
GlobalTracer [baseline] (248.841 ms) : 0, 248841
GlobalTracer [candidate] (250.33 ms) : 0, 250330
AppSec [baseline] (32.216 ms) : 0, 32216
AppSec [candidate] (32.254 ms) : 0, 32254
Debugger [baseline] (63.335 ms) : 0, 63335
Debugger [candidate] (63.07 ms) : 0, 63070
Remote Config [baseline] (624.011 µs) : 0, 624
Remote Config [candidate] (629.98 µs) : 0, 630
Telemetry [baseline] (8.299 ms) : 0, 8299
Telemetry [candidate] (8.352 ms) : 0, 8352
Flare Poller [baseline] (3.707 ms) : 0, 3707
Flare Poller [candidate] (3.71 ms) : 0, 3710
section iast
crashtracking [baseline] (1.483 ms) : 0, 1483
crashtracking [candidate] (1.483 ms) : 0, 1483
BytebuddyAgent [baseline] (832.996 ms) : 0, 832996
BytebuddyAgent [candidate] (830.872 ms) : 0, 830872
GlobalTracer [baseline] (237.087 ms) : 0, 237087
GlobalTracer [candidate] (237.654 ms) : 0, 237654
AppSec [baseline] (31.287 ms) : 0, 31287
AppSec [candidate] (33.604 ms) : 0, 33604
Debugger [baseline] (60.053 ms) : 0, 60053
Debugger [candidate] (60.206 ms) : 0, 60206
Remote Config [baseline] (545.945 µs) : 0, 546
Remote Config [candidate] (540.661 µs) : 0, 541
Telemetry [baseline] (7.629 ms) : 0, 7629
Telemetry [candidate] (7.567 ms) : 0, 7567
Flare Poller [baseline] (3.524 ms) : 0, 3524
Flare Poller [candidate] (3.426 ms) : 0, 3426
IAST [baseline] (29.76 ms) : 0, 29760
IAST [candidate] (27.388 ms) : 0, 27388
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/dualship
git_commit_date 1763731854 1763738977
git_commit_sha 614cc72 0882768
release_version 1.57.0-SNAPSHOT~614cc721f6 1.57.0-SNAPSHOT~0882768757
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763741797 1763741797
ci_job_id 1251009323 1251009323
ci_pipeline_id 83610917 83610917
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-0e2zplxr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-0e2zplxr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-206.254µs; -126.580µs] or [-7.955%; -4.882%]		 better
[-587.042µs; -282.475µs] or [-7.809%; -3.757%]		 unstable
[-53.670op/s; +229.170op/s] or [-3.885%; +16.591%]		 2.426ms 7.083ms 1469.062op/s 2.593ms 7.518ms 1381.312op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+95.192µs; +182.576µs] or [+3.377%; +6.478%]		 same
[-37.643µs; +378.695µs] or [-0.472%; +4.750%]		 unstable
[-170.659op/s; +87.784op/s] or [-13.267%; +6.824%]		 2.957ms 8.143ms 1244.906op/s 2.819ms 7.973ms 1286.344op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.431ms; +1.812ms] or [+2.477%; +10.402%]		 unstable
[+0.046ms; +3.032ms] or [+0.157%; +10.291%]		 unstable
[-38.747op/s; +11.122op/s] or [-14.953%; +4.292%]		 18.541ms 31.001ms 245.312op/s 17.419ms 29.462ms 259.125op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~0882768757, baseline=1.57.0-SNAPSHOT~614cc721f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.007 ms) : 17825, 18190
.   : milestone, 18007,
appsec (18.88 ms) : 18686, 19073
.   : milestone, 18880,
code_origins (17.844 ms) : 17665, 18024
.   : milestone, 17844,
iast (17.83 ms) : 17654, 18006
.   : milestone, 17830,
profiling (18.578 ms) : 18393, 18763
.   : milestone, 18578,
tracing (17.599 ms) : 17424, 17773
.   : milestone, 17599,
section candidate
no_agent (19.026 ms) : 18831, 19221
.   : milestone, 19026,
appsec (19.011 ms) : 18817, 19206
.   : milestone, 19011,
code_origins (17.463 ms) : 17290, 17636
.   : milestone, 17463,
iast (17.937 ms) : 17760, 18113
.   : milestone, 17937,
profiling (18.616 ms) : 18433, 18800
.   : milestone, 18616,
tracing (17.719 ms) : 17543, 17895
.   : milestone, 17719,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.007 ms [17.825 ms, 18.19 ms] -
appsec 18.88 ms [18.686 ms, 19.073 ms] 872.657 µs (4.8%)
code_origins 17.844 ms [17.665 ms, 18.024 ms] -162.577 µs (-0.9%)
iast 17.83 ms [17.654 ms, 18.006 ms] -176.752 µs (-1.0%)
profiling 18.578 ms [18.393 ms, 18.763 ms] 570.753 µs (3.2%)
tracing 17.599 ms [17.424 ms, 17.773 ms] -408.189 µs (-2.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.026 ms [18.831 ms, 19.221 ms] -
appsec 19.011 ms [18.817 ms, 19.206 ms] -14.919 µs (-0.1%)
code_origins 17.463 ms [17.29 ms, 17.636 ms] -1.563 ms (-8.2%)
iast 17.937 ms [17.76 ms, 18.113 ms] -1.09 ms (-5.7%)
profiling 18.616 ms [18.433 ms, 18.8 ms] -409.997 µs (-2.2%)
tracing 17.719 ms [17.543 ms, 17.895 ms] -1.307 ms (-6.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~0882768757, baseline=1.57.0-SNAPSHOT~614cc721f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.206 ms) : 1194, 1218
.   : milestone, 1206,
iast (3.315 ms) : 3273, 3358
.   : milestone, 3315,
iast_FULL (6.015 ms) : 5953, 6077
.   : milestone, 6015,
iast_GLOBAL (3.563 ms) : 3514, 3612
.   : milestone, 3563,
profiling (2.148 ms) : 2126, 2170
.   : milestone, 2148,
tracing (1.84 ms) : 1824, 1856
.   : milestone, 1840,
section candidate
no_agent (1.211 ms) : 1199, 1223
.   : milestone, 1211,
iast (3.112 ms) : 3072, 3151
.   : milestone, 3112,
iast_FULL (5.836 ms) : 5777, 5896
.   : milestone, 5836,
iast_GLOBAL (3.685 ms) : 3632, 3739
.   : milestone, 3685,
profiling (2.189 ms) : 2169, 2210
.   : milestone, 2189,
tracing (1.815 ms) : 1800, 1829
.   : milestone, 1815,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.206 ms [1.194 ms, 1.218 ms] -
iast 3.315 ms [3.273 ms, 3.358 ms] 2.11 ms (175.0%)
iast_FULL 6.015 ms [5.953 ms, 6.077 ms] 4.809 ms (398.9%)
iast_GLOBAL 3.563 ms [3.514 ms, 3.612 ms] 2.357 ms (195.5%)
profiling 2.148 ms [2.126 ms, 2.17 ms] 942.492 µs (78.2%)
tracing 1.84 ms [1.824 ms, 1.856 ms] 634.628 µs (52.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.211 ms [1.199 ms, 1.223 ms] -
iast 3.112 ms [3.072 ms, 3.151 ms] 1.901 ms (157.0%)
iast_FULL 5.836 ms [5.777 ms, 5.896 ms] 4.626 ms (382.1%)
iast_GLOBAL 3.685 ms [3.632 ms, 3.739 ms] 2.475 ms (204.4%)
profiling 2.189 ms [2.169 ms, 2.21 ms] 978.886 µs (80.9%)
tracing 1.815 ms [1.8 ms, 1.829 ms] 603.928 µs (49.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/dualship
git_commit_date 1763731854 1763738977
git_commit_sha 614cc72 0882768
release_version 1.57.0-SNAPSHOT~614cc721f6 1.57.0-SNAPSHOT~0882768757
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763741555 1763741555
ci_job_id 1251009325 1251009325
ci_pipeline_id 83610917 83610917
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-qlb2dz0i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-qlb2dz0i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~0882768757, baseline=1.57.0-SNAPSHOT~614cc721f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (3.726 ms) : 3506, 3947
.   : milestone, 3726,
iast (2.227 ms) : 2163, 2292
.   : milestone, 2227,
iast_GLOBAL (2.259 ms) : 2194, 2324
.   : milestone, 2259,
profiling (2.085 ms) : 2031, 2138
.   : milestone, 2085,
tracing (2.053 ms) : 2002, 2103
.   : milestone, 2053,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.728 ms) : 3506, 3950
.   : milestone, 3728,
iast (2.231 ms) : 2166, 2296
.   : milestone, 2231,
iast_GLOBAL (2.262 ms) : 2198, 2327
.   : milestone, 2262,
profiling (2.072 ms) : 2020, 2125
.   : milestone, 2072,
tracing (2.054 ms) : 2003, 2105
.   : milestone, 2054,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.472 ms, 1.495 ms] -
appsec 3.726 ms [3.506 ms, 3.947 ms] 2.243 ms (151.2%)
iast 2.227 ms [2.163 ms, 2.292 ms] 743.882 µs (50.2%)
iast_GLOBAL 2.259 ms [2.194 ms, 2.324 ms] 775.844 µs (52.3%)
profiling 2.085 ms [2.031 ms, 2.138 ms] 601.491 µs (40.6%)
tracing 2.053 ms [2.002 ms, 2.103 ms] 569.347 µs (38.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 3.728 ms [3.506 ms, 3.95 ms] 2.248 ms (152.0%)
iast 2.231 ms [2.166 ms, 2.296 ms] 751.441 µs (50.8%)
iast_GLOBAL 2.262 ms [2.198 ms, 2.327 ms] 783.124 µs (52.9%)
profiling 2.072 ms [2.02 ms, 2.125 ms] 592.977 µs (40.1%)
tracing 2.054 ms [2.003 ms, 2.105 ms] 574.845 µs (38.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~0882768757, baseline=1.57.0-SNAPSHOT~614cc721f6
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.118 s) : 15118000, 15118000
.   : milestone, 15118000,
appsec (14.7 s) : 14700000, 14700000
.   : milestone, 14700000,
iast (18.213 s) : 18213000, 18213000
.   : milestone, 18213000,
iast_GLOBAL (17.988 s) : 17988000, 17988000
.   : milestone, 17988000,
profiling (14.775 s) : 14775000, 14775000
.   : milestone, 14775000,
tracing (14.959 s) : 14959000, 14959000
.   : milestone, 14959000,
section candidate
no_agent (14.819 s) : 14819000, 14819000
.   : milestone, 14819000,
appsec (15.125 s) : 15125000, 15125000
.   : milestone, 15125000,
iast (18.511 s) : 18511000, 18511000
.   : milestone, 18511000,
iast_GLOBAL (17.984 s) : 17984000, 17984000
.   : milestone, 17984000,
profiling (14.765 s) : 14765000, 14765000
.   : milestone, 14765000,
tracing (14.892 s) : 14892000, 14892000
.   : milestone, 14892000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.118 s [15.118 s, 15.118 s] -
appsec 14.7 s [14.7 s, 14.7 s] -418.0 ms (-2.8%)
iast 18.213 s [18.213 s, 18.213 s] 3.095 s (20.5%)
iast_GLOBAL 17.988 s [17.988 s, 17.988 s] 2.87 s (19.0%)
profiling 14.775 s [14.775 s, 14.775 s] -343.0 ms (-2.3%)
tracing 14.959 s [14.959 s, 14.959 s] -159.0 ms (-1.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.819 s [14.819 s, 14.819 s] -
appsec 15.125 s [15.125 s, 15.125 s] 306.0 ms (2.1%)
iast 18.511 s [18.511 s, 18.511 s] 3.692 s (24.9%)
iast_GLOBAL 17.984 s [17.984 s, 17.984 s] 3.165 s (21.4%)
profiling 14.765 s [14.765 s, 14.765 s] -54.0 ms (-0.4%)
tracing 14.892 s [14.892 s, 14.892 s] 73.0 ms (0.5%)

@pr-commenter
Copy link

pr-commenter bot commented Nov 21, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1763737917 1763738252
end_time 2025-11-21T15:13:19 2025-11-21T15:18:55
git_branch master andrea.marziali/dualship
git_commit_sha 614cc72 b921659
start_time 2025-11-21T15:11:57 2025-11-21T15:17:33
See matching parameters
Baseline Candidate
ci_job_id 1250844207 1250844207
ci_pipeline_id 83600252 83600252
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1763736936 1763736936

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 7 metrics, 8 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-59.135µs; +34.084µs] or [-19.580%; +11.286%]		 unstable
[-73.753µs; +41.176µs] or [-21.331%; +11.909%]		 unstable
[-89.749µs; +51.609µs] or [-24.689%; +14.197%]		 unstable
[-703.419µs; +293.699µs] or [-59.843%; +24.986%]		 unstable
[-127.167op/s; +127.167op/s] or [-5.277%; +5.277%]
scenario:basic same same same unstable
[-92.405µs; +176.369µs] or [-11.781%; +22.486%]		 unstable
[-127.260op/s; +255.465op/s] or [-5.090%; +10.219%]
scenario:loop same same same unstable
[-322.103µs; +564.535µs] or [-3.695%; +6.477%]		 same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (345.758 µs) : 277, 414
.   : milestone, 346,
basic (296.369 µs) : 286, 307
.   : milestone, 296,
loop (8.442 ms) : 8380, 8504
.   : milestone, 8442,
section candidate
noprobe (329.469 µs) : 294, 365
.   : milestone, 329,
basic (294.3 µs) : 287, 302
.   : milestone, 294,
loop (8.44 ms) : 8379, 8501
.   : milestone, 8440,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 345.758 µs [277.278 µs, 414.238 µs]
basic 296.369 µs [285.882 µs, 306.857 µs]
loop 8.442 ms [8.38 ms, 8.504 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 329.469 µs [293.572 µs, 365.366 µs]
basic 294.3 µs [286.684 µs, 301.917 µs]
loop 8.44 ms [8.379 ms, 8.501 ms]

@amarziali amarziali force-pushed the andrea.marziali/dualship branch from b921659 to 0882768 Compare November 21, 2025 15:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@amarziali