Skip to content

Add support for Weaver Framework v0.11 #10012

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Add support for Weaver Framework v0.11 #10012

wants to merge 2 commits into from
+1,512 −25

Conversation

@daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Nov 21, 2025

What Does This Do

  • Adds support for v0.11 of Weaver

Motivation

  • The newest released version of Weaver introduced several breaking changes:
    • The Result.Cancelled outcome (and cancel method) were removed in favor of Result.Ignored
    • Result.Failure outcome was refactored to Result.Failures.Failure
    • Several fields were updated to stop using Optional<>:
      • Result.Ignored.reason
      • Result.Failures.Failure.source
    • AssertionException was renamed to ExpectationFailed

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@daniel-mohedano daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Nov 21, 2025
@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025 •
edited
Loading

Test Environment - sbt-scalatest

Job Status: success

Scenario Overhead (%)
agent 57.68
agentEvpProxy 57.30

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025 •
edited
Loading

Test Environment - nebula-release-plugin

Job Status: success

Scenario Overhead (%)
agent 36.58
agentless 36.59
agentlessCodeCoverage 45.68
agentlessLineCoverage 74.25

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025 •
edited
Loading

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 11.10
agentless 11.35
agentlessCodeCoverage 18.58

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025 •
edited
Loading

Test Environment - netflix-zuul

Job Status: success

Scenario Overhead (%)
agent 91.50
agentless 85.16
agentlessCodeCoverage 99.27
agentlessLineCoverage 113.12

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025 •
edited
Loading

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent 23.06
agentless 18.19
agentlessCodeCoverage 19.56
agentlessLineCoverage 30.02

@datadog-official
Copy link

datadog-official bot commented Nov 21, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.65%

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 5601ed3 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025 •
edited
Loading

Test Environment - sonar-kotlin

Job Status: success

Scenario Overhead (%)
agent 15.17
agentless 13.31
agentlessCodeCoverage 15.87
agentlessLineCoverage 19.90

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025 •
edited
Loading

Test Environment - jolokia

Job Status: success

Scenario Overhead (%)
agent 88.90
agentless 84.43
agentlessCodeCoverage 92.14
agentlessLineCoverage 94.86

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025 •
edited
Loading

Test Environment - spring_boot

Job Status: success

Scenario Overhead (%)
agent 11.91
agentless 6.07
agentlessCodeCoverage 9.99
agentlessLineCoverage 29.59

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025

Test Environment - okhttp

Job Status: success

Scenario Overhead (%)
agent 18.98
agentless 18.34
agentlessCodeCoverage 20.56
agentlessLineCoverage 37.18

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Nov 21, 2025 •
edited
Loading

Test Environment - sonar-java

Job Status: success

Scenario Overhead (%)
agent 5.22
agentless -4.87
agentlessCodeCoverage 79.28
agentlessLineCoverage 162.79

@daniel-mohedano daniel-mohedano marked this pull request as ready for review November 21, 2025 15:52
@daniel-mohedano daniel-mohedano requested a review from a team as a code owner November 21, 2025 15:52
@pr-commenter
Copy link

pr-commenter bot commented Nov 21, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/update-latest-weaver
git_commit_date 1763361517 1763738001
git_commit_sha d0353e2 5601ed3
release_version 1.56.0-SNAPSHOT~d0353e2240 1.56.0-SNAPSHOT~5601ed38db
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763740075 1763740075
ci_job_id 1250924778 1250924778
ci_pipeline_id 83605887 83605887
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-3356iixx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-3356iixx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~5601ed38db, baseline=1.56.0-SNAPSHOT~d0353e2240

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.098 s) : 0, 1098342
Total [baseline] (10.764 s) : 0, 10763872
Agent [candidate] (1.106 s) : 0, 1106456
Total [candidate] (10.945 s) : 0, 10944607
section appsec
Agent [baseline] (1.278 s) : 0, 1278124
Total [baseline] (11.121 s) : 0, 11120542
Agent [candidate] (1.287 s) : 0, 1287385
Total [candidate] (11.044 s) : 0, 11044027
section iast
Agent [baseline] (1.256 s) : 0, 1255618
Total [baseline] (11.22 s) : 0, 11220177
Agent [candidate] (1.234 s) : 0, 1234431
Total [candidate] (11.221 s) : 0, 11221264
section profiling
Agent [baseline] (1.23 s) : 0, 1229746
Total [baseline] (10.971 s) : 0, 10970784
Agent [candidate] (1.232 s) : 0, 1231897
Total [candidate] (11.104 s) : 0, 11104219
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.098 s -
Agent appsec 1.278 s 179.782 ms (16.4%)
Agent iast 1.256 s 157.276 ms (14.3%)
Agent profiling 1.23 s 131.404 ms (12.0%)
Total tracing 10.764 s -
Total appsec 11.121 s 356.67 ms (3.3%)
Total iast 11.22 s 456.305 ms (4.2%)
Total profiling 10.971 s 206.912 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.106 s -
Agent appsec 1.287 s 180.929 ms (16.4%)
Agent iast 1.234 s 127.975 ms (11.6%)
Agent profiling 1.232 s 125.441 ms (11.3%)
Total tracing 10.945 s -
Total appsec 11.044 s 99.421 ms (0.9%)
Total iast 11.221 s 276.657 ms (2.5%)
Total profiling 11.104 s 159.612 ms (1.5%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~5601ed38db, baseline=1.56.0-SNAPSHOT~d0353e2240

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (705.098 ms) : 0, 705098
BytebuddyAgent [candidate] (710.608 ms) : 0, 710608
GlobalTracer [baseline] (247.968 ms) : 0, 247968
GlobalTracer [candidate] (249.784 ms) : 0, 249784
AppSec [baseline] (32.101 ms) : 0, 32101
AppSec [candidate] (32.514 ms) : 0, 32514
Debugger [baseline] (64.302 ms) : 0, 64302
Debugger [candidate] (64.333 ms) : 0, 64333
Remote Config [baseline] (643.402 µs) : 0, 643
Remote Config [candidate] (643.824 µs) : 0, 644
Telemetry [baseline] (8.274 ms) : 0, 8274
Telemetry [candidate] (8.357 ms) : 0, 8357
Flare Poller [baseline] (3.684 ms) : 0, 3684
Flare Poller [candidate] (3.74 ms) : 0, 3740
section appsec
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (729.374 ms) : 0, 729374
BytebuddyAgent [candidate] (734.889 ms) : 0, 734889
GlobalTracer [baseline] (239.71 ms) : 0, 239710
GlobalTracer [candidate] (241.815 ms) : 0, 241815
IAST [baseline] (24.546 ms) : 0, 24546
IAST [candidate] (25.002 ms) : 0, 25002
AppSec [baseline] (174.43 ms) : 0, 174430
AppSec [candidate] (174.941 ms) : 0, 174941
Debugger [baseline] (60.792 ms) : 0, 60792
Debugger [candidate] (61.238 ms) : 0, 61238
Remote Config [baseline] (689.795 µs) : 0, 690
Remote Config [candidate] (686.327 µs) : 0, 686
Telemetry [baseline] (8.218 ms) : 0, 8218
Telemetry [candidate] (8.332 ms) : 0, 8332
Flare Poller [baseline] (3.904 ms) : 0, 3904
Flare Poller [candidate] (3.891 ms) : 0, 3891
section iast
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.441 ms) : 0, 1441
BytebuddyAgent [baseline] (843.178 ms) : 0, 843178
BytebuddyAgent [candidate] (827.046 ms) : 0, 827046
GlobalTracer [baseline] (240.176 ms) : 0, 240176
GlobalTracer [candidate] (237.509 ms) : 0, 237509
IAST [baseline] (32.455 ms) : 0, 32455
IAST [candidate] (33.326 ms) : 0, 33326
AppSec [baseline] (29.832 ms) : 0, 29832
AppSec [candidate] (27.687 ms) : 0, 27687
Debugger [baseline] (61.496 ms) : 0, 61496
Debugger [candidate] (61.01 ms) : 0, 61010
Remote Config [baseline] (546.064 µs) : 0, 546
Remote Config [candidate] (536.132 µs) : 0, 536
Telemetry [baseline] (7.731 ms) : 0, 7731
Telemetry [candidate] (7.667 ms) : 0, 7667
Flare Poller [baseline] (3.562 ms) : 0, 3562
Flare Poller [candidate] (3.54 ms) : 0, 3540
section profiling
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.43 ms) : 0, 1430
BytebuddyAgent [baseline] (731.017 ms) : 0, 731017
BytebuddyAgent [candidate] (731.693 ms) : 0, 731693
GlobalTracer [baseline] (222.35 ms) : 0, 222350
GlobalTracer [candidate] (222.862 ms) : 0, 222862
AppSec [baseline] (32.303 ms) : 0, 32303
AppSec [candidate] (32.227 ms) : 0, 32227
Debugger [baseline] (62.771 ms) : 0, 62771
Debugger [candidate] (63.524 ms) : 0, 63524
Remote Config [baseline] (665.419 µs) : 0, 665
Remote Config [candidate] (652.48 µs) : 0, 652
Telemetry [baseline] (8.049 ms) : 0, 8049
Telemetry [candidate] (8.001 ms) : 0, 8001
Flare Poller [baseline] (3.792 ms) : 0, 3792
Flare Poller [candidate] (3.759 ms) : 0, 3759
ProfilingAgent [baseline] (97.604 ms) : 0, 97604
ProfilingAgent [candidate] (98.032 ms) : 0, 98032
Profiling [baseline] (98.18 ms) : 0, 98180
Profiling [candidate] (98.634 ms) : 0, 98634
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~5601ed38db, baseline=1.56.0-SNAPSHOT~d0353e2240

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.104 s) : 0, 1104394
Total [baseline] (8.841 s) : 0, 8840518
Agent [candidate] (1.099 s) : 0, 1099101
Total [candidate] (8.816 s) : 0, 8816004
section iast
Agent [baseline] (1.239 s) : 0, 1239168
Total [baseline] (9.584 s) : 0, 9583947
Agent [candidate] (1.241 s) : 0, 1240672
Total [candidate] (9.53 s) : 0, 9529665
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.104 s -
Agent iast 1.239 s 134.774 ms (12.2%)
Total tracing 8.841 s -
Total iast 9.584 s 743.429 ms (8.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.099 s -
Agent iast 1.241 s 141.571 ms (12.9%)
Total tracing 8.816 s -
Total iast 9.53 s 713.661 ms (8.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~5601ed38db, baseline=1.56.0-SNAPSHOT~d0353e2240

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (710.593 ms) : 0, 710593
BytebuddyAgent [candidate] (706.079 ms) : 0, 706079
GlobalTracer [baseline] (248.472 ms) : 0, 248472
GlobalTracer [candidate] (248.435 ms) : 0, 248435
AppSec [baseline] (32.47 ms) : 0, 32470
AppSec [candidate] (32.313 ms) : 0, 32313
Debugger [baseline] (63.919 ms) : 0, 63919
Debugger [candidate] (63.404 ms) : 0, 63404
Remote Config [baseline] (632.71 µs) : 0, 633
Remote Config [candidate] (632.365 µs) : 0, 632
Telemetry [baseline] (8.203 ms) : 0, 8203
Telemetry [candidate] (8.216 ms) : 0, 8216
Flare Poller [baseline] (3.721 ms) : 0, 3721
Flare Poller [candidate] (3.746 ms) : 0, 3746
section iast
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (830.947 ms) : 0, 830947
BytebuddyAgent [candidate] (832.442 ms) : 0, 832442
GlobalTracer [baseline] (238.252 ms) : 0, 238252
GlobalTracer [candidate] (238.743 ms) : 0, 238743
IAST [baseline] (26.616 ms) : 0, 26616
IAST [candidate] (28.346 ms) : 0, 28346
AppSec [baseline] (34.975 ms) : 0, 34975
AppSec [candidate] (32.958 ms) : 0, 32958
Debugger [baseline] (60.1 ms) : 0, 60100
Debugger [candidate] (60.108 ms) : 0, 60108
Remote Config [baseline] (534.238 µs) : 0, 534
Remote Config [candidate] (543.612 µs) : 0, 544
Telemetry [baseline] (7.712 ms) : 0, 7712
Telemetry [candidate] (7.658 ms) : 0, 7658
Flare Poller [baseline] (3.501 ms) : 0, 3501
Flare Poller [candidate] (3.493 ms) : 0, 3493
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/update-latest-weaver
git_commit_date 1763361517 1763738001
git_commit_sha d0353e2 5601ed3
release_version 1.56.0-SNAPSHOT~d0353e2240 1.56.0-SNAPSHOT~5601ed38db
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763740650 1763740650
ci_job_id 1250924779 1250924779
ci_pipeline_id 83605887 83605887
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-x529p6jy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-x529p6jy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 0 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load better
[-433.755µs; -201.648µs] or [-8.182%; -3.804%]		 better
[-1005.058µs; -273.628µs] or [-8.008%; -2.180%]		 unstable
[-42.361op/s; +122.986op/s] or [-5.453%; +15.830%]		 4.983ms 11.912ms 817.219op/s 5.301ms 12.551ms 776.906op/s
scenario:load:petclinic:appsec:high_load better
[-1272.903µs; -527.266µs] or [-6.569%; -2.721%]		 same
[-1586.378µs; +247.435µs] or [-5.142%; +0.802%]		 unstable
[-18.210op/s; +37.773op/s] or [-7.651%; +15.871%]		 18.479ms 30.182ms 247.781op/s 19.379ms 30.852ms 238.000op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~5601ed38db, baseline=1.56.0-SNAPSHOT~d0353e2240
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.085 ms) : 17901, 18269
.   : milestone, 18085,
appsec (19.612 ms) : 19413, 19810
.   : milestone, 19612,
code_origins (17.766 ms) : 17588, 17943
.   : milestone, 17766,
iast (18.008 ms) : 17827, 18188
.   : milestone, 18008,
profiling (19.579 ms) : 19382, 19775
.   : milestone, 19579,
tracing (17.618 ms) : 17444, 17791
.   : milestone, 17618,
section candidate
no_agent (19.101 ms) : 18904, 19298
.   : milestone, 19101,
appsec (18.838 ms) : 18644, 19031
.   : milestone, 18838,
code_origins (17.511 ms) : 17339, 17683
.   : milestone, 17511,
iast (17.997 ms) : 17816, 18179
.   : milestone, 17997,
profiling (20.268 ms) : 20060, 20476
.   : milestone, 20268,
tracing (17.788 ms) : 17612, 17965
.   : milestone, 17788,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.085 ms [17.901 ms, 18.269 ms] -
appsec 19.612 ms [19.413 ms, 19.81 ms] 1.527 ms (8.4%)
code_origins 17.766 ms [17.588 ms, 17.943 ms] -319.618 µs (-1.8%)
iast 18.008 ms [17.827 ms, 18.188 ms] -77.53 µs (-0.4%)
profiling 19.579 ms [19.382 ms, 19.775 ms] 1.493 ms (8.3%)
tracing 17.618 ms [17.444 ms, 17.791 ms] -467.674 µs (-2.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.101 ms [18.904 ms, 19.298 ms] -
appsec 18.838 ms [18.644 ms, 19.031 ms] -263.354 µs (-1.4%)
code_origins 17.511 ms [17.339 ms, 17.683 ms] -1.591 ms (-8.3%)
iast 17.997 ms [17.816 ms, 18.179 ms] -1.104 ms (-5.8%)
profiling 20.268 ms [20.06 ms, 20.476 ms] 1.167 ms (6.1%)
tracing 17.788 ms [17.612 ms, 17.965 ms] -1.313 ms (-6.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~5601ed38db, baseline=1.56.0-SNAPSHOT~d0353e2240
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.194 ms) : 1183, 1205
.   : milestone, 1194,
iast (3.226 ms) : 3176, 3276
.   : milestone, 3226,
iast_FULL (5.953 ms) : 5892, 6014
.   : milestone, 5953,
iast_GLOBAL (3.5 ms) : 3450, 3549
.   : milestone, 3500,
profiling (2.206 ms) : 2186, 2226
.   : milestone, 2206,
tracing (1.825 ms) : 1810, 1841
.   : milestone, 1825,
section candidate
no_agent (1.213 ms) : 1202, 1225
.   : milestone, 1213,
iast (3.289 ms) : 3253, 3326
.   : milestone, 3289,
iast_FULL (5.654 ms) : 5598, 5711
.   : milestone, 5654,
iast_GLOBAL (3.634 ms) : 3572, 3697
.   : milestone, 3634,
profiling (2.026 ms) : 2009, 2043
.   : milestone, 2026,
tracing (1.824 ms) : 1808, 1839
.   : milestone, 1824,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.194 ms [1.183 ms, 1.205 ms] -
iast 3.226 ms [3.176 ms, 3.276 ms] 2.032 ms (170.2%)
iast_FULL 5.953 ms [5.892 ms, 6.014 ms] 4.759 ms (398.6%)
iast_GLOBAL 3.5 ms [3.45 ms, 3.549 ms] 2.306 ms (193.1%)
profiling 2.206 ms [2.186 ms, 2.226 ms] 1.012 ms (84.7%)
tracing 1.825 ms [1.81 ms, 1.841 ms] 631.093 µs (52.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.213 ms [1.202 ms, 1.225 ms] -
iast 3.289 ms [3.253 ms, 3.326 ms] 2.076 ms (171.1%)
iast_FULL 5.654 ms [5.598 ms, 5.711 ms] 4.441 ms (366.0%)
iast_GLOBAL 3.634 ms [3.572 ms, 3.697 ms] 2.421 ms (199.5%)
profiling 2.026 ms [2.009 ms, 2.043 ms] 812.469 µs (67.0%)
tracing 1.824 ms [1.808 ms, 1.839 ms] 610.051 µs (50.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/update-latest-weaver
git_commit_date 1763361517 1763738001
git_commit_sha d0353e2 5601ed3
release_version 1.56.0-SNAPSHOT~d0353e2240 1.56.0-SNAPSHOT~5601ed38db
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1763740325 1763740325
ci_job_id 1250924781 1250924781
ci_pipeline_id 83605887 83605887
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-x7lh9fbl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-x7lh9fbl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~5601ed38db, baseline=1.56.0-SNAPSHOT~d0353e2240
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1487
.   : milestone, 1475,
appsec (2.468 ms) : 2417, 2519
.   : milestone, 2468,
iast (2.201 ms) : 2138, 2264
.   : milestone, 2201,
iast_GLOBAL (2.242 ms) : 2178, 2305
.   : milestone, 2242,
profiling (2.08 ms) : 2028, 2133
.   : milestone, 2080,
tracing (2.027 ms) : 1978, 2077
.   : milestone, 2027,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (3.65 ms) : 3438, 3862
.   : milestone, 3650,
iast (2.215 ms) : 2151, 2279
.   : milestone, 2215,
iast_GLOBAL (2.254 ms) : 2189, 2318
.   : milestone, 2254,
profiling (2.073 ms) : 2021, 2126
.   : milestone, 2073,
tracing (2.026 ms) : 1977, 2076
.   : milestone, 2026,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.487 ms] -
appsec 2.468 ms [2.417 ms, 2.519 ms] 992.631 µs (67.3%)
iast 2.201 ms [2.138 ms, 2.264 ms] 725.627 µs (49.2%)
iast_GLOBAL 2.242 ms [2.178 ms, 2.305 ms] 766.552 µs (52.0%)
profiling 2.08 ms [2.028 ms, 2.133 ms] 605.442 µs (41.0%)
tracing 2.027 ms [1.978 ms, 2.077 ms] 552.277 µs (37.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 3.65 ms [3.438 ms, 3.862 ms] 2.175 ms (147.4%)
iast 2.215 ms [2.151 ms, 2.279 ms] 739.344 µs (50.1%)
iast_GLOBAL 2.254 ms [2.189 ms, 2.318 ms] 777.893 µs (52.7%)
profiling 2.073 ms [2.021 ms, 2.126 ms] 597.383 µs (40.5%)
tracing 2.026 ms [1.977 ms, 2.076 ms] 550.695 µs (37.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~5601ed38db, baseline=1.56.0-SNAPSHOT~d0353e2240
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.017 s) : 15017000, 15017000
.   : milestone, 15017000,
appsec (14.731 s) : 14731000, 14731000
.   : milestone, 14731000,
iast (18.317 s) : 18317000, 18317000
.   : milestone, 18317000,
iast_GLOBAL (17.839 s) : 17839000, 17839000
.   : milestone, 17839000,
profiling (15.063 s) : 15063000, 15063000
.   : milestone, 15063000,
tracing (14.885 s) : 14885000, 14885000
.   : milestone, 14885000,
section candidate
no_agent (14.992 s) : 14992000, 14992000
.   : milestone, 14992000,
appsec (14.724 s) : 14724000, 14724000
.   : milestone, 14724000,
iast (18.62 s) : 18620000, 18620000
.   : milestone, 18620000,
iast_GLOBAL (17.744 s) : 17744000, 17744000
.   : milestone, 17744000,
profiling (14.848 s) : 14848000, 14848000
.   : milestone, 14848000,
tracing (14.815 s) : 14815000, 14815000
.   : milestone, 14815000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.017 s [15.017 s, 15.017 s] -
appsec 14.731 s [14.731 s, 14.731 s] -286.0 ms (-1.9%)
iast 18.317 s [18.317 s, 18.317 s] 3.3 s (22.0%)
iast_GLOBAL 17.839 s [17.839 s, 17.839 s] 2.822 s (18.8%)
profiling 15.063 s [15.063 s, 15.063 s] 46.0 ms (0.3%)
tracing 14.885 s [14.885 s, 14.885 s] -132.0 ms (-0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.992 s [14.992 s, 14.992 s] -
appsec 14.724 s [14.724 s, 14.724 s] -268.0 ms (-1.8%)
iast 18.62 s [18.62 s, 18.62 s] 3.628 s (24.2%)
iast_GLOBAL 17.744 s [17.744 s, 17.744 s] 2.752 s (18.4%)
profiling 14.848 s [14.848 s, 14.848 s] -144.0 ms (-1.0%)
tracing 14.815 s [14.815 s, 14.815 s] -177.0 ms (-1.2%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@nikita-tkachenko-datadog nikita-tkachenko-datadog nikita-tkachenko-datadog approved these changes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@daniel-mohedano @nikita-tkachenko-datadog @AlexeyKuznetsov-DD