Skip to content

Comments

Test latest JDK 26 RC image#10626

Draft
sarahchen6 wants to merge 5 commits intomasterfrom
sarahchen6/test-26-rc
Draft

Test latest JDK 26 RC image#10626
sarahchen6 wants to merge 5 commits intomasterfrom
sarahchen6/test-26-rc

Conversation

@sarahchen6
Copy link
Contributor

What Does This Do

Test DataDog/dd-trace-java-docker-build#133

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@sarahchen6 sarahchen6 added the tag: do not merge Do not merge changes label Feb 18, 2026
@pr-commenter
Copy link

pr-commenter bot commented Feb 18, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-26-rc
git_commit_date 1771612286 1771614330
git_commit_sha 4789e89 4d6a29c
release_version 1.60.0-SNAPSHOT~4789e8923e 1.60.0-SNAPSHOT~4d6a29c643
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771616060 1771616060
ci_job_id 1444306207 1444306207
ci_pipeline_id 97949503 97949503
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-99pj3lh1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-99pj3lh1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~4d6a29c643, baseline=1.60.0-SNAPSHOT~4789e8923e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1070044
Total [baseline] (8.783 s) : 0, 8783387
Agent [candidate] (1.069 s) : 0, 1069412
Total [candidate] (8.75 s) : 0, 8750246
section iast
Agent [baseline] (1.226 s) : 0, 1225703
Total [baseline] (9.322 s) : 0, 9322455
Agent [candidate] (1.232 s) : 0, 1232188
Total [candidate] (9.365 s) : 0, 9365037
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent iast 1.226 s 155.659 ms (14.5%)
Total tracing 8.783 s -
Total iast 9.322 s 539.068 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.232 s 162.776 ms (15.2%)
Total tracing 8.75 s -
Total iast 9.365 s 614.791 ms (7.0%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~4d6a29c643, baseline=1.60.0-SNAPSHOT~4789e8923e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (631.631 ms) : 0, 631631
BytebuddyAgent [candidate] (630.305 ms) : 0, 630305
AgentMeter [baseline] (29.191 ms) : 0, 29191
AgentMeter [candidate] (29.202 ms) : 0, 29202
GlobalTracer [baseline] (258.657 ms) : 0, 258657
GlobalTracer [candidate] (258.574 ms) : 0, 258574
AppSec [baseline] (33.425 ms) : 0, 33425
AppSec [candidate] (33.043 ms) : 0, 33043
Debugger [baseline] (64.075 ms) : 0, 64075
Debugger [candidate] (64.299 ms) : 0, 64299
Remote Config [baseline] (630.473 µs) : 0, 630
Remote Config [candidate] (640.87 µs) : 0, 641
Telemetry [baseline] (9.862 ms) : 0, 9862
Telemetry [candidate] (10.492 ms) : 0, 10492
Flare Poller [baseline] (5.247 ms) : 0, 5247
Flare Poller [candidate] (5.386 ms) : 0, 5386
section iast
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (792.28 ms) : 0, 792280
BytebuddyAgent [candidate] (796.166 ms) : 0, 796166
AgentMeter [baseline] (11.269 ms) : 0, 11269
AgentMeter [candidate] (11.329 ms) : 0, 11329
GlobalTracer [baseline] (246.517 ms) : 0, 246517
GlobalTracer [candidate] (247.921 ms) : 0, 247921
IAST [baseline] (27.029 ms) : 0, 27029
IAST [candidate] (27.299 ms) : 0, 27299
AppSec [baseline] (35.342 ms) : 0, 35342
AppSec [candidate] (35.588 ms) : 0, 35588
Debugger [baseline] (63.406 ms) : 0, 63406
Debugger [candidate] (63.941 ms) : 0, 63941
Remote Config [baseline] (541.086 µs) : 0, 541
Remote Config [candidate] (529.573 µs) : 0, 530
Telemetry [baseline] (8.696 ms) : 0, 8696
Telemetry [candidate] (8.743 ms) : 0, 8743
Flare Poller [baseline] (3.506 ms) : 0, 3506
Flare Poller [candidate] (3.489 ms) : 0, 3489
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~4d6a29c643, baseline=1.60.0-SNAPSHOT~4789e8923e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1070961
Total [baseline] (11.014 s) : 0, 11014345
Agent [candidate] (1.072 s) : 0, 1071528
Total [candidate] (10.899 s) : 0, 10899463
section appsec
Agent [baseline] (1.235 s) : 0, 1235445
Total [baseline] (11.058 s) : 0, 11057647
Agent [candidate] (1.246 s) : 0, 1245682
Total [candidate] (11.047 s) : 0, 11046980
section iast
Agent [baseline] (1.232 s) : 0, 1231513
Total [baseline] (11.244 s) : 0, 11243722
Agent [candidate] (1.236 s) : 0, 1235601
Total [candidate] (11.174 s) : 0, 11174029
section profiling
Agent [baseline] (1.193 s) : 0, 1193080
Total [baseline] (11.002 s) : 0, 11002219
Agent [candidate] (1.197 s) : 0, 1197047
Total [candidate] (10.922 s) : 0, 10921765
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent appsec 1.235 s 164.484 ms (15.4%)
Agent iast 1.232 s 160.553 ms (15.0%)
Agent profiling 1.193 s 122.119 ms (11.4%)
Total tracing 11.014 s -
Total appsec 11.058 s 43.302 ms (0.4%)
Total iast 11.244 s 229.377 ms (2.1%)
Total profiling 11.002 s -12.126 ms (-0.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent appsec 1.246 s 174.154 ms (16.3%)
Agent iast 1.236 s 164.073 ms (15.3%)
Agent profiling 1.197 s 125.519 ms (11.7%)
Total tracing 10.899 s -
Total appsec 11.047 s 147.517 ms (1.4%)
Total iast 11.174 s 274.566 ms (2.5%)
Total profiling 10.922 s 22.301 ms (0.2%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~4d6a29c643, baseline=1.60.0-SNAPSHOT~4789e8923e

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (632.395 ms) : 0, 632395
BytebuddyAgent [candidate] (630.763 ms) : 0, 630763
AgentMeter [baseline] (29.089 ms) : 0, 29089
AgentMeter [candidate] (29.199 ms) : 0, 29199
GlobalTracer [baseline] (257.897 ms) : 0, 257897
GlobalTracer [candidate] (258.931 ms) : 0, 258931
AppSec [baseline] (32.992 ms) : 0, 32992
AppSec [candidate] (33.087 ms) : 0, 33087
Debugger [baseline] (66.234 ms) : 0, 66234
Debugger [candidate] (65.49 ms) : 0, 65490
Remote Config [baseline] (626.366 µs) : 0, 626
Remote Config [candidate] (631.74 µs) : 0, 632
Telemetry [baseline] (10.624 ms) : 0, 10624
Telemetry [candidate] (10.738 ms) : 0, 10738
Flare Poller [baseline] (3.85 ms) : 0, 3850
Flare Poller [candidate] (5.395 ms) : 0, 5395
section appsec
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (655.383 ms) : 0, 655383
BytebuddyAgent [candidate] (662.402 ms) : 0, 662402
AgentMeter [baseline] (12.005 ms) : 0, 12005
AgentMeter [candidate] (12.01 ms) : 0, 12010
GlobalTracer [baseline] (257.488 ms) : 0, 257488
GlobalTracer [candidate] (259.189 ms) : 0, 259189
IAST [baseline] (25.376 ms) : 0, 25376
IAST [candidate] (25.533 ms) : 0, 25533
AppSec [baseline] (167.597 ms) : 0, 167597
AppSec [candidate] (168.357 ms) : 0, 168357
Debugger [baseline] (66.665 ms) : 0, 66665
Debugger [candidate] (66.923 ms) : 0, 66923
Remote Config [baseline] (666.44 µs) : 0, 666
Remote Config [candidate] (641.687 µs) : 0, 642
Telemetry [baseline] (9.445 ms) : 0, 9445
Telemetry [candidate] (9.593 ms) : 0, 9593
Flare Poller [baseline] (3.666 ms) : 0, 3666
Flare Poller [candidate] (3.75 ms) : 0, 3750
section iast
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (794.049 ms) : 0, 794049
BytebuddyAgent [candidate] (797.504 ms) : 0, 797504
AgentMeter [baseline] (11.369 ms) : 0, 11369
AgentMeter [candidate] (11.351 ms) : 0, 11351
GlobalTracer [baseline] (248.171 ms) : 0, 248171
GlobalTracer [candidate] (248.575 ms) : 0, 248575
IAST [baseline] (27.35 ms) : 0, 27350
IAST [candidate] (27.196 ms) : 0, 27196
AppSec [baseline] (34.839 ms) : 0, 34839
AppSec [candidate] (33.177 ms) : 0, 33177
Debugger [baseline] (66.017 ms) : 0, 66017
Debugger [candidate] (67.696 ms) : 0, 67696
Remote Config [baseline] (543.777 µs) : 0, 544
Remote Config [candidate] (552.161 µs) : 0, 552
Telemetry [baseline] (8.636 ms) : 0, 8636
Telemetry [candidate] (8.791 ms) : 0, 8791
Flare Poller [baseline] (3.461 ms) : 0, 3461
Flare Poller [candidate] (3.545 ms) : 0, 3545
section profiling
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (684.431 ms) : 0, 684431
BytebuddyAgent [candidate] (686.989 ms) : 0, 686989
AgentMeter [baseline] (8.488 ms) : 0, 8488
AgentMeter [candidate] (8.547 ms) : 0, 8547
GlobalTracer [baseline] (215.765 ms) : 0, 215765
GlobalTracer [candidate] (217.261 ms) : 0, 217261
AppSec [baseline] (32.474 ms) : 0, 32474
AppSec [candidate] (32.745 ms) : 0, 32745
Debugger [baseline] (67.42 ms) : 0, 67420
Debugger [candidate] (67.112 ms) : 0, 67112
Remote Config [baseline] (623.835 µs) : 0, 624
Remote Config [candidate] (642.679 µs) : 0, 643
Telemetry [baseline] (9.126 ms) : 0, 9126
Telemetry [candidate] (9.031 ms) : 0, 9031
Flare Poller [baseline] (3.785 ms) : 0, 3785
Flare Poller [candidate] (3.777 ms) : 0, 3777
ProfilingAgent [baseline] (99.028 ms) : 0, 99028
ProfilingAgent [candidate] (98.8 ms) : 0, 98800
Profiling [baseline] (99.614 ms) : 0, 99614
Profiling [candidate] (99.373 ms) : 0, 99373
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-26-rc
git_commit_date 1771612286 1771614330
git_commit_sha 4789e89 4d6a29c
release_version 1.60.0-SNAPSHOT~4789e8923e 1.60.0-SNAPSHOT~4d6a29c643
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771616640 1771616640
ci_job_id 1444306208 1444306208
ci_pipeline_id 97949503 97949503
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-xx0b7tay 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-xx0b7tay 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 16 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+53.306µs; +115.746µs] or [+2.150%; +4.668%]
same
[-38.367µs; +610.142µs] or [-0.523%; +8.312%]
unstable
[-200.236op/s; +105.736op/s] or [-14.025%; +7.406%]
2.564ms 7.627ms 1380.469op/s 2.480ms 7.341ms 1427.719op/s
scenario:load:petclinic:iast:high_load worse
[+1.081ms; +1.872ms] or [+6.327%; +10.954%]
worse
[+0.780ms; +2.212ms] or [+2.746%; +7.787%]
unstable
[-46.969op/s; +9.469op/s] or [-17.678%; +3.564%]
18.568ms 29.905ms 246.938op/s 17.091ms 28.409ms 265.688op/s
scenario:load:petclinic:code_origins:high_load worse
[+0.714ms; +1.474ms] or [+4.091%; +8.441%]
unsure
[+141.993µs; +1710.182µs] or [+0.490%; +5.900%]
unstable
[-41.987op/s; +14.300op/s] or [-16.068%; +5.472%]
18.561ms 29.914ms 247.469op/s 17.466ms 28.988ms 261.312op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.508ms; +2.028ms] or [+2.900%; +11.590%]
same
[-0.333ms; +2.444ms] or [-1.122%; +8.233%]
unstable
[-43.254op/s; +14.379op/s] or [-16.820%; +5.592%]
18.770ms 30.741ms 242.719op/s 17.502ms 29.685ms 257.156op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~4d6a29c643, baseline=1.60.0-SNAPSHOT~4789e8923e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.204 ms) : 1191, 1217
.   : milestone, 1204,
iast (3.203 ms) : 3161, 3245
.   : milestone, 3203,
iast_FULL (5.846 ms) : 5787, 5904
.   : milestone, 5846,
iast_GLOBAL (3.515 ms) : 3463, 3567
.   : milestone, 3515,
profiling (2.164 ms) : 2143, 2185
.   : milestone, 2164,
tracing (1.828 ms) : 1813, 1842
.   : milestone, 1828,
section candidate
no_agent (1.19 ms) : 1178, 1202
.   : milestone, 1190,
iast (3.317 ms) : 3270, 3365
.   : milestone, 3317,
iast_FULL (5.719 ms) : 5662, 5776
.   : milestone, 5719,
iast_GLOBAL (3.644 ms) : 3583, 3706
.   : milestone, 3644,
profiling (2.245 ms) : 2220, 2270
.   : milestone, 2245,
tracing (1.777 ms) : 1762, 1792
.   : milestone, 1777,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.204 ms [1.191 ms, 1.217 ms] -
iast 3.203 ms [3.161 ms, 3.245 ms] 1.999 ms (166.1%)
iast_FULL 5.846 ms [5.787 ms, 5.904 ms] 4.642 ms (385.5%)
iast_GLOBAL 3.515 ms [3.463 ms, 3.567 ms] 2.311 ms (191.9%)
profiling 2.164 ms [2.143 ms, 2.185 ms] 959.635 µs (79.7%)
tracing 1.828 ms [1.813 ms, 1.842 ms] 623.59 µs (51.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.19 ms [1.178 ms, 1.202 ms] -
iast 3.317 ms [3.27 ms, 3.365 ms] 2.128 ms (178.9%)
iast_FULL 5.719 ms [5.662 ms, 5.776 ms] 4.529 ms (380.7%)
iast_GLOBAL 3.644 ms [3.583 ms, 3.706 ms] 2.455 ms (206.3%)
profiling 2.245 ms [2.22 ms, 2.27 ms] 1.055 ms (88.7%)
tracing 1.777 ms [1.762 ms, 1.792 ms] 587.437 µs (49.4%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~4d6a29c643, baseline=1.60.0-SNAPSHOT~4789e8923e
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.144 ms) : 17957, 18332
.   : milestone, 18144,
appsec (18.248 ms) : 18061, 18435
.   : milestone, 18248,
code_origins (17.853 ms) : 17671, 18034
.   : milestone, 17853,
iast (17.556 ms) : 17381, 17732
.   : milestone, 17556,
profiling (18.77 ms) : 18585, 18955
.   : milestone, 18770,
tracing (17.564 ms) : 17394, 17734
.   : milestone, 17564,
section candidate
no_agent (19.228 ms) : 19032, 19424
.   : milestone, 19228,
appsec (18.5 ms) : 18312, 18687
.   : milestone, 18500,
code_origins (18.862 ms) : 18671, 19054
.   : milestone, 18862,
iast (18.898 ms) : 18709, 19087
.   : milestone, 18898,
profiling (18.513 ms) : 18332, 18695
.   : milestone, 18513,
tracing (17.509 ms) : 17335, 17683
.   : milestone, 17509,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.144 ms [17.957 ms, 18.332 ms] -
appsec 18.248 ms [18.061 ms, 18.435 ms] 103.549 µs (0.6%)
code_origins 17.853 ms [17.671 ms, 18.034 ms] -291.938 µs (-1.6%)
iast 17.556 ms [17.381 ms, 17.732 ms] -588.063 µs (-3.2%)
profiling 18.77 ms [18.585 ms, 18.955 ms] 625.636 µs (3.4%)
tracing 17.564 ms [17.394 ms, 17.734 ms] -580.042 µs (-3.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.228 ms [19.032 ms, 19.424 ms] -
appsec 18.5 ms [18.312 ms, 18.687 ms] -728.286 µs (-3.8%)
code_origins 18.862 ms [18.671 ms, 19.054 ms] -365.877 µs (-1.9%)
iast 18.898 ms [18.709 ms, 19.087 ms] -330.039 µs (-1.7%)
profiling 18.513 ms [18.332 ms, 18.695 ms] -714.612 µs (-3.7%)
tracing 17.509 ms [17.335 ms, 17.683 ms] -1.719 ms (-8.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-26-rc
git_commit_date 1771612286 1771614330
git_commit_sha 4789e89 4d6a29c
release_version 1.60.0-SNAPSHOT~4789e8923e 1.60.0-SNAPSHOT~4d6a29c643
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771616279 1771616279
ci_job_id 1444306210 1444306210
ci_pipeline_id 97949503 97949503
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-v92ffjhk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-v92ffjhk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~4d6a29c643, baseline=1.60.0-SNAPSHOT~4789e8923e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.801 ms) : 3579, 4023
.   : milestone, 3801,
iast (2.262 ms) : 2193, 2331
.   : milestone, 2262,
iast_GLOBAL (2.3 ms) : 2231, 2370
.   : milestone, 2300,
profiling (2.505 ms) : 2341, 2669
.   : milestone, 2505,
tracing (2.07 ms) : 2016, 2123
.   : milestone, 2070,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (3.748 ms) : 3530, 3966
.   : milestone, 3748,
iast (2.265 ms) : 2195, 2334
.   : milestone, 2265,
iast_GLOBAL (2.304 ms) : 2234, 2374
.   : milestone, 2304,
profiling (2.086 ms) : 2031, 2141
.   : milestone, 2086,
tracing (2.069 ms) : 2015, 2123
.   : milestone, 2069,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.801 ms [3.579 ms, 4.023 ms] 2.327 ms (157.9%)
iast 2.262 ms [2.193 ms, 2.331 ms] 788.323 µs (53.5%)
iast_GLOBAL 2.3 ms [2.231 ms, 2.37 ms] 826.625 µs (56.1%)
profiling 2.505 ms [2.341 ms, 2.669 ms] 1.031 ms (70.0%)
tracing 2.07 ms [2.016 ms, 2.123 ms] 595.925 µs (40.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 3.748 ms [3.53 ms, 3.966 ms] 2.272 ms (154.0%)
iast 2.265 ms [2.195 ms, 2.334 ms] 788.832 µs (53.4%)
iast_GLOBAL 2.304 ms [2.234 ms, 2.374 ms] 828.384 µs (56.1%)
profiling 2.086 ms [2.031 ms, 2.141 ms] 610.407 µs (41.4%)
tracing 2.069 ms [2.015 ms, 2.123 ms] 592.815 µs (40.2%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~4d6a29c643, baseline=1.60.0-SNAPSHOT~4789e8923e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.608 s) : 15608000, 15608000
.   : milestone, 15608000,
appsec (14.847 s) : 14847000, 14847000
.   : milestone, 14847000,
iast (18.4 s) : 18400000, 18400000
.   : milestone, 18400000,
iast_GLOBAL (17.991 s) : 17991000, 17991000
.   : milestone, 17991000,
profiling (15.397 s) : 15397000, 15397000
.   : milestone, 15397000,
tracing (14.816 s) : 14816000, 14816000
.   : milestone, 14816000,
section candidate
no_agent (15.274 s) : 15274000, 15274000
.   : milestone, 15274000,
appsec (14.934 s) : 14934000, 14934000
.   : milestone, 14934000,
iast (18.164 s) : 18164000, 18164000
.   : milestone, 18164000,
iast_GLOBAL (17.925 s) : 17925000, 17925000
.   : milestone, 17925000,
profiling (14.717 s) : 14717000, 14717000
.   : milestone, 14717000,
tracing (14.768 s) : 14768000, 14768000
.   : milestone, 14768000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.608 s [15.608 s, 15.608 s] -
appsec 14.847 s [14.847 s, 14.847 s] -761.0 ms (-4.9%)
iast 18.4 s [18.4 s, 18.4 s] 2.792 s (17.9%)
iast_GLOBAL 17.991 s [17.991 s, 17.991 s] 2.383 s (15.3%)
profiling 15.397 s [15.397 s, 15.397 s] -211.0 ms (-1.4%)
tracing 14.816 s [14.816 s, 14.816 s] -792.0 ms (-5.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.274 s [15.274 s, 15.274 s] -
appsec 14.934 s [14.934 s, 14.934 s] -340.0 ms (-2.2%)
iast 18.164 s [18.164 s, 18.164 s] 2.89 s (18.9%)
iast_GLOBAL 17.925 s [17.925 s, 17.925 s] 2.651 s (17.4%)
profiling 14.717 s [14.717 s, 14.717 s] -557.0 ms (-3.6%)
tracing 14.768 s [14.768 s, 14.768 s] -506.0 ms (-3.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: do not merge Do not merge changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant