Skip to content

Comments

Add an error sampler for Log probes#10638

Open
jpbempel wants to merge 1 commit intomasterfrom
jpbempel/log-template-error-rate
Open

Add an error sampler for Log probes#10638
jpbempel wants to merge 1 commit intomasterfrom
jpbempel/log-template-error-rate

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Feb 19, 2026

What Does This Do

log template only probe are rate limited to a higher rate. if condition is set and returns an error, we don't want to return a snapshot at the same rate just for reporting the condition evaluation failure. So we are introducing a specific sampler at 1/s rate to report error in that case.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: DEBUG-5193

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@jpbempel jpbempel requested a review from a team as a code owner February 19, 2026 14:56
@jpbempel jpbempel requested review from andreimatei and removed request for a team February 19, 2026 14:56
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label Feb 19, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Feb 19, 2026

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added the type: bug Bug report and fix label Feb 19, 2026
@pr-commenter
Copy link

pr-commenter bot commented Feb 19, 2026

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1771535588 1771535934
end_time 2026-02-19T21:14:29 2026-02-19T21:20:14
git_branch master jpbempel/log-template-error-rate
git_commit_sha af8b844 3f98bc4
start_time 2026-02-19T21:13:09 2026-02-19T21:18:55
See matching parameters
Baseline Candidate
ci_job_id 1441274947 1441274947
ci_pipeline_id 97717619 97717619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1771535090 1771535090

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 7 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-54.098µs; +26.273µs] or [-18.734%; +9.098%]
unstable
[-70.483µs; +36.309µs] or [-21.183%; +10.912%]
unstable
[-82.391µs; +42.924µs] or [-23.660%; +12.327%]
unstable
[-512.154µs; +140.391µs] or [-47.461%; +13.010%]
unstable
[-97.165op/s; +158.893op/s] or [-3.935%; +6.435%]
scenario:basic same same same unstable
[-132.519µs; +39.317µs] or [-17.259%; +5.120%]
unstable
[-115.574op/s; +257.822op/s] or [-4.392%; +9.797%]
scenario:loop unsure
[+11.016µs; +17.918µs] or [+0.124%; +0.202%]
unsure
[+5.470µs; +18.249µs] or [+0.061%; +0.204%]
same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (332.73 µs) : 268, 398
.   : milestone, 333,
basic (274.767 µs) : 268, 282
.   : milestone, 275,
loop (8.945 ms) : 8939, 8951
.   : milestone, 8945,
section candidate
noprobe (315.643 µs) : 285, 347
.   : milestone, 316,
basic (278.883 µs) : 272, 286
.   : milestone, 279,
loop (8.957 ms) : 8951, 8963
.   : milestone, 8957,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 332.73 µs [267.799 µs, 397.661 µs]
basic 274.767 µs [267.868 µs, 281.667 µs]
loop 8.945 ms [8.939 ms, 8.951 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 315.643 µs [284.784 µs, 346.501 µs]
basic 278.883 µs [271.749 µs, 286.017 µs]
loop 8.957 ms [8.951 ms, 8.963 ms]

@pr-commenter
Copy link

pr-commenter bot commented Feb 19, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/log-template-error-rate
git_commit_date 1771530866 1771535090
git_commit_sha af8b844 3f98bc4
release_version 1.60.0-SNAPSHOT~af8b84438c 1.60.0-SNAPSHOT~3f98bc4b1c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771536872 1771536872
ci_job_id 1441274936 1441274936
ci_pipeline_id 97717619 97717619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-cfy5mcaq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-cfy5mcaq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~3f98bc4b1c, baseline=1.60.0-SNAPSHOT~af8b84438c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1066789
Total [baseline] (10.913 s) : 0, 10912901
Agent [candidate] (1.074 s) : 0, 1074258
Total [candidate] (10.913 s) : 0, 10913067
section appsec
Agent [baseline] (1.239 s) : 0, 1239424
Total [baseline] (11.09 s) : 0, 11089599
Agent [candidate] (1.24 s) : 0, 1239680
Total [candidate] (11.081 s) : 0, 11081018
section iast
Agent [baseline] (1.244 s) : 0, 1243882
Total [baseline] (11.253 s) : 0, 11253230
Agent [candidate] (1.236 s) : 0, 1236018
Total [candidate] (11.182 s) : 0, 11181798
section profiling
Agent [baseline] (1.192 s) : 0, 1192051
Total [baseline] (11.007 s) : 0, 11007403
Agent [candidate] (1.206 s) : 0, 1205756
Total [candidate] (10.996 s) : 0, 10996109
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent appsec 1.239 s 172.635 ms (16.2%)
Agent iast 1.244 s 177.093 ms (16.6%)
Agent profiling 1.192 s 125.262 ms (11.7%)
Total tracing 10.913 s -
Total appsec 11.09 s 176.699 ms (1.6%)
Total iast 11.253 s 340.329 ms (3.1%)
Total profiling 11.007 s 94.502 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.24 s 165.423 ms (15.4%)
Agent iast 1.236 s 161.76 ms (15.1%)
Agent profiling 1.206 s 131.498 ms (12.2%)
Total tracing 10.913 s -
Total appsec 11.081 s 167.951 ms (1.5%)
Total iast 11.182 s 268.731 ms (2.5%)
Total profiling 10.996 s 83.042 ms (0.8%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~3f98bc4b1c, baseline=1.60.0-SNAPSHOT~af8b84438c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (627.471 ms) : 0, 627471
BytebuddyAgent [candidate] (633.425 ms) : 0, 633425
AgentMeter [baseline] (29.025 ms) : 0, 29025
AgentMeter [candidate] (29.349 ms) : 0, 29349
GlobalTracer [baseline] (257.638 ms) : 0, 257638
GlobalTracer [candidate] (259.075 ms) : 0, 259075
AppSec [baseline] (33.181 ms) : 0, 33181
AppSec [candidate] (33.069 ms) : 0, 33069
Debugger [baseline] (66.372 ms) : 0, 66372
Debugger [candidate] (66.329 ms) : 0, 66329
Remote Config [baseline] (631.614 µs) : 0, 632
Remote Config [candidate] (630.757 µs) : 0, 631
Telemetry [baseline] (10.004 ms) : 0, 10004
Telemetry [candidate] (10.577 ms) : 0, 10577
Flare Poller [baseline] (5.269 ms) : 0, 5269
Flare Poller [candidate] (4.505 ms) : 0, 4505
section appsec
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (658.172 ms) : 0, 658172
BytebuddyAgent [candidate] (658.219 ms) : 0, 658219
AgentMeter [baseline] (11.949 ms) : 0, 11949
AgentMeter [candidate] (11.972 ms) : 0, 11972
GlobalTracer [baseline] (258.234 ms) : 0, 258234
GlobalTracer [candidate] (258.365 ms) : 0, 258365
AppSec [baseline] (168.019 ms) : 0, 168019
AppSec [candidate] (168.036 ms) : 0, 168036
Debugger [baseline] (66.817 ms) : 0, 66817
Debugger [candidate] (66.69 ms) : 0, 66690
Remote Config [baseline] (645.982 µs) : 0, 646
Remote Config [candidate] (658.187 µs) : 0, 658
Telemetry [baseline] (9.481 ms) : 0, 9481
Telemetry [candidate] (9.46 ms) : 0, 9460
Flare Poller [baseline] (3.697 ms) : 0, 3697
Flare Poller [candidate] (3.782 ms) : 0, 3782
IAST [baseline] (25.239 ms) : 0, 25239
IAST [candidate] (25.35 ms) : 0, 25350
section iast
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (805.811 ms) : 0, 805811
BytebuddyAgent [candidate] (798.061 ms) : 0, 798061
AgentMeter [baseline] (11.4 ms) : 0, 11400
AgentMeter [candidate] (11.324 ms) : 0, 11324
GlobalTracer [baseline] (248.508 ms) : 0, 248508
GlobalTracer [candidate] (248.544 ms) : 0, 248544
AppSec [baseline] (34.643 ms) : 0, 34643
AppSec [candidate] (31.489 ms) : 0, 31489
Debugger [baseline] (66.131 ms) : 0, 66131
Debugger [candidate] (69.712 ms) : 0, 69712
Remote Config [baseline] (547.599 µs) : 0, 548
Remote Config [candidate] (543.16 µs) : 0, 543
Telemetry [baseline] (8.81 ms) : 0, 8810
Telemetry [candidate] (8.587 ms) : 0, 8587
Flare Poller [baseline] (3.52 ms) : 0, 3520
Flare Poller [candidate] (3.456 ms) : 0, 3456
IAST [baseline] (27.151 ms) : 0, 27151
IAST [candidate] (27.181 ms) : 0, 27181
section profiling
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (682.325 ms) : 0, 682325
BytebuddyAgent [candidate] (691.834 ms) : 0, 691834
AgentMeter [baseline] (8.548 ms) : 0, 8548
AgentMeter [candidate] (8.618 ms) : 0, 8618
GlobalTracer [baseline] (216.326 ms) : 0, 216326
GlobalTracer [candidate] (218.255 ms) : 0, 218255
AppSec [baseline] (32.783 ms) : 0, 32783
AppSec [candidate] (33.178 ms) : 0, 33178
Debugger [baseline] (67.238 ms) : 0, 67238
Debugger [candidate] (67.931 ms) : 0, 67931
Remote Config [baseline] (639.085 µs) : 0, 639
Remote Config [candidate] (647.861 µs) : 0, 648
Telemetry [baseline] (8.948 ms) : 0, 8948
Telemetry [candidate] (9.131 ms) : 0, 9131
Flare Poller [baseline] (3.73 ms) : 0, 3730
Flare Poller [candidate] (3.768 ms) : 0, 3768
ProfilingAgent [baseline] (99.707 ms) : 0, 99707
ProfilingAgent [candidate] (99.843 ms) : 0, 99843
Profiling [baseline] (100.278 ms) : 0, 100278
Profiling [candidate] (100.439 ms) : 0, 100439
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~3f98bc4b1c, baseline=1.60.0-SNAPSHOT~af8b84438c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068560
Total [baseline] (8.756 s) : 0, 8756129
Agent [candidate] (1.062 s) : 0, 1062219
Total [candidate] (8.722 s) : 0, 8722160
section iast
Agent [baseline] (1.227 s) : 0, 1227116
Total [baseline] (9.39 s) : 0, 9390466
Agent [candidate] (1.23 s) : 0, 1229573
Total [candidate] (9.358 s) : 0, 9357573
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.227 s 158.556 ms (14.8%)
Total tracing 8.756 s -
Total iast 9.39 s 634.337 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.23 s 167.353 ms (15.8%)
Total tracing 8.722 s -
Total iast 9.358 s 635.414 ms (7.3%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~3f98bc4b1c, baseline=1.60.0-SNAPSHOT~af8b84438c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (630.8 ms) : 0, 630800
BytebuddyAgent [candidate] (627.244 ms) : 0, 627244
AgentMeter [baseline] (29.168 ms) : 0, 29168
AgentMeter [candidate] (29.058 ms) : 0, 29058
GlobalTracer [baseline] (258.156 ms) : 0, 258156
GlobalTracer [candidate] (257.475 ms) : 0, 257475
AppSec [baseline] (33.153 ms) : 0, 33153
AppSec [candidate] (33.0 ms) : 0, 33000
Debugger [baseline] (64.126 ms) : 0, 64126
Debugger [candidate] (61.794 ms) : 0, 61794
Remote Config [baseline] (622.418 µs) : 0, 622
Remote Config [candidate] (615.246 µs) : 0, 615
Telemetry [baseline] (10.653 ms) : 0, 10653
Telemetry [candidate] (9.812 ms) : 0, 9812
Flare Poller [baseline] (4.534 ms) : 0, 4534
Flare Poller [candidate] (6.041 ms) : 0, 6041
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (793.607 ms) : 0, 793607
BytebuddyAgent [candidate] (794.725 ms) : 0, 794725
AgentMeter [baseline] (11.272 ms) : 0, 11272
AgentMeter [candidate] (11.28 ms) : 0, 11280
GlobalTracer [baseline] (246.591 ms) : 0, 246591
GlobalTracer [candidate] (247.659 ms) : 0, 247659
AppSec [baseline] (33.86 ms) : 0, 33860
AppSec [candidate] (32.366 ms) : 0, 32366
Debugger [baseline] (65.268 ms) : 0, 65268
Debugger [candidate] (66.965 ms) : 0, 66965
Remote Config [baseline] (541.584 µs) : 0, 542
Remote Config [candidate] (542.192 µs) : 0, 542
Telemetry [baseline] (8.517 ms) : 0, 8517
Telemetry [candidate] (8.548 ms) : 0, 8548
Flare Poller [baseline] (3.403 ms) : 0, 3403
Flare Poller [candidate] (3.397 ms) : 0, 3398
IAST [baseline] (26.852 ms) : 0, 26852
IAST [candidate] (27.001 ms) : 0, 27001
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/log-template-error-rate
git_commit_date 1771530866 1771535090
git_commit_sha af8b844 3f98bc4
release_version 1.60.0-SNAPSHOT~af8b84438c 1.60.0-SNAPSHOT~3f98bc4b1c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771537277 1771537277
ci_job_id 1441274939 1441274939
ci_pipeline_id 97717619 97717619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-1cnj2m5b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-1cnj2m5b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 5 performance improvements and 1 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-257.928µs; -125.555µs] or [-8.948%; -4.356%]
better
[-636.930µs; -211.128µs] or [-7.903%; -2.620%]
unstable
[-42.850op/s; +213.663op/s] or [-3.401%; +16.959%]
2.691ms 7.635ms 1345.312op/s 2.882ms 8.059ms 1259.906op/s
scenario:load:insecure-bank:iast:high_load better
[-183.802µs; -83.344µs] or [-7.296%; -3.308%]
same
[-511.763µs; +49.373µs] or [-6.892%; +0.665%]
unstable
[-68.505op/s; +213.630op/s] or [-4.888%; +15.243%]
2.386ms 7.194ms 1474.031op/s 2.519ms 7.425ms 1401.469op/s
scenario:load:insecure-bank:iast_FULL:high_load unsure
[-376.603µs; -63.242µs] or [-7.236%; -1.215%]
better
[-985.869µs; -325.518µs] or [-7.875%; -2.600%]
unstable
[-40.773op/s; +101.710op/s] or [-5.162%; +12.877%]
4.984ms 11.864ms 820.312op/s 5.204ms 12.519ms 789.844op/s
scenario:load:petclinic:iast:high_load worse
[+465.919µs; +1254.009µs] or [+2.702%; +7.273%]
unsure
[+0.474ms; +1.768ms] or [+1.665%; +6.214%]
unstable
[-40.059op/s; +15.747op/s] or [-15.111%; +5.940%]
18.102ms 29.567ms 252.938op/s 17.242ms 28.447ms 265.094op/s
scenario:load:petclinic:profiling:high_load better
[-1.727ms; -0.824ms] or [-9.037%; -4.310%]
unsure
[-1435.360µs; -226.984µs] or [-4.747%; -0.751%]
unstable
[-13.362op/s; +40.112op/s] or [-5.516%; +16.558%]
17.833ms 29.405ms 255.625op/s 19.109ms 30.236ms 242.250op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f98bc4b1c, baseline=1.60.0-SNAPSHOT~af8b84438c
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.105 ms) : 17917, 18294
.   : milestone, 18105,
appsec (18.694 ms) : 18506, 18882
.   : milestone, 18694,
code_origins (17.621 ms) : 17447, 17795
.   : milestone, 17621,
iast (17.604 ms) : 17428, 17780
.   : milestone, 17604,
profiling (19.268 ms) : 19077, 19459
.   : milestone, 19268,
tracing (17.641 ms) : 17465, 17817
.   : milestone, 17641,
section candidate
no_agent (17.077 ms) : 16907, 17246
.   : milestone, 17077,
appsec (18.34 ms) : 18153, 18527
.   : milestone, 18340,
code_origins (17.534 ms) : 17358, 17710
.   : milestone, 17534,
iast (18.453 ms) : 18266, 18641
.   : milestone, 18453,
profiling (18.262 ms) : 18081, 18443
.   : milestone, 18262,
tracing (17.536 ms) : 17362, 17709
.   : milestone, 17536,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.105 ms [17.917 ms, 18.294 ms] -
appsec 18.694 ms [18.506 ms, 18.882 ms] 588.732 µs (3.3%)
code_origins 17.621 ms [17.447 ms, 17.795 ms] -484.363 µs (-2.7%)
iast 17.604 ms [17.428 ms, 17.78 ms] -501.047 µs (-2.8%)
profiling 19.268 ms [19.077 ms, 19.459 ms] 1.163 ms (6.4%)
tracing 17.641 ms [17.465 ms, 17.817 ms] -464.162 µs (-2.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.077 ms [16.907 ms, 17.246 ms] -
appsec 18.34 ms [18.153 ms, 18.527 ms] 1.263 ms (7.4%)
code_origins 17.534 ms [17.358 ms, 17.71 ms] 457.493 µs (2.7%)
iast 18.453 ms [18.266 ms, 18.641 ms] 1.377 ms (8.1%)
profiling 18.262 ms [18.081 ms, 18.443 ms] 1.185 ms (6.9%)
tracing 17.536 ms [17.362 ms, 17.709 ms] 459.36 µs (2.7%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f98bc4b1c, baseline=1.60.0-SNAPSHOT~af8b84438c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.185 ms) : 1173, 1196
.   : milestone, 1185,
iast (3.266 ms) : 3219, 3313
.   : milestone, 3266,
iast_FULL (5.854 ms) : 5795, 5914
.   : milestone, 5854,
iast_GLOBAL (3.642 ms) : 3584, 3700
.   : milestone, 3642,
profiling (2.038 ms) : 2019, 2057
.   : milestone, 2038,
tracing (1.729 ms) : 1715, 1742
.   : milestone, 1729,
section candidate
no_agent (1.18 ms) : 1168, 1191
.   : milestone, 1180,
iast (3.101 ms) : 3058, 3145
.   : milestone, 3101,
iast_FULL (5.635 ms) : 5579, 5690
.   : milestone, 5635,
iast_GLOBAL (3.405 ms) : 3352, 3458
.   : milestone, 3405,
profiling (2.109 ms) : 2089, 2129
.   : milestone, 2109,
tracing (1.765 ms) : 1751, 1778
.   : milestone, 1765,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.173 ms, 1.196 ms] -
iast 3.266 ms [3.219 ms, 3.313 ms] 2.081 ms (175.7%)
iast_FULL 5.854 ms [5.795 ms, 5.914 ms] 4.67 ms (394.2%)
iast_GLOBAL 3.642 ms [3.584 ms, 3.7 ms] 2.458 ms (207.5%)
profiling 2.038 ms [2.019 ms, 2.057 ms] 853.574 µs (72.1%)
tracing 1.729 ms [1.715 ms, 1.742 ms] 543.891 µs (45.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.18 ms [1.168 ms, 1.191 ms] -
iast 3.101 ms [3.058 ms, 3.145 ms] 1.922 ms (162.9%)
iast_FULL 5.635 ms [5.579 ms, 5.69 ms] 4.455 ms (377.7%)
iast_GLOBAL 3.405 ms [3.352 ms, 3.458 ms] 2.226 ms (188.7%)
profiling 2.109 ms [2.089 ms, 2.129 ms] 929.167 µs (78.8%)
tracing 1.765 ms [1.751 ms, 1.778 ms] 584.993 µs (49.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/log-template-error-rate
git_commit_date 1771530866 1771535090
git_commit_sha af8b844 3f98bc4
release_version 1.60.0-SNAPSHOT~af8b84438c 1.60.0-SNAPSHOT~3f98bc4b1c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771537078 1771537078
ci_job_id 1441274941 1441274941
ci_pipeline_id 97717619 97717619
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-79o9tem6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-79o9tem6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f98bc4b1c, baseline=1.60.0-SNAPSHOT~af8b84438c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (3.794 ms) : 3572, 4017
.   : milestone, 3794,
iast (2.258 ms) : 2189, 2327
.   : milestone, 2258,
iast_GLOBAL (2.302 ms) : 2232, 2371
.   : milestone, 2302,
profiling (2.082 ms) : 2027, 2136
.   : milestone, 2082,
tracing (2.056 ms) : 2003, 2110
.   : milestone, 2056,
section candidate
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (3.765 ms) : 3544, 3986
.   : milestone, 3765,
iast (2.252 ms) : 2182, 2321
.   : milestone, 2252,
iast_GLOBAL (2.296 ms) : 2226, 2366
.   : milestone, 2296,
profiling (2.099 ms) : 2043, 2156
.   : milestone, 2099,
tracing (2.058 ms) : 2004, 2111
.   : milestone, 2058,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 3.794 ms [3.572 ms, 4.017 ms] 2.324 ms (158.0%)
iast 2.258 ms [2.189 ms, 2.327 ms] 787.001 µs (53.5%)
iast_GLOBAL 2.302 ms [2.232 ms, 2.371 ms] 830.779 µs (56.5%)
profiling 2.082 ms [2.027 ms, 2.136 ms] 610.693 µs (41.5%)
tracing 2.056 ms [2.003 ms, 2.11 ms] 585.567 µs (39.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.466 ms, 1.489 ms] -
appsec 3.765 ms [3.544 ms, 3.986 ms] 2.288 ms (154.9%)
iast 2.252 ms [2.182 ms, 2.321 ms] 774.487 µs (52.4%)
iast_GLOBAL 2.296 ms [2.226 ms, 2.366 ms] 818.671 µs (55.4%)
profiling 2.099 ms [2.043 ms, 2.156 ms] 622.043 µs (42.1%)
tracing 2.058 ms [2.004 ms, 2.111 ms] 580.445 µs (39.3%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f98bc4b1c, baseline=1.60.0-SNAPSHOT~af8b84438c
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.007 s) : 15007000, 15007000
.   : milestone, 15007000,
appsec (15.05 s) : 15050000, 15050000
.   : milestone, 15050000,
iast (18.485 s) : 18485000, 18485000
.   : milestone, 18485000,
iast_GLOBAL (17.975 s) : 17975000, 17975000
.   : milestone, 17975000,
profiling (15.019 s) : 15019000, 15019000
.   : milestone, 15019000,
tracing (14.78 s) : 14780000, 14780000
.   : milestone, 14780000,
section candidate
no_agent (15.072 s) : 15072000, 15072000
.   : milestone, 15072000,
appsec (15.009 s) : 15009000, 15009000
.   : milestone, 15009000,
iast (18.282 s) : 18282000, 18282000
.   : milestone, 18282000,
iast_GLOBAL (18.021 s) : 18021000, 18021000
.   : milestone, 18021000,
profiling (14.824 s) : 14824000, 14824000
.   : milestone, 14824000,
tracing (14.771 s) : 14771000, 14771000
.   : milestone, 14771000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.007 s [15.007 s, 15.007 s] -
appsec 15.05 s [15.05 s, 15.05 s] 43.0 ms (0.3%)
iast 18.485 s [18.485 s, 18.485 s] 3.478 s (23.2%)
iast_GLOBAL 17.975 s [17.975 s, 17.975 s] 2.968 s (19.8%)
profiling 15.019 s [15.019 s, 15.019 s] 12.0 ms (0.1%)
tracing 14.78 s [14.78 s, 14.78 s] -227.0 ms (-1.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.072 s [15.072 s, 15.072 s] -
appsec 15.009 s [15.009 s, 15.009 s] -63.0 ms (-0.4%)
iast 18.282 s [18.282 s, 18.282 s] 3.21 s (21.3%)
iast_GLOBAL 18.021 s [18.021 s, 18.021 s] 2.949 s (19.6%)
profiling 14.824 s [14.824 s, 14.824 s] -248.0 ms (-1.6%)
tracing 14.771 s [14.771 s, 14.771 s] -301.0 ms (-2.0%)

log template only probe are rate limited to a higher rate. if condition
is set and returns an error, we don't want to return a snapshot
at the same rate just for reporting the condition evaluation failure.
So we are introducing a specific sampler at 1/s rate to report error
in that case.
@jpbempel jpbempel force-pushed the jpbempel/log-template-error-rate branch from 0678c9d to 3f98bc4 Compare February 19, 2026 21:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: debugger Dynamic Instrumentation type: bug Bug report and fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant