Skip to content

Conversation

sarahchen6
Copy link
Contributor

What Does This Do

Revert kotlin workaround put in place for Java 25-ea in #9274.

Motivation

Additional Notes

Waiting until Java 25 GA on Sep 16 to merge.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements tag: do not merge Do not merge changes tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Sep 9, 2025
Copy link

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 81.23% (+23.39%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 5be239a | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 9, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1757443459 1757443804
end_time 2025-09-09T18:45:40 2025-09-09T18:51:25
git_branch master sarahchen6/revert-kotlin-25-ea-workaround
git_commit_sha 622aa34 5be239a
start_time 2025-09-09T18:44:20 2025-09-09T18:50:05
See matching parameters
Baseline Candidate
ci_job_id 1121217613 1121217613
ci_pipeline_id 75993454 75993454
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1757442868 1757442868

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 7 metrics, 8 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-17105.100ns; +17955.569ns] or [-6.120%; +6.424%]
unstable
[-26030.330ns; +27830.281ns] or [-8.169%; +8.734%]
unstable
[-35.218µs; +37.788µs] or [-10.621%; +11.396%]
unstable
[-56.074µs; +164.842µs] or [-6.067%; +17.836%]
same
scenario:basic same unstable
[-24.494µs; +5.952µs] or [-8.515%; +2.069%]
unstable
[-31.302µs; +6.964µs] or [-10.451%; +2.325%]
unstable
[-59.702µs; +146.331µs] or [-7.848%; +19.235%]
unstable
[-81.294op/s; +223.542op/s] or [-3.089%; +8.495%]
scenario:loop same unsure
[-10.687µs; -1.511µs] or [-0.119%; -0.017%]
unsure
[-12.445µs; -1.991µs] or [-0.138%; -0.022%]
same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (318.64 µs) : 297, 340
.   : milestone, 319,
basic (287.66 µs) : 267, 308
.   : milestone, 288,
loop (8.971 ms) : 8966, 8975
.   : milestone, 8971,
section candidate
noprobe (319.54 µs) : 291, 349
.   : milestone, 320,
basic (278.389 µs) : 273, 284
.   : milestone, 278,
loop (8.964 ms) : 8960, 8969
.   : milestone, 8964,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 318.64 µs [296.931 µs, 340.349 µs]
basic 287.66 µs [267.337 µs, 307.983 µs]
loop 8.971 ms [8.966 ms, 8.975 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 319.54 µs [290.502 µs, 348.579 µs]
basic 278.389 µs [272.742 µs, 284.036 µs]
loop 8.964 ms [8.96 ms, 8.969 ms]

@pr-commenter
Copy link

pr-commenter bot commented Sep 9, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/revert-kotlin-25-ea-workaround
git_commit_date 1757441367 1757442868
git_commit_sha 622aa34 5be239a
release_version 1.54.0-SNAPSHOT~622aa3443a 1.54.0-SNAPSHOT~5be239a4d8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1757444684 1757444684
ci_job_id 1121217606 1121217606
ci_pipeline_id 75993454 75993454
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ggy4n1vi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ggy4n1vi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~5be239a4d8, baseline=1.54.0-SNAPSHOT~622aa3443a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1046944
Total [baseline] (10.801 s) : 0, 10800586
Agent [candidate] (1.044 s) : 0, 1044345
Total [candidate] (10.753 s) : 0, 10752614
section appsec
Agent [baseline] (1.234 s) : 0, 1233666
Total [baseline] (10.878 s) : 0, 10877730
Agent [candidate] (1.233 s) : 0, 1233489
Total [candidate] (10.803 s) : 0, 10803049
section iast
Agent [baseline] (1.188 s) : 0, 1188461
Total [baseline] (10.976 s) : 0, 10975576
Agent [candidate] (1.181 s) : 0, 1180719
Total [candidate] (10.968 s) : 0, 10967772
section profiling
Agent [baseline] (1.199 s) : 0, 1199388
Total [baseline] (10.899 s) : 0, 10898816
Agent [candidate] (1.197 s) : 0, 1197192
Total [candidate] (10.853 s) : 0, 10853416
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.234 s 186.722 ms (17.8%)
Agent iast 1.188 s 141.517 ms (13.5%)
Agent profiling 1.199 s 152.444 ms (14.6%)
Total tracing 10.801 s -
Total appsec 10.878 s 77.145 ms (0.7%)
Total iast 10.976 s 174.99 ms (1.6%)
Total profiling 10.899 s 98.231 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent appsec 1.233 s 189.144 ms (18.1%)
Agent iast 1.181 s 136.373 ms (13.1%)
Agent profiling 1.197 s 152.847 ms (14.6%)
Total tracing 10.753 s -
Total appsec 10.803 s 50.435 ms (0.5%)
Total iast 10.968 s 215.158 ms (2.0%)
Total profiling 10.853 s 100.802 ms (0.9%)
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~5be239a4d8, baseline=1.54.0-SNAPSHOT~622aa3443a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (733.122 ms) : 0, 733122
BytebuddyAgent [candidate] (730.575 ms) : 0, 730575
GlobalTracer [baseline] (242.892 ms) : 0, 242892
GlobalTracer [candidate] (241.787 ms) : 0, 241787
AppSec [baseline] (30.16 ms) : 0, 30160
AppSec [candidate] (30.12 ms) : 0, 30120
Debugger [baseline] (6.405 ms) : 0, 6405
Debugger [candidate] (6.423 ms) : 0, 6423
Remote Config [baseline] (676.154 µs) : 0, 676
Remote Config [candidate] (675.448 µs) : 0, 675
Telemetry [baseline] (10.996 ms) : 0, 10996
Telemetry [candidate] (12.185 ms) : 0, 12185
section appsec
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (761.737 ms) : 0, 761737
BytebuddyAgent [candidate] (761.647 ms) : 0, 761647
GlobalTracer [baseline] (237.525 ms) : 0, 237525
GlobalTracer [candidate] (237.566 ms) : 0, 237566
AppSec [baseline] (168.738 ms) : 0, 168738
AppSec [candidate] (168.875 ms) : 0, 168875
Debugger [baseline] (9.156 ms) : 0, 9156
Debugger [candidate] (9.872 ms) : 0, 9872
Remote Config [baseline] (648.883 µs) : 0, 649
Remote Config [candidate] (631.075 µs) : 0, 631
Telemetry [baseline] (9.315 ms) : 0, 9315
Telemetry [candidate] (8.554 ms) : 0, 8554
IAST [baseline] (23.842 ms) : 0, 23842
IAST [candidate] (23.642 ms) : 0, 23642
section iast
crashtracking [baseline] (1.474 ms) : 0, 1474
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (857.738 ms) : 0, 857738
BytebuddyAgent [candidate] (851.662 ms) : 0, 851662
GlobalTracer [baseline] (234.253 ms) : 0, 234253
GlobalTracer [candidate] (232.994 ms) : 0, 232994
AppSec [baseline] (26.302 ms) : 0, 26302
AppSec [candidate] (27.949 ms) : 0, 27949
Debugger [baseline] (7.015 ms) : 0, 7015
Debugger [candidate] (6.167 ms) : 0, 6167
Remote Config [baseline] (608.62 µs) : 0, 609
Remote Config [candidate] (609.151 µs) : 0, 609
Telemetry [baseline] (8.573 ms) : 0, 8573
Telemetry [candidate] (8.397 ms) : 0, 8397
IAST [baseline] (31.261 ms) : 0, 31261
IAST [candidate] (30.304 ms) : 0, 30304
section profiling
crashtracking [baseline] (1.421 ms) : 0, 1421
crashtracking [candidate] (1.426 ms) : 0, 1426
BytebuddyAgent [baseline] (761.132 ms) : 0, 761132
BytebuddyAgent [candidate] (760.279 ms) : 0, 760279
GlobalTracer [baseline] (223.724 ms) : 0, 223724
GlobalTracer [candidate] (222.837 ms) : 0, 222837
AppSec [baseline] (30.542 ms) : 0, 30542
AppSec [candidate] (30.381 ms) : 0, 30381
Debugger [baseline] (6.742 ms) : 0, 6742
Debugger [candidate] (6.69 ms) : 0, 6690
Remote Config [baseline] (708.711 µs) : 0, 709
Remote Config [candidate] (713.187 µs) : 0, 713
Telemetry [baseline] (16.43 ms) : 0, 16430
Telemetry [candidate] (16.23 ms) : 0, 16230
ProfilingAgent [baseline] (108.136 ms) : 0, 108136
ProfilingAgent [candidate] (108.162 ms) : 0, 108162
Profiling [baseline] (108.814 ms) : 0, 108814
Profiling [candidate] (108.843 ms) : 0, 108843
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~5be239a4d8, baseline=1.54.0-SNAPSHOT~622aa3443a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1051762
Total [baseline] (8.659 s) : 0, 8659406
Agent [candidate] (1.045 s) : 0, 1045459
Total [candidate] (8.635 s) : 0, 8635446
section iast
Agent [baseline] (1.184 s) : 0, 1184129
Total [baseline] (9.366 s) : 0, 9366119
Agent [candidate] (1.179 s) : 0, 1179322
Total [candidate] (9.353 s) : 0, 9352734
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent iast 1.184 s 132.366 ms (12.6%)
Total tracing 8.659 s -
Total iast 9.366 s 706.712 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.179 s 133.863 ms (12.8%)
Total tracing 8.635 s -
Total iast 9.353 s 717.288 ms (8.3%)
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~5be239a4d8, baseline=1.54.0-SNAPSHOT~622aa3443a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (733.591 ms) : 0, 733591
BytebuddyAgent [candidate] (731.916 ms) : 0, 731916
GlobalTracer [baseline] (243.643 ms) : 0, 243643
GlobalTracer [candidate] (242.763 ms) : 0, 242763
AppSec [baseline] (30.679 ms) : 0, 30679
AppSec [candidate] (30.103 ms) : 0, 30103
Debugger [baseline] (6.515 ms) : 0, 6515
Debugger [candidate] (6.451 ms) : 0, 6451
Remote Config [baseline] (681.198 µs) : 0, 681
Remote Config [candidate] (677.551 µs) : 0, 678
Telemetry [baseline] (14.071 ms) : 0, 14071
Telemetry [candidate] (11.005 ms) : 0, 11005
section iast
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (854.42 ms) : 0, 854420
BytebuddyAgent [candidate] (850.834 ms) : 0, 850834
GlobalTracer [baseline] (233.994 ms) : 0, 233994
GlobalTracer [candidate] (232.846 ms) : 0, 232846
AppSec [baseline] (26.879 ms) : 0, 26879
AppSec [candidate] (28.511 ms) : 0, 28511
Debugger [baseline] (6.133 ms) : 0, 6133
Debugger [candidate] (6.876 ms) : 0, 6876
Remote Config [baseline] (677.065 µs) : 0, 677
Remote Config [candidate] (603.986 µs) : 0, 604
Telemetry [baseline] (8.382 ms) : 0, 8382
Telemetry [candidate] (8.303 ms) : 0, 8303
IAST [baseline] (31.118 ms) : 0, 31118
IAST [candidate] (28.804 ms) : 0, 28804
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/revert-kotlin-25-ea-workaround
git_commit_date 1757441367 1757442868
git_commit_sha 622aa34 5be239a
release_version 1.54.0-SNAPSHOT~622aa3443a 1.54.0-SNAPSHOT~5be239a4d8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1757444299 1757444299
ci_job_id 1121217607 1121217607
ci_pipeline_id 75993454 75993454
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-8ctxnad1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-8ctxnad1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+348.105µs; +667.976µs] or [+3.934%; +7.550%]
unstable
[-89.953op/s; +33.703op/s] or [-17.158%; +6.429%]
9.356ms 496.125op/s 8.848ms 524.250op/s
scenario:load:petclinic:no_agent:high_load better
[-1.532ms; -0.889ms] or [-4.055%; -2.352%]
unstable
[-4.634op/s; +12.809op/s] or [-3.744%; +10.350%]
36.568ms 127.838op/s 37.779ms 123.750op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.374ms; +2.209ms] or [+3.125%; +5.021%]
unstable
[-11.193op/s; +3.068op/s] or [-10.524%; +2.884%]
45.782ms 102.287op/s 43.990ms 106.350op/s
scenario:load:petclinic:appsec:high_load worse
[+1.700ms; +2.632ms] or [+3.614%; +5.595%]
unstable
[-11.456op/s; +2.581op/s] or [-11.510%; +2.593%]
49.199ms 95.100op/s 47.033ms 99.537op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~5be239a4d8, baseline=1.54.0-SNAPSHOT~622aa3443a
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.779 ms) : 37472, 38086
.   : milestone, 37779,
appsec (47.033 ms) : 46599, 47467
.   : milestone, 47033,
code_origins (43.99 ms) : 43609, 44372
.   : milestone, 43990,
iast (45.062 ms) : 44664, 45460
.   : milestone, 45062,
profiling (50.479 ms) : 49987, 50972
.   : milestone, 50479,
tracing (43.508 ms) : 43134, 43881
.   : milestone, 43508,
section candidate
no_agent (36.568 ms) : 36278, 36859
.   : milestone, 36568,
appsec (49.199 ms) : 48767, 49631
.   : milestone, 49199,
code_origins (45.782 ms) : 45388, 46175
.   : milestone, 45782,
iast (44.953 ms) : 44553, 45354
.   : milestone, 44953,
profiling (49.016 ms) : 48452, 49580
.   : milestone, 49016,
tracing (44.764 ms) : 44377, 45152
.   : milestone, 44764,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.779 ms [37.472 ms, 38.086 ms] -
appsec 47.033 ms [46.599 ms, 47.467 ms] 9.254 ms (24.5%)
code_origins 43.99 ms [43.609 ms, 44.372 ms] 6.211 ms (16.4%)
iast 45.062 ms [44.664 ms, 45.46 ms] 7.283 ms (19.3%)
profiling 50.479 ms [49.987 ms, 50.972 ms] 12.701 ms (33.6%)
tracing 43.508 ms [43.134 ms, 43.881 ms] 5.729 ms (15.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.568 ms [36.278 ms, 36.859 ms] -
appsec 49.199 ms [48.767 ms, 49.631 ms] 12.63 ms (34.5%)
code_origins 45.782 ms [45.388 ms, 46.175 ms] 9.213 ms (25.2%)
iast 44.953 ms [44.553 ms, 45.354 ms] 8.385 ms (22.9%)
profiling 49.016 ms [48.452 ms, 49.58 ms] 12.447 ms (34.0%)
tracing 44.764 ms [44.377 ms, 45.152 ms] 8.196 ms (22.4%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~5be239a4d8, baseline=1.54.0-SNAPSHOT~622aa3443a
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.331 ms) : 4283, 4380
.   : milestone, 4331,
iast (9.194 ms) : 9041, 9347
.   : milestone, 9194,
iast_FULL (13.845 ms) : 13566, 14125
.   : milestone, 13845,
iast_GLOBAL (10.127 ms) : 9949, 10305
.   : milestone, 10127,
profiling (8.848 ms) : 8709, 8986
.   : milestone, 8848,
tracing (7.579 ms) : 7466, 7692
.   : milestone, 7579,
section candidate
no_agent (4.253 ms) : 4205, 4300
.   : milestone, 4253,
iast (9.365 ms) : 9209, 9521
.   : milestone, 9365,
iast_FULL (14.192 ms) : 13909, 14476
.   : milestone, 14192,
iast_GLOBAL (10.419 ms) : 10220, 10618
.   : milestone, 10419,
profiling (9.356 ms) : 9197, 9514
.   : milestone, 9356,
tracing (7.535 ms) : 7421, 7650
.   : milestone, 7535,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.331 ms [4.283 ms, 4.38 ms] -
iast 9.194 ms [9.041 ms, 9.347 ms] 4.862 ms (112.3%)
iast_FULL 13.845 ms [13.566 ms, 14.125 ms] 9.514 ms (219.6%)
iast_GLOBAL 10.127 ms [9.949 ms, 10.305 ms] 5.796 ms (133.8%)
profiling 8.848 ms [8.709 ms, 8.986 ms] 4.516 ms (104.3%)
tracing 7.579 ms [7.466 ms, 7.692 ms] 3.248 ms (75.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.253 ms [4.205 ms, 4.3 ms] -
iast 9.365 ms [9.209 ms, 9.521 ms] 5.112 ms (120.2%)
iast_FULL 14.192 ms [13.909 ms, 14.476 ms] 9.94 ms (233.7%)
iast_GLOBAL 10.419 ms [10.22 ms, 10.618 ms] 6.166 ms (145.0%)
profiling 9.356 ms [9.197 ms, 9.514 ms] 5.103 ms (120.0%)
tracing 7.535 ms [7.421 ms, 7.65 ms] 3.283 ms (77.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/revert-kotlin-25-ea-workaround
git_commit_date 1757441367 1757442868
git_commit_sha 622aa34 5be239a
release_version 1.54.0-SNAPSHOT~622aa3443a 1.54.0-SNAPSHOT~5be239a4d8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1757444894 1757444894
ci_job_id 1121217608 1121217608
ci_pipeline_id 75993454 75993454
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-ph02fgm8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-ph02fgm8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~5be239a4d8, baseline=1.54.0-SNAPSHOT~622aa3443a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.631 ms) : 3413, 3848
.   : milestone, 3631,
iast (2.19 ms) : 2128, 2253
.   : milestone, 2190,
iast_GLOBAL (2.241 ms) : 2179, 2304
.   : milestone, 2241,
profiling (2.056 ms) : 2004, 2107
.   : milestone, 2056,
tracing (2.018 ms) : 1969, 2066
.   : milestone, 2018,
section candidate
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.649 ms) : 3433, 3865
.   : milestone, 3649,
iast (2.197 ms) : 2135, 2260
.   : milestone, 2197,
iast_GLOBAL (2.238 ms) : 2175, 2300
.   : milestone, 2238,
profiling (2.06 ms) : 2008, 2112
.   : milestone, 2060,
tracing (2.016 ms) : 1967, 2065
.   : milestone, 2016,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 3.631 ms [3.413 ms, 3.848 ms] 2.156 ms (146.2%)
iast 2.19 ms [2.128 ms, 2.253 ms] 715.396 µs (48.5%)
iast_GLOBAL 2.241 ms [2.179 ms, 2.304 ms] 766.667 µs (52.0%)
profiling 2.056 ms [2.004 ms, 2.107 ms] 580.751 µs (39.4%)
tracing 2.018 ms [1.969 ms, 2.066 ms] 542.748 µs (36.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.649 ms [3.433 ms, 3.865 ms] 2.172 ms (147.1%)
iast 2.197 ms [2.135 ms, 2.26 ms] 720.576 µs (48.8%)
iast_GLOBAL 2.238 ms [2.175 ms, 2.3 ms] 760.86 µs (51.5%)
profiling 2.06 ms [2.008 ms, 2.112 ms] 582.938 µs (39.5%)
tracing 2.016 ms [1.967 ms, 2.065 ms] 539.139 µs (36.5%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~5be239a4d8, baseline=1.54.0-SNAPSHOT~622aa3443a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.996 s) : 14996000, 14996000
.   : milestone, 14996000,
appsec (15.095 s) : 15095000, 15095000
.   : milestone, 15095000,
iast (18.98 s) : 18980000, 18980000
.   : milestone, 18980000,
iast_GLOBAL (17.927 s) : 17927000, 17927000
.   : milestone, 17927000,
profiling (16.119 s) : 16119000, 16119000
.   : milestone, 16119000,
tracing (15.015 s) : 15015000, 15015000
.   : milestone, 15015000,
section candidate
no_agent (14.94 s) : 14940000, 14940000
.   : milestone, 14940000,
appsec (14.984 s) : 14984000, 14984000
.   : milestone, 14984000,
iast (18.124 s) : 18124000, 18124000
.   : milestone, 18124000,
iast_GLOBAL (17.629 s) : 17629000, 17629000
.   : milestone, 17629000,
profiling (15.985 s) : 15985000, 15985000
.   : milestone, 15985000,
tracing (15.285 s) : 15285000, 15285000
.   : milestone, 15285000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.996 s [14.996 s, 14.996 s] -
appsec 15.095 s [15.095 s, 15.095 s] 99.0 ms (0.7%)
iast 18.98 s [18.98 s, 18.98 s] 3.984 s (26.6%)
iast_GLOBAL 17.927 s [17.927 s, 17.927 s] 2.931 s (19.5%)
profiling 16.119 s [16.119 s, 16.119 s] 1.123 s (7.5%)
tracing 15.015 s [15.015 s, 15.015 s] 19.0 ms (0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.94 s [14.94 s, 14.94 s] -
appsec 14.984 s [14.984 s, 14.984 s] 44.0 ms (0.3%)
iast 18.124 s [18.124 s, 18.124 s] 3.184 s (21.3%)
iast_GLOBAL 17.629 s [17.629 s, 17.629 s] 2.689 s (18.0%)
profiling 15.985 s [15.985 s, 15.985 s] 1.045 s (7.0%)
tracing 15.285 s [15.285 s, 15.285 s] 345.0 ms (2.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: tooling Build & Tooling tag: do not merge Do not merge changes tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants