Skip to content

Update Gradle dependencies #8794

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 47 commits into from

Conversation

github-actions[bot]
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels May 11, 2025
@github-actions github-actions bot requested review from a team as code owners May 11, 2025 04:47
@github-actions github-actions bot requested review from smola, jandro996, shatzi and nikita-tkachenko-datadog and removed request for a team May 11, 2025 04:47
@pr-commenter
Copy link

pr-commenter bot commented May 11, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250511
git_commit_date 1746825821 1746938784
git_commit_sha f494c33 0ee8a0f
release_version 1.50.0-SNAPSHOT~f494c33b01 1.50.0-SNAPSHOT~0ee8a0f1d1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1746941449 1746941449
ci_job_id 932609201 932609201
ci_pipeline_id 64723776 64723776
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ujqpvmht-project-304-concurrent-3-vyar12nr 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ujqpvmht-project-304-concurrent-3-vyar12nr 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.027 s) : 0, 1027242
Total [baseline] (8.736 s) : 0, 8735939
Agent [candidate] (1.018 s) : 0, 1017935
Total [candidate] (8.637 s) : 0, 8636663
section iast
Agent [baseline] (1.152 s) : 0, 1152280
Total [baseline] (9.266 s) : 0, 9265547
Agent [candidate] (1.148 s) : 0, 1147508
Total [candidate] (9.29 s) : 0, 9290156
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.148 s) : 0, 1147770
Total [baseline] (9.209 s) : 0, 9209185
Agent [candidate] (1.15 s) : 0, 1150007
Total [candidate] (9.263 s) : 0, 9262710
section iast_TELEMETRY_OFF
Agent [baseline] (1.145 s) : 0, 1144962
Total [baseline] (9.308 s) : 0, 9308459
Agent [candidate] (1.141 s) : 0, 1141352
Total [candidate] (9.221 s) : 0, 9221322
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.027 s -
Agent iast 1.152 s 125.038 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.148 s 120.528 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.145 s 117.72 ms (11.5%)
Total tracing 8.736 s -
Total iast 9.266 s 529.608 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.209 s 473.246 ms (5.4%)
Total iast_TELEMETRY_OFF 9.308 s 572.52 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent iast 1.148 s 129.574 ms (12.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.15 s 132.073 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.141 s 123.418 ms (12.1%)
Total tracing 8.637 s -
Total iast 9.29 s 653.492 ms (7.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.263 s 626.046 ms (7.2%)
Total iast_TELEMETRY_OFF 9.221 s 584.658 ms (6.8%)
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.905 ms) : 0, 687905
BytebuddyAgent [candidate] (679.97 ms) : 0, 679970
GlobalTracer [baseline] (242.225 ms) : 0, 242225
GlobalTracer [candidate] (239.191 ms) : 0, 239191
AppSec [baseline] (55.121 ms) : 0, 55121
AppSec [candidate] (54.439 ms) : 0, 54439
Debugger [baseline] (8.5 ms) : 0, 8500
Debugger [candidate] (8.967 ms) : 0, 8967
Remote Config [baseline] (694.64 µs) : 0, 695
Remote Config [candidate] (692.821 µs) : 0, 693
Telemetry [baseline] (9.068 ms) : 0, 9068
Telemetry [candidate] (11.193 ms) : 0, 11193
section iast
BytebuddyAgent [baseline] (802.964 ms) : 0, 802964
BytebuddyAgent [candidate] (800.714 ms) : 0, 800714
GlobalTracer [baseline] (231.881 ms) : 0, 231881
GlobalTracer [candidate] (229.803 ms) : 0, 229803
IAST [baseline] (28.597 ms) : 0, 28597
IAST [candidate] (27.538 ms) : 0, 27538
AppSec [baseline] (50.787 ms) : 0, 50787
AppSec [candidate] (51.48 ms) : 0, 51480
Debugger [baseline] (5.958 ms) : 0, 5958
Debugger [candidate] (5.979 ms) : 0, 5979
Remote Config [baseline] (595.761 µs) : 0, 596
Remote Config [candidate] (619.469 µs) : 0, 619
Telemetry [baseline] (7.952 ms) : 0, 7952
Telemetry [candidate] (7.977 ms) : 0, 7977
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (801.327 ms) : 0, 801327
BytebuddyAgent [candidate] (801.453 ms) : 0, 801453
GlobalTracer [baseline] (230.352 ms) : 0, 230352
GlobalTracer [candidate] (231.466 ms) : 0, 231466
IAST [baseline] (28.22 ms) : 0, 28220
IAST [candidate] (28.527 ms) : 0, 28527
AppSec [baseline] (50.062 ms) : 0, 50062
AppSec [candidate] (50.645 ms) : 0, 50645
Debugger [baseline] (5.875 ms) : 0, 5875
Debugger [candidate] (5.934 ms) : 0, 5934
Remote Config [baseline] (590.427 µs) : 0, 590
Remote Config [candidate] (600.122 µs) : 0, 600
Telemetry [baseline] (7.869 ms) : 0, 7869
Telemetry [candidate] (7.89 ms) : 0, 7890
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.231 ms) : 0, 798231
BytebuddyAgent [candidate] (796.04 ms) : 0, 796040
GlobalTracer [baseline] (230.873 ms) : 0, 230873
GlobalTracer [candidate] (230.033 ms) : 0, 230033
IAST [baseline] (22.363 ms) : 0, 22363
IAST [candidate] (23.047 ms) : 0, 23047
AppSec [baseline] (55.66 ms) : 0, 55660
AppSec [candidate] (54.63 ms) : 0, 54630
Debugger [baseline] (5.951 ms) : 0, 5951
Debugger [candidate] (5.89 ms) : 0, 5890
Remote Config [baseline] (604.172 µs) : 0, 604
Remote Config [candidate] (595.033 µs) : 0, 595
Telemetry [baseline] (7.795 ms) : 0, 7795
Telemetry [candidate] (7.705 ms) : 0, 7705
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.024 s) : 0, 1023910
Total [baseline] (10.489 s) : 0, 10489073
Agent [candidate] (1.025 s) : 0, 1024602
Total [candidate] (10.503 s) : 0, 10502894
section appsec
Agent [baseline] (1.159 s) : 0, 1159329
Total [baseline] (10.656 s) : 0, 10656172
Agent [candidate] (1.164 s) : 0, 1163655
Total [candidate] (10.672 s) : 0, 10671940
section iast
Agent [baseline] (1.149 s) : 0, 1148678
Total [baseline] (10.917 s) : 0, 10916928
Agent [candidate] (1.149 s) : 0, 1149262
Total [candidate] (10.93 s) : 0, 10929569
section profiling
Agent [baseline] (1.283 s) : 0, 1283116
Total [baseline] (10.922 s) : 0, 10921585
Agent [candidate] (1.291 s) : 0, 1290836
Total [candidate] (10.919 s) : 0, 10918676
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent appsec 1.159 s 135.42 ms (13.2%)
Agent iast 1.149 s 124.769 ms (12.2%)
Agent profiling 1.283 s 259.207 ms (25.3%)
Total tracing 10.489 s -
Total appsec 10.656 s 167.1 ms (1.6%)
Total iast 10.917 s 427.855 ms (4.1%)
Total profiling 10.922 s 432.513 ms (4.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent appsec 1.164 s 139.054 ms (13.6%)
Agent iast 1.149 s 124.66 ms (12.2%)
Agent profiling 1.291 s 266.235 ms (26.0%)
Total tracing 10.503 s -
Total appsec 10.672 s 169.046 ms (1.6%)
Total iast 10.93 s 426.675 ms (4.1%)
Total profiling 10.919 s 415.783 ms (4.0%)
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.396 ms) : 0, 686396
BytebuddyAgent [candidate] (686.14 ms) : 0, 686140
GlobalTracer [baseline] (241.149 ms) : 0, 241149
GlobalTracer [candidate] (239.76 ms) : 0, 239760
AppSec [baseline] (56.065 ms) : 0, 56065
AppSec [candidate] (54.521 ms) : 0, 54521
Debugger [baseline] (7.616 ms) : 0, 7616
Debugger [candidate] (9.228 ms) : 0, 9228
Remote Config [baseline] (690.297 µs) : 0, 690
Remote Config [candidate] (701.066 µs) : 0, 701
Telemetry [baseline] (8.295 ms) : 0, 8295
Telemetry [candidate] (10.475 ms) : 0, 10475
section appsec
BytebuddyAgent [baseline] (699.479 ms) : 0, 699479
BytebuddyAgent [candidate] (703.037 ms) : 0, 703037
GlobalTracer [baseline] (236.154 ms) : 0, 236154
GlobalTracer [candidate] (237.216 ms) : 0, 237216
IAST [baseline] (21.664 ms) : 0, 21664
IAST [candidate] (21.727 ms) : 0, 21727
AppSec [baseline] (175.433 ms) : 0, 175433
AppSec [candidate] (175.067 ms) : 0, 175067
Debugger [baseline] (5.928 ms) : 0, 5928
Debugger [candidate] (5.931 ms) : 0, 5931
Remote Config [baseline] (623.948 µs) : 0, 624
Remote Config [candidate] (614.699 µs) : 0, 615
Telemetry [baseline] (7.373 ms) : 0, 7373
Telemetry [candidate] (7.349 ms) : 0, 7349
section iast
BytebuddyAgent [baseline] (801.96 ms) : 0, 801960
BytebuddyAgent [candidate] (802.83 ms) : 0, 802830
GlobalTracer [baseline] (229.919 ms) : 0, 229919
GlobalTracer [candidate] (230.532 ms) : 0, 230532
IAST [baseline] (27.613 ms) : 0, 27613
IAST [candidate] (28.049 ms) : 0, 28049
AppSec [baseline] (49.73 ms) : 0, 49730
AppSec [candidate] (49.278 ms) : 0, 49278
Debugger [baseline] (5.89 ms) : 0, 5890
Debugger [candidate] (5.817 ms) : 0, 5817
Remote Config [baseline] (589.451 µs) : 0, 589
Remote Config [candidate] (581.518 µs) : 0, 582
Telemetry [baseline] (7.942 ms) : 0, 7942
Telemetry [candidate] (7.882 ms) : 0, 7882
section profiling
BytebuddyAgent [baseline] (675.614 ms) : 0, 675614
BytebuddyAgent [candidate] (678.825 ms) : 0, 678825
GlobalTracer [baseline] (377.895 ms) : 0, 377895
GlobalTracer [candidate] (381.15 ms) : 0, 381150
AppSec [baseline] (54.313 ms) : 0, 54313
AppSec [candidate] (53.615 ms) : 0, 53615
Debugger [baseline] (6.08 ms) : 0, 6080
Debugger [candidate] (6.125 ms) : 0, 6125
Remote Config [baseline] (649.697 µs) : 0, 650
Remote Config [candidate] (658.471 µs) : 0, 658
Telemetry [baseline] (8.063 ms) : 0, 8063
Telemetry [candidate] (8.107 ms) : 0, 8107
ProfilingAgent [baseline] (109.827 ms) : 0, 109827
ProfilingAgent [candidate] (111.334 ms) : 0, 111334
Profiling [baseline] (109.852 ms) : 0, 109852
Profiling [candidate] (111.36 ms) : 0, 111360
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-11T04:59:37 2025-05-11T05:07:22
git_branch master ci/update-gradle-dependencies-20250511
git_commit_date 1746825821 1746938784
git_commit_sha f494c33 0ee8a0f
release_version 1.50.0-SNAPSHOT~f494c33b01 1.50.0-SNAPSHOT~0ee8a0f1d1
start_time 2025-05-11T04:59:22 2025-05-11T05:07:08
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1746940440 1746940440
ci_job_id 932609202 932609202
ci_pipeline_id 64723776 64723776
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-snzwzxk-project-304-concurrent-2-1tvtzvl5 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-snzwzxk-project-304-concurrent-2-1tvtzvl5 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 18 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling better
[-108.801µs; -44.047µs] or [-6.959%; -2.817%]
unstable
[-326.907op/s; +800.981op/s] or [-11.033%; +27.033%]
1.487ms 3200.000op/s 1.563ms 2962.963op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.941 µs) : 364, 406
.   : milestone, 385,
iast (529.402 µs) : 506, 553
.   : milestone, 529,
iast_FULL (736.673 µs) : 715, 758
.   : milestone, 737,
iast_GLOBAL (580.022 µs) : 557, 603
.   : milestone, 580,
iast_HARDCODED_SECRET_DISABLED (518.211 µs) : 496, 540
.   : milestone, 518,
iast_INACTIVE (467.538 µs) : 445, 490
.   : milestone, 468,
iast_TELEMETRY_OFF (510.038 µs) : 487, 533
.   : milestone, 510,
tracing (466.774 µs) : 445, 489
.   : milestone, 467,
section candidate
no_agent (380.374 µs) : 360, 400
.   : milestone, 380,
iast (524.087 µs) : 502, 547
.   : milestone, 524,
iast_FULL (741.921 µs) : 720, 764
.   : milestone, 742,
iast_GLOBAL (557.85 µs) : 536, 579
.   : milestone, 558,
iast_HARDCODED_SECRET_DISABLED (526.001 µs) : 504, 548
.   : milestone, 526,
iast_INACTIVE (473.8 µs) : 451, 497
.   : milestone, 474,
iast_TELEMETRY_OFF (522.46 µs) : 499, 546
.   : milestone, 522,
tracing (458.586 µs) : 437, 480
.   : milestone, 459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.941 µs [363.962 µs, 405.92 µs] -
iast 529.402 µs [506.26 µs, 552.545 µs] 144.461 µs (37.5%)
iast_FULL 736.673 µs [714.952 µs, 758.395 µs] 351.732 µs (91.4%)
iast_GLOBAL 580.022 µs [557.493 µs, 602.552 µs] 195.081 µs (50.7%)
iast_HARDCODED_SECRET_DISABLED 518.211 µs [496.16 µs, 540.261 µs] 133.269 µs (34.6%)
iast_INACTIVE 467.538 µs [444.957 µs, 490.119 µs] 82.597 µs (21.5%)
iast_TELEMETRY_OFF 510.038 µs [486.851 µs, 533.224 µs] 125.097 µs (32.5%)
tracing 466.774 µs [444.567 µs, 488.98 µs] 81.832 µs (21.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.374 µs [360.401 µs, 400.348 µs] -
iast 524.087 µs [501.632 µs, 546.541 µs] 143.712 µs (37.8%)
iast_FULL 741.921 µs [719.886 µs, 763.956 µs] 361.546 µs (95.1%)
iast_GLOBAL 557.85 µs [536.29 µs, 579.41 µs] 177.475 µs (46.7%)
iast_HARDCODED_SECRET_DISABLED 526.001 µs [503.725 µs, 548.277 µs] 145.627 µs (38.3%)
iast_INACTIVE 473.8 µs [451.025 µs, 496.575 µs] 93.425 µs (24.6%)
iast_TELEMETRY_OFF 522.46 µs [499.306 µs, 545.613 µs] 142.085 µs (37.4%)
tracing 458.586 µs [436.834 µs, 480.339 µs] 78.212 µs (20.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.359 ms) : 1340, 1379
.   : milestone, 1359,
appsec (1.716 ms) : 1693, 1740
.   : milestone, 1716,
appsec_no_iast (1.73 ms) : 1707, 1753
.   : milestone, 1730,
code_origins (1.672 ms) : 1645, 1699
.   : milestone, 1672,
iast (1.533 ms) : 1509, 1557
.   : milestone, 1533,
profiling (1.563 ms) : 1528, 1599
.   : milestone, 1563,
tracing (1.495 ms) : 1473, 1518
.   : milestone, 1495,
section candidate
no_agent (1.373 ms) : 1353, 1394
.   : milestone, 1373,
appsec (1.74 ms) : 1716, 1764
.   : milestone, 1740,
appsec_no_iast (1.74 ms) : 1716, 1764
.   : milestone, 1740,
code_origins (1.672 ms) : 1646, 1699
.   : milestone, 1672,
iast (1.519 ms) : 1495, 1543
.   : milestone, 1519,
profiling (1.487 ms) : 1463, 1511
.   : milestone, 1487,
tracing (1.499 ms) : 1476, 1523
.   : milestone, 1499,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.359 ms [1.34 ms, 1.379 ms] -
appsec 1.716 ms [1.693 ms, 1.74 ms] 357.074 µs (26.3%)
appsec_no_iast 1.73 ms [1.707 ms, 1.753 ms] 370.502 µs (27.3%)
code_origins 1.672 ms [1.645 ms, 1.699 ms] 312.53 µs (23.0%)
iast 1.533 ms [1.509 ms, 1.557 ms] 173.9 µs (12.8%)
profiling 1.563 ms [1.528 ms, 1.599 ms] 204.22 µs (15.0%)
tracing 1.495 ms [1.473 ms, 1.518 ms] 136.114 µs (10.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.373 ms [1.353 ms, 1.394 ms] -
appsec 1.74 ms [1.716 ms, 1.764 ms] 366.734 µs (26.7%)
appsec_no_iast 1.74 ms [1.716 ms, 1.764 ms] 366.673 µs (26.7%)
code_origins 1.672 ms [1.646 ms, 1.699 ms] 298.867 µs (21.8%)
iast 1.519 ms [1.495 ms, 1.543 ms] 145.883 µs (10.6%)
profiling 1.487 ms [1.463 ms, 1.511 ms] 113.788 µs (8.3%)
tracing 1.499 ms [1.476 ms, 1.523 ms] 125.853 µs (9.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250511
git_commit_date 1746825821 1746938784
git_commit_sha f494c33 0ee8a0f
release_version 1.50.0-SNAPSHOT~f494c33b01 1.50.0-SNAPSHOT~0ee8a0f1d1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1746940999 1746940999
ci_job_id 932609203 932609203
ci_pipeline_id 64723776 64723776
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ecrswmq9-project-304-concurrent-3-ntjbfkb7 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ecrswmq9-project-304-concurrent-3-ntjbfkb7 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.417 ms) : 2368, 2467
.   : milestone, 2417,
iast (2.197 ms) : 2135, 2259
.   : milestone, 2197,
iast_GLOBAL (2.229 ms) : 2166, 2291
.   : milestone, 2229,
profiling (2.032 ms) : 1983, 2081
.   : milestone, 2032,
tracing (2.014 ms) : 1966, 2062
.   : milestone, 2014,
section candidate
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (2.406 ms) : 2357, 2455
.   : milestone, 2406,
iast (2.199 ms) : 2136, 2261
.   : milestone, 2199,
iast_GLOBAL (2.234 ms) : 2171, 2296
.   : milestone, 2234,
profiling (2.05 ms) : 1999, 2101
.   : milestone, 2050,
tracing (2.019 ms) : 1971, 2068
.   : milestone, 2019,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 2.417 ms [2.368 ms, 2.467 ms] 948.706 µs (64.6%)
iast 2.197 ms [2.135 ms, 2.259 ms] 728.022 µs (49.6%)
iast_GLOBAL 2.229 ms [2.166 ms, 2.291 ms] 760.023 µs (51.8%)
profiling 2.032 ms [1.983 ms, 2.081 ms] 563.67 µs (38.4%)
tracing 2.014 ms [1.966 ms, 2.062 ms] 545.763 µs (37.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 2.406 ms [2.357 ms, 2.455 ms] 927.617 µs (62.8%)
iast 2.199 ms [2.136 ms, 2.261 ms] 720.54 µs (48.7%)
iast_GLOBAL 2.234 ms [2.171 ms, 2.296 ms] 755.843 µs (51.1%)
profiling 2.05 ms [1.999 ms, 2.101 ms] 571.555 µs (38.7%)
tracing 2.019 ms [1.971 ms, 2.068 ms] 541.151 µs (36.6%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~0ee8a0f1d1, baseline=1.50.0-SNAPSHOT~f494c33b01
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.841 s) : 14841000, 14841000
.   : milestone, 14841000,
appsec (15.198 s) : 15198000, 15198000
.   : milestone, 15198000,
iast (19.202 s) : 19202000, 19202000
.   : milestone, 19202000,
iast_GLOBAL (18.207 s) : 18207000, 18207000
.   : milestone, 18207000,
profiling (14.863 s) : 14863000, 14863000
.   : milestone, 14863000,
tracing (15.018 s) : 15018000, 15018000
.   : milestone, 15018000,
section candidate
no_agent (15.21 s) : 15210000, 15210000
.   : milestone, 15210000,
appsec (15.098 s) : 15098000, 15098000
.   : milestone, 15098000,
iast (18.93 s) : 18930000, 18930000
.   : milestone, 18930000,
iast_GLOBAL (17.87 s) : 17870000, 17870000
.   : milestone, 17870000,
profiling (14.994 s) : 14994000, 14994000
.   : milestone, 14994000,
tracing (15.11 s) : 15110000, 15110000
.   : milestone, 15110000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.841 s [14.841 s, 14.841 s] -
appsec 15.198 s [15.198 s, 15.198 s] 357.0 ms (2.4%)
iast 19.202 s [19.202 s, 19.202 s] 4.361 s (29.4%)
iast_GLOBAL 18.207 s [18.207 s, 18.207 s] 3.366 s (22.7%)
profiling 14.863 s [14.863 s, 14.863 s] 22.0 ms (0.1%)
tracing 15.018 s [15.018 s, 15.018 s] 177.0 ms (1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.21 s [15.21 s, 15.21 s] -
appsec 15.098 s [15.098 s, 15.098 s] -112.0 ms (-0.7%)
iast 18.93 s [18.93 s, 18.93 s] 3.72 s (24.5%)
iast_GLOBAL 17.87 s [17.87 s, 17.87 s] 2.66 s (17.5%)
profiling 14.994 s [14.994 s, 14.994 s] -216.0 ms (-1.4%)
tracing 15.11 s [15.11 s, 15.11 s] -100.0 ms (-0.7%)

@pr-commenter
Copy link

pr-commenter bot commented May 11, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1746939578 1746939975
end_time 2025-05-11T05:00:56 2025-05-11T05:07:34
git_branch master ci/update-gradle-dependencies-20250511
git_commit_sha f494c33 1e44600
start_time 2025-05-11T04:59:39 2025-05-11T05:06:16
See matching parameters
Baseline Candidate
ci_job_id 932610737 932610737
ci_pipeline_id 64723786 64723786
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1746938811 1746938811

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop unsure
[-449.812µs; -28.270µs] or [-3.956%; -0.249%]
unsure
[-436.432µs; -6.375µs] or [-3.779%; -0.055%]
same same better
[+1.655op/s; +4.449op/s] or [+1.928%; +5.183%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-17.112µs; +23.685µs] or [-6.242%; +8.640%]
unstable
[-29.289µs; +34.739µs] or [-9.254%; +10.976%]
unstable
[-42.202µs; +46.116µs] or [-12.732%; +13.913%]
unstable
[-111.353µs; +76.340µs] or [-18.319%; +12.559%]
same
scenario:basic same same same unstable
[-55.417µs; +12.053µs] or [-9.924%; +2.158%]
unstable
[-211.490op/s; +89.539op/s] or [-8.460%; +3.582%]
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (316.511 µs) : 286, 347
.   : milestone, 317,
basic (315.75 µs) : 307, 325
.   : milestone, 316,
loop (11.55 ms) : 11532, 11568
.   : milestone, 11550,
section candidate
noprobe (319.237 µs) : 289, 350
.   : milestone, 319,
basic (319.284 µs) : 311, 328
.   : milestone, 319,
loop (11.329 ms) : 11047, 11611
.   : milestone, 11329,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 316.511 µs [285.894 µs, 347.129 µs]
basic 315.75 µs [306.748 µs, 324.753 µs]
loop 11.55 ms [11.532 ms, 11.568 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 319.237 µs [288.853 µs, 349.62 µs]
basic 319.284 µs [310.929 µs, 327.638 µs]
loop 11.329 ms [11.047 ms, 11.611 ms]

@pr-commenter
Copy link

pr-commenter bot commented May 11, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250511
git_commit_date 1746825821 1746938808
git_commit_sha f494c33 cace63b
See matching parameters
Baseline Candidate
ci_job_date 1746940068 1746940068
ci_job_id 932610582 932610582
ci_pipeline_id 64723785 64723785
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented May 11, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250511
git_commit_date 1746825821 1746938789
git_commit_sha f494c33 1ede360
See matching parameters
Baseline Candidate
ci_job_date 1746940123 1746940123
ci_job_id 932609512 932609512
ci_pipeline_id 64723778 64723778
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@smola
Copy link
Member

smola commented May 19, 2025

Closing in favor of #8842

@smola smola closed this May 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant