Skip to content

Fix master failure after adding JDK 25 EA testing #9274

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jul 30, 2025
Merged

Fix master failure after adding JDK 25 EA testing #9274

merged 1 commit into from
Jul 30, 2025

Conversation

sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Jul 29, 2025 •
edited
Loading

What Does This Do

Kotlin compilation fails for JDK 25 EA and JDK 25 (unreleased). So, temporarily override the java.version to be the latest JDK general release 24 until 25 is GA-ed and tested.

Motivation

Fix master

Additional Notes

Master failure: https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/jobs/1053846178
Running ./gradlew :dd-java-agent:agent-debugger:test -PtestJvm=25 was failing but now passes locally.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Jul 29, 2025 •
edited
Loading

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1753825814 1753826160
end_time 2025-07-29T21:51:35 2025-07-29T21:57:21
git_branch master sarahchen6/fix-master-failure-from-adding-25ea
git_commit_sha 6860793 e52dbc2
start_time 2025-07-29T21:50:15 2025-07-29T21:56:01
See matching parameters
Baseline Candidate
ci_job_id 1054264996 1054264996
ci_pipeline_id 72106146 72106146
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1753823256 1753823256

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-40.232µs; +26.594µs] or [-14.029%; +9.274%]		 unstable
[-58.182µs; +35.908µs] or [-17.569%; +10.843%]		 unstable
[-68.663µs; +44.139µs] or [-19.801%; +12.729%]		 unstable
[-248.470µs; +218.324µs] or [-24.061%; +21.142%]		 same
scenario:basic same same same unstable
[-3.289µs; +172.628µs] or [-0.458%; +24.036%]		 unstable
[-78.937op/s; +221.184op/s] or [-3.000%; +8.405%]
scenario:loop same unsure
[-14.017µs; -2.019µs] or [-0.156%; -0.023%]		 unsure
[-14.541µs; -2.739µs] or [-0.161%; -0.030%]		 same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (331.167 µs) : 275, 387
.   : milestone, 331,
basic (280.341 µs) : 274, 287
.   : milestone, 280,
loop (8.97 ms) : 8964, 8975
.   : milestone, 8970,
section candidate
noprobe (320.03 µs) : 291, 349
.   : milestone, 320,
basic (276.899 µs) : 272, 282
.   : milestone, 277,
loop (8.962 ms) : 8956, 8967
.   : milestone, 8962,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 331.167 µs [274.983 µs, 387.351 µs]
basic 280.341 µs [274.108 µs, 286.574 µs]
loop 8.97 ms [8.964 ms, 8.975 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 320.03 µs [290.791 µs, 349.269 µs]
basic 276.899 µs [271.534 µs, 282.264 µs]
loop 8.962 ms [8.956 ms, 8.967 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jul 29, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/fix-master-failure-from-adding-25ea
git_commit_date 1753822152 1753823256
git_commit_sha 6860793 e52dbc2
release_version 1.51.1-SNAPSHOT~6860793509 1.51.1-SNAPSHOT~e52dbc2514
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753826976 1753826976
ci_job_id 1054264989 1054264989
ci_pipeline_id 72106146 72106146
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-m3u3yvfp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-m3u3yvfp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.51.1-SNAPSHOT~e52dbc2514, baseline=1.51.1-SNAPSHOT~6860793509

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1049639
Total [baseline] (8.625 s) : 0, 8624741
Agent [candidate] (1.045 s) : 0, 1045417
Total [candidate] (8.58 s) : 0, 8580044
section iast
Agent [baseline] (1.173 s) : 0, 1173303
Total [baseline] (9.331 s) : 0, 9330668
Agent [candidate] (1.181 s) : 0, 1181340
Total [candidate] (9.34 s) : 0, 9340119
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent iast 1.173 s 123.664 ms (11.8%)
Total tracing 8.625 s -
Total iast 9.331 s 705.927 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.181 s 135.923 ms (13.0%)
Total tracing 8.58 s -
Total iast 9.34 s 760.075 ms (8.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.51.1-SNAPSHOT~e52dbc2514, baseline=1.51.1-SNAPSHOT~6860793509

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.45 ms) : 0, 1450
crashtracking [candidate] (1.438 ms) : 0, 1438
BytebuddyAgent [baseline] (734.851 ms) : 0, 734851
BytebuddyAgent [candidate] (730.555 ms) : 0, 730555
GlobalTracer [baseline] (242.948 ms) : 0, 242948
GlobalTracer [candidate] (241.688 ms) : 0, 241688
AppSec [baseline] (30.577 ms) : 0, 30577
AppSec [candidate] (30.171 ms) : 0, 30171
Debugger [baseline] (6.069 ms) : 0, 6069
Debugger [candidate] (6.014 ms) : 0, 6014
Remote Config [baseline] (652.97 µs) : 0, 653
Remote Config [candidate] (641.875 µs) : 0, 642
Telemetry [baseline] (11.996 ms) : 0, 11996
Telemetry [candidate] (13.95 ms) : 0, 13950
section iast
crashtracking [baseline] (1.425 ms) : 0, 1425
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (846.581 ms) : 0, 846581
BytebuddyAgent [candidate] (854.109 ms) : 0, 854109
GlobalTracer [baseline] (230.817 ms) : 0, 230817
GlobalTracer [candidate] (231.848 ms) : 0, 231848
IAST [baseline] (28.382 ms) : 0, 28382
IAST [candidate] (28.993 ms) : 0, 28993
AppSec [baseline] (26.894 ms) : 0, 26894
AppSec [candidate] (27.523 ms) : 0, 27523
Debugger [baseline] (9.394 ms) : 0, 9394
Debugger [candidate] (7.521 ms) : 0, 7521
Remote Config [baseline] (602.543 µs) : 0, 603
Remote Config [candidate] (586.08 µs) : 0, 586
Telemetry [baseline] (8.18 ms) : 0, 8180
Telemetry [candidate] (8.089 ms) : 0, 8089
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.51.1-SNAPSHOT~e52dbc2514, baseline=1.51.1-SNAPSHOT~6860793509

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1043894
Total [baseline] (10.704 s) : 0, 10703560
Agent [candidate] (1.043 s) : 0, 1042936
Total [candidate] (10.744 s) : 0, 10743742
section appsec
Agent [baseline] (1.218 s) : 0, 1217966
Total [baseline] (10.756 s) : 0, 10755533
Agent [candidate] (1.228 s) : 0, 1228449
Total [candidate] (10.769 s) : 0, 10768637
section iast
Agent [baseline] (1.186 s) : 0, 1185679
Total [baseline] (10.943 s) : 0, 10942546
Agent [candidate] (1.175 s) : 0, 1175457
Total [candidate] (10.914 s) : 0, 10914041
section profiling
Agent [baseline] (1.192 s) : 0, 1192035
Total [baseline] (10.841 s) : 0, 10841171
Agent [candidate] (1.198 s) : 0, 1198220
Total [candidate] (10.935 s) : 0, 10935136
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent appsec 1.218 s 174.072 ms (16.7%)
Agent iast 1.186 s 141.785 ms (13.6%)
Agent profiling 1.192 s 148.141 ms (14.2%)
Total tracing 10.704 s -
Total appsec 10.756 s 51.973 ms (0.5%)
Total iast 10.943 s 238.986 ms (2.2%)
Total profiling 10.841 s 137.611 ms (1.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent appsec 1.228 s 185.513 ms (17.8%)
Agent iast 1.175 s 132.52 ms (12.7%)
Agent profiling 1.198 s 155.283 ms (14.9%)
Total tracing 10.744 s -
Total appsec 10.769 s 24.895 ms (0.2%)
Total iast 10.914 s 170.299 ms (1.6%)
Total profiling 10.935 s 191.394 ms (1.8%) 
gantt
    title petclinic - break down per module: candidate=1.51.1-SNAPSHOT~e52dbc2514, baseline=1.51.1-SNAPSHOT~6860793509

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (729.84 ms) : 0, 729840
BytebuddyAgent [candidate] (730.644 ms) : 0, 730644
GlobalTracer [baseline] (241.423 ms) : 0, 241423
GlobalTracer [candidate] (241.568 ms) : 0, 241568
AppSec [baseline] (30.263 ms) : 0, 30263
AppSec [candidate] (30.364 ms) : 0, 30364
Debugger [baseline] (5.993 ms) : 0, 5993
Debugger [candidate] (6.011 ms) : 0, 6011
Remote Config [baseline] (650.965 µs) : 0, 651
Remote Config [candidate] (657.226 µs) : 0, 657
Telemetry [baseline] (13.275 ms) : 0, 13275
Telemetry [candidate] (11.184 ms) : 0, 11184
section appsec
crashtracking [baseline] (1.435 ms) : 0, 1435
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (751.956 ms) : 0, 751956
BytebuddyAgent [candidate] (758.606 ms) : 0, 758606
GlobalTracer [baseline] (234.814 ms) : 0, 234814
GlobalTracer [candidate] (236.681 ms) : 0, 236681
AppSec [baseline] (169.178 ms) : 0, 169178
AppSec [candidate] (168.147 ms) : 0, 168147
Debugger [baseline] (7.162 ms) : 0, 7162
Debugger [candidate] (9.594 ms) : 0, 9594
Remote Config [baseline] (622.504 µs) : 0, 623
Remote Config [candidate] (617.723 µs) : 0, 618
Telemetry [baseline] (8.252 ms) : 0, 8252
Telemetry [candidate] (8.232 ms) : 0, 8232
IAST [baseline] (23.549 ms) : 0, 23549
IAST [candidate] (23.883 ms) : 0, 23883
section iast
crashtracking [baseline] (1.437 ms) : 0, 1437
crashtracking [candidate] (1.433 ms) : 0, 1433
BytebuddyAgent [baseline] (856.374 ms) : 0, 856374
BytebuddyAgent [candidate] (847.867 ms) : 0, 847867
GlobalTracer [baseline] (233.193 ms) : 0, 233193
GlobalTracer [candidate] (231.989 ms) : 0, 231989
AppSec [baseline] (26.017 ms) : 0, 26017
AppSec [candidate] (26.645 ms) : 0, 26645
Debugger [baseline] (6.723 ms) : 0, 6723
Debugger [candidate] (7.638 ms) : 0, 7638
Remote Config [baseline] (605.414 µs) : 0, 605
Remote Config [candidate] (613.412 µs) : 0, 613
Telemetry [baseline] (8.155 ms) : 0, 8155
Telemetry [candidate] (8.215 ms) : 0, 8215
IAST [baseline] (31.957 ms) : 0, 31957
IAST [candidate] (30.028 ms) : 0, 30028
section profiling
ProfilingAgent [baseline] (108.401 ms) : 0, 108401
ProfilingAgent [candidate] (108.596 ms) : 0, 108596
crashtracking [baseline] (1.395 ms) : 0, 1395
crashtracking [candidate] (1.408 ms) : 0, 1408
BytebuddyAgent [baseline] (759.384 ms) : 0, 759384
BytebuddyAgent [candidate] (763.84 ms) : 0, 763840
GlobalTracer [baseline] (221.334 ms) : 0, 221334
GlobalTracer [candidate] (221.453 ms) : 0, 221453
AppSec [baseline] (30.127 ms) : 0, 30127
AppSec [candidate] (30.477 ms) : 0, 30477
Debugger [baseline] (6.271 ms) : 0, 6271
Debugger [candidate] (6.321 ms) : 0, 6321
Remote Config [baseline] (688.913 µs) : 0, 689
Remote Config [candidate] (701.87 µs) : 0, 702
Telemetry [baseline] (15.057 ms) : 0, 15057
Telemetry [candidate] (15.766 ms) : 0, 15766
Profiling [baseline] (109.024 ms) : 0, 109024
Profiling [candidate] (109.255 ms) : 0, 109255
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/fix-master-failure-from-adding-25ea
git_commit_date 1753822152 1753823256
git_commit_sha 6860793 e52dbc2
release_version 1.51.1-SNAPSHOT~6860793509 1.51.1-SNAPSHOT~e52dbc2514
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753826652 1753826652
ci_job_id 1054264990 1054264990
ci_pipeline_id 72106146 72106146
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-cwv4v4eh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-cwv4v4eh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load worse
[+337.184µs; +925.966µs] or [+2.499%; +6.861%]		 unstable
[-52.084op/s; +21.522op/s] or [-15.089%; +6.235%]		 14.127ms 329.906op/s 13.495ms 345.188op/s
scenario:load:petclinic:appsec:high_load better
[-2.833ms; -1.938ms] or [-5.831%; -3.989%]		 unstable
[-2.347op/s; +12.297op/s] or [-2.436%; +12.765%]		 46.200ms 101.312op/s 48.585ms 96.338op/s
scenario:load:petclinic:no_agent:high_load better
[-1.517ms; -0.864ms] or [-3.990%; -2.271%]		 unstable
[-4.817op/s; +12.792op/s] or [-3.917%; +10.402%]		 36.835ms 126.963op/s 38.026ms 122.975op/s
scenario:load:petclinic:iast:high_load better
[-1.924ms; -1.039ms] or [-4.219%; -2.279%]		 unstable
[-2.458op/s; +12.018op/s] or [-2.395%; +11.711%]		 44.117ms 107.405op/s 45.599ms 102.625op/s
scenario:load:petclinic:profiling:high_load worse
[+1.801ms; +2.835ms] or [+3.745%; +5.896%]		 unstable
[-11.243op/s; +2.180op/s] or [-11.405%; +2.212%]		 50.408ms 94.051op/s 48.089ms 98.582op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~e52dbc2514, baseline=1.51.1-SNAPSHOT~6860793509
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.026 ms) : 37721, 38330
.   : milestone, 38026,
appsec (48.585 ms) : 48155, 49016
.   : milestone, 48585,
code_origins (45.214 ms) : 44825, 45603
.   : milestone, 45214,
iast (45.599 ms) : 45176, 46022
.   : milestone, 45599,
profiling (48.089 ms) : 47657, 48522
.   : milestone, 48089,
tracing (42.578 ms) : 42204, 42952
.   : milestone, 42578,
section candidate
no_agent (36.835 ms) : 36532, 37138
.   : milestone, 36835,
appsec (46.2 ms) : 45799, 46600
.   : milestone, 46200,
code_origins (45.301 ms) : 44937, 45666
.   : milestone, 45301,
iast (44.117 ms) : 43719, 44516
.   : milestone, 44117,
profiling (50.408 ms) : 49883, 50932
.   : milestone, 50408,
tracing (43.459 ms) : 43088, 43830
.   : milestone, 43459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.026 ms [37.721 ms, 38.33 ms] -
appsec 48.585 ms [48.155 ms, 49.016 ms] 10.56 ms (27.8%)
code_origins 45.214 ms [44.825 ms, 45.603 ms] 7.189 ms (18.9%)
iast 45.599 ms [45.176 ms, 46.022 ms] 7.573 ms (19.9%)
profiling 48.089 ms [47.657 ms, 48.522 ms] 10.064 ms (26.5%)
tracing 42.578 ms [42.204 ms, 42.952 ms] 4.552 ms (12.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.835 ms [36.532 ms, 37.138 ms] -
appsec 46.2 ms [45.799 ms, 46.6 ms] 9.365 ms (25.4%)
code_origins 45.301 ms [44.937 ms, 45.666 ms] 8.466 ms (23.0%)
iast 44.117 ms [43.719 ms, 44.516 ms] 7.282 ms (19.8%)
profiling 50.408 ms [49.883 ms, 50.932 ms] 13.573 ms (36.8%)
tracing 43.459 ms [43.088 ms, 43.83 ms] 6.624 ms (18.0%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~e52dbc2514, baseline=1.51.1-SNAPSHOT~6860793509
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.369 ms) : 4315, 4422
.   : milestone, 4369,
iast (9.438 ms) : 9286, 9591
.   : milestone, 9438,
iast_FULL (13.495 ms) : 13230, 13761
.   : milestone, 13495,
iast_GLOBAL (10.29 ms) : 10095, 10485
.   : milestone, 10290,
profiling (9.107 ms) : 8965, 9248
.   : milestone, 9107,
tracing (7.519 ms) : 7405, 7634
.   : milestone, 7519,
section candidate
no_agent (4.44 ms) : 4383, 4497
.   : milestone, 4440,
iast (9.421 ms) : 9262, 9580
.   : milestone, 9421,
iast_FULL (14.127 ms) : 13846, 14408
.   : milestone, 14127,
iast_GLOBAL (10.339 ms) : 10145, 10534
.   : milestone, 10339,
profiling (8.85 ms) : 8698, 9002
.   : milestone, 8850,
tracing (7.68 ms) : 7563, 7798
.   : milestone, 7680,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.369 ms [4.315 ms, 4.422 ms] -
iast 9.438 ms [9.286 ms, 9.591 ms] 5.07 ms (116.1%)
iast_FULL 13.495 ms [13.23 ms, 13.761 ms] 9.127 ms (208.9%)
iast_GLOBAL 10.29 ms [10.095 ms, 10.485 ms] 5.921 ms (135.5%)
profiling 9.107 ms [8.965 ms, 9.248 ms] 4.738 ms (108.5%)
tracing 7.519 ms [7.405 ms, 7.634 ms] 3.151 ms (72.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.44 ms [4.383 ms, 4.497 ms] -
iast 9.421 ms [9.262 ms, 9.58 ms] 4.981 ms (112.2%)
iast_FULL 14.127 ms [13.846 ms, 14.408 ms] 9.687 ms (218.1%)
iast_GLOBAL 10.339 ms [10.145 ms, 10.534 ms] 5.899 ms (132.8%)
profiling 8.85 ms [8.698 ms, 9.002 ms] 4.41 ms (99.3%)
tracing 7.68 ms [7.563 ms, 7.798 ms] 3.24 ms (73.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/fix-master-failure-from-adding-25ea
git_commit_date 1753822152 1753823256
git_commit_sha 6860793 e52dbc2
release_version 1.51.1-SNAPSHOT~6860793509 1.51.1-SNAPSHOT~e52dbc2514
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1753827227 1753827227
ci_job_id 1054264991 1054264991
ci_pipeline_id 72106146 72106146
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-bxyi606m 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-bxyi606m 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~e52dbc2514, baseline=1.51.1-SNAPSHOT~6860793509
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.477 ms) : 2423, 2531
.   : milestone, 2477,
iast (2.21 ms) : 2147, 2273
.   : milestone, 2210,
iast_GLOBAL (2.248 ms) : 2185, 2311
.   : milestone, 2248,
profiling (2.048 ms) : 1997, 2098
.   : milestone, 2048,
tracing (2.015 ms) : 1967, 2064
.   : milestone, 2015,
section candidate
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (3.653 ms) : 3434, 3871
.   : milestone, 3653,
iast (2.204 ms) : 2141, 2267
.   : milestone, 2204,
iast_GLOBAL (2.247 ms) : 2184, 2310
.   : milestone, 2247,
profiling (2.042 ms) : 1992, 2092
.   : milestone, 2042,
tracing (2.021 ms) : 1973, 2070
.   : milestone, 2021,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 2.477 ms [2.423 ms, 2.531 ms] 999.22 µs (67.6%)
iast 2.21 ms [2.147 ms, 2.273 ms] 732.369 µs (49.6%)
iast_GLOBAL 2.248 ms [2.185 ms, 2.311 ms] 770.201 µs (52.1%)
profiling 2.048 ms [1.997 ms, 2.098 ms] 570.125 µs (38.6%)
tracing 2.015 ms [1.967 ms, 2.064 ms] 537.782 µs (36.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 3.653 ms [3.434 ms, 3.871 ms] 2.175 ms (147.2%)
iast 2.204 ms [2.141 ms, 2.267 ms] 726.008 µs (49.1%)
iast_GLOBAL 2.247 ms [2.184 ms, 2.31 ms] 769.363 µs (52.1%)
profiling 2.042 ms [1.992 ms, 2.092 ms] 564.1 µs (38.2%)
tracing 2.021 ms [1.973 ms, 2.07 ms] 543.596 µs (36.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~e52dbc2514, baseline=1.51.1-SNAPSHOT~6860793509
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.43 s) : 15430000, 15430000
.   : milestone, 15430000,
appsec (14.731 s) : 14731000, 14731000
.   : milestone, 14731000,
iast (18.477 s) : 18477000, 18477000
.   : milestone, 18477000,
iast_GLOBAL (17.937 s) : 17937000, 17937000
.   : milestone, 17937000,
profiling (15.311 s) : 15311000, 15311000
.   : milestone, 15311000,
tracing (15.109 s) : 15109000, 15109000
.   : milestone, 15109000,
section candidate
no_agent (15.52 s) : 15520000, 15520000
.   : milestone, 15520000,
appsec (14.893 s) : 14893000, 14893000
.   : milestone, 14893000,
iast (18.635 s) : 18635000, 18635000
.   : milestone, 18635000,
iast_GLOBAL (18.104 s) : 18104000, 18104000
.   : milestone, 18104000,
profiling (15.743 s) : 15743000, 15743000
.   : milestone, 15743000,
tracing (14.865 s) : 14865000, 14865000
.   : milestone, 14865000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.43 s [15.43 s, 15.43 s] -
appsec 14.731 s [14.731 s, 14.731 s] -699.0 ms (-4.5%)
iast 18.477 s [18.477 s, 18.477 s] 3.047 s (19.7%)
iast_GLOBAL 17.937 s [17.937 s, 17.937 s] 2.507 s (16.2%)
profiling 15.311 s [15.311 s, 15.311 s] -119.0 ms (-0.8%)
tracing 15.109 s [15.109 s, 15.109 s] -321.0 ms (-2.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.52 s [15.52 s, 15.52 s] -
appsec 14.893 s [14.893 s, 14.893 s] -627.0 ms (-4.0%)
iast 18.635 s [18.635 s, 18.635 s] 3.115 s (20.1%)
iast_GLOBAL 18.104 s [18.104 s, 18.104 s] 2.584 s (16.6%)
profiling 15.743 s [15.743 s, 15.743 s] 223.0 ms (1.4%)
tracing 14.865 s [14.865 s, 14.865 s] -655.0 ms (-4.2%)

@sarahchen6 sarahchen6 added type: bug Bug report and fix tag: no release notes Changes to exclude from release notes labels Jul 29, 2025
@sarahchen6 sarahchen6 marked this pull request as ready for review July 29, 2025 22:00
@sarahchen6 sarahchen6 requested a review from a team as a code owner July 29, 2025 22:00
@sarahchen6 sarahchen6 requested review from jpbempel and removed request for a team July 29, 2025 22:00
@sarahchen6 sarahchen6 merged commit b35e121 into master Jul 30, 2025
813 of 814 checks passed
@sarahchen6 sarahchen6 deleted the sarahchen6/fix-master-failure-from-adding-25ea branch July 30, 2025 00:10
@github-actions github-actions bot added this to the 1.52.0 milestone Jul 30, 2025
nayeem-kamal pushed a commit that referenced this pull request Aug 4, 2025
@sarahchen6
Override java version 25-ea to be 24 for kotlin compiler (#9274)
25b6900 
Signed-off-by: Nayeem Kamal <[email protected]>
@sarahchen6 sarahchen6 mentioned this pull request Sep 9, 2025
Draft
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@jpbempel jpbempel Awaiting requested review from jpbempel jpbempel is a code owner automatically assigned from DataDog/debugger-java

Assignees
No one assigned
Labels
tag: no release notes Changes to exclude from release notes type: bug Bug report and fix
Projects
None yet
Milestone
1.52.0
Development

Successfully merging this pull request may close these issues.
2 participants
@sarahchen6 @AlexeyKuznetsov-DD