Test new docker base image #8841

sarahchen6 · 2025-05-16T15:10:27Z

What Does This Do

Test new docker base image from DataDog/dd-trace-java-docker-build#95

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-493

pr-commenter · 2025-05-16T16:01:15Z

Benchmarks

Startup

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-05-21T14:14:23	2025-05-21T14:22:07
git_branch	master	sarahchen6/test-new-docker-images
git_commit_date	1747835480	1747836149
git_commit_sha	`7dfc057`	`7aba671`
release_version	1.50.0-SNAPSHOT~7dfc057631	1.50.0-SNAPSHOT~7aba6710d2
start_time	2025-05-21T14:14:09	2025-05-21T14:21:53

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1747837725	1747837725
ci_job_id	948045665	948045665
ci_pipeline_id	65732086	65732086
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-pycpjsjc-project-304-concurrent-5-oxkiefd4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-pycpjsjc-project-304-concurrent-5-oxkiefd4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~7aba6710d2, baseline=1.50.0-SNAPSHOT~7dfc057631
    dateFormat X
    axisFormat %s
section baseline
no_agent (380.86 µs) : 359, 403
.   : milestone, 381,
iast (526.823 µs) : 504, 550
.   : milestone, 527,
iast_FULL (734.927 µs) : 713, 757
.   : milestone, 735,
iast_GLOBAL (562.634 µs) : 540, 585
.   : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (514.03 µs) : 492, 536
.   : milestone, 514,
iast_INACTIVE (463.377 µs) : 442, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (509.903 µs) : 487, 533
.   : milestone, 510,
tracing (459.718 µs) : 438, 482
.   : milestone, 460,
section candidate
no_agent (380.69 µs) : 360, 401
.   : milestone, 381,
iast (517.902 µs) : 496, 540
.   : milestone, 518,
iast_FULL (737.179 µs) : 715, 759
.   : milestone, 737,
iast_GLOBAL (565.933 µs) : 544, 588
.   : milestone, 566,
iast_HARDCODED_SECRET_DISABLED (521.954 µs) : 499, 545
.   : milestone, 522,
iast_INACTIVE (466.761 µs) : 445, 489
.   : milestone, 467,
iast_TELEMETRY_OFF (499.143 µs) : 476, 522
.   : milestone, 499,
tracing (458.008 µs) : 436, 480
.   : milestone, 458,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	380.86 µs [358.75 µs, 402.97 µs]	-
iast	526.823 µs [503.651 µs, 549.994 µs]	145.963 µs (38.3%)
iast_FULL	734.927 µs [712.822 µs, 757.031 µs]	354.067 µs (93.0%)
iast_GLOBAL	562.634 µs [540.385 µs, 584.883 µs]	181.774 µs (47.7%)
iast_HARDCODED_SECRET_DISABLED	514.03 µs [491.816 µs, 536.244 µs]	133.17 µs (35.0%)
iast_INACTIVE	463.377 µs [441.903 µs, 484.85 µs]	82.517 µs (21.7%)
iast_TELEMETRY_OFF	509.903 µs [486.861 µs, 532.945 µs]	129.043 µs (33.9%)
tracing	459.718 µs [437.914 µs, 481.523 µs]	78.859 µs (20.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	380.69 µs [360.296 µs, 401.083 µs]	-
iast	517.902 µs [495.792 µs, 540.012 µs]	137.212 µs (36.0%)
iast_FULL	737.179 µs [715.023 µs, 759.335 µs]	356.489 µs (93.6%)
iast_GLOBAL	565.933 µs [543.925 µs, 587.94 µs]	185.243 µs (48.7%)
iast_HARDCODED_SECRET_DISABLED	521.954 µs [498.912 µs, 544.995 µs]	141.264 µs (37.1%)
iast_INACTIVE	466.761 µs [444.823 µs, 488.699 µs]	86.071 µs (22.6%)
iast_TELEMETRY_OFF	499.143 µs [475.927 µs, 522.359 µs]	118.453 µs (31.1%)
tracing	458.008 µs [435.71 µs, 480.307 µs]	77.319 µs (20.3%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~7aba6710d2, baseline=1.50.0-SNAPSHOT~7dfc057631
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.353 ms) : 1334, 1372
.   : milestone, 1353,
appsec (1.728 ms) : 1704, 1751
.   : milestone, 1728,
appsec_no_iast (1.739 ms) : 1716, 1762
.   : milestone, 1739,
code_origins (1.676 ms) : 1650, 1702
.   : milestone, 1676,
iast (1.51 ms) : 1486, 1534
.   : milestone, 1510,
profiling (1.518 ms) : 1496, 1541
.   : milestone, 1518,
tracing (1.501 ms) : 1477, 1525
.   : milestone, 1501,
section candidate
no_agent (1.371 ms) : 1350, 1391
.   : milestone, 1371,
appsec (1.736 ms) : 1712, 1759
.   : milestone, 1736,
appsec_no_iast (1.727 ms) : 1703, 1750
.   : milestone, 1727,
code_origins (1.672 ms) : 1645, 1700
.   : milestone, 1672,
iast (1.535 ms) : 1511, 1559
.   : milestone, 1535,
profiling (1.525 ms) : 1501, 1550
.   : milestone, 1525,
tracing (1.481 ms) : 1458, 1504
.   : milestone, 1481,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.353 ms [1.334 ms, 1.372 ms]	-
appsec	1.728 ms [1.704 ms, 1.751 ms]	374.355 µs (27.7%)
appsec_no_iast	1.739 ms [1.716 ms, 1.762 ms]	385.713 µs (28.5%)
code_origins	1.676 ms [1.65 ms, 1.702 ms]	323.086 µs (23.9%)
iast	1.51 ms [1.486 ms, 1.534 ms]	156.98 µs (11.6%)
profiling	1.518 ms [1.496 ms, 1.541 ms]	165.138 µs (12.2%)
tracing	1.501 ms [1.477 ms, 1.525 ms]	147.642 µs (10.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.371 ms [1.35 ms, 1.391 ms]	-
appsec	1.736 ms [1.712 ms, 1.759 ms]	365.019 µs (26.6%)
appsec_no_iast	1.727 ms [1.703 ms, 1.75 ms]	356.047 µs (26.0%)
code_origins	1.672 ms [1.645 ms, 1.7 ms]	301.715 µs (22.0%)
iast	1.535 ms [1.511 ms, 1.559 ms]	164.06 µs (12.0%)
profiling	1.525 ms [1.501 ms, 1.55 ms]	154.685 µs (11.3%)
tracing	1.481 ms [1.458 ms, 1.504 ms]	110.224 µs (8.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-new-docker-images
git_commit_date	1747835480	1747836149
git_commit_sha	`7dfc057`	`7aba671`
release_version	1.50.0-SNAPSHOT~7dfc057631	1.50.0-SNAPSHOT~7aba6710d2

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1747838236	1747838236
ci_job_id	948045667	948045667
ci_pipeline_id	65732086	65732086
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-pycpjsjc-project-304-concurrent-6-fz3edy89 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-pycpjsjc-project-304-concurrent-6-fz3edy89 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~7aba6710d2, baseline=1.50.0-SNAPSHOT~7dfc057631
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.08 s) : 15080000, 15080000
.   : milestone, 15080000,
appsec (15.083 s) : 15083000, 15083000
.   : milestone, 15083000,
iast (18.287 s) : 18287000, 18287000
.   : milestone, 18287000,
iast_GLOBAL (17.999 s) : 17999000, 17999000
.   : milestone, 17999000,
profiling (15.11 s) : 15110000, 15110000
.   : milestone, 15110000,
tracing (15.06 s) : 15060000, 15060000
.   : milestone, 15060000,
section candidate
no_agent (14.971 s) : 14971000, 14971000
.   : milestone, 14971000,
appsec (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
iast (18.84 s) : 18840000, 18840000
.   : milestone, 18840000,
iast_GLOBAL (18.026 s) : 18026000, 18026000
.   : milestone, 18026000,
profiling (15.155 s) : 15155000, 15155000
.   : milestone, 15155000,
tracing (14.954 s) : 14954000, 14954000
.   : milestone, 14954000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.08 s [15.08 s, 15.08 s]	-
appsec	15.083 s [15.083 s, 15.083 s]	3.0 ms (0.0%)
iast	18.287 s [18.287 s, 18.287 s]	3.207 s (21.3%)
iast_GLOBAL	17.999 s [17.999 s, 17.999 s]	2.919 s (19.4%)
profiling	15.11 s [15.11 s, 15.11 s]	30.0 ms (0.2%)
tracing	15.06 s [15.06 s, 15.06 s]	-20.0 ms (-0.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.971 s [14.971 s, 14.971 s]	-
appsec	15.006 s [15.006 s, 15.006 s]	35.0 ms (0.2%)
iast	18.84 s [18.84 s, 18.84 s]	3.869 s (25.8%)
iast_GLOBAL	18.026 s [18.026 s, 18.026 s]	3.055 s (20.4%)
profiling	15.155 s [15.155 s, 15.155 s]	184.0 ms (1.2%)
tracing	14.954 s [14.954 s, 14.954 s]	-17.0 ms (-0.1%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~7aba6710d2, baseline=1.50.0-SNAPSHOT~7dfc057631
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.397 ms) : 2348, 2445
.   : milestone, 2397,
iast (2.177 ms) : 2116, 2239
.   : milestone, 2177,
iast_GLOBAL (2.225 ms) : 2164, 2287
.   : milestone, 2225,
profiling (2.017 ms) : 1968, 2066
.   : milestone, 2017,
tracing (2.01 ms) : 1962, 2058
.   : milestone, 2010,
section candidate
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (2.393 ms) : 2344, 2441
.   : milestone, 2393,
iast (2.177 ms) : 2115, 2239
.   : milestone, 2177,
iast_GLOBAL (2.232 ms) : 2169, 2294
.   : milestone, 2232,
profiling (2.016 ms) : 1968, 2065
.   : milestone, 2016,
tracing (2.015 ms) : 1966, 2063
.   : milestone, 2015,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.461 ms, 1.484 ms]	-
appsec	2.397 ms [2.348 ms, 2.445 ms]	923.97 µs (62.7%)
iast	2.177 ms [2.116 ms, 2.239 ms]	704.612 µs (47.8%)
iast_GLOBAL	2.225 ms [2.164 ms, 2.287 ms]	752.626 µs (51.1%)
profiling	2.017 ms [1.968 ms, 2.066 ms]	544.584 µs (37.0%)
tracing	2.01 ms [1.962 ms, 2.058 ms]	537.385 µs (36.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.46 ms, 1.483 ms]	-
appsec	2.393 ms [2.344 ms, 2.441 ms]	920.652 µs (62.5%)
iast	2.177 ms [2.115 ms, 2.239 ms]	705.236 µs (47.9%)
iast_GLOBAL	2.232 ms [2.169 ms, 2.294 ms]	759.802 µs (51.6%)
profiling	2.016 ms [1.968 ms, 2.065 ms]	544.598 µs (37.0%)
tracing	2.015 ms [1.966 ms, 2.063 ms]	542.907 µs (36.9%)

sarahchen6 · 2025-05-22T13:39:09Z

All gitlab tests have passed with the new build, so will merge this and close.

sarahchen6 added type: enhancement Enhancements and improvements tag: do not merge Do not merge changes comp: tooling Build & Tooling labels May 16, 2025

sarahchen6 force-pushed the sarahchen6/test-new-docker-images branch from 6572604 to 526b92a Compare May 16, 2025 15:31

sarahchen6 force-pushed the sarahchen6/test-new-docker-images branch from 1d8cd2c to 243045b Compare May 19, 2025 13:15

sarahchen6 mentioned this pull request May 19, 2025

Replace cimg base image with ubuntu:latest DataDog/dd-trace-java-docker-build#95

Merged

sarahchen6 force-pushed the sarahchen6/test-new-docker-images branch from 243045b to d713023 Compare May 19, 2025 15:58

sarahchen6 added 5 commits May 20, 2025 16:52

Test new docker base image

5c9c7c5

Remove edits

6cf5b3f

Try changing DOCKER_IMAGE_VERSION

f609f4c

Empty commit

ab886dd

Empty commit 1

4d37f6a

sarahchen6 force-pushed the sarahchen6/test-new-docker-images branch from d713023 to 4d37f6a Compare May 20, 2025 15:02

sarahchen6 added 2 commits May 21, 2025 11:53

Empty commit 2

6572cf3

Try different paths

7aba671

sarahchen6 closed this May 22, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Test new docker base image #8841

Test new docker base image #8841

Uh oh!

sarahchen6 commented May 16, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented May 16, 2025 •

edited

Loading

Uh oh!

sarahchen6 commented May 22, 2025

Uh oh!

Uh oh!

Test new docker base image #8841

Test new docker base image #8841

Uh oh!

Conversation

sarahchen6 commented May 16, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented May 16, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

sarahchen6 commented May 22, 2025

Uh oh!

Uh oh!

sarahchen6 commented May 16, 2025 •

edited

Loading

pr-commenter bot commented May 16, 2025 •

edited

Loading