Skip to content

Test new docker base image #8841

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 6 commits into
base: master
Choose a base branch
from

Conversation

sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented May 16, 2025

What Does This Do

Test new docker base image from DataDog/dd-trace-java-docker-build#95

Motivation

Additional Notes

Contributor Checklist

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-493

@sarahchen6 sarahchen6 added type: enhancement tag: do not merge Do not merge changes comp: tooling Build & Tooling labels May 16, 2025
@sarahchen6 sarahchen6 force-pushed the sarahchen6/test-new-docker-images branch from 6572604 to 526b92a Compare May 16, 2025 15:31
@pr-commenter
Copy link

pr-commenter bot commented May 16, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-new-docker-images
git_commit_date 1747407449 1747409218
git_commit_sha 2dab68d 6572604
release_version 1.50.0-SNAPSHOT~2dab68de32 1.50.0-SNAPSHOT~65726049ad
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747411592 1747411592
ci_job_id 941999092 941999092
ci_pipeline_id 65341766 65341766
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-k6odmlti-project-304-concurrent-0-jxg9n24d 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-k6odmlti-project-304-concurrent-0-jxg9n24d 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 14 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~65726049ad, baseline=1.50.0-SNAPSHOT~2dab68de32

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.018 s) : 0, 1018251
Total [baseline] (8.674 s) : 0, 8673741
Agent [candidate] (1.021 s) : 0, 1020514
Total [candidate] (8.641 s) : 0, 8640955
section iast
Agent [baseline] (1.154 s) : 0, 1153754
Total [baseline] (9.209 s) : 0, 9209282
Agent [candidate] (1.149 s) : 0, 1148964
Total [candidate] (9.224 s) : 0, 9224127
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.148 s) : 0, 1148355
Total [baseline] (9.175 s) : 0, 9175349
Agent [candidate] (1.148 s) : 0, 1148425
Total [candidate] (9.258 s) : 0, 9258264
section iast_TELEMETRY_OFF
Agent [baseline] (1.144 s) : 0, 1143892
Total [baseline] (9.236 s) : 0, 9236127
Agent [candidate] (1.144 s) : 0, 1144169
Total [candidate] (9.201 s) : 0, 9201305
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent iast 1.154 s 135.503 ms (13.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.148 s 130.105 ms (12.8%)
Agent iast_TELEMETRY_OFF 1.144 s 125.641 ms (12.3%)
Total tracing 8.674 s -
Total iast 9.209 s 535.542 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.175 s 501.608 ms (5.8%)
Total iast_TELEMETRY_OFF 9.236 s 562.386 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent iast 1.149 s 128.45 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.148 s 127.911 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.144 s 123.655 ms (12.1%)
Total tracing 8.641 s -
Total iast 9.224 s 583.172 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.258 s 617.31 ms (7.1%)
Total iast_TELEMETRY_OFF 9.201 s 560.351 ms (6.5%)
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~65726049ad, baseline=1.50.0-SNAPSHOT~2dab68de32

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (680.355 ms) : 0, 680355
BytebuddyAgent [candidate] (683.003 ms) : 0, 683003
GlobalTracer [baseline] (239.073 ms) : 0, 239073
GlobalTracer [candidate] (240.52 ms) : 0, 240520
AppSec [baseline] (55.667 ms) : 0, 55667
AppSec [candidate] (55.116 ms) : 0, 55116
Debugger [baseline] (7.527 ms) : 0, 7527
Debugger [candidate] (6.834 ms) : 0, 6834
Remote Config [baseline] (693.382 µs) : 0, 693
Remote Config [candidate] (700.098 µs) : 0, 700
Telemetry [baseline] (11.42 ms) : 0, 11420
Telemetry [candidate] (10.662 ms) : 0, 10662
section iast
BytebuddyAgent [baseline] (805.703 ms) : 0, 805703
BytebuddyAgent [candidate] (801.775 ms) : 0, 801775
GlobalTracer [baseline] (231.06 ms) : 0, 231060
GlobalTracer [candidate] (230.56 ms) : 0, 230560
IAST [baseline] (29.347 ms) : 0, 29347
IAST [candidate] (28.341 ms) : 0, 28341
AppSec [baseline] (48.695 ms) : 0, 48695
AppSec [candidate] (49.539 ms) : 0, 49539
Debugger [baseline] (5.952 ms) : 0, 5952
Debugger [candidate] (5.912 ms) : 0, 5912
Remote Config [baseline] (608.651 µs) : 0, 609
Remote Config [candidate] (590.246 µs) : 0, 590
Telemetry [baseline] (8.007 ms) : 0, 8007
Telemetry [candidate] (7.956 ms) : 0, 7956
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (801.171 ms) : 0, 801171
BytebuddyAgent [candidate] (800.81 ms) : 0, 800810
GlobalTracer [baseline] (230.58 ms) : 0, 230580
GlobalTracer [candidate] (230.573 ms) : 0, 230573
IAST [baseline] (29.183 ms) : 0, 29183
IAST [candidate] (29.503 ms) : 0, 29503
AppSec [baseline] (49.515 ms) : 0, 49515
AppSec [candidate] (49.646 ms) : 0, 49646
Debugger [baseline] (5.916 ms) : 0, 5916
Debugger [candidate] (5.895 ms) : 0, 5895
Remote Config [baseline] (595.494 µs) : 0, 595
Remote Config [candidate] (603.052 µs) : 0, 603
Telemetry [baseline] (7.908 ms) : 0, 7908
Telemetry [candidate] (7.95 ms) : 0, 7950
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.231 ms) : 0, 798231
BytebuddyAgent [candidate] (798.127 ms) : 0, 798127
GlobalTracer [baseline] (230.209 ms) : 0, 230209
GlobalTracer [candidate] (230.212 ms) : 0, 230212
IAST [baseline] (23.726 ms) : 0, 23726
IAST [candidate] (22.257 ms) : 0, 22257
AppSec [baseline] (54.038 ms) : 0, 54038
AppSec [candidate] (55.781 ms) : 0, 55781
Debugger [baseline] (5.907 ms) : 0, 5907
Debugger [candidate] (5.943 ms) : 0, 5943
Remote Config [baseline] (597.75 µs) : 0, 598
Remote Config [candidate] (593.792 µs) : 0, 594
Telemetry [baseline] (7.715 ms) : 0, 7715
Telemetry [candidate] (7.762 ms) : 0, 7762
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~65726049ad, baseline=1.50.0-SNAPSHOT~2dab68de32

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1020150
Total [baseline] (10.463 s) : 0, 10463348
Agent [candidate] (1.019 s) : 0, 1019215
Total [candidate] (10.487 s) : 0, 10486559
section appsec
Agent [baseline] (1.16 s) : 0, 1160359
Total [baseline] (10.678 s) : 0, 10677598
Agent [candidate] (1.16 s) : 0, 1160113
Total [candidate] (10.714 s) : 0, 10713525
section iast
Agent [baseline] (1.148 s) : 0, 1147621
Total [baseline] (10.933 s) : 0, 10933029
Agent [candidate] (1.148 s) : 0, 1148241
Total [candidate] (10.911 s) : 0, 10911459
section profiling
Agent [baseline] (1.273 s) : 0, 1273255
Total [baseline] (10.79 s) : 0, 10790387
Agent [candidate] (1.28 s) : 0, 1279989
Total [candidate] (10.815 s) : 0, 10815334
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent appsec 1.16 s 140.209 ms (13.7%)
Agent iast 1.148 s 127.471 ms (12.5%)
Agent profiling 1.273 s 253.105 ms (24.8%)
Total tracing 10.463 s -
Total appsec 10.678 s 214.25 ms (2.0%)
Total iast 10.933 s 469.681 ms (4.5%)
Total profiling 10.79 s 327.039 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent appsec 1.16 s 140.897 ms (13.8%)
Agent iast 1.148 s 129.026 ms (12.7%)
Agent profiling 1.28 s 260.774 ms (25.6%)
Total tracing 10.487 s -
Total appsec 10.714 s 226.966 ms (2.2%)
Total iast 10.911 s 424.9 ms (4.1%)
Total profiling 10.815 s 328.776 ms (3.1%)
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~65726049ad, baseline=1.50.0-SNAPSHOT~2dab68de32

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.632 ms) : 0, 682632
BytebuddyAgent [candidate] (681.463 ms) : 0, 681463
GlobalTracer [baseline] (240.09 ms) : 0, 240090
GlobalTracer [candidate] (240.171 ms) : 0, 240171
AppSec [baseline] (54.144 ms) : 0, 54144
AppSec [candidate] (54.375 ms) : 0, 54375
Debugger [baseline] (9.123 ms) : 0, 9123
Debugger [candidate] (9.786 ms) : 0, 9786
Remote Config [baseline] (694.189 µs) : 0, 694
Remote Config [candidate] (701.949 µs) : 0, 702
Telemetry [baseline] (9.831 ms) : 0, 9831
Telemetry [candidate] (9.031 ms) : 0, 9031
section appsec
BytebuddyAgent [baseline] (699.68 ms) : 0, 699680
BytebuddyAgent [candidate] (699.643 ms) : 0, 699643
GlobalTracer [baseline] (236.266 ms) : 0, 236266
GlobalTracer [candidate] (236.452 ms) : 0, 236452
IAST [baseline] (21.589 ms) : 0, 21589
IAST [candidate] (21.763 ms) : 0, 21763
AppSec [baseline] (175.45 ms) : 0, 175450
AppSec [candidate] (174.455 ms) : 0, 174455
Debugger [baseline] (6.279 ms) : 0, 6279
Debugger [candidate] (6.381 ms) : 0, 6381
Remote Config [baseline] (619.383 µs) : 0, 619
Remote Config [candidate] (639.996 µs) : 0, 640
Telemetry [baseline] (7.738 ms) : 0, 7738
Telemetry [candidate] (8.12 ms) : 0, 8120
section iast
BytebuddyAgent [baseline] (800.737 ms) : 0, 800737
BytebuddyAgent [candidate] (801.999 ms) : 0, 801999
GlobalTracer [baseline] (230.177 ms) : 0, 230177
GlobalTracer [candidate] (230.338 ms) : 0, 230338
IAST [baseline] (28.305 ms) : 0, 28305
IAST [candidate] (29.723 ms) : 0, 29723
AppSec [baseline] (50.492 ms) : 0, 50492
AppSec [candidate] (48.39 ms) : 0, 48390
Debugger [baseline] (5.953 ms) : 0, 5953
Debugger [candidate] (5.843 ms) : 0, 5843
Remote Config [baseline] (585.66 µs) : 0, 586
Remote Config [candidate] (581.948 µs) : 0, 582
Telemetry [baseline] (7.881 ms) : 0, 7881
Telemetry [candidate] (7.889 ms) : 0, 7889
section profiling
BytebuddyAgent [baseline] (670.984 ms) : 0, 670984
BytebuddyAgent [candidate] (674.341 ms) : 0, 674341
GlobalTracer [baseline] (372.786 ms) : 0, 372786
GlobalTracer [candidate] (374.666 ms) : 0, 374666
AppSec [baseline] (61.678 ms) : 0, 61678
AppSec [candidate] (61.652 ms) : 0, 61652
Debugger [baseline] (6.247 ms) : 0, 6247
Debugger [candidate] (6.225 ms) : 0, 6225
Remote Config [baseline] (654.402 µs) : 0, 654
Remote Config [candidate] (655.344 µs) : 0, 655
Telemetry [baseline] (8.137 ms) : 0, 8137
Telemetry [candidate] (8.261 ms) : 0, 8261
ProfilingAgent [baseline] (102.062 ms) : 0, 102062
ProfilingAgent [candidate] (103.35 ms) : 0, 103350
Profiling [baseline] (102.087 ms) : 0, 102087
Profiling [candidate] (103.377 ms) : 0, 103377
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-16T15:36:54 2025-05-16T15:44:40
git_branch master sarahchen6/test-new-docker-images
git_commit_date 1747407449 1747409218
git_commit_sha 2dab68d 6572604
release_version 1.50.0-SNAPSHOT~2dab68de32 1.50.0-SNAPSHOT~65726049ad
start_time 2025-05-16T15:36:40 2025-05-16T15:44:26
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747410679 1747410679
ci_job_id 941999093 941999093
ci_pipeline_id 65341766 65341766
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-px6-mzwm-project-304-concurrent-0-48ok3l5q 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-px6-mzwm-project-304-concurrent-0-48ok3l5q 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~65726049ad, baseline=1.50.0-SNAPSHOT~2dab68de32
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.377 ms) : 1357, 1397
.   : milestone, 1377,
appsec (1.734 ms) : 1710, 1757
.   : milestone, 1734,
appsec_no_iast (1.735 ms) : 1711, 1758
.   : milestone, 1735,
code_origins (1.675 ms) : 1648, 1702
.   : milestone, 1675,
iast (1.531 ms) : 1508, 1555
.   : milestone, 1531,
profiling (1.555 ms) : 1529, 1581
.   : milestone, 1555,
tracing (1.489 ms) : 1464, 1513
.   : milestone, 1489,
section candidate
no_agent (1.357 ms) : 1338, 1377
.   : milestone, 1357,
appsec (1.745 ms) : 1721, 1768
.   : milestone, 1745,
appsec_no_iast (1.744 ms) : 1721, 1766
.   : milestone, 1744,
code_origins (1.66 ms) : 1633, 1687
.   : milestone, 1660,
iast (1.533 ms) : 1509, 1557
.   : milestone, 1533,
profiling (1.551 ms) : 1525, 1576
.   : milestone, 1551,
tracing (1.506 ms) : 1481, 1530
.   : milestone, 1506,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.377 ms [1.357 ms, 1.397 ms] -
appsec 1.734 ms [1.71 ms, 1.757 ms] 356.893 µs (25.9%)
appsec_no_iast 1.735 ms [1.711 ms, 1.758 ms] 357.608 µs (26.0%)
code_origins 1.675 ms [1.648 ms, 1.702 ms] 298.368 µs (21.7%)
iast 1.531 ms [1.508 ms, 1.555 ms] 154.529 µs (11.2%)
profiling 1.555 ms [1.529 ms, 1.581 ms] 178.157 µs (12.9%)
tracing 1.489 ms [1.464 ms, 1.513 ms] 111.827 µs (8.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.357 ms [1.338 ms, 1.377 ms] -
appsec 1.745 ms [1.721 ms, 1.768 ms] 387.321 µs (28.5%)
appsec_no_iast 1.744 ms [1.721 ms, 1.766 ms] 386.358 µs (28.5%)
code_origins 1.66 ms [1.633 ms, 1.687 ms] 302.632 µs (22.3%)
iast 1.533 ms [1.509 ms, 1.557 ms] 175.344 µs (12.9%)
profiling 1.551 ms [1.525 ms, 1.576 ms] 193.239 µs (14.2%)
tracing 1.506 ms [1.481 ms, 1.53 ms] 148.319 µs (10.9%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~65726049ad, baseline=1.50.0-SNAPSHOT~2dab68de32
    dateFormat X
    axisFormat %s
section baseline
no_agent (376.475 µs) : 357, 396
.   : milestone, 376,
iast (517.28 µs) : 496, 539
.   : milestone, 517,
iast_FULL (738.215 µs) : 716, 760
.   : milestone, 738,
iast_GLOBAL (569.565 µs) : 547, 592
.   : milestone, 570,
iast_HARDCODED_SECRET_DISABLED (514.307 µs) : 492, 537
.   : milestone, 514,
iast_INACTIVE (469.914 µs) : 448, 492
.   : milestone, 470,
iast_TELEMETRY_OFF (508.992 µs) : 486, 532
.   : milestone, 509,
tracing (463.257 µs) : 441, 485
.   : milestone, 463,
section candidate
no_agent (393.816 µs) : 374, 414
.   : milestone, 394,
iast (526.996 µs) : 505, 549
.   : milestone, 527,
iast_FULL (736.045 µs) : 714, 758
.   : milestone, 736,
iast_GLOBAL (572.572 µs) : 550, 595
.   : milestone, 573,
iast_HARDCODED_SECRET_DISABLED (517.366 µs) : 495, 540
.   : milestone, 517,
iast_INACTIVE (469.608 µs) : 448, 491
.   : milestone, 470,
iast_TELEMETRY_OFF (511.152 µs) : 488, 535
.   : milestone, 511,
tracing (466.18 µs) : 444, 489
.   : milestone, 466,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.475 µs [356.688 µs, 396.262 µs] -
iast 517.28 µs [495.705 µs, 538.856 µs] 140.805 µs (37.4%)
iast_FULL 738.215 µs [716.253 µs, 760.177 µs] 361.74 µs (96.1%)
iast_GLOBAL 569.565 µs [547.445 µs, 591.684 µs] 193.089 µs (51.3%)
iast_HARDCODED_SECRET_DISABLED 514.307 µs [491.61 µs, 537.005 µs] 137.832 µs (36.6%)
iast_INACTIVE 469.914 µs [447.608 µs, 492.22 µs] 93.439 µs (24.8%)
iast_TELEMETRY_OFF 508.992 µs [485.873 µs, 532.11 µs] 132.516 µs (35.2%)
tracing 463.257 µs [441.019 µs, 485.496 µs] 86.782 µs (23.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 393.816 µs [373.777 µs, 413.856 µs] -
iast 526.996 µs [504.844 µs, 549.149 µs] 133.18 µs (33.8%)
iast_FULL 736.045 µs [714.091 µs, 757.998 µs] 342.228 µs (86.9%)
iast_GLOBAL 572.572 µs [550.199 µs, 594.946 µs] 178.756 µs (45.4%)
iast_HARDCODED_SECRET_DISABLED 517.366 µs [494.565 µs, 540.167 µs] 123.549 µs (31.4%)
iast_INACTIVE 469.608 µs [448.183 µs, 491.033 µs] 75.792 µs (19.2%)
iast_TELEMETRY_OFF 511.152 µs [487.711 µs, 534.594 µs] 117.336 µs (29.8%)
tracing 466.18 µs [443.553 µs, 488.807 µs] 72.363 µs (18.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-new-docker-images
git_commit_date 1747407449 1747409218
git_commit_sha 2dab68d 6572604
release_version 1.50.0-SNAPSHOT~2dab68de32 1.50.0-SNAPSHOT~65726049ad
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1747411225 1747411225
ci_job_id 941999095 941999095
ci_pipeline_id 65341766 65341766
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-k6odmlti-project-304-concurrent-1-9ar2qz1k 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-k6odmlti-project-304-concurrent-1-9ar2qz1k 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~65726049ad, baseline=1.50.0-SNAPSHOT~2dab68de32
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.407 s) : 15407000, 15407000
.   : milestone, 15407000,
appsec (15.106 s) : 15106000, 15106000
.   : milestone, 15106000,
iast (18.579 s) : 18579000, 18579000
.   : milestone, 18579000,
iast_GLOBAL (18.267 s) : 18267000, 18267000
.   : milestone, 18267000,
profiling (14.805 s) : 14805000, 14805000
.   : milestone, 14805000,
tracing (14.897 s) : 14897000, 14897000
.   : milestone, 14897000,
section candidate
no_agent (15.522 s) : 15522000, 15522000
.   : milestone, 15522000,
appsec (14.818 s) : 14818000, 14818000
.   : milestone, 14818000,
iast (18.494 s) : 18494000, 18494000
.   : milestone, 18494000,
iast_GLOBAL (18.274 s) : 18274000, 18274000
.   : milestone, 18274000,
profiling (14.919 s) : 14919000, 14919000
.   : milestone, 14919000,
tracing (15.412 s) : 15412000, 15412000
.   : milestone, 15412000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.407 s [15.407 s, 15.407 s] -
appsec 15.106 s [15.106 s, 15.106 s] -301.0 ms (-2.0%)
iast 18.579 s [18.579 s, 18.579 s] 3.172 s (20.6%)
iast_GLOBAL 18.267 s [18.267 s, 18.267 s] 2.86 s (18.6%)
profiling 14.805 s [14.805 s, 14.805 s] -602.0 ms (-3.9%)
tracing 14.897 s [14.897 s, 14.897 s] -510.0 ms (-3.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.522 s [15.522 s, 15.522 s] -
appsec 14.818 s [14.818 s, 14.818 s] -704.0 ms (-4.5%)
iast 18.494 s [18.494 s, 18.494 s] 2.972 s (19.1%)
iast_GLOBAL 18.274 s [18.274 s, 18.274 s] 2.752 s (17.7%)
profiling 14.919 s [14.919 s, 14.919 s] -603.0 ms (-3.9%)
tracing 15.412 s [15.412 s, 15.412 s] -110.0 ms (-0.7%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~65726049ad, baseline=1.50.0-SNAPSHOT~2dab68de32
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (2.417 ms) : 2367, 2466
.   : milestone, 2417,
iast (2.193 ms) : 2131, 2255
.   : milestone, 2193,
iast_GLOBAL (2.238 ms) : 2176, 2301
.   : milestone, 2238,
profiling (2.056 ms) : 2006, 2106
.   : milestone, 2056,
tracing (2.029 ms) : 1981, 2078
.   : milestone, 2029,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.418 ms) : 2369, 2467
.   : milestone, 2418,
iast (2.192 ms) : 2130, 2254
.   : milestone, 2192,
iast_GLOBAL (2.232 ms) : 2170, 2295
.   : milestone, 2232,
profiling (2.051 ms) : 2001, 2101
.   : milestone, 2051,
tracing (2.018 ms) : 1970, 2067
.   : milestone, 2018,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.471 ms, 1.494 ms] -
appsec 2.417 ms [2.367 ms, 2.466 ms] 934.243 µs (63.0%)
iast 2.193 ms [2.131 ms, 2.255 ms] 711.071 µs (48.0%)
iast_GLOBAL 2.238 ms [2.176 ms, 2.301 ms] 756.06 µs (51.0%)
profiling 2.056 ms [2.006 ms, 2.106 ms] 573.499 µs (38.7%)
tracing 2.029 ms [1.981 ms, 2.078 ms] 546.856 µs (36.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.418 ms [2.369 ms, 2.467 ms] 941.526 µs (63.8%)
iast 2.192 ms [2.13 ms, 2.254 ms] 715.501 µs (48.5%)
iast_GLOBAL 2.232 ms [2.17 ms, 2.295 ms] 756.04 µs (51.2%)
profiling 2.051 ms [2.001 ms, 2.101 ms] 574.575 µs (38.9%)
tracing 2.018 ms [1.97 ms, 2.067 ms] 541.893 µs (36.7%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant