testing how tests behave in the CI #9503

vandonr · 2025-09-10T09:23:50Z

What Does This Do

maybe testcontainers/testcontainers-java#6938

test fails with

ContainerLaunchException: Container startup failed for image registry.ddbuild.io/images/mirror/couchbase/server:7.1.0
...
at CouchbaseClient31Test.setupSpec(CouchbaseClient31Test.groovy:47)

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

datadog-datadog-prod-us1 · 2025-09-10T09:42:56Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 60.12% (-0.01%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: d58f083 | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-09-10T09:53:55Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	vandonr/fix2
git_commit_date	1757594538	1757596037
git_commit_sha	`2349c6e`	`d58f083`
release_version	1.54.0-SNAPSHOT~2349c6ec12	1.54.0-SNAPSHOT~d58f083a29

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1757597857	1757597857
ci_job_id	1124498951	1124498951
ci_pipeline_id	76188153	76188153
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-2fel4lp2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-2fel4lp2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1046411
Total [baseline] (8.625 s) : 0, 8624722
Agent [candidate] (1.054 s) : 0, 1054367
Total [candidate] (8.618 s) : 0, 8618420
section iast
Agent [baseline] (1.19 s) : 0, 1189988
Total [baseline] (9.328 s) : 0, 9327901
Agent [candidate] (1.183 s) : 0, 1183326
Total [candidate] (9.369 s) : 0, 9368869

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.046 s	-
Agent	iast	1.19 s	143.577 ms (13.7%)
Total	tracing	8.625 s	-
Total	iast	9.328 s	703.179 ms (8.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.054 s	-
Agent	iast	1.183 s	128.959 ms (12.2%)
Total	tracing	8.618 s	-
Total	iast	9.369 s	750.449 ms (8.7%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (732.258 ms) : 0, 732258
BytebuddyAgent [candidate] (738.587 ms) : 0, 738587
GlobalTracer [baseline] (242.31 ms) : 0, 242310
GlobalTracer [candidate] (243.801 ms) : 0, 243801
AppSec [baseline] (30.526 ms) : 0, 30526
AppSec [candidate] (30.547 ms) : 0, 30547
Debugger [baseline] (6.512 ms) : 0, 6512
Debugger [candidate] (6.473 ms) : 0, 6473
Remote Config [baseline] (678.345 µs) : 0, 678
Remote Config [candidate] (674.351 µs) : 0, 674
Telemetry [baseline] (11.666 ms) : 0, 11666
Telemetry [candidate] (11.707 ms) : 0, 11707
section iast
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (859.556 ms) : 0, 859556
BytebuddyAgent [candidate] (853.923 ms) : 0, 853923
GlobalTracer [baseline] (234.297 ms) : 0, 234297
GlobalTracer [candidate] (233.781 ms) : 0, 233781
AppSec [baseline] (28.82 ms) : 0, 28820
AppSec [candidate] (26.816 ms) : 0, 26816
Debugger [baseline] (6.149 ms) : 0, 6149
Debugger [candidate] (6.155 ms) : 0, 6155
Remote Config [baseline] (604.465 µs) : 0, 604
Remote Config [candidate] (594.507 µs) : 0, 595
Telemetry [baseline] (8.365 ms) : 0, 8365
Telemetry [candidate] (8.341 ms) : 0, 8341
IAST [baseline] (29.622 ms) : 0, 29622
IAST [candidate] (31.206 ms) : 0, 31206

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1048403
Total [baseline] (10.724 s) : 0, 10723774
Agent [candidate] (1.048 s) : 0, 1048442
Total [candidate] (10.609 s) : 0, 10609031
section appsec
Agent [baseline] (1.226 s) : 0, 1225541
Total [baseline] (10.797 s) : 0, 10796890
Agent [candidate] (1.221 s) : 0, 1220880
Total [candidate] (10.771 s) : 0, 10771381
section iast
Agent [baseline] (1.181 s) : 0, 1181230
Total [baseline] (10.947 s) : 0, 10947174
Agent [candidate] (1.179 s) : 0, 1179087
Total [candidate] (10.919 s) : 0, 10919308
section profiling
Agent [baseline] (1.209 s) : 0, 1209306
Total [baseline] (11.005 s) : 0, 11005482
Agent [candidate] (1.207 s) : 0, 1207326
Total [candidate] (10.971 s) : 0, 10971087

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.048 s	-
Agent	appsec	1.226 s	177.138 ms (16.9%)
Agent	iast	1.181 s	132.827 ms (12.7%)
Agent	profiling	1.209 s	160.903 ms (15.3%)
Total	tracing	10.724 s	-
Total	appsec	10.797 s	73.116 ms (0.7%)
Total	iast	10.947 s	223.4 ms (2.1%)
Total	profiling	11.005 s	281.708 ms (2.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.048 s	-
Agent	appsec	1.221 s	172.438 ms (16.4%)
Agent	iast	1.179 s	130.645 ms (12.5%)
Agent	profiling	1.207 s	158.883 ms (15.2%)
Total	tracing	10.609 s	-
Total	appsec	10.771 s	162.35 ms (1.5%)
Total	iast	10.919 s	310.277 ms (2.9%)
Total	profiling	10.971 s	362.056 ms (3.4%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (731.702 ms) : 0, 731702
BytebuddyAgent [candidate] (733.634 ms) : 0, 733634
GlobalTracer [baseline] (242.546 ms) : 0, 242546
GlobalTracer [candidate] (242.703 ms) : 0, 242703
AppSec [baseline] (30.571 ms) : 0, 30571
AppSec [candidate] (30.13 ms) : 0, 30130
Debugger [baseline] (6.509 ms) : 0, 6509
Debugger [candidate] (6.427 ms) : 0, 6427
Remote Config [baseline] (682.837 µs) : 0, 683
Remote Config [candidate] (672.875 µs) : 0, 673
Telemetry [baseline] (13.823 ms) : 0, 13823
Telemetry [candidate] (12.247 ms) : 0, 12247
section appsec
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (756.466 ms) : 0, 756466
BytebuddyAgent [candidate] (753.642 ms) : 0, 753642
GlobalTracer [baseline] (235.779 ms) : 0, 235779
GlobalTracer [candidate] (235.13 ms) : 0, 235130
IAST [baseline] (23.576 ms) : 0, 23576
IAST [candidate] (23.345 ms) : 0, 23345
AppSec [baseline] (171.106 ms) : 0, 171106
AppSec [candidate] (167.896 ms) : 0, 167896
Debugger [baseline] (6.896 ms) : 0, 6896
Debugger [candidate] (9.3 ms) : 0, 9300
Remote Config [baseline] (645.758 µs) : 0, 646
Remote Config [candidate] (622.977 µs) : 0, 623
Telemetry [baseline] (8.495 ms) : 0, 8495
Telemetry [candidate] (8.454 ms) : 0, 8454
section iast
crashtracking [baseline] (1.446 ms) : 0, 1446
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (851.886 ms) : 0, 851886
BytebuddyAgent [candidate] (850.29 ms) : 0, 850290
GlobalTracer [baseline] (232.925 ms) : 0, 232925
GlobalTracer [candidate] (233.181 ms) : 0, 233181
IAST [baseline] (30.22 ms) : 0, 30220
IAST [candidate] (31.929 ms) : 0, 31929
AppSec [baseline] (26.573 ms) : 0, 26573
AppSec [candidate] (25.112 ms) : 0, 25112
Debugger [baseline] (7.954 ms) : 0, 7954
Debugger [candidate] (7.087 ms) : 0, 7087
Remote Config [baseline] (615.783 µs) : 0, 616
Remote Config [candidate] (615.937 µs) : 0, 616
Telemetry [baseline] (8.472 ms) : 0, 8472
Telemetry [candidate] (8.418 ms) : 0, 8418
section profiling
crashtracking [baseline] (1.439 ms) : 0, 1439
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (768.372 ms) : 0, 768372
BytebuddyAgent [candidate] (766.782 ms) : 0, 766782
GlobalTracer [baseline] (224.33 ms) : 0, 224330
GlobalTracer [candidate] (224.612 ms) : 0, 224612
AppSec [baseline] (31.038 ms) : 0, 31038
AppSec [candidate] (30.949 ms) : 0, 30949
Debugger [baseline] (6.714 ms) : 0, 6714
Debugger [candidate] (7.516 ms) : 0, 7516
Remote Config [baseline] (761.829 µs) : 0, 762
Remote Config [candidate] (693.636 µs) : 0, 694
Telemetry [baseline] (16.648 ms) : 0, 16648
Telemetry [candidate] (15.817 ms) : 0, 15817
ProfilingAgent [baseline] (109.012 ms) : 0, 109012
ProfilingAgent [candidate] (108.681 ms) : 0, 108681
Profiling [baseline] (109.73 ms) : 0, 109730
Profiling [candidate] (109.415 ms) : 0, 109415

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	vandonr/fix2
git_commit_date	1757594538	1757596037
git_commit_sha	`2349c6e`	`d58f083`
release_version	1.54.0-SNAPSHOT~2349c6ec12	1.54.0-SNAPSHOT~d58f083a29

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1757597618	1757597618
ci_job_id	1124498952	1124498952
ci_pipeline_id	76188153	76188153
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-qf5hwb1h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-qf5hwb1h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+208.405µs; +455.737µs] or [+2.717%; +5.942%]	unstable [-100.790op/s; +51.290op/s] or [-16.694%; +8.495%]	8.002ms	579.000op/s	7.670ms	603.750op/s
scenario:load:insecure-bank:profiling:high_load	worse [+231.441µs; +528.907µs] or [+2.724%; +6.225%]	unstable [-93.972op/s; +47.847op/s] or [-17.220%; +8.768%]	8.876ms	522.656op/s	8.496ms	545.719op/s
scenario:load:petclinic:profiling:high_load	worse [+2.806ms; +3.787ms] or [+6.215%; +8.388%]	unstable [-14.498op/s; +0.448op/s] or [-13.993%; +0.432%]	48.450ms	96.588op/s	45.153ms	103.612op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.452 ms) : 4400, 4504
.   : milestone, 4452,
iast (9.59 ms) : 9423, 9757
.   : milestone, 9590,
iast_FULL (14.242 ms) : 13956, 14527
.   : milestone, 14242,
iast_GLOBAL (10.43 ms) : 10247, 10613
.   : milestone, 10430,
profiling (8.496 ms) : 8357, 8636
.   : milestone, 8496,
tracing (7.67 ms) : 7554, 7785
.   : milestone, 7670,
section candidate
no_agent (4.388 ms) : 4333, 4443
.   : milestone, 4388,
iast (9.477 ms) : 9317, 9636
.   : milestone, 9477,
iast_FULL (13.856 ms) : 13580, 14132
.   : milestone, 13856,
iast_GLOBAL (10.265 ms) : 10085, 10445
.   : milestone, 10265,
profiling (8.876 ms) : 8740, 9013
.   : milestone, 8876,
tracing (8.002 ms) : 7887, 8116
.   : milestone, 8002,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.452 ms [4.4 ms, 4.504 ms]	-
iast	9.59 ms [9.423 ms, 9.757 ms]	5.138 ms (115.4%)
iast_FULL	14.242 ms [13.956 ms, 14.527 ms]	9.79 ms (219.9%)
iast_GLOBAL	10.43 ms [10.247 ms, 10.613 ms]	5.978 ms (134.3%)
profiling	8.496 ms [8.357 ms, 8.636 ms]	4.044 ms (90.8%)
tracing	7.67 ms [7.554 ms, 7.785 ms]	3.218 ms (72.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.388 ms [4.333 ms, 4.443 ms]	-
iast	9.477 ms [9.317 ms, 9.636 ms]	5.089 ms (116.0%)
iast_FULL	13.856 ms [13.58 ms, 14.132 ms]	9.468 ms (215.8%)
iast_GLOBAL	10.265 ms [10.085 ms, 10.445 ms]	5.877 ms (133.9%)
profiling	8.876 ms [8.74 ms, 9.013 ms]	4.488 ms (102.3%)
tracing	8.002 ms [7.887 ms, 8.116 ms]	3.613 ms (82.3%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12
    dateFormat X
    axisFormat %s
section baseline
no_agent (35.971 ms) : 35683, 36260
.   : milestone, 35971,
appsec (48.93 ms) : 48501, 49360
.   : milestone, 48930,
code_origins (46.01 ms) : 45621, 46399
.   : milestone, 46010,
iast (45.125 ms) : 44740, 45510
.   : milestone, 45125,
profiling (45.153 ms) : 44750, 45557
.   : milestone, 45153,
tracing (44.005 ms) : 43654, 44357
.   : milestone, 44005,
section candidate
no_agent (36.543 ms) : 36250, 36837
.   : milestone, 36543,
appsec (49.554 ms) : 49108, 49999
.   : milestone, 49554,
code_origins (46.528 ms) : 46135, 46922
.   : milestone, 46528,
iast (45.18 ms) : 44773, 45587
.   : milestone, 45180,
profiling (48.45 ms) : 47947, 48953
.   : milestone, 48450,
tracing (44.032 ms) : 43666, 44398
.   : milestone, 44032,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	35.971 ms [35.683 ms, 36.26 ms]	-
appsec	48.93 ms [48.501 ms, 49.36 ms]	12.959 ms (36.0%)
code_origins	46.01 ms [45.621 ms, 46.399 ms]	10.039 ms (27.9%)
iast	45.125 ms [44.74 ms, 45.51 ms]	9.154 ms (25.4%)
profiling	45.153 ms [44.75 ms, 45.557 ms]	9.182 ms (25.5%)
tracing	44.005 ms [43.654 ms, 44.357 ms]	8.034 ms (22.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.543 ms [36.25 ms, 36.837 ms]	-
appsec	49.554 ms [49.108 ms, 49.999 ms]	13.01 ms (35.6%)
code_origins	46.528 ms [46.135 ms, 46.922 ms]	9.985 ms (27.3%)
iast	45.18 ms [44.773 ms, 45.587 ms]	8.637 ms (23.6%)
profiling	48.45 ms [47.947 ms, 48.953 ms]	11.907 ms (32.6%)
tracing	44.032 ms [43.666 ms, 44.398 ms]	7.489 ms (20.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	vandonr/fix2
git_commit_date	1757594538	1757596037
git_commit_sha	`2349c6e`	`d58f083`
release_version	1.54.0-SNAPSHOT~2349c6ec12	1.54.0-SNAPSHOT~d58f083a29

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1757598144	1757598144
ci_job_id	1124498954	1124498954
ci_pipeline_id	76188153	76188153
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-xfxdxb2x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-xfxdxb2x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.719 ms) : 3503, 3936
.   : milestone, 3719,
iast (2.209 ms) : 2147, 2271
.   : milestone, 2209,
iast_GLOBAL (2.24 ms) : 2177, 2303
.   : milestone, 2240,
profiling (2.072 ms) : 2020, 2124
.   : milestone, 2072,
tracing (2.025 ms) : 1977, 2073
.   : milestone, 2025,
section candidate
no_agent (1.477 ms) : 1465, 1489
.   : milestone, 1477,
appsec (3.59 ms) : 3379, 3802
.   : milestone, 3590,
iast (2.186 ms) : 2123, 2248
.   : milestone, 2186,
iast_GLOBAL (2.262 ms) : 2198, 2325
.   : milestone, 2262,
profiling (2.052 ms) : 2001, 2102
.   : milestone, 2052,
tracing (2.014 ms) : 1966, 2062
.   : milestone, 2014,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.465 ms, 1.488 ms]	-
appsec	3.719 ms [3.503 ms, 3.936 ms]	2.243 ms (151.9%)
iast	2.209 ms [2.147 ms, 2.271 ms]	732.932 µs (49.6%)
iast_GLOBAL	2.24 ms [2.177 ms, 2.303 ms]	763.778 µs (51.7%)
profiling	2.072 ms [2.02 ms, 2.124 ms]	595.779 µs (40.4%)
tracing	2.025 ms [1.977 ms, 2.073 ms]	548.834 µs (37.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.465 ms, 1.489 ms]	-
appsec	3.59 ms [3.379 ms, 3.802 ms]	2.113 ms (143.1%)
iast	2.186 ms [2.123 ms, 2.248 ms]	708.646 µs (48.0%)
iast_GLOBAL	2.262 ms [2.198 ms, 2.325 ms]	784.717 µs (53.1%)
profiling	2.052 ms [2.001 ms, 2.102 ms]	574.63 µs (38.9%)
tracing	2.014 ms [1.966 ms, 2.062 ms]	536.665 µs (36.3%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~d58f083a29, baseline=1.54.0-SNAPSHOT~2349c6ec12
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.326 s) : 15326000, 15326000
.   : milestone, 15326000,
appsec (15.02 s) : 15020000, 15020000
.   : milestone, 15020000,
iast (19.073 s) : 19073000, 19073000
.   : milestone, 19073000,
iast_GLOBAL (18.114 s) : 18114000, 18114000
.   : milestone, 18114000,
profiling (15.388 s) : 15388000, 15388000
.   : milestone, 15388000,
tracing (15.059 s) : 15059000, 15059000
.   : milestone, 15059000,
section candidate
no_agent (15.326 s) : 15326000, 15326000
.   : milestone, 15326000,
appsec (15.002 s) : 15002000, 15002000
.   : milestone, 15002000,
iast (18.895 s) : 18895000, 18895000
.   : milestone, 18895000,
iast_GLOBAL (18.304 s) : 18304000, 18304000
.   : milestone, 18304000,
profiling (15.569 s) : 15569000, 15569000
.   : milestone, 15569000,
tracing (15.103 s) : 15103000, 15103000
.   : milestone, 15103000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.326 s [15.326 s, 15.326 s]	-
appsec	15.02 s [15.02 s, 15.02 s]	-306.0 ms (-2.0%)
iast	19.073 s [19.073 s, 19.073 s]	3.747 s (24.4%)
iast_GLOBAL	18.114 s [18.114 s, 18.114 s]	2.788 s (18.2%)
profiling	15.388 s [15.388 s, 15.388 s]	62.0 ms (0.4%)
tracing	15.059 s [15.059 s, 15.059 s]	-267.0 ms (-1.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.326 s [15.326 s, 15.326 s]	-
appsec	15.002 s [15.002 s, 15.002 s]	-324.0 ms (-2.1%)
iast	18.895 s [18.895 s, 18.895 s]	3.569 s (23.3%)
iast_GLOBAL	18.304 s [18.304 s, 18.304 s]	2.978 s (19.4%)
profiling	15.569 s [15.569 s, 15.569 s]	243.0 ms (1.6%)
tracing	15.103 s [15.103 s, 15.103 s]	-223.0 ms (-1.5%)

vandonr changed the title ~~Allow more time for Couchebase init in tests~~ testing how tests behave in the CI Sep 10, 2025

more logging

d58f083

vandonr force-pushed the vandonr/fix2 branch from 6ab19f9 to d58f083 Compare September 11, 2025 13:08

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

testing how tests behave in the CI #9503

testing how tests behave in the CI #9503

Uh oh!

vandonr commented Sep 10, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Sep 10, 2025 •

edited by datadog-official bot

Loading

Uh oh!

pr-commenter bot commented Sep 10, 2025 •

edited

Loading

Uh oh!

Uh oh!

testing how tests behave in the CI #9503

Are you sure you want to change the base?

testing how tests behave in the CI #9503

Uh oh!

Conversation

vandonr commented Sep 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-datadog-prod-us1 bot commented Sep 10, 2025 • edited by datadog-official bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Sep 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

vandonr commented Sep 10, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Sep 10, 2025 •

edited by datadog-official bot

Loading

pr-commenter bot commented Sep 10, 2025 •

edited

Loading