Add In-Product Enablement (#8461) #8501

nikita-tkachenko-datadog · 2025-03-04T12:27:46Z

Introduce the ability to start and stop Debugger features:

Dynamic Instrumentation
Exception Replay
Code Origin
Distributed Debugger dynamically based on RemoteConfig record: APM_TRACING DebuggerAgent is now run every time at startup to have the base of some feature ready and be able to start the minimum required foe each feature.
Ability to stop also the feature at any time to uninstall probes. Add smoke tests

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

Introduce the ability to start and stop Debugger features: - Dynamic Instrumentation - Exception Replay - Code Origin - Distributed Debugger dynamically based on RemoteConfig record: APM_TRACING DebuggerAgent is now run every time at startup to have the base of some feature ready and be able to start the minimum required foe each feature. Ability to stop also the feature at any time to uninstall probes. Add smoke tests

pr-commenter · 2025-03-04T13:07:17Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/test-env-dceca289e92135ea27f85bb6e066205b8ca16828
git_commit_date	1741082792	1740765357
git_commit_sha	`8f945b0`	`dceca28`
release_version	1.47.0-SNAPSHOT~8f945b02a7	1.47.0-SNAPSHOT~dceca289e9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1741093589	1741093589
ci_job_id	831558081	831558081
ci_pipeline_id	57629107	57629107
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zrt-bbxu-project-304-concurrent-1-b3j4pn7q 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zrt-bbxu-project-304-concurrent-1-b3j4pn7q 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~dceca289e9, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.135 s) : 0, 1135250
Total [baseline] (11.541 s) : 0, 11541085
Agent [candidate] (1.136 s) : 0, 1136067
Total [candidate] (11.476 s) : 0, 11475902
section appsec
Agent [baseline] (1.275 s) : 0, 1274937
Total [baseline] (11.64 s) : 0, 11639813
Agent [candidate] (1.27 s) : 0, 1270224
Total [candidate] (11.736 s) : 0, 11736380
section iast
Agent [baseline] (1.275 s) : 0, 1274551
Total [baseline] (11.986 s) : 0, 11986273
Agent [candidate] (1.26 s) : 0, 1260297
Total [candidate] (11.95 s) : 0, 11950149
section profiling
Agent [baseline] (1.388 s) : 0, 1387579
Total [baseline] (11.834 s) : 0, 11833937
Agent [candidate] (1.383 s) : 0, 1383061
Total [candidate] (11.839 s) : 0, 11839293

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.135 s	-
Agent	appsec	1.275 s	139.687 ms (12.3%)
Agent	iast	1.275 s	139.3 ms (12.3%)
Agent	profiling	1.388 s	252.329 ms (22.2%)
Total	tracing	11.541 s	-
Total	appsec	11.64 s	98.728 ms (0.9%)
Total	iast	11.986 s	445.188 ms (3.9%)
Total	profiling	11.834 s	292.851 ms (2.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.136 s	-
Agent	appsec	1.27 s	134.157 ms (11.8%)
Agent	iast	1.26 s	124.23 ms (10.9%)
Agent	profiling	1.383 s	246.994 ms (21.7%)
Total	tracing	11.476 s	-
Total	appsec	11.736 s	260.478 ms (2.3%)
Total	iast	11.95 s	474.247 ms (4.1%)
Total	profiling	11.839 s	363.391 ms (3.2%)

gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~dceca289e9, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.77 ms) : 0, 716770
BytebuddyAgent [candidate] (717.611 ms) : 0, 717611
GlobalTracer [baseline] (239.631 ms) : 0, 239631
GlobalTracer [candidate] (239.707 ms) : 0, 239707
AppSec [baseline] (55.923 ms) : 0, 55923
AppSec [candidate] (55.696 ms) : 0, 55696
Debugger [baseline] (94.985 ms) : 0, 94985
Debugger [candidate] (95.005 ms) : 0, 95005
Remote Config [baseline] (580.731 µs) : 0, 581
Remote Config [candidate] (583.303 µs) : 0, 583
Telemetry [baseline] (12.329 ms) : 0, 12329
Telemetry [candidate] (12.505 ms) : 0, 12505
section appsec
BytebuddyAgent [baseline] (736.289 ms) : 0, 736289
BytebuddyAgent [candidate] (733.362 ms) : 0, 733362
GlobalTracer [baseline] (237.358 ms) : 0, 237358
GlobalTracer [candidate] (235.933 ms) : 0, 235933
AppSec [baseline] (177.976 ms) : 0, 177976
AppSec [candidate] (177.362 ms) : 0, 177362
Debugger [baseline] (84.616 ms) : 0, 84616
Debugger [candidate] (84.611 ms) : 0, 84611
Remote Config [baseline] (635.379 µs) : 0, 635
Remote Config [candidate] (634.147 µs) : 0, 634
Telemetry [baseline] (12.434 ms) : 0, 12434
Telemetry [candidate] (12.405 ms) : 0, 12405
IAST [baseline] (21.273 ms) : 0, 21273
IAST [candidate] (21.797 ms) : 0, 21797
section iast
BytebuddyAgent [baseline] (846.937 ms) : 0, 846937
BytebuddyAgent [candidate] (837.789 ms) : 0, 837789
GlobalTracer [baseline] (231.698 ms) : 0, 231698
GlobalTracer [candidate] (230.275 ms) : 0, 230275
AppSec [baseline] (57.776 ms) : 0, 57776
AppSec [candidate] (57.389 ms) : 0, 57389
Debugger [baseline] (84.182 ms) : 0, 84182
Debugger [candidate] (84.317 ms) : 0, 84317
Remote Config [baseline] (532.083 µs) : 0, 532
Remote Config [candidate] (522.141 µs) : 0, 522
Telemetry [baseline] (15.317 ms) : 0, 15317
Telemetry [candidate] (12.194 ms) : 0, 12194
IAST [baseline] (23.016 ms) : 0, 23016
IAST [candidate] (22.798 ms) : 0, 22798
section profiling
BytebuddyAgent [baseline] (713.378 ms) : 0, 713378
BytebuddyAgent [candidate] (711.212 ms) : 0, 711212
GlobalTracer [baseline] (352.524 ms) : 0, 352524
GlobalTracer [candidate] (351.353 ms) : 0, 351353
AppSec [baseline] (55.855 ms) : 0, 55855
AppSec [candidate] (54.708 ms) : 0, 54708
Debugger [baseline] (88.569 ms) : 0, 88569
Debugger [candidate] (88.558 ms) : 0, 88558
Remote Config [baseline] (619.185 µs) : 0, 619
Remote Config [candidate] (617.626 µs) : 0, 618
Telemetry [baseline] (12.722 ms) : 0, 12722
Telemetry [candidate] (12.666 ms) : 0, 12666
ProfilingAgent [baseline] (123.323 ms) : 0, 123323
ProfilingAgent [candidate] (123.375 ms) : 0, 123375
Profiling [baseline] (123.345 ms) : 0, 123345
Profiling [candidate] (123.396 ms) : 0, 123396

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~dceca289e9, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.155 s) : 0, 1154834
Total [baseline] (9.322 s) : 0, 9322167
Agent [candidate] (1.144 s) : 0, 1143749
Total [candidate] (9.27 s) : 0, 9269585
section iast
Agent [baseline] (1.26 s) : 0, 1259504
Total [baseline] (9.874 s) : 0, 9873882
Agent [candidate] (1.26 s) : 0, 1259549
Total [candidate] (9.903 s) : 0, 9902884
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.258 s) : 0, 1258118
Total [baseline] (9.859 s) : 0, 9858991
Agent [candidate] (1.259 s) : 0, 1259190
Total [candidate] (9.856 s) : 0, 9855673
section iast_TELEMETRY_OFF
Agent [baseline] (1.262 s) : 0, 1261852
Total [baseline] (9.868 s) : 0, 9868384
Agent [candidate] (1.26 s) : 0, 1260444
Total [candidate] (9.957 s) : 0, 9956781

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.155 s	-
Agent	iast	1.26 s	104.671 ms (9.1%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.258 s	103.284 ms (8.9%)
Agent	iast_TELEMETRY_OFF	1.262 s	107.018 ms (9.3%)
Total	tracing	9.322 s	-
Total	iast	9.874 s	551.716 ms (5.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.859 s	536.824 ms (5.8%)
Total	iast_TELEMETRY_OFF	9.868 s	546.217 ms (5.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.144 s	-
Agent	iast	1.26 s	115.8 ms (10.1%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.259 s	115.441 ms (10.1%)
Agent	iast_TELEMETRY_OFF	1.26 s	116.695 ms (10.2%)
Total	tracing	9.27 s	-
Total	iast	9.903 s	633.299 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.856 s	586.088 ms (6.3%)
Total	iast_TELEMETRY_OFF	9.957 s	687.196 ms (7.4%)

gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~dceca289e9, baseline=1.47.0-SNAPSHOT~8f945b02a7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (729.424 ms) : 0, 729424
BytebuddyAgent [candidate] (722.978 ms) : 0, 722978
GlobalTracer [baseline] (244.053 ms) : 0, 244053
GlobalTracer [candidate] (240.768 ms) : 0, 240768
AppSec [baseline] (56.554 ms) : 0, 56554
AppSec [candidate] (55.75 ms) : 0, 55750
Debugger [baseline] (96.46 ms) : 0, 96460
Debugger [candidate] (96.191 ms) : 0, 96191
Remote Config [baseline] (590.846 µs) : 0, 591
Remote Config [candidate] (579.328 µs) : 0, 579
Telemetry [baseline] (12.634 ms) : 0, 12634
Telemetry [candidate] (12.434 ms) : 0, 12434
section iast
BytebuddyAgent [baseline] (835.311 ms) : 0, 835311
BytebuddyAgent [candidate] (837.31 ms) : 0, 837310
GlobalTracer [baseline] (230.452 ms) : 0, 230452
GlobalTracer [candidate] (230.523 ms) : 0, 230523
IAST [baseline] (22.848 ms) : 0, 22848
IAST [candidate] (22.722 ms) : 0, 22722
AppSec [baseline] (56.98 ms) : 0, 56980
AppSec [candidate] (57.301 ms) : 0, 57301
Debugger [baseline] (83.44 ms) : 0, 83440
Debugger [candidate] (83.924 ms) : 0, 83924
Remote Config [baseline] (515.733 µs) : 0, 516
Remote Config [candidate] (531.674 µs) : 0, 532
Telemetry [baseline] (14.968 ms) : 0, 14968
Telemetry [candidate] (12.165 ms) : 0, 12165
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (835.173 ms) : 0, 835173
BytebuddyAgent [candidate] (837.05 ms) : 0, 837050
GlobalTracer [baseline] (230.537 ms) : 0, 230537
GlobalTracer [candidate] (230.503 ms) : 0, 230503
IAST [baseline] (22.814 ms) : 0, 22814
IAST [candidate] (22.88 ms) : 0, 22880
AppSec [baseline] (57.167 ms) : 0, 57167
AppSec [candidate] (57.583 ms) : 0, 57583
Debugger [baseline] (83.458 ms) : 0, 83458
Debugger [candidate] (83.269 ms) : 0, 83269
Remote Config [baseline] (517.438 µs) : 0, 517
Remote Config [candidate] (519.364 µs) : 0, 519
Telemetry [baseline] (13.466 ms) : 0, 13466
Telemetry [candidate] (12.365 ms) : 0, 12365
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (839.337 ms) : 0, 839337
BytebuddyAgent [candidate] (838.75 ms) : 0, 838750
GlobalTracer [baseline] (231.323 ms) : 0, 231323
GlobalTracer [candidate] (230.465 ms) : 0, 230465
IAST [baseline] (23.328 ms) : 0, 23328
IAST [candidate] (23.923 ms) : 0, 23923
AppSec [baseline] (56.29 ms) : 0, 56290
AppSec [candidate] (55.71 ms) : 0, 55710
Debugger [baseline] (83.85 ms) : 0, 83850
Debugger [candidate] (83.757 ms) : 0, 83757
Remote Config [baseline] (528.108 µs) : 0, 528
Remote Config [candidate] (519.989 µs) : 0, 520
Telemetry [baseline] (12.127 ms) : 0, 12127
Telemetry [candidate] (12.211 ms) : 0, 12211

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-03-04T12:34:17	2025-03-04T12:42:13
git_branch	master	nikita-tkachenko/test-env-dceca289e92135ea27f85bb6e066205b8ca16828
git_commit_date	1741082792	1740765357
git_commit_sha	`8f945b0`	`dceca28`
release_version	1.47.0-SNAPSHOT~8f945b02a7	1.47.0-SNAPSHOT~dceca289e9
start_time	2025-03-04T12:34:03	2025-03-04T12:41:59

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1741092539	1741092539
ci_job_id	831558082	831558082
ci_pipeline_id	57629107	57629107
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-xk9phren-project-304-concurrent-4-qjajddkw 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-xk9phren-project-304-concurrent-4-qjajddkw 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~dceca289e9, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.358 ms) : 1338, 1377
.   : milestone, 1358,
appsec (1.723 ms) : 1698, 1747
.   : milestone, 1723,
appsec_no_iast (1.73 ms) : 1706, 1753
.   : milestone, 1730,
code_origins (1.686 ms) : 1654, 1719
.   : milestone, 1686,
iast (1.516 ms) : 1491, 1542
.   : milestone, 1516,
profiling (1.555 ms) : 1526, 1583
.   : milestone, 1555,
tracing (1.48 ms) : 1456, 1504
.   : milestone, 1480,
section candidate
no_agent (1.348 ms) : 1328, 1368
.   : milestone, 1348,
appsec (1.719 ms) : 1694, 1744
.   : milestone, 1719,
appsec_no_iast (1.724 ms) : 1701, 1747
.   : milestone, 1724,
code_origins (1.694 ms) : 1662, 1727
.   : milestone, 1694,
iast (1.516 ms) : 1492, 1541
.   : milestone, 1516,
profiling (1.499 ms) : 1475, 1523
.   : milestone, 1499,
tracing (1.476 ms) : 1452, 1501
.   : milestone, 1476,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.358 ms [1.338 ms, 1.377 ms]	-
appsec	1.723 ms [1.698 ms, 1.747 ms]	365.273 µs (26.9%)
appsec_no_iast	1.73 ms [1.706 ms, 1.753 ms]	372.368 µs (27.4%)
code_origins	1.686 ms [1.654 ms, 1.719 ms]	328.886 µs (24.2%)
iast	1.516 ms [1.491 ms, 1.542 ms]	158.905 µs (11.7%)
profiling	1.555 ms [1.526 ms, 1.583 ms]	197.094 µs (14.5%)
tracing	1.48 ms [1.456 ms, 1.504 ms]	122.431 µs (9.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.348 ms [1.328 ms, 1.368 ms]	-
appsec	1.719 ms [1.694 ms, 1.744 ms]	370.871 µs (27.5%)
appsec_no_iast	1.724 ms [1.701 ms, 1.747 ms]	375.571 µs (27.9%)
code_origins	1.694 ms [1.662 ms, 1.727 ms]	346.472 µs (25.7%)
iast	1.516 ms [1.492 ms, 1.541 ms]	168.308 µs (12.5%)
profiling	1.499 ms [1.475 ms, 1.523 ms]	150.845 µs (11.2%)
tracing	1.476 ms [1.452 ms, 1.501 ms]	128.283 µs (9.5%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~dceca289e9, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.098 µs) : 364, 404
.   : milestone, 384,
iast (509.154 µs) : 488, 531
.   : milestone, 509,
iast_FULL (731.836 µs) : 710, 754
.   : milestone, 732,
iast_GLOBAL (561.752 µs) : 539, 584
.   : milestone, 562,
iast_HARDCODED_SECRET_DISABLED (520.719 µs) : 498, 543
.   : milestone, 521,
iast_INACTIVE (462.494 µs) : 441, 484
.   : milestone, 462,
iast_TELEMETRY_OFF (496.998 µs) : 475, 519
.   : milestone, 497,
tracing (456.319 µs) : 435, 478
.   : milestone, 456,
section candidate
no_agent (381.262 µs) : 361, 401
.   : milestone, 381,
iast (512.438 µs) : 491, 534
.   : milestone, 512,
iast_FULL (726.067 µs) : 703, 749
.   : milestone, 726,
iast_GLOBAL (558.351 µs) : 536, 581
.   : milestone, 558,
iast_HARDCODED_SECRET_DISABLED (514.555 µs) : 493, 536
.   : milestone, 515,
iast_INACTIVE (461.425 µs) : 440, 483
.   : milestone, 461,
iast_TELEMETRY_OFF (498.701 µs) : 476, 521
.   : milestone, 499,
tracing (462.401 µs) : 441, 484
.   : milestone, 462,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	384.098 µs [364.061 µs, 404.135 µs]	-
iast	509.154 µs [487.555 µs, 530.753 µs]	125.056 µs (32.6%)
iast_FULL	731.836 µs [709.624 µs, 754.048 µs]	347.738 µs (90.5%)
iast_GLOBAL	561.752 µs [539.204 µs, 584.299 µs]	177.654 µs (46.3%)
iast_HARDCODED_SECRET_DISABLED	520.719 µs [498.423 µs, 543.014 µs]	136.621 µs (35.6%)
iast_INACTIVE	462.494 µs [440.823 µs, 484.165 µs]	78.396 µs (20.4%)
iast_TELEMETRY_OFF	496.998 µs [475.33 µs, 518.666 µs]	112.9 µs (29.4%)
tracing	456.319 µs [435.05 µs, 477.588 µs]	72.221 µs (18.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	381.262 µs [361.402 µs, 401.123 µs]	-
iast	512.438 µs [490.67 µs, 534.206 µs]	131.175 µs (34.4%)
iast_FULL	726.067 µs [702.732 µs, 749.401 µs]	344.804 µs (90.4%)
iast_GLOBAL	558.351 µs [535.894 µs, 580.807 µs]	177.088 µs (46.4%)
iast_HARDCODED_SECRET_DISABLED	514.555 µs [492.698 µs, 536.411 µs]	133.292 µs (35.0%)
iast_INACTIVE	461.425 µs [439.728 µs, 483.122 µs]	80.163 µs (21.0%)
iast_TELEMETRY_OFF	498.701 µs [476.236 µs, 521.167 µs]	117.439 µs (30.8%)
tracing	462.401 µs [440.769 µs, 484.034 µs]	81.139 µs (21.3%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/test-env-dceca289e92135ea27f85bb6e066205b8ca16828
git_commit_date	1741082792	1740765357
git_commit_sha	`8f945b0`	`dceca28`
release_version	1.47.0-SNAPSHOT~8f945b02a7	1.47.0-SNAPSHOT~dceca289e9

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1741093063	1741093063
ci_job_id	831558083	831558083
ci_pipeline_id	57629107	57629107
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zrt-bbxu-project-304-concurrent-2-az0mwetq 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zrt-bbxu-project-304-concurrent-2-az0mwetq 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~dceca289e9, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.232 s) : 15232000, 15232000
.   : milestone, 15232000,
appsec (15.017 s) : 15017000, 15017000
.   : milestone, 15017000,
iast (18.715 s) : 18715000, 18715000
.   : milestone, 18715000,
iast_GLOBAL (18.179 s) : 18179000, 18179000
.   : milestone, 18179000,
profiling (14.992 s) : 14992000, 14992000
.   : milestone, 14992000,
tracing (14.971 s) : 14971000, 14971000
.   : milestone, 14971000,
section candidate
no_agent (15.452 s) : 15452000, 15452000
.   : milestone, 15452000,
appsec (14.889 s) : 14889000, 14889000
.   : milestone, 14889000,
iast (19.042 s) : 19042000, 19042000
.   : milestone, 19042000,
iast_GLOBAL (18.205 s) : 18205000, 18205000
.   : milestone, 18205000,
profiling (15.656 s) : 15656000, 15656000
.   : milestone, 15656000,
tracing (14.713 s) : 14713000, 14713000
.   : milestone, 14713000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.232 s [15.232 s, 15.232 s]	-
appsec	15.017 s [15.017 s, 15.017 s]	-215.0 ms (-1.4%)
iast	18.715 s [18.715 s, 18.715 s]	3.483 s (22.9%)
iast_GLOBAL	18.179 s [18.179 s, 18.179 s]	2.947 s (19.3%)
profiling	14.992 s [14.992 s, 14.992 s]	-240.0 ms (-1.6%)
tracing	14.971 s [14.971 s, 14.971 s]	-261.0 ms (-1.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.452 s [15.452 s, 15.452 s]	-
appsec	14.889 s [14.889 s, 14.889 s]	-563.0 ms (-3.6%)
iast	19.042 s [19.042 s, 19.042 s]	3.59 s (23.2%)
iast_GLOBAL	18.205 s [18.205 s, 18.205 s]	2.753 s (17.8%)
profiling	15.656 s [15.656 s, 15.656 s]	204.0 ms (1.3%)
tracing	14.713 s [14.713 s, 14.713 s]	-739.0 ms (-4.8%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~dceca289e9, baseline=1.47.0-SNAPSHOT~8f945b02a7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.349 ms) : 2305, 2392
.   : milestone, 2349,
iast (2.125 ms) : 2070, 2180
.   : milestone, 2125,
iast_GLOBAL (2.169 ms) : 2113, 2224
.   : milestone, 2169,
profiling (1.998 ms) : 1953, 2043
.   : milestone, 1998,
tracing (1.953 ms) : 1911, 1995
.   : milestone, 1953,
section candidate
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (2.342 ms) : 2299, 2386
.   : milestone, 2342,
iast (2.123 ms) : 2068, 2179
.   : milestone, 2123,
iast_GLOBAL (2.165 ms) : 2110, 2221
.   : milestone, 2165,
profiling (2.463 ms) : 2280, 2647
.   : milestone, 2463,
tracing (1.953 ms) : 1911, 1995
.   : milestone, 1953,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	2.349 ms [2.305 ms, 2.392 ms]	875.071 µs (59.4%)
iast	2.125 ms [2.07 ms, 2.18 ms]	651.159 µs (44.2%)
iast_GLOBAL	2.169 ms [2.113 ms, 2.224 ms]	694.973 µs (47.2%)
profiling	1.998 ms [1.953 ms, 2.043 ms]	524.037 µs (35.6%)
tracing	1.953 ms [1.911 ms, 1.995 ms]	479.251 µs (32.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.483 ms [1.472 ms, 1.495 ms]	-
appsec	2.342 ms [2.299 ms, 2.386 ms]	859.111 µs (57.9%)
iast	2.123 ms [2.068 ms, 2.179 ms]	640.109 µs (43.2%)
iast_GLOBAL	2.165 ms [2.11 ms, 2.221 ms]	682.095 µs (46.0%)
profiling	2.463 ms [2.28 ms, 2.647 ms]	980.263 µs (66.1%)
tracing	1.953 ms [1.911 ms, 1.995 ms]	469.611 µs (31.7%)

nikita-tkachenko-datadog added the tag: do not merge Do not merge changes label Mar 4, 2025

nikita-tkachenko-datadog closed this Mar 4, 2025

nikita-tkachenko-datadog deleted the nikita-tkachenko/test-env-dceca289e92135ea27f85bb6e066205b8ca16828 branch March 4, 2025 14:10

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add In-Product Enablement (#8461) #8501

Add In-Product Enablement (#8461) #8501

Uh oh!

nikita-tkachenko-datadog commented Mar 4, 2025

Uh oh!

pr-commenter bot commented Mar 4, 2025

Uh oh!

Uh oh!

Add In-Product Enablement (#8461) #8501

Add In-Product Enablement (#8461) #8501

Uh oh!

Conversation

nikita-tkachenko-datadog commented Mar 4, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Mar 4, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!