Skip to content

Enable API Security by default #8511

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 1 commit into
base: master
Choose a base branch
from
Draft

Enable API Security by default #8511

wants to merge 1 commit into from

Conversation

smola
Copy link
Member

@smola smola commented Mar 5, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@smola smola added comp: asm waf Application Security Management (WAF) type: enhancement labels Mar 5, 2025
@pr-commenter
Copy link

pr-commenter bot commented Mar 5, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/enable-api-security-by-default
git_commit_date 1747134305 1747148866
git_commit_sha f21ec9e 2de3c8d763
release_version 1.50.0-SNAPSHOT~f21ec9ed7b 1.50.0-SNAPSHOT~82de3c8d763
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747150716 1747150716
ci_job_id 936030668 936030668
ci_pipeline_id 64954961 64954961
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-5esuzn9-project-304-concurrent-0-kl4zfc62 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-5esuzn9-project-304-concurrent-0-kl4zfc62 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 54 metrics, 15 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:AppSec worse
[+3.369ms; +8.794ms] or [+6.125%; +15.985%]		 61.096ms 55.014ms
scenario:startup:petclinic:profiling:AppSec worse
[+1.440ms; +3.262ms] or [+2.307%; +5.228%]		 64.750ms 62.399ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~82de3c8d763, baseline=1.50.0-SNAPSHOT~f21ec9ed7b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1019525
Total [baseline] (8.647 s) : 0, 8647196
Agent [candidate] (1.026 s) : 0, 1025542
Total [candidate] (8.666 s) : 0, 8665559
section iast
Agent [baseline] (1.148 s) : 0, 1148302
Total [baseline] (9.241 s) : 0, 9241135
Agent [candidate] (1.151 s) : 0, 1151088
Total [candidate] (9.237 s) : 0, 9237498
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.151 s) : 0, 1151050
Total [baseline] (9.262 s) : 0, 9261849
Agent [candidate] (1.151 s) : 0, 1151472
Total [candidate] (9.22 s) : 0, 9220137
section iast_TELEMETRY_OFF
Agent [baseline] (1.153 s) : 0, 1153099
Total [baseline] (9.221 s) : 0, 9220658
Agent [candidate] (1.154 s) : 0, 1154004
Total [candidate] (9.277 s) : 0, 9276635
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent iast 1.148 s 128.777 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.151 s 131.525 ms (12.9%)
Agent iast_TELEMETRY_OFF 1.153 s 133.574 ms (13.1%)
Total tracing 8.647 s -
Total iast 9.241 s 593.938 ms (6.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.262 s 614.653 ms (7.1%)
Total iast_TELEMETRY_OFF 9.221 s 573.462 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.151 s 125.546 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.151 s 125.93 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.154 s 128.461 ms (12.5%)
Total tracing 8.666 s -
Total iast 9.237 s 571.938 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.22 s 554.578 ms (6.4%)
Total iast_TELEMETRY_OFF 9.277 s 611.076 ms (7.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~82de3c8d763, baseline=1.50.0-SNAPSHOT~f21ec9ed7b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.95 ms) : 0, 682950
BytebuddyAgent [candidate] (683.525 ms) : 0, 683525
GlobalTracer [baseline] (239.912 ms) : 0, 239912
GlobalTracer [candidate] (240.701 ms) : 0, 240701
AppSec [baseline] (55.014 ms) : 0, 55014
AppSec [candidate] (61.096 ms) : 0, 61096
Debugger [baseline] (6.849 ms) : 0, 6849
Debugger [candidate] (6.126 ms) : 0, 6126
Remote Config [baseline] (707.317 µs) : 0, 707
Remote Config [candidate] (710.771 µs) : 0, 711
Telemetry [baseline] (10.501 ms) : 0, 10501
Telemetry [candidate] (9.872 ms) : 0, 9872
section iast
BytebuddyAgent [baseline] (801.706 ms) : 0, 801706
BytebuddyAgent [candidate] (800.653 ms) : 0, 800653
GlobalTracer [baseline] (230.503 ms) : 0, 230503
GlobalTracer [candidate] (230.512 ms) : 0, 230512
IAST [baseline] (28.871 ms) : 0, 28871
IAST [candidate] (26.965 ms) : 0, 26965
AppSec [baseline] (49.275 ms) : 0, 49275
AppSec [candidate] (55.014 ms) : 0, 55014
Debugger [baseline] (5.919 ms) : 0, 5919
Debugger [candidate] (5.986 ms) : 0, 5986
Remote Config [baseline] (593.549 µs) : 0, 594
Remote Config [candidate] (585.507 µs) : 0, 586
Telemetry [baseline] (7.884 ms) : 0, 7884
Telemetry [candidate] (7.861 ms) : 0, 7861
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (802.537 ms) : 0, 802537
BytebuddyAgent [candidate] (801.219 ms) : 0, 801219
GlobalTracer [baseline] (230.93 ms) : 0, 230930
GlobalTracer [candidate] (230.241 ms) : 0, 230241
IAST [baseline] (28.616 ms) : 0, 28616
IAST [candidate] (26.201 ms) : 0, 26201
AppSec [baseline] (50.872 ms) : 0, 50872
AppSec [candidate] (55.701 ms) : 0, 55701
Debugger [baseline] (5.954 ms) : 0, 5954
Debugger [candidate] (6.003 ms) : 0, 6003
Remote Config [baseline] (602.211 µs) : 0, 602
Remote Config [candidate] (591.181 µs) : 0, 591
Telemetry [baseline] (7.951 ms) : 0, 7951
Telemetry [candidate] (7.863 ms) : 0, 7863
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (804.813 ms) : 0, 804813
BytebuddyAgent [candidate] (803.509 ms) : 0, 803509
GlobalTracer [baseline] (231.72 ms) : 0, 231720
GlobalTracer [candidate] (231.343 ms) : 0, 231343
IAST [baseline] (24.088 ms) : 0, 24088
IAST [candidate] (24.639 ms) : 0, 24639
AppSec [baseline] (54.39 ms) : 0, 54390
AppSec [candidate] (56.268 ms) : 0, 56268
Debugger [baseline] (6.018 ms) : 0, 6018
Debugger [candidate] (6.044 ms) : 0, 6044
Remote Config [baseline] (621.266 µs) : 0, 621
Remote Config [candidate] (601.255 µs) : 0, 601
Telemetry [baseline] (7.737 ms) : 0, 7737
Telemetry [candidate] (7.854 ms) : 0, 7854
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~82de3c8d763, baseline=1.50.0-SNAPSHOT~f21ec9ed7b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1019807
Total [baseline] (10.533 s) : 0, 10533054
Agent [candidate] (1.03 s) : 0, 1030427
Total [candidate] (10.483 s) : 0, 10483397
section appsec
Agent [baseline] (1.174 s) : 0, 1173656
Total [baseline] (10.795 s) : 0, 10795495
Agent [candidate] (1.168 s) : 0, 1167960
Total [candidate] (10.711 s) : 0, 10711355
section iast
Agent [baseline] (1.151 s) : 0, 1150903
Total [baseline] (10.868 s) : 0, 10868471
Agent [candidate] (1.169 s) : 0, 1168736
Total [candidate] (10.928 s) : 0, 10927936
section profiling
Agent [baseline] (1.293 s) : 0, 1293490
Total [baseline] (10.857 s) : 0, 10857367
Agent [candidate] (1.286 s) : 0, 1285627
Total [candidate] (10.858 s) : 0, 10858303
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent appsec 1.174 s 153.85 ms (15.1%)
Agent iast 1.151 s 131.096 ms (12.9%)
Agent profiling 1.293 s 273.683 ms (26.8%)
Total tracing 10.533 s -
Total appsec 10.795 s 262.441 ms (2.5%)
Total iast 10.868 s 335.417 ms (3.2%)
Total profiling 10.857 s 324.312 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.03 s -
Agent appsec 1.168 s 137.532 ms (13.3%)
Agent iast 1.169 s 138.308 ms (13.4%)
Agent profiling 1.286 s 255.2 ms (24.8%)
Total tracing 10.483 s -
Total appsec 10.711 s 227.958 ms (2.2%)
Total iast 10.928 s 444.54 ms (4.2%)
Total profiling 10.858 s 374.907 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~82de3c8d763, baseline=1.50.0-SNAPSHOT~f21ec9ed7b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.677 ms) : 0, 682677
BytebuddyAgent [candidate] (687.029 ms) : 0, 687029
GlobalTracer [baseline] (240.01 ms) : 0, 240010
GlobalTracer [candidate] (241.711 ms) : 0, 241711
AppSec [baseline] (54.371 ms) : 0, 54371
AppSec [candidate] (61.322 ms) : 0, 61322
Debugger [baseline] (7.779 ms) : 0, 7779
Debugger [candidate] (6.135 ms) : 0, 6135
Remote Config [baseline] (707.141 µs) : 0, 707
Remote Config [candidate] (704.729 µs) : 0, 705
Telemetry [baseline] (10.62 ms) : 0, 10620
Telemetry [candidate] (9.764 ms) : 0, 9764
section appsec
BytebuddyAgent [baseline] (709.716 ms) : 0, 709716
BytebuddyAgent [candidate] (702.787 ms) : 0, 702787
GlobalTracer [baseline] (238.545 ms) : 0, 238545
GlobalTracer [candidate] (237.729 ms) : 0, 237729
IAST [baseline] (21.811 ms) : 0, 21811
IAST [candidate] (21.59 ms) : 0, 21590
AppSec [baseline] (176.156 ms) : 0, 176156
AppSec [candidate] (179.049 ms) : 0, 179049
Debugger [baseline] (5.993 ms) : 0, 5993
Debugger [candidate] (5.909 ms) : 0, 5909
Remote Config [baseline] (627.98 µs) : 0, 628
Remote Config [candidate] (622.687 µs) : 0, 623
Telemetry [baseline] (7.861 ms) : 0, 7861
Telemetry [candidate] (7.373 ms) : 0, 7373
section iast
BytebuddyAgent [baseline] (803.431 ms) : 0, 803431
BytebuddyAgent [candidate] (814.641 ms) : 0, 814641
GlobalTracer [baseline] (231.058 ms) : 0, 231058
GlobalTracer [candidate] (233.831 ms) : 0, 233831
IAST [baseline] (27.342 ms) : 0, 27342
IAST [candidate] (28.676 ms) : 0, 28676
AppSec [baseline] (51.124 ms) : 0, 51124
AppSec [candidate] (52.542 ms) : 0, 52542
Debugger [baseline] (5.907 ms) : 0, 5907
Debugger [candidate] (6.016 ms) : 0, 6016
Remote Config [baseline] (592.902 µs) : 0, 593
Remote Config [candidate] (585.621 µs) : 0, 586
Telemetry [baseline] (7.861 ms) : 0, 7861
Telemetry [candidate] (7.87 ms) : 0, 7870
section profiling
BytebuddyAgent [baseline] (682.743 ms) : 0, 682743
BytebuddyAgent [candidate] (675.223 ms) : 0, 675223
GlobalTracer [baseline] (376.921 ms) : 0, 376921
GlobalTracer [candidate] (376.037 ms) : 0, 376037
AppSec [baseline] (62.399 ms) : 0, 62399
AppSec [candidate] (64.75 ms) : 0, 64750
Debugger [baseline] (6.406 ms) : 0, 6406
Debugger [candidate] (6.334 ms) : 0, 6334
Remote Config [baseline] (666.519 µs) : 0, 667
Remote Config [candidate] (674.074 µs) : 0, 674
Telemetry [baseline] (8.316 ms) : 0, 8316
Telemetry [candidate] (8.155 ms) : 0, 8155
ProfilingAgent [baseline] (104.465 ms) : 0, 104465
ProfilingAgent [candidate] (103.551 ms) : 0, 103551
Profiling [baseline] (104.49 ms) : 0, 104490
Profiling [candidate] (103.575 ms) : 0, 103575
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-13T15:08:54 2025-05-13T15:16:41
git_branch master smola/enable-api-security-by-default
git_commit_date 1747134305 1747148865
git_commit_sha f21ec9e 2de3c8d763
release_version 1.50.0-SNAPSHOT~f21ec9ed7b 1.50.0-SNAPSHOT~82de3c8d763
start_time 2025-05-13T15:08:40 2025-05-13T15:16:27
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747149803 1747149803
ci_job_id 936030670 936030670
ci_pipeline_id 64954961 64954961
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-sqqzovbx-project-304-concurrent-0-t1xvl4nq 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-sqqzovbx-project-304-concurrent-0-t1xvl4nq 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~82de3c8d763, baseline=1.50.0-SNAPSHOT~f21ec9ed7b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.367 ms) : 1347, 1387
.   : milestone, 1367,
appsec (1.742 ms) : 1719, 1766
.   : milestone, 1742,
appsec_no_iast (1.745 ms) : 1721, 1768
.   : milestone, 1745,
code_origins (1.695 ms) : 1668, 1722
.   : milestone, 1695,
iast (1.536 ms) : 1511, 1560
.   : milestone, 1536,
profiling (1.528 ms) : 1505, 1551
.   : milestone, 1528,
tracing (1.512 ms) : 1487, 1537
.   : milestone, 1512,
section candidate
no_agent (1.36 ms) : 1341, 1379
.   : milestone, 1360,
appsec (1.737 ms) : 1714, 1761
.   : milestone, 1737,
appsec_no_iast (1.749 ms) : 1725, 1773
.   : milestone, 1749,
code_origins (1.691 ms) : 1664, 1718
.   : milestone, 1691,
iast (1.535 ms) : 1511, 1559
.   : milestone, 1535,
profiling (1.531 ms) : 1508, 1555
.   : milestone, 1531,
tracing (1.498 ms) : 1475, 1521
.   : milestone, 1498,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.367 ms [1.347 ms, 1.387 ms] -
appsec 1.742 ms [1.719 ms, 1.766 ms] 375.396 µs (27.5%)
appsec_no_iast 1.745 ms [1.721 ms, 1.768 ms] 377.923 µs (27.6%)
code_origins 1.695 ms [1.668 ms, 1.722 ms] 327.732 µs (24.0%)
iast 1.536 ms [1.511 ms, 1.56 ms] 168.99 µs (12.4%)
profiling 1.528 ms [1.505 ms, 1.551 ms] 160.7 µs (11.8%)
tracing 1.512 ms [1.487 ms, 1.537 ms] 145.242 µs (10.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.36 ms [1.341 ms, 1.379 ms] -
appsec 1.737 ms [1.714 ms, 1.761 ms] 377.335 µs (27.7%)
appsec_no_iast 1.749 ms [1.725 ms, 1.773 ms] 389.173 µs (28.6%)
code_origins 1.691 ms [1.664 ms, 1.718 ms] 330.995 µs (24.3%)
iast 1.535 ms [1.511 ms, 1.559 ms] 175.206 µs (12.9%)
profiling 1.531 ms [1.508 ms, 1.555 ms] 171.449 µs (12.6%)
tracing 1.498 ms [1.475 ms, 1.521 ms] 137.935 µs (10.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~82de3c8d763, baseline=1.50.0-SNAPSHOT~f21ec9ed7b
    dateFormat X
    axisFormat %s
section baseline
no_agent (386.887 µs) : 367, 407
.   : milestone, 387,
iast (528.314 µs) : 506, 550
.   : milestone, 528,
iast_FULL (743.006 µs) : 721, 765
.   : milestone, 743,
iast_GLOBAL (571.304 µs) : 549, 593
.   : milestone, 571,
iast_HARDCODED_SECRET_DISABLED (527.773 µs) : 505, 551
.   : milestone, 528,
iast_INACTIVE (470.907 µs) : 448, 493
.   : milestone, 471,
iast_TELEMETRY_OFF (520.895 µs) : 498, 544
.   : milestone, 521,
tracing (463.086 µs) : 441, 485
.   : milestone, 463,
section candidate
no_agent (388.784 µs) : 369, 408
.   : milestone, 389,
iast (523.94 µs) : 502, 546
.   : milestone, 524,
iast_FULL (741.722 µs) : 720, 764
.   : milestone, 742,
iast_GLOBAL (567.608 µs) : 546, 589
.   : milestone, 568,
iast_HARDCODED_SECRET_DISABLED (531.778 µs) : 510, 554
.   : milestone, 532,
iast_INACTIVE (476.712 µs) : 454, 500
.   : milestone, 477,
iast_TELEMETRY_OFF (518.589 µs) : 495, 542
.   : milestone, 519,
tracing (467.664 µs) : 445, 490
.   : milestone, 468,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 386.887 µs [367.03 µs, 406.744 µs] -
iast 528.314 µs [506.377 µs, 550.252 µs] 141.428 µs (36.6%)
iast_FULL 743.006 µs [720.965 µs, 765.046 µs] 356.119 µs (92.0%)
iast_GLOBAL 571.304 µs [549.466 µs, 593.142 µs] 184.418 µs (47.7%)
iast_HARDCODED_SECRET_DISABLED 527.773 µs [504.662 µs, 550.883 µs] 140.886 µs (36.4%)
iast_INACTIVE 470.907 µs [448.411 µs, 493.403 µs] 84.02 µs (21.7%)
iast_TELEMETRY_OFF 520.895 µs [497.689 µs, 544.102 µs] 134.009 µs (34.6%)
tracing 463.086 µs [440.685 µs, 485.488 µs] 76.2 µs (19.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 388.784 µs [369.191 µs, 408.377 µs] -
iast 523.94 µs [502.138 µs, 545.741 µs] 135.155 µs (34.8%)
iast_FULL 741.722 µs [719.746 µs, 763.698 µs] 352.938 µs (90.8%)
iast_GLOBAL 567.608 µs [546.159 µs, 589.057 µs] 178.823 µs (46.0%)
iast_HARDCODED_SECRET_DISABLED 531.778 µs [509.929 µs, 553.626 µs] 142.993 µs (36.8%)
iast_INACTIVE 476.712 µs [453.578 µs, 499.845 µs] 87.928 µs (22.6%)
iast_TELEMETRY_OFF 518.589 µs [494.68 µs, 542.498 µs] 129.805 µs (33.4%)
tracing 467.664 µs [445.242 µs, 490.086 µs] 78.879 µs (20.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/enable-api-security-by-default
git_commit_date 1747134305 1747149007
git_commit_sha f21ec9e 2de3c8d763
release_version 1.50.0-SNAPSHOT~f21ec9ed7b 1.50.0-SNAPSHOT~82de3c8d763
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1747150446 1747150446
ci_job_id 936030672 936030672
ci_pipeline_id 64954961 64954961
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-sqqzovbx-project-304-concurrent-1-l4mllcii 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-sqqzovbx-project-304-concurrent-1-l4mllcii 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~82de3c8d763, baseline=1.50.0-SNAPSHOT~f21ec9ed7b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.495 s) : 15495000, 15495000
.   : milestone, 15495000,
appsec (15.2 s) : 15200000, 15200000
.   : milestone, 15200000,
iast (19.201 s) : 19201000, 19201000
.   : milestone, 19201000,
iast_GLOBAL (18.292 s) : 18292000, 18292000
.   : milestone, 18292000,
profiling (15.154 s) : 15154000, 15154000
.   : milestone, 15154000,
tracing (14.749 s) : 14749000, 14749000
.   : milestone, 14749000,
section candidate
no_agent (15.476 s) : 15476000, 15476000
.   : milestone, 15476000,
appsec (15.163 s) : 15163000, 15163000
.   : milestone, 15163000,
iast (19.036 s) : 19036000, 19036000
.   : milestone, 19036000,
iast_GLOBAL (18.077 s) : 18077000, 18077000
.   : milestone, 18077000,
profiling (14.971 s) : 14971000, 14971000
.   : milestone, 14971000,
tracing (14.917 s) : 14917000, 14917000
.   : milestone, 14917000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.495 s [15.495 s, 15.495 s] -
appsec 15.2 s [15.2 s, 15.2 s] -295.0 ms (-1.9%)
iast 19.201 s [19.201 s, 19.201 s] 3.706 s (23.9%)
iast_GLOBAL 18.292 s [18.292 s, 18.292 s] 2.797 s (18.1%)
profiling 15.154 s [15.154 s, 15.154 s] -341.0 ms (-2.2%)
tracing 14.749 s [14.749 s, 14.749 s] -746.0 ms (-4.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.476 s [15.476 s, 15.476 s] -
appsec 15.163 s [15.163 s, 15.163 s] -313.0 ms (-2.0%)
iast 19.036 s [19.036 s, 19.036 s] 3.56 s (23.0%)
iast_GLOBAL 18.077 s [18.077 s, 18.077 s] 2.601 s (16.8%)
profiling 14.971 s [14.971 s, 14.971 s] -505.0 ms (-3.3%)
tracing 14.917 s [14.917 s, 14.917 s] -559.0 ms (-3.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~82de3c8d763, baseline=1.50.0-SNAPSHOT~f21ec9ed7b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.488 ms) : 1476, 1500
.   : milestone, 1488,
appsec (2.432 ms) : 2383, 2482
.   : milestone, 2432,
iast (2.217 ms) : 2154, 2279
.   : milestone, 2217,
iast_GLOBAL (2.247 ms) : 2185, 2310
.   : milestone, 2247,
profiling (2.051 ms) : 2001, 2101
.   : milestone, 2051,
tracing (2.027 ms) : 1979, 2075
.   : milestone, 2027,
section candidate
no_agent (1.484 ms) : 1473, 1496
.   : milestone, 1484,
appsec (2.417 ms) : 2368, 2467
.   : milestone, 2417,
iast (2.197 ms) : 2135, 2259
.   : milestone, 2197,
iast_GLOBAL (2.246 ms) : 2184, 2309
.   : milestone, 2246,
profiling (2.043 ms) : 1993, 2093
.   : milestone, 2043,
tracing (2.027 ms) : 1979, 2076
.   : milestone, 2027,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.488 ms [1.476 ms, 1.5 ms] -
appsec 2.432 ms [2.383 ms, 2.482 ms] 944.505 µs (63.5%)
iast 2.217 ms [2.154 ms, 2.279 ms] 728.852 µs (49.0%)
iast_GLOBAL 2.247 ms [2.185 ms, 2.31 ms] 759.117 µs (51.0%)
profiling 2.051 ms [2.001 ms, 2.101 ms] 563.201 µs (37.9%)
tracing 2.027 ms [1.979 ms, 2.075 ms] 538.774 µs (36.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.473 ms, 1.496 ms] -
appsec 2.417 ms [2.368 ms, 2.467 ms] 932.903 µs (62.8%)
iast 2.197 ms [2.135 ms, 2.259 ms] 712.274 µs (48.0%)
iast_GLOBAL 2.246 ms [2.184 ms, 2.309 ms] 762.038 µs (51.3%)
profiling 2.043 ms [1.993 ms, 2.093 ms] 558.653 µs (37.6%)
tracing 2.027 ms [1.979 ms, 2.076 ms] 542.728 µs (36.6%)

@smola smola force-pushed the smola/enable-api-security-by-default branch from 70381c5 to 82de3c8 Compare May 13, 2025 14:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
comp: asm waf Application Security Management (WAF) type: enhancement
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@smola