Skip to content

Skip check-slo-breaches during POPULATE_CACHE pipelines #9243

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jul 24, 2025
Merged

Skip check-slo-breaches during POPULATE_CACHE pipelines #9243

merged 1 commit into from
Jul 24, 2025

Conversation

randomanderson
Copy link
Contributor

What Does This Do

Skip check-slo-breaches during POPULATE_CACHE pipelines

Motivation

During POPULATE_CACHE pipelines, none of the jobs that the slo check depends on are run and the pipeline is broken. This PR aligns the slo check with the benchmark runs

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@randomanderson randomanderson requested a review from a team as a code owner July 24, 2025 16:10
@randomanderson randomanderson added the tag: no release notes Changes to exclude from release notes label Jul 24, 2025
@randomanderson randomanderson requested review from colin-higgins and removed request for a team July 24, 2025 16:10
@randomanderson randomanderson added the comp: tooling Build & Tooling label Jul 24, 2025
@randomanderson randomanderson requested review from AlexeyKuznetsov-DD and removed request for colin-higgins July 24, 2025 16:10
@randomanderson randomanderson enabled auto-merge (squash) July 24, 2025 16:10
@pr-commenter
Copy link

pr-commenter bot commented Jul 24, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/skip-check-slo-on-cache
git_commit_date 1753372641 1753373294
git_commit_sha 94cd99a bcbacd1
release_version 1.51.1-SNAPSHOT~94cd99adda 1.51.1-SNAPSHOT~bcbacd1f9d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753375341 1753375341
ci_job_id 1046289930 1046289930
ci_pipeline_id 71615492 71615492
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tszvskh1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tszvskh1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 10 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.51.1-SNAPSHOT~bcbacd1f9d, baseline=1.51.1-SNAPSHOT~94cd99adda

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.042 s) : 0, 1042466
Total [baseline] (8.619 s) : 0, 8618701
Agent [candidate] (1.045 s) : 0, 1045317
Total [candidate] (8.632 s) : 0, 8631598
section iast
Agent [baseline] (1.175 s) : 0, 1174962
Total [baseline] (9.309 s) : 0, 9309457
Agent [candidate] (1.198 s) : 0, 1198287
Total [candidate] (9.411 s) : 0, 9411273
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent iast 1.175 s 132.495 ms (12.7%)
Total tracing 8.619 s -
Total iast 9.309 s 690.756 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.198 s 152.97 ms (14.6%)
Total tracing 8.632 s -
Total iast 9.411 s 779.674 ms (9.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.51.1-SNAPSHOT~bcbacd1f9d, baseline=1.51.1-SNAPSHOT~94cd99adda

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.436 ms) : 0, 1436
crashtracking [candidate] (1.43 ms) : 0, 1430
BytebuddyAgent [baseline] (729.046 ms) : 0, 729046
BytebuddyAgent [candidate] (731.813 ms) : 0, 731813
GlobalTracer [baseline] (241.445 ms) : 0, 241445
GlobalTracer [candidate] (242.654 ms) : 0, 242654
AppSec [baseline] (30.273 ms) : 0, 30273
AppSec [candidate] (30.48 ms) : 0, 30480
Debugger [baseline] (5.968 ms) : 0, 5968
Debugger [candidate] (5.986 ms) : 0, 5986
Remote Config [baseline] (649.936 µs) : 0, 650
Remote Config [candidate] (649.195 µs) : 0, 649
Telemetry [baseline] (12.715 ms) : 0, 12715
Telemetry [candidate] (11.356 ms) : 0, 11356
section iast
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (848.348 ms) : 0, 848348
BytebuddyAgent [candidate] (865.815 ms) : 0, 865815
GlobalTracer [baseline] (232.429 ms) : 0, 232429
GlobalTracer [candidate] (235.044 ms) : 0, 235044
AppSec [baseline] (28.082 ms) : 0, 28082
AppSec [candidate] (30.599 ms) : 0, 30599
Debugger [baseline] (7.603 ms) : 0, 7603
Debugger [candidate] (5.861 ms) : 0, 5861
Remote Config [baseline] (577.921 µs) : 0, 578
Remote Config [candidate] (607.315 µs) : 0, 607
Telemetry [baseline] (8.082 ms) : 0, 8082
Telemetry [candidate] (8.401 ms) : 0, 8401
IAST [baseline] (27.434 ms) : 0, 27434
IAST [candidate] (29.247 ms) : 0, 29247
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.51.1-SNAPSHOT~bcbacd1f9d, baseline=1.51.1-SNAPSHOT~94cd99adda

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044705
Total [baseline] (10.776 s) : 0, 10776364
Agent [candidate] (1.043 s) : 0, 1042518
Total [candidate] (10.829 s) : 0, 10829304
section appsec
Agent [baseline] (1.221 s) : 0, 1221307
Total [baseline] (10.823 s) : 0, 10822599
Agent [candidate] (1.219 s) : 0, 1219149
Total [candidate] (10.785 s) : 0, 10785175
section iast
Agent [baseline] (1.174 s) : 0, 1173794
Total [baseline] (10.906 s) : 0, 10906258
Agent [candidate] (1.176 s) : 0, 1175899
Total [candidate] (10.868 s) : 0, 10867938
section profiling
Agent [baseline] (1.194 s) : 0, 1194092
Total [baseline] (10.959 s) : 0, 10959051
Agent [candidate] (1.203 s) : 0, 1203424
Total [candidate] (10.928 s) : 0, 10927707
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent appsec 1.221 s 176.602 ms (16.9%)
Agent iast 1.174 s 129.089 ms (12.4%)
Agent profiling 1.194 s 149.387 ms (14.3%)
Total tracing 10.776 s -
Total appsec 10.823 s 46.235 ms (0.4%)
Total iast 10.906 s 129.894 ms (1.2%)
Total profiling 10.959 s 182.687 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent appsec 1.219 s 176.631 ms (16.9%)
Agent iast 1.176 s 133.381 ms (12.8%)
Agent profiling 1.203 s 160.906 ms (15.4%)
Total tracing 10.829 s -
Total appsec 10.785 s -44.129 ms (-0.4%)
Total iast 10.868 s 38.634 ms (0.4%)
Total profiling 10.928 s 98.403 ms (0.9%) 
gantt
    title petclinic - break down per module: candidate=1.51.1-SNAPSHOT~bcbacd1f9d, baseline=1.51.1-SNAPSHOT~94cd99adda

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.428 ms) : 0, 1428
crashtracking [candidate] (1.438 ms) : 0, 1438
BytebuddyAgent [baseline] (732.492 ms) : 0, 732492
BytebuddyAgent [candidate] (730.609 ms) : 0, 730609
GlobalTracer [baseline] (242.076 ms) : 0, 242076
GlobalTracer [candidate] (241.26 ms) : 0, 241260
AppSec [baseline] (30.395 ms) : 0, 30395
AppSec [candidate] (30.359 ms) : 0, 30359
Debugger [baseline] (5.993 ms) : 0, 5993
Debugger [candidate] (5.949 ms) : 0, 5949
Remote Config [baseline] (657.297 µs) : 0, 657
Remote Config [candidate] (661.111 µs) : 0, 661
Telemetry [baseline] (10.595 ms) : 0, 10595
Telemetry [candidate] (11.243 ms) : 0, 11243
section appsec
crashtracking [baseline] (1.433 ms) : 0, 1433
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (753.377 ms) : 0, 753377
BytebuddyAgent [candidate] (752.121 ms) : 0, 752121
GlobalTracer [baseline] (235.677 ms) : 0, 235677
GlobalTracer [candidate] (235.351 ms) : 0, 235351
AppSec [baseline] (169.151 ms) : 0, 169151
AppSec [candidate] (167.977 ms) : 0, 167977
Debugger [baseline] (7.906 ms) : 0, 7906
Debugger [candidate] (8.737 ms) : 0, 8737
Remote Config [baseline] (617.777 µs) : 0, 618
Remote Config [candidate] (611.806 µs) : 0, 612
Telemetry [baseline] (8.252 ms) : 0, 8252
Telemetry [candidate] (8.226 ms) : 0, 8226
IAST [baseline] (23.577 ms) : 0, 23577
IAST [candidate] (23.421 ms) : 0, 23421
section iast
crashtracking [baseline] (1.441 ms) : 0, 1441
crashtracking [candidate] (1.423 ms) : 0, 1423
BytebuddyAgent [baseline] (847.318 ms) : 0, 847318
BytebuddyAgent [candidate] (848.806 ms) : 0, 848806
GlobalTracer [baseline] (231.809 ms) : 0, 231809
GlobalTracer [candidate] (234.06 ms) : 0, 234060
AppSec [baseline] (26.382 ms) : 0, 26382
AppSec [candidate] (26.488 ms) : 0, 26488
Debugger [baseline] (7.503 ms) : 0, 7503
Debugger [candidate] (6.554 ms) : 0, 6554
Remote Config [baseline] (584.597 µs) : 0, 585
Remote Config [candidate] (579.915 µs) : 0, 580
Telemetry [baseline] (8.071 ms) : 0, 8071
Telemetry [candidate] (8.05 ms) : 0, 8050
IAST [baseline] (29.74 ms) : 0, 29740
IAST [candidate] (28.965 ms) : 0, 28965
section profiling
crashtracking [baseline] (1.399 ms) : 0, 1399
crashtracking [candidate] (1.42 ms) : 0, 1420
BytebuddyAgent [baseline] (760.321 ms) : 0, 760321
BytebuddyAgent [candidate] (767.874 ms) : 0, 767874
GlobalTracer [baseline] (222.031 ms) : 0, 222031
GlobalTracer [candidate] (223.359 ms) : 0, 223359
AppSec [baseline] (30.543 ms) : 0, 30543
AppSec [candidate] (30.706 ms) : 0, 30706
Debugger [baseline] (6.255 ms) : 0, 6255
Debugger [candidate] (6.289 ms) : 0, 6289
Remote Config [baseline] (718.35 µs) : 0, 718
Remote Config [candidate] (689.268 µs) : 0, 689
Telemetry [baseline] (15.923 ms) : 0, 15923
Telemetry [candidate] (16.045 ms) : 0, 16045
ProfilingAgent [baseline] (108.331 ms) : 0, 108331
ProfilingAgent [candidate] (108.187 ms) : 0, 108187
Profiling [baseline] (108.355 ms) : 0, 108355
Profiling [candidate] (108.214 ms) : 0, 108214
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/skip-check-slo-on-cache
git_commit_date 1753372641 1753373294
git_commit_sha 94cd99a bcbacd1
release_version 1.51.1-SNAPSHOT~94cd99adda 1.51.1-SNAPSHOT~bcbacd1f9d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753375089 1753375089
ci_job_id 1046289931 1046289931
ci_pipeline_id 71615492 71615492
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-rknhnrzc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-rknhnrzc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:tracing:high_load better
[-2.647ms; -1.812ms] or [-5.728%; -3.921%]		 unstable
[-3.123op/s; +10.808op/s] or [-3.044%; +10.536%]		 43.977ms 106.425op/s 46.206ms 102.582op/s
scenario:load:petclinic:profiling:high_load worse
[+1.657ms; +2.606ms] or [+3.571%; +5.615%]		 unstable
[-12.527op/s; +1.124op/s] or [-12.269%; +1.101%]		 48.546ms 96.400op/s 46.414ms 102.101op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~bcbacd1f9d, baseline=1.51.1-SNAPSHOT~94cd99adda
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.622 ms) : 37310, 37934
.   : milestone, 37622,
appsec (47.708 ms) : 47291, 48125
.   : milestone, 47708,
code_origins (44.647 ms) : 44274, 45019
.   : milestone, 44647,
iast (45.077 ms) : 44676, 45478
.   : milestone, 45077,
profiling (46.414 ms) : 46001, 46827
.   : milestone, 46414,
tracing (46.206 ms) : 45818, 46594
.   : milestone, 46206,
section candidate
no_agent (36.751 ms) : 36455, 37047
.   : milestone, 36751,
appsec (48.388 ms) : 47954, 48823
.   : milestone, 48388,
code_origins (45.417 ms) : 45040, 45795
.   : milestone, 45417,
iast (44.842 ms) : 44461, 45223
.   : milestone, 44842,
profiling (48.546 ms) : 48079, 49013
.   : milestone, 48546,
tracing (43.977 ms) : 43589, 44365
.   : milestone, 43977,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.622 ms [37.31 ms, 37.934 ms] -
appsec 47.708 ms [47.291 ms, 48.125 ms] 10.086 ms (26.8%)
code_origins 44.647 ms [44.274 ms, 45.019 ms] 7.025 ms (18.7%)
iast 45.077 ms [44.676 ms, 45.478 ms] 7.455 ms (19.8%)
profiling 46.414 ms [46.001 ms, 46.827 ms] 8.792 ms (23.4%)
tracing 46.206 ms [45.818 ms, 46.594 ms] 8.584 ms (22.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.751 ms [36.455 ms, 37.047 ms] -
appsec 48.388 ms [47.954 ms, 48.823 ms] 11.638 ms (31.7%)
code_origins 45.417 ms [45.04 ms, 45.795 ms] 8.667 ms (23.6%)
iast 44.842 ms [44.461 ms, 45.223 ms] 8.091 ms (22.0%)
profiling 48.546 ms [48.079 ms, 49.013 ms] 11.795 ms (32.1%)
tracing 43.977 ms [43.589 ms, 44.365 ms] 7.226 ms (19.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~bcbacd1f9d, baseline=1.51.1-SNAPSHOT~94cd99adda
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.395 ms) : 4342, 4449
.   : milestone, 4395,
iast (9.291 ms) : 9140, 9441
.   : milestone, 9291,
iast_FULL (13.77 ms) : 13496, 14045
.   : milestone, 13770,
iast_GLOBAL (10.14 ms) : 9962, 10318
.   : milestone, 10140,
profiling (8.639 ms) : 8506, 8772
.   : milestone, 8639,
tracing (7.637 ms) : 7530, 7744
.   : milestone, 7637,
section candidate
no_agent (4.402 ms) : 4352, 4452
.   : milestone, 4402,
iast (9.447 ms) : 9287, 9608
.   : milestone, 9447,
iast_FULL (13.971 ms) : 13694, 14248
.   : milestone, 13971,
iast_GLOBAL (10.232 ms) : 10030, 10433
.   : milestone, 10232,
profiling (8.797 ms) : 8658, 8936
.   : milestone, 8797,
tracing (7.448 ms) : 7338, 7559
.   : milestone, 7448,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.395 ms [4.342 ms, 4.449 ms] -
iast 9.291 ms [9.14 ms, 9.441 ms] 4.895 ms (111.4%)
iast_FULL 13.77 ms [13.496 ms, 14.045 ms] 9.375 ms (213.3%)
iast_GLOBAL 10.14 ms [9.962 ms, 10.318 ms] 5.744 ms (130.7%)
profiling 8.639 ms [8.506 ms, 8.772 ms] 4.244 ms (96.6%)
tracing 7.637 ms [7.53 ms, 7.744 ms] 3.242 ms (73.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.402 ms [4.352 ms, 4.452 ms] -
iast 9.447 ms [9.287 ms, 9.608 ms] 5.046 ms (114.6%)
iast_FULL 13.971 ms [13.694 ms, 14.248 ms] 9.569 ms (217.4%)
iast_GLOBAL 10.232 ms [10.03 ms, 10.433 ms] 5.83 ms (132.4%)
profiling 8.797 ms [8.658 ms, 8.936 ms] 4.395 ms (99.8%)
tracing 7.448 ms [7.338 ms, 7.559 ms] 3.047 ms (69.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/skip-check-slo-on-cache
git_commit_date 1753372641 1753373294
git_commit_sha 94cd99a bcbacd1
release_version 1.51.1-SNAPSHOT~94cd99adda 1.51.1-SNAPSHOT~bcbacd1f9d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1753375638 1753375638
ci_job_id 1046289932 1046289932
ci_pipeline_id 71615492 71615492
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5fe4tae0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5fe4tae0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.385ms; -1.047ms] or [-37.872%; -28.616%]		 2.441ms 3.657ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~bcbacd1f9d, baseline=1.51.1-SNAPSHOT~94cd99adda
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.09 s) : 15090000, 15090000
.   : milestone, 15090000,
appsec (14.869 s) : 14869000, 14869000
.   : milestone, 14869000,
iast (18.925 s) : 18925000, 18925000
.   : milestone, 18925000,
iast_GLOBAL (17.894 s) : 17894000, 17894000
.   : milestone, 17894000,
profiling (15.27 s) : 15270000, 15270000
.   : milestone, 15270000,
tracing (14.803 s) : 14803000, 14803000
.   : milestone, 14803000,
section candidate
no_agent (15.501 s) : 15501000, 15501000
.   : milestone, 15501000,
appsec (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,
iast (18.469 s) : 18469000, 18469000
.   : milestone, 18469000,
iast_GLOBAL (18.129 s) : 18129000, 18129000
.   : milestone, 18129000,
profiling (15.246 s) : 15246000, 15246000
.   : milestone, 15246000,
tracing (14.932 s) : 14932000, 14932000
.   : milestone, 14932000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.09 s [15.09 s, 15.09 s] -
appsec 14.869 s [14.869 s, 14.869 s] -221.0 ms (-1.5%)
iast 18.925 s [18.925 s, 18.925 s] 3.835 s (25.4%)
iast_GLOBAL 17.894 s [17.894 s, 17.894 s] 2.804 s (18.6%)
profiling 15.27 s [15.27 s, 15.27 s] 180.0 ms (1.2%)
tracing 14.803 s [14.803 s, 14.803 s] -287.0 ms (-1.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.501 s [15.501 s, 15.501 s] -
appsec 14.987 s [14.987 s, 14.987 s] -514.0 ms (-3.3%)
iast 18.469 s [18.469 s, 18.469 s] 2.968 s (19.1%)
iast_GLOBAL 18.129 s [18.129 s, 18.129 s] 2.628 s (17.0%)
profiling 15.246 s [15.246 s, 15.246 s] -255.0 ms (-1.6%)
tracing 14.932 s [14.932 s, 14.932 s] -569.0 ms (-3.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~bcbacd1f9d, baseline=1.51.1-SNAPSHOT~94cd99adda
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.657 ms) : 3441, 3873
.   : milestone, 3657,
iast (2.189 ms) : 2127, 2252
.   : milestone, 2189,
iast_GLOBAL (2.226 ms) : 2164, 2288
.   : milestone, 2226,
profiling (2.056 ms) : 2005, 2108
.   : milestone, 2056,
tracing (1.995 ms) : 1946, 2043
.   : milestone, 1995,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.441 ms) : 2389, 2494
.   : milestone, 2441,
iast (2.187 ms) : 2125, 2249
.   : milestone, 2187,
iast_GLOBAL (2.22 ms) : 2157, 2282
.   : milestone, 2220,
profiling (2.038 ms) : 1987, 2089
.   : milestone, 2038,
tracing (2.015 ms) : 1966, 2063
.   : milestone, 2015,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.657 ms [3.441 ms, 3.873 ms] 2.18 ms (147.6%)
iast 2.189 ms [2.127 ms, 2.252 ms] 712.594 µs (48.3%)
iast_GLOBAL 2.226 ms [2.164 ms, 2.288 ms] 749.245 µs (50.7%)
profiling 2.056 ms [2.005 ms, 2.108 ms] 579.472 µs (39.2%)
tracing 1.995 ms [1.946 ms, 2.043 ms] 517.725 µs (35.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 2.441 ms [2.389 ms, 2.494 ms] 968.706 µs (65.8%)
iast 2.187 ms [2.125 ms, 2.249 ms] 714.838 µs (48.5%)
iast_GLOBAL 2.22 ms [2.157 ms, 2.282 ms] 747.076 µs (50.7%)
profiling 2.038 ms [1.987 ms, 2.089 ms] 565.414 µs (38.4%)
tracing 2.015 ms [1.966 ms, 2.063 ms] 542.014 µs (36.8%)

@randomanderson randomanderson merged commit b94ca59 into master Jul 24, 2025
508 checks passed
@randomanderson randomanderson deleted the landerson/skip-check-slo-on-cache branch July 24, 2025 17:38
@github-actions github-actions bot added this to the 1.52.0 milestone Jul 24, 2025
@randomanderson randomanderson mentioned this pull request Jul 25, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sarahchen6 sarahchen6 sarahchen6 approved these changes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.52.0
Development

Successfully merging this pull request may close these issues.
3 participants
@randomanderson @sarahchen6 @AlexeyKuznetsov-DD