Skip to content

Pin shared pipeline #8812

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
May 16, 2025
Merged

Pin shared pipeline #8812

merged 1 commit into from
May 16, 2025

Conversation

TonyCTHsu
Copy link
Contributor

What Does This Do

Pin a version to shared pipeline to provide consistent result.

Contributor Checklist

@TonyCTHsu TonyCTHsu requested a review from a team as a code owner May 13, 2025 11:06
@TonyCTHsu TonyCTHsu requested a review from smola May 13, 2025 11:06
@github-actions GitHub Actions
Copy link
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@smola smola requested review from bric3 and PerfectSlayer May 13, 2025 11:08
@datadog-datadog-prod-us1
Copy link
Contributor

Datadog Summary

✅ Code Quality    ✅ Code Security    ✅ Dependencies

Was this helpful? Give us feedback!

@smola smola added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels May 13, 2025
@smola smola requested a review from randomanderson May 13, 2025 11:08
@pr-commenter
Copy link

pr-commenter bot commented May 13, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master tonycthsu/pin-shared-pipeline
git_commit_date 1747289323 1747384995
git_commit_sha 50e8b5a 5b7716c
release_version 1.50.0-SNAPSHOT~50e8b5aefc 1.50.0-SNAPSHOT~5b7716c7c1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747387538 1747387538
ci_job_id 941267205 941267205
ci_pipeline_id 65296650 65296650
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-thkehp5s-project-304-concurrent-0-kmt006o8 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-thkehp5s-project-304-concurrent-0-kmt006o8 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~5b7716c7c1, baseline=1.50.0-SNAPSHOT~50e8b5aefc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.024 s) : 0, 1024433
Total [baseline] (10.425 s) : 0, 10424801
Agent [candidate] (1.016 s) : 0, 1015789
Total [candidate] (10.482 s) : 0, 10482041
section appsec
Agent [baseline] (1.16 s) : 0, 1159716
Total [baseline] (10.655 s) : 0, 10654734
Agent [candidate] (1.159 s) : 0, 1158658
Total [candidate] (10.629 s) : 0, 10629375
section iast
Agent [baseline] (1.145 s) : 0, 1144899
Total [baseline] (10.847 s) : 0, 10847012
Agent [candidate] (1.163 s) : 0, 1162880
Total [candidate] (11.109 s) : 0, 11108888
section profiling
Agent [baseline] (1.279 s) : 0, 1278513
Total [baseline] (10.854 s) : 0, 10854056
Agent [candidate] (1.28 s) : 0, 1280400
Total [candidate] (10.827 s) : 0, 10827190
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent appsec 1.16 s 135.283 ms (13.2%)
Agent iast 1.145 s 120.467 ms (11.8%)
Agent profiling 1.279 s 254.08 ms (24.8%)
Total tracing 10.425 s -
Total appsec 10.655 s 229.933 ms (2.2%)
Total iast 10.847 s 422.211 ms (4.1%)
Total profiling 10.854 s 429.254 ms (4.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.016 s -
Agent appsec 1.159 s 142.868 ms (14.1%)
Agent iast 1.163 s 147.091 ms (14.5%)
Agent profiling 1.28 s 264.611 ms (26.0%)
Total tracing 10.482 s -
Total appsec 10.629 s 147.334 ms (1.4%)
Total iast 11.109 s 626.848 ms (6.0%)
Total profiling 10.827 s 345.149 ms (3.3%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~5b7716c7c1, baseline=1.50.0-SNAPSHOT~50e8b5aefc

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.374 ms) : 0, 686374
BytebuddyAgent [candidate] (680.875 ms) : 0, 680875
GlobalTracer [baseline] (240.369 ms) : 0, 240369
GlobalTracer [candidate] (239.866 ms) : 0, 239866
AppSec [baseline] (54.41 ms) : 0, 54410
AppSec [candidate] (54.063 ms) : 0, 54063
Debugger [baseline] (6.9 ms) : 0, 6900
Debugger [candidate] (6.87 ms) : 0, 6870
Remote Config [baseline] (704.91 µs) : 0, 705
Remote Config [candidate] (704.131 µs) : 0, 704
Telemetry [baseline] (12.039 ms) : 0, 12039
Telemetry [candidate] (9.852 ms) : 0, 9852
section appsec
BytebuddyAgent [baseline] (699.268 ms) : 0, 699268
BytebuddyAgent [candidate] (698.861 ms) : 0, 698861
GlobalTracer [baseline] (236.377 ms) : 0, 236377
GlobalTracer [candidate] (235.958 ms) : 0, 235958
IAST [baseline] (21.771 ms) : 0, 21771
IAST [candidate] (21.658 ms) : 0, 21658
AppSec [baseline] (175.685 ms) : 0, 175685
AppSec [candidate] (175.596 ms) : 0, 175596
Debugger [baseline] (5.933 ms) : 0, 5933
Debugger [candidate] (5.912 ms) : 0, 5912
Remote Config [baseline] (620.472 µs) : 0, 620
Remote Config [candidate] (620.185 µs) : 0, 620
Telemetry [baseline] (7.408 ms) : 0, 7408
Telemetry [candidate] (7.365 ms) : 0, 7365
section iast
BytebuddyAgent [baseline] (799.494 ms) : 0, 799494
BytebuddyAgent [candidate] (813.492 ms) : 0, 813492
GlobalTracer [baseline] (229.856 ms) : 0, 229856
GlobalTracer [candidate] (231.952 ms) : 0, 231952
IAST [baseline] (30.542 ms) : 0, 30542
IAST [candidate] (27.695 ms) : 0, 27695
AppSec [baseline] (47.362 ms) : 0, 47362
AppSec [candidate] (51.349 ms) : 0, 51349
Debugger [baseline] (5.821 ms) : 0, 5821
Debugger [candidate] (5.97 ms) : 0, 5970
Remote Config [baseline] (579.196 µs) : 0, 579
Remote Config [candidate] (598.117 µs) : 0, 598
Telemetry [baseline] (7.8 ms) : 0, 7800
Telemetry [candidate] (7.986 ms) : 0, 7986
section profiling
BytebuddyAgent [baseline] (673.118 ms) : 0, 673118
BytebuddyAgent [candidate] (673.635 ms) : 0, 673635
GlobalTracer [baseline] (374.318 ms) : 0, 374318
GlobalTracer [candidate] (374.675 ms) : 0, 374675
AppSec [baseline] (62.111 ms) : 0, 62111
AppSec [candidate] (62.526 ms) : 0, 62526
Debugger [baseline] (6.262 ms) : 0, 6262
Debugger [candidate] (6.342 ms) : 0, 6342
Remote Config [baseline] (663.116 µs) : 0, 663
Remote Config [candidate] (657.953 µs) : 0, 658
Telemetry [baseline] (8.142 ms) : 0, 8142
Telemetry [candidate] (8.242 ms) : 0, 8242
ProfilingAgent [baseline] (103.189 ms) : 0, 103189
ProfilingAgent [candidate] (103.332 ms) : 0, 103332
Profiling [baseline] (103.213 ms) : 0, 103213
Profiling [candidate] (103.356 ms) : 0, 103356
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~5b7716c7c1, baseline=1.50.0-SNAPSHOT~50e8b5aefc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1020357
Total [baseline] (8.627 s) : 0, 8626858
Agent [candidate] (1.023 s) : 0, 1023494
Total [candidate] (8.626 s) : 0, 8626408
section iast
Agent [baseline] (1.145 s) : 0, 1144977
Total [baseline] (9.194 s) : 0, 9194233
Agent [candidate] (1.163 s) : 0, 1163284
Total [candidate] (9.235 s) : 0, 9234930
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.148 s) : 0, 1148358
Total [baseline] (9.2 s) : 0, 9199683
Agent [candidate] (1.146 s) : 0, 1146355
Total [candidate] (9.17 s) : 0, 9169985
section iast_TELEMETRY_OFF
Agent [baseline] (1.143 s) : 0, 1142786
Total [baseline] (9.189 s) : 0, 9188783
Agent [candidate] (1.143 s) : 0, 1142940
Total [candidate] (9.227 s) : 0, 9226825
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent iast 1.145 s 124.62 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.148 s 128.002 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.143 s 122.429 ms (12.0%)
Total tracing 8.627 s -
Total iast 9.194 s 567.375 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.2 s 572.825 ms (6.6%)
Total iast_TELEMETRY_OFF 9.189 s 561.925 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.163 s 139.79 ms (13.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.146 s 122.861 ms (12.0%)
Agent iast_TELEMETRY_OFF 1.143 s 119.447 ms (11.7%)
Total tracing 8.626 s -
Total iast 9.235 s 608.522 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.17 s 543.577 ms (6.3%)
Total iast_TELEMETRY_OFF 9.227 s 600.417 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~5b7716c7c1, baseline=1.50.0-SNAPSHOT~50e8b5aefc

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.699 ms) : 0, 681699
BytebuddyAgent [candidate] (684.87 ms) : 0, 684870
GlobalTracer [baseline] (240.453 ms) : 0, 240453
GlobalTracer [candidate] (240.671 ms) : 0, 240671
AppSec [baseline] (55.93 ms) : 0, 55930
AppSec [candidate] (54.544 ms) : 0, 54544
Debugger [baseline] (8.268 ms) : 0, 8268
Debugger [candidate] (8.413 ms) : 0, 8413
Remote Config [baseline] (696.782 µs) : 0, 697
Remote Config [candidate] (710.099 µs) : 0, 710
Telemetry [baseline] (9.774 ms) : 0, 9774
Telemetry [candidate] (10.664 ms) : 0, 10664
section iast
BytebuddyAgent [baseline] (799.326 ms) : 0, 799326
BytebuddyAgent [candidate] (812.52 ms) : 0, 812520
GlobalTracer [baseline] (229.696 ms) : 0, 229696
GlobalTracer [candidate] (232.347 ms) : 0, 232347
IAST [baseline] (29.037 ms) : 0, 29037
IAST [candidate] (29.871 ms) : 0, 29871
AppSec [baseline] (49.195 ms) : 0, 49195
AppSec [candidate] (50.099 ms) : 0, 50099
Debugger [baseline] (5.83 ms) : 0, 5830
Debugger [candidate] (6.039 ms) : 0, 6039
Remote Config [baseline] (594.704 µs) : 0, 595
Remote Config [candidate] (623.267 µs) : 0, 623
Telemetry [baseline] (7.766 ms) : 0, 7766
Telemetry [candidate] (8.022 ms) : 0, 8022
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (801.269 ms) : 0, 801269
BytebuddyAgent [candidate] (799.936 ms) : 0, 799936
GlobalTracer [baseline] (230.689 ms) : 0, 230689
GlobalTracer [candidate] (230.226 ms) : 0, 230226
IAST [baseline] (28.319 ms) : 0, 28319
IAST [candidate] (29.757 ms) : 0, 29757
AppSec [baseline] (50.288 ms) : 0, 50288
AppSec [candidate] (48.524 ms) : 0, 48524
Debugger [baseline] (5.87 ms) : 0, 5870
Debugger [candidate] (5.856 ms) : 0, 5856
Remote Config [baseline] (590.592 µs) : 0, 591
Remote Config [candidate] (583.039 µs) : 0, 583
Telemetry [baseline] (7.845 ms) : 0, 7845
Telemetry [candidate] (7.914 ms) : 0, 7914
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (797.878 ms) : 0, 797878
BytebuddyAgent [candidate] (796.909 ms) : 0, 796909
GlobalTracer [baseline] (229.728 ms) : 0, 229728
GlobalTracer [candidate] (230.394 ms) : 0, 230394
IAST [baseline] (22.28 ms) : 0, 22280
IAST [candidate] (22.281 ms) : 0, 22281
AppSec [baseline] (55.275 ms) : 0, 55275
AppSec [candidate] (55.605 ms) : 0, 55605
Debugger [baseline] (5.9 ms) : 0, 5900
Debugger [candidate] (5.901 ms) : 0, 5901
Remote Config [baseline] (607.103 µs) : 0, 607
Remote Config [candidate] (593.365 µs) : 0, 593
Telemetry [baseline] (7.682 ms) : 0, 7682
Telemetry [candidate] (7.709 ms) : 0, 7709
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-16T08:56:12 2025-05-16T09:03:54
git_branch master tonycthsu/pin-shared-pipeline
git_commit_date 1747289323 1747384995
git_commit_sha 50e8b5a 5b7716c
release_version 1.50.0-SNAPSHOT~50e8b5aefc 1.50.0-SNAPSHOT~5b7716c7c1
start_time 2025-05-16T08:55:58 2025-05-16T09:03:40
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747386630 1747386630
ci_job_id 941267206 941267206
ci_pipeline_id 65296650 65296650
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xnwlpqwj-project-304-concurrent-0-da6221um 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xnwlpqwj-project-304-concurrent-0-da6221um 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 19 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~5b7716c7c1, baseline=1.50.0-SNAPSHOT~50e8b5aefc
    dateFormat X
    axisFormat %s
section baseline
no_agent (386.211 µs) : 366, 406
.   : milestone, 386,
iast (508.617 µs) : 486, 531
.   : milestone, 509,
iast_FULL (732.418 µs) : 710, 755
.   : milestone, 732,
iast_GLOBAL (560.479 µs) : 538, 583
.   : milestone, 560,
iast_HARDCODED_SECRET_DISABLED (525.024 µs) : 503, 547
.   : milestone, 525,
iast_INACTIVE (456.886 µs) : 436, 478
.   : milestone, 457,
iast_TELEMETRY_OFF (505.326 µs) : 480, 530
.   : milestone, 505,
tracing (458.03 µs) : 436, 480
.   : milestone, 458,
section candidate
no_agent (383.347 µs) : 363, 403
.   : milestone, 383,
iast (522.03 µs) : 499, 545
.   : milestone, 522,
iast_FULL (728.654 µs) : 707, 751
.   : milestone, 729,
iast_GLOBAL (559.407 µs) : 537, 581
.   : milestone, 559,
iast_HARDCODED_SECRET_DISABLED (516.014 µs) : 492, 540
.   : milestone, 516,
iast_INACTIVE (463.051 µs) : 441, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (511.187 µs) : 487, 536
.   : milestone, 511,
tracing (459.241 µs) : 437, 482
.   : milestone, 459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 386.211 µs [366.252 µs, 406.17 µs] -
iast 508.617 µs [485.878 µs, 531.355 µs] 122.406 µs (31.7%)
iast_FULL 732.418 µs [710.095 µs, 754.741 µs] 346.207 µs (89.6%)
iast_GLOBAL 560.479 µs [538.223 µs, 582.735 µs] 174.268 µs (45.1%)
iast_HARDCODED_SECRET_DISABLED 525.024 µs [502.693 µs, 547.356 µs] 138.813 µs (35.9%)
iast_INACTIVE 456.886 µs [435.737 µs, 478.035 µs] 70.676 µs (18.3%)
iast_TELEMETRY_OFF 505.326 µs [480.289 µs, 530.364 µs] 119.115 µs (30.8%)
tracing 458.03 µs [435.933 µs, 480.127 µs] 71.819 µs (18.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 383.347 µs [363.459 µs, 403.235 µs] -
iast 522.03 µs [498.962 µs, 545.098 µs] 138.683 µs (36.2%)
iast_FULL 728.654 µs [706.761 µs, 750.546 µs] 345.307 µs (90.1%)
iast_GLOBAL 559.407 µs [537.48 µs, 581.333 µs] 176.06 µs (45.9%)
iast_HARDCODED_SECRET_DISABLED 516.014 µs [492.378 µs, 539.651 µs] 132.667 µs (34.6%)
iast_INACTIVE 463.051 µs [441.288 µs, 484.813 µs] 79.704 µs (20.8%)
iast_TELEMETRY_OFF 511.187 µs [486.755 µs, 535.618 µs] 127.84 µs (33.3%)
tracing 459.241 µs [436.86 µs, 481.622 µs] 75.894 µs (19.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~5b7716c7c1, baseline=1.50.0-SNAPSHOT~50e8b5aefc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.353 ms) : 1334, 1373
.   : milestone, 1353,
appsec (1.733 ms) : 1709, 1757
.   : milestone, 1733,
appsec_no_iast (1.691 ms) : 1667, 1714
.   : milestone, 1691,
code_origins (1.65 ms) : 1623, 1677
.   : milestone, 1650,
iast (1.512 ms) : 1488, 1537
.   : milestone, 1512,
profiling (1.529 ms) : 1504, 1554
.   : milestone, 1529,
tracing (1.483 ms) : 1458, 1508
.   : milestone, 1483,
section candidate
no_agent (1.349 ms) : 1329, 1368
.   : milestone, 1349,
appsec (1.72 ms) : 1697, 1743
.   : milestone, 1720,
appsec_no_iast (1.728 ms) : 1705, 1751
.   : milestone, 1728,
code_origins (1.655 ms) : 1629, 1682
.   : milestone, 1655,
iast (1.496 ms) : 1472, 1520
.   : milestone, 1496,
profiling (1.514 ms) : 1490, 1538
.   : milestone, 1514,
tracing (1.499 ms) : 1474, 1524
.   : milestone, 1499,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.353 ms [1.334 ms, 1.373 ms] -
appsec 1.733 ms [1.709 ms, 1.757 ms] 379.749 µs (28.1%)
appsec_no_iast 1.691 ms [1.667 ms, 1.714 ms] 337.227 µs (24.9%)
code_origins 1.65 ms [1.623 ms, 1.677 ms] 296.327 µs (21.9%)
iast 1.512 ms [1.488 ms, 1.537 ms] 158.916 µs (11.7%)
profiling 1.529 ms [1.504 ms, 1.554 ms] 175.804 µs (13.0%)
tracing 1.483 ms [1.458 ms, 1.508 ms] 129.999 µs (9.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.349 ms [1.329 ms, 1.368 ms] -
appsec 1.72 ms [1.697 ms, 1.743 ms] 371.21 µs (27.5%)
appsec_no_iast 1.728 ms [1.705 ms, 1.751 ms] 379.232 µs (28.1%)
code_origins 1.655 ms [1.629 ms, 1.682 ms] 306.57 µs (22.7%)
iast 1.496 ms [1.472 ms, 1.52 ms] 147.405 µs (10.9%)
profiling 1.514 ms [1.49 ms, 1.538 ms] 165.456 µs (12.3%)
tracing 1.499 ms [1.474 ms, 1.524 ms] 150.279 µs (11.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master tonycthsu/pin-shared-pipeline
git_commit_date 1747289323 1747384995
git_commit_sha 50e8b5a 5b7716c
release_version 1.50.0-SNAPSHOT~50e8b5aefc 1.50.0-SNAPSHOT~5b7716c7c1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1747387089 1747387089
ci_job_id 941267207 941267207
ci_pipeline_id 65296650 65296650
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-6ae23wjf-project-304-concurrent-0-s9qmn9ys 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-6ae23wjf-project-304-concurrent-0-s9qmn9ys 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~5b7716c7c1, baseline=1.50.0-SNAPSHOT~50e8b5aefc
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.542 s) : 15542000, 15542000
.   : milestone, 15542000,
appsec (15.145 s) : 15145000, 15145000
.   : milestone, 15145000,
iast (18.651 s) : 18651000, 18651000
.   : milestone, 18651000,
iast_GLOBAL (18.365 s) : 18365000, 18365000
.   : milestone, 18365000,
profiling (15.104 s) : 15104000, 15104000
.   : milestone, 15104000,
tracing (14.855 s) : 14855000, 14855000
.   : milestone, 14855000,
section candidate
no_agent (14.778 s) : 14778000, 14778000
.   : milestone, 14778000,
appsec (15.134 s) : 15134000, 15134000
.   : milestone, 15134000,
iast (18.672 s) : 18672000, 18672000
.   : milestone, 18672000,
iast_GLOBAL (18.255 s) : 18255000, 18255000
.   : milestone, 18255000,
profiling (15.066 s) : 15066000, 15066000
.   : milestone, 15066000,
tracing (15.126 s) : 15126000, 15126000
.   : milestone, 15126000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.542 s [15.542 s, 15.542 s] -
appsec 15.145 s [15.145 s, 15.145 s] -397.0 ms (-2.6%)
iast 18.651 s [18.651 s, 18.651 s] 3.109 s (20.0%)
iast_GLOBAL 18.365 s [18.365 s, 18.365 s] 2.823 s (18.2%)
profiling 15.104 s [15.104 s, 15.104 s] -438.0 ms (-2.8%)
tracing 14.855 s [14.855 s, 14.855 s] -687.0 ms (-4.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.778 s [14.778 s, 14.778 s] -
appsec 15.134 s [15.134 s, 15.134 s] 356.0 ms (2.4%)
iast 18.672 s [18.672 s, 18.672 s] 3.894 s (26.3%)
iast_GLOBAL 18.255 s [18.255 s, 18.255 s] 3.477 s (23.5%)
profiling 15.066 s [15.066 s, 15.066 s] 288.0 ms (1.9%)
tracing 15.126 s [15.126 s, 15.126 s] 348.0 ms (2.4%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~5b7716c7c1, baseline=1.50.0-SNAPSHOT~50e8b5aefc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (2.415 ms) : 2366, 2464
.   : milestone, 2415,
iast (2.203 ms) : 2140, 2265
.   : milestone, 2203,
iast_GLOBAL (2.24 ms) : 2178, 2303
.   : milestone, 2240,
profiling (2.041 ms) : 1992, 2091
.   : milestone, 2041,
tracing (2.023 ms) : 1975, 2071
.   : milestone, 2023,
section candidate
no_agent (1.487 ms) : 1475, 1498
.   : milestone, 1487,
appsec (2.413 ms) : 2364, 2462
.   : milestone, 2413,
iast (2.197 ms) : 2134, 2259
.   : milestone, 2197,
iast_GLOBAL (2.244 ms) : 2181, 2306
.   : milestone, 2244,
profiling (2.485 ms) : 2245, 2725
.   : milestone, 2485,
tracing (2.012 ms) : 1964, 2060
.   : milestone, 2012,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.47 ms, 1.493 ms] -
appsec 2.415 ms [2.366 ms, 2.464 ms] 933.685 µs (63.0%)
iast 2.203 ms [2.14 ms, 2.265 ms] 721.149 µs (48.7%)
iast_GLOBAL 2.24 ms [2.178 ms, 2.303 ms] 759.012 µs (51.2%)
profiling 2.041 ms [1.992 ms, 2.091 ms] 559.765 µs (37.8%)
tracing 2.023 ms [1.975 ms, 2.071 ms] 541.664 µs (36.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.487 ms [1.475 ms, 1.498 ms] -
appsec 2.413 ms [2.364 ms, 2.462 ms] 926.236 µs (62.3%)
iast 2.197 ms [2.134 ms, 2.259 ms] 709.98 µs (47.8%)
iast_GLOBAL 2.244 ms [2.181 ms, 2.306 ms] 757.149 µs (50.9%)
profiling 2.485 ms [2.245 ms, 2.725 ms] 998.522 µs (67.2%)
tracing 2.012 ms [1.964 ms, 2.06 ms] 525.333 µs (35.3%)

@TonyCTHsu TonyCTHsu force-pushed the tonycthsu/pin-shared-pipeline branch from e464538 to 5b7716c Compare May 16, 2025 08:43
@TonyCTHsu TonyCTHsu merged commit 9eafda9 into master May 16, 2025
521 of 524 checks passed
@TonyCTHsu TonyCTHsu deleted the tonycthsu/pin-shared-pipeline branch May 16, 2025 13:16
@github-actions github-actions bot added this to the 1.50.0 milestone May 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bric3 bric3 bric3 approved these changes

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/apm-java

@PerfectSlayer PerfectSlayer Awaiting requested review from PerfectSlayer

@randomanderson randomanderson Awaiting requested review from randomanderson

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.50.0
Development

Successfully merging this pull request may close these issues.
3 participants
@TonyCTHsu @bric3 @smola