Skip to content

Enable the quarkus-native smoke test #8783

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
May 8, 2025
Merged

Enable the quarkus-native smoke test #8783

merged 2 commits into from
May 8, 2025

Conversation

ygree
Copy link
Contributor

@ygree ygree commented May 7, 2025

What Does This Do

Enables the quarkus-native smoke test

Motivation

quarkus-native smoke test was broken but unnoticed because it never runs on the CI.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@ygree ygree self-assigned this May 7, 2025
@ygree ygree requested a review from a team as a code owner May 7, 2025 18:29
@ygree ygree requested a review from dougqh May 7, 2025 18:29
@ygree ygree added comp: testing Testing tag: no release notes Changes to exclude from release notes labels May 7, 2025
@ygree ygree marked this pull request as draft May 7, 2025 18:42
@ygree ygree marked this pull request as ready for review May 7, 2025 18:42
@pr-commenter
Copy link

pr-commenter bot commented May 7, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/enable-quarkus-native-smoke-test
git_commit_date 1746692171 1746721991
git_commit_sha d5d53cd a3d432e
release_version 1.50.0-SNAPSHOT~d5d53cd553 1.50.0-SNAPSHOT~a3d432e98f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1746725004 1746725004
ci_job_id 930138934 930138934
ci_pipeline_id 64551256 64551256
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-psrqmy6d-project-304-concurrent-0-g7tu7q2w 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-psrqmy6d-project-304-concurrent-0-g7tu7q2w 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 14 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1020367
Total [baseline] (8.662 s) : 0, 8661608
Agent [candidate] (1.031 s) : 0, 1030942
Total [candidate] (8.697 s) : 0, 8696856
section iast
Agent [baseline] (1.145 s) : 0, 1145354
Total [baseline] (9.235 s) : 0, 9234964
Agent [candidate] (1.148 s) : 0, 1148426
Total [candidate] (9.243 s) : 0, 9242667
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.148 s) : 0, 1148301
Total [baseline] (9.194 s) : 0, 9194283
Agent [candidate] (1.15 s) : 0, 1149555
Total [candidate] (9.21 s) : 0, 9210195
section iast_TELEMETRY_OFF
Agent [baseline] (1.15 s) : 0, 1150467
Total [baseline] (9.232 s) : 0, 9232326
Agent [candidate] (1.155 s) : 0, 1154676
Total [candidate] (9.205 s) : 0, 9204659
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent iast 1.145 s 124.987 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.148 s 127.934 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.15 s 130.1 ms (12.8%)
Total tracing 8.662 s -
Total iast 9.235 s 573.356 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.194 s 532.675 ms (6.1%)
Total iast_TELEMETRY_OFF 9.232 s 570.718 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.031 s -
Agent iast 1.148 s 117.485 ms (11.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.15 s 118.613 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.155 s 123.735 ms (12.0%)
Total tracing 8.697 s -
Total iast 9.243 s 545.81 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.21 s 513.339 ms (5.9%)
Total iast_TELEMETRY_OFF 9.205 s 507.803 ms (5.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.005 ms) : 0, 682005
BytebuddyAgent [candidate] (688.642 ms) : 0, 688642
GlobalTracer [baseline] (240.003 ms) : 0, 240003
GlobalTracer [candidate] (242.972 ms) : 0, 242972
AppSec [baseline] (54.382 ms) : 0, 54382
AppSec [candidate] (56.639 ms) : 0, 56639
Debugger [baseline] (9.127 ms) : 0, 9127
Debugger [candidate] (7.765 ms) : 0, 7765
Remote Config [baseline] (693.392 µs) : 0, 693
Remote Config [candidate] (699.501 µs) : 0, 700
Telemetry [baseline] (10.575 ms) : 0, 10575
Telemetry [candidate] (10.622 ms) : 0, 10622
section iast
BytebuddyAgent [baseline] (800.035 ms) : 0, 800035
BytebuddyAgent [candidate] (800.247 ms) : 0, 800247
GlobalTracer [baseline] (229.486 ms) : 0, 229486
GlobalTracer [candidate] (231.202 ms) : 0, 231202
AppSec [baseline] (50.114 ms) : 0, 50114
AppSec [candidate] (48.871 ms) : 0, 48871
Debugger [baseline] (5.858 ms) : 0, 5858
Debugger [candidate] (5.934 ms) : 0, 5934
Remote Config [baseline] (590.283 µs) : 0, 590
Remote Config [candidate] (593.338 µs) : 0, 593
Telemetry [baseline] (7.854 ms) : 0, 7854
Telemetry [candidate] (7.891 ms) : 0, 7891
IAST [baseline] (26.517 ms) : 0, 26517
IAST [candidate] (29.517 ms) : 0, 29517
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (800.783 ms) : 0, 800783
BytebuddyAgent [candidate] (801.867 ms) : 0, 801867
GlobalTracer [baseline] (230.314 ms) : 0, 230314
GlobalTracer [candidate] (230.592 ms) : 0, 230592
AppSec [baseline] (52.377 ms) : 0, 52377
AppSec [candidate] (52.313 ms) : 0, 52313
Debugger [baseline] (5.962 ms) : 0, 5962
Debugger [candidate] (5.938 ms) : 0, 5938
Remote Config [baseline] (606.561 µs) : 0, 607
Remote Config [candidate] (579.725 µs) : 0, 580
Telemetry [baseline] (7.975 ms) : 0, 7975
Telemetry [candidate] (7.972 ms) : 0, 7972
IAST [baseline] (24.348 ms) : 0, 24348
IAST [candidate] (25.195 ms) : 0, 25195
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (803.052 ms) : 0, 803052
BytebuddyAgent [candidate] (805.081 ms) : 0, 805081
GlobalTracer [baseline] (231.372 ms) : 0, 231372
GlobalTracer [candidate] (231.856 ms) : 0, 231856
AppSec [baseline] (55.806 ms) : 0, 55806
AppSec [candidate] (55.922 ms) : 0, 55922
Debugger [baseline] (5.978 ms) : 0, 5978
Debugger [candidate] (6.097 ms) : 0, 6097
Remote Config [baseline] (594.208 µs) : 0, 594
Remote Config [candidate] (610.6 µs) : 0, 611
Telemetry [baseline] (7.725 ms) : 0, 7725
Telemetry [candidate] (7.97 ms) : 0, 7970
IAST [baseline] (22.32 ms) : 0, 22320
IAST [candidate] (23.549 ms) : 0, 23549
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1025804
Total [baseline] (10.458 s) : 0, 10457849
Agent [candidate] (1.018 s) : 0, 1017532
Total [candidate] (10.406 s) : 0, 10406090
section appsec
Agent [baseline] (1.166 s) : 0, 1165961
Total [baseline] (10.707 s) : 0, 10707383
Agent [candidate] (1.159 s) : 0, 1159114
Total [candidate] (10.66 s) : 0, 10659751
section iast
Agent [baseline] (1.151 s) : 0, 1151137
Total [baseline] (10.945 s) : 0, 10945488
Agent [candidate] (1.148 s) : 0, 1148377
Total [candidate] (10.858 s) : 0, 10857661
section profiling
Agent [baseline] (1.286 s) : 0, 1286213
Total [baseline] (10.8 s) : 0, 10799885
Agent [candidate] (1.282 s) : 0, 1282417
Total [candidate] (10.807 s) : 0, 10806749
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent appsec 1.166 s 140.157 ms (13.7%)
Agent iast 1.151 s 125.333 ms (12.2%)
Agent profiling 1.286 s 260.409 ms (25.4%)
Total tracing 10.458 s -
Total appsec 10.707 s 249.534 ms (2.4%)
Total iast 10.945 s 487.638 ms (4.7%)
Total profiling 10.8 s 342.036 ms (3.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent appsec 1.159 s 141.583 ms (13.9%)
Agent iast 1.148 s 130.845 ms (12.9%)
Agent profiling 1.282 s 264.885 ms (26.0%)
Total tracing 10.406 s -
Total appsec 10.66 s 253.662 ms (2.4%)
Total iast 10.858 s 451.571 ms (4.3%)
Total profiling 10.807 s 400.66 ms (3.9%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.752 ms) : 0, 686752
BytebuddyAgent [candidate] (681.492 ms) : 0, 681492
GlobalTracer [baseline] (241.376 ms) : 0, 241376
GlobalTracer [candidate] (239.415 ms) : 0, 239415
AppSec [baseline] (55.378 ms) : 0, 55378
AppSec [candidate] (55.248 ms) : 0, 55248
Debugger [baseline] (9.022 ms) : 0, 9022
Debugger [candidate] (8.999 ms) : 0, 8999
Remote Config [baseline] (690.756 µs) : 0, 691
Remote Config [candidate] (683.588 µs) : 0, 684
Telemetry [baseline] (9.019 ms) : 0, 9019
Telemetry [candidate] (8.27 ms) : 0, 8270
section appsec
BytebuddyAgent [baseline] (703.869 ms) : 0, 703869
BytebuddyAgent [candidate] (699.252 ms) : 0, 699252
GlobalTracer [baseline] (237.467 ms) : 0, 237467
GlobalTracer [candidate] (236.174 ms) : 0, 236174
AppSec [baseline] (175.828 ms) : 0, 175828
AppSec [candidate] (175.177 ms) : 0, 175177
Debugger [baseline] (5.978 ms) : 0, 5978
Debugger [candidate] (6.275 ms) : 0, 6275
Remote Config [baseline] (624.066 µs) : 0, 624
Remote Config [candidate] (617.815 µs) : 0, 618
Telemetry [baseline] (7.815 ms) : 0, 7815
Telemetry [candidate] (7.353 ms) : 0, 7353
IAST [baseline] (21.571 ms) : 0, 21571
IAST [candidate] (21.599 ms) : 0, 21599
section iast
BytebuddyAgent [baseline] (803.111 ms) : 0, 803111
BytebuddyAgent [candidate] (801.448 ms) : 0, 801448
GlobalTracer [baseline] (231.239 ms) : 0, 231239
GlobalTracer [candidate] (230.373 ms) : 0, 230373
AppSec [baseline] (48.779 ms) : 0, 48779
AppSec [candidate] (51.293 ms) : 0, 51293
Debugger [baseline] (5.945 ms) : 0, 5945
Debugger [candidate] (5.924 ms) : 0, 5924
Remote Config [baseline] (611.812 µs) : 0, 612
Remote Config [candidate] (595.141 µs) : 0, 595
Telemetry [baseline] (7.966 ms) : 0, 7966
Telemetry [candidate] (7.92 ms) : 0, 7920
IAST [baseline] (26.886 ms) : 0, 26886
IAST [candidate] (25.102 ms) : 0, 25102
section profiling
BytebuddyAgent [baseline] (677.079 ms) : 0, 677079
BytebuddyAgent [candidate] (673.36 ms) : 0, 673360
GlobalTracer [baseline] (379.61 ms) : 0, 379610
GlobalTracer [candidate] (379.471 ms) : 0, 379471
AppSec [baseline] (54.663 ms) : 0, 54663
AppSec [candidate] (54.033 ms) : 0, 54033
Debugger [baseline] (6.127 ms) : 0, 6127
Debugger [candidate] (6.152 ms) : 0, 6152
Remote Config [baseline] (653.127 µs) : 0, 653
Remote Config [candidate] (665.259 µs) : 0, 665
Telemetry [baseline] (8.104 ms) : 0, 8104
Telemetry [candidate] (8.136 ms) : 0, 8136
ProfilingAgent [baseline] (109.196 ms) : 0, 109196
ProfilingAgent [candidate] (110.048 ms) : 0, 110048
Profiling [baseline] (109.221 ms) : 0, 109221
Profiling [candidate] (110.074 ms) : 0, 110074
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-08T16:51:51 2025-05-08T16:59:35
git_branch master ygree/enable-quarkus-native-smoke-test
git_commit_date 1746692171 1746721991
git_commit_sha d5d53cd a3d432e
release_version 1.50.0-SNAPSHOT~d5d53cd553 1.50.0-SNAPSHOT~a3d432e98f
start_time 2025-05-08T16:51:37 2025-05-08T16:59:21
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1746723970 1746723970
ci_job_id 930138936 930138936
ci_pipeline_id 64551256 64551256
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-brbdd7pm-project-304-concurrent-0-68j2vocn 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-brbdd7pm-project-304-concurrent-0-68j2vocn 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.411 µs) : 358, 399
.   : milestone, 378,
iast (519.265 µs) : 497, 541
.   : milestone, 519,
iast_FULL (730.0 µs) : 708, 752
.   : milestone, 730,
iast_GLOBAL (559.983 µs) : 538, 582
.   : milestone, 560,
iast_HARDCODED_SECRET_DISABLED (513.022 µs) : 491, 535
.   : milestone, 513,
iast_INACTIVE (460.564 µs) : 439, 482
.   : milestone, 461,
iast_TELEMETRY_OFF (504.787 µs) : 482, 528
.   : milestone, 505,
tracing (459.575 µs) : 437, 482
.   : milestone, 460,
section candidate
no_agent (377.945 µs) : 358, 398
.   : milestone, 378,
iast (512.84 µs) : 491, 535
.   : milestone, 513,
iast_FULL (728.673 µs) : 707, 751
.   : milestone, 729,
iast_GLOBAL (553.663 µs) : 532, 576
.   : milestone, 554,
iast_HARDCODED_SECRET_DISABLED (510.69 µs) : 488, 534
.   : milestone, 511,
iast_INACTIVE (465.016 µs) : 442, 488
.   : milestone, 465,
iast_TELEMETRY_OFF (507.857 µs) : 485, 531
.   : milestone, 508,
tracing (455.967 µs) : 434, 478
.   : milestone, 456,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.411 µs [358.169 µs, 398.654 µs] -
iast 519.265 µs [497.056 µs, 541.474 µs] 140.854 µs (37.2%)
iast_FULL 730.0 µs [708.316 µs, 751.684 µs] 351.588 µs (92.9%)
iast_GLOBAL 559.983 µs [538.119 µs, 581.846 µs] 181.571 µs (48.0%)
iast_HARDCODED_SECRET_DISABLED 513.022 µs [491.25 µs, 534.794 µs] 134.611 µs (35.6%)
iast_INACTIVE 460.564 µs [439.042 µs, 482.086 µs] 82.152 µs (21.7%)
iast_TELEMETRY_OFF 504.787 µs [481.531 µs, 528.043 µs] 126.376 µs (33.4%)
tracing 459.575 µs [437.038 µs, 482.112 µs] 81.164 µs (21.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.945 µs [358.289 µs, 397.601 µs] -
iast 512.84 µs [490.831 µs, 534.85 µs] 134.896 µs (35.7%)
iast_FULL 728.673 µs [706.827 µs, 750.518 µs] 350.728 µs (92.8%)
iast_GLOBAL 553.663 µs [531.679 µs, 575.647 µs] 175.718 µs (46.5%)
iast_HARDCODED_SECRET_DISABLED 510.69 µs [487.684 µs, 533.697 µs] 132.746 µs (35.1%)
iast_INACTIVE 465.016 µs [441.798 µs, 488.234 µs] 87.072 µs (23.0%)
iast_TELEMETRY_OFF 507.857 µs [485.024 µs, 530.69 µs] 129.913 µs (34.4%)
tracing 455.967 µs [434.05 µs, 477.884 µs] 78.022 µs (20.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.371 ms) : 1351, 1392
.   : milestone, 1371,
appsec (1.727 ms) : 1704, 1751
.   : milestone, 1727,
appsec_no_iast (1.721 ms) : 1698, 1745
.   : milestone, 1721,
code_origins (1.681 ms) : 1655, 1708
.   : milestone, 1681,
iast (1.513 ms) : 1489, 1537
.   : milestone, 1513,
profiling (1.527 ms) : 1504, 1550
.   : milestone, 1527,
tracing (1.49 ms) : 1465, 1514
.   : milestone, 1490,
section candidate
no_agent (1.359 ms) : 1339, 1379
.   : milestone, 1359,
appsec (1.718 ms) : 1695, 1741
.   : milestone, 1718,
appsec_no_iast (1.732 ms) : 1709, 1755
.   : milestone, 1732,
code_origins (1.672 ms) : 1646, 1699
.   : milestone, 1672,
iast (1.514 ms) : 1490, 1537
.   : milestone, 1514,
profiling (1.523 ms) : 1499, 1547
.   : milestone, 1523,
tracing (1.478 ms) : 1453, 1503
.   : milestone, 1478,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.371 ms [1.351 ms, 1.392 ms] -
appsec 1.727 ms [1.704 ms, 1.751 ms] 356.015 µs (26.0%)
appsec_no_iast 1.721 ms [1.698 ms, 1.745 ms] 350.033 µs (25.5%)
code_origins 1.681 ms [1.655 ms, 1.708 ms] 309.758 µs (22.6%)
iast 1.513 ms [1.489 ms, 1.537 ms] 141.553 µs (10.3%)
profiling 1.527 ms [1.504 ms, 1.55 ms] 155.394 µs (11.3%)
tracing 1.49 ms [1.465 ms, 1.514 ms] 118.431 µs (8.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.359 ms [1.339 ms, 1.379 ms] -
appsec 1.718 ms [1.695 ms, 1.741 ms] 358.969 µs (26.4%)
appsec_no_iast 1.732 ms [1.709 ms, 1.755 ms] 372.647 µs (27.4%)
code_origins 1.672 ms [1.646 ms, 1.699 ms] 313.464 µs (23.1%)
iast 1.514 ms [1.49 ms, 1.537 ms] 154.553 µs (11.4%)
profiling 1.523 ms [1.499 ms, 1.547 ms] 164.11 µs (12.1%)
tracing 1.478 ms [1.453 ms, 1.503 ms] 118.983 µs (8.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/enable-quarkus-native-smoke-test
git_commit_date 1746692171 1746721991
git_commit_sha d5d53cd a3d432e
release_version 1.50.0-SNAPSHOT~d5d53cd553 1.50.0-SNAPSHOT~a3d432e98f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1746724644 1746724644
ci_job_id 930138937 930138937
ci_pipeline_id 64551256 64551256
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-psrqmy6d-project-304-concurrent-1-tiv0spu6 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-psrqmy6d-project-304-concurrent-1-tiv0spu6 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.379 ms) : 2332, 2426
.   : milestone, 2379,
iast (2.157 ms) : 2097, 2216
.   : milestone, 2157,
iast_GLOBAL (2.194 ms) : 2135, 2254
.   : milestone, 2194,
profiling (2.014 ms) : 1966, 2061
.   : milestone, 2014,
tracing (1.978 ms) : 1932, 2024
.   : milestone, 1978,
section candidate
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (2.37 ms) : 2323, 2417
.   : milestone, 2370,
iast (2.149 ms) : 2089, 2208
.   : milestone, 2149,
iast_GLOBAL (2.197 ms) : 2137, 2256
.   : milestone, 2197,
profiling (2.023 ms) : 1975, 2072
.   : milestone, 2023,
tracing (1.987 ms) : 1940, 2033
.   : milestone, 1987,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 2.379 ms [2.332 ms, 2.426 ms] 907.991 µs (61.7%)
iast 2.157 ms [2.097 ms, 2.216 ms] 685.578 µs (46.6%)
iast_GLOBAL 2.194 ms [2.135 ms, 2.254 ms] 722.938 µs (49.1%)
profiling 2.014 ms [1.966 ms, 2.061 ms] 542.229 µs (36.9%)
tracing 1.978 ms [1.932 ms, 2.024 ms] 506.783 µs (34.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.479 ms] -
appsec 2.37 ms [2.323 ms, 2.417 ms] 902.798 µs (61.5%)
iast 2.149 ms [2.089 ms, 2.208 ms] 681.195 µs (46.4%)
iast_GLOBAL 2.197 ms [2.137 ms, 2.256 ms] 729.325 µs (49.7%)
profiling 2.023 ms [1.975 ms, 2.072 ms] 555.961 µs (37.9%)
tracing 1.987 ms [1.94 ms, 2.033 ms] 519.409 µs (35.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.974 s) : 14974000, 14974000
.   : milestone, 14974000,
appsec (15.003 s) : 15003000, 15003000
.   : milestone, 15003000,
iast (18.982 s) : 18982000, 18982000
.   : milestone, 18982000,
iast_GLOBAL (17.871 s) : 17871000, 17871000
.   : milestone, 17871000,
profiling (14.815 s) : 14815000, 14815000
.   : milestone, 14815000,
tracing (15.031 s) : 15031000, 15031000
.   : milestone, 15031000,
section candidate
no_agent (14.928 s) : 14928000, 14928000
.   : milestone, 14928000,
appsec (14.989 s) : 14989000, 14989000
.   : milestone, 14989000,
iast (18.803 s) : 18803000, 18803000
.   : milestone, 18803000,
iast_GLOBAL (18.107 s) : 18107000, 18107000
.   : milestone, 18107000,
profiling (15.055 s) : 15055000, 15055000
.   : milestone, 15055000,
tracing (15.055 s) : 15055000, 15055000
.   : milestone, 15055000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.974 s [14.974 s, 14.974 s] -
appsec 15.003 s [15.003 s, 15.003 s] 29.0 ms (0.2%)
iast 18.982 s [18.982 s, 18.982 s] 4.008 s (26.8%)
iast_GLOBAL 17.871 s [17.871 s, 17.871 s] 2.897 s (19.3%)
profiling 14.815 s [14.815 s, 14.815 s] -159.0 ms (-1.1%)
tracing 15.031 s [15.031 s, 15.031 s] 57.0 ms (0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.928 s [14.928 s, 14.928 s] -
appsec 14.989 s [14.989 s, 14.989 s] 61.0 ms (0.4%)
iast 18.803 s [18.803 s, 18.803 s] 3.875 s (26.0%)
iast_GLOBAL 18.107 s [18.107 s, 18.107 s] 3.179 s (21.3%)
profiling 15.055 s [15.055 s, 15.055 s] 127.0 ms (0.9%)
tracing 15.055 s [15.055 s, 15.055 s] 127.0 ms (0.9%)

mcculls
mcculls approved these changes May 7, 2025
View reviewed changes
Copy link
Contributor

@mcculls mcculls left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch!

@ygree ygree enabled auto-merge (squash) May 8, 2025 00:55
@ygree ygree mentioned this pull request May 8, 2025
Merged
@ygree ygree merged commit d8111df into master May 8, 2025
470 of 509 checks passed
@ygree ygree deleted the ygree/enable-quarkus-native-smoke-test branch May 8, 2025 22:51
@github-actions github-actions bot added this to the 1.50.0 milestone May 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mcculls mcculls mcculls approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees

@ygree ygree

Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.50.0
Development

Successfully merging this pull request may close these issues.
2 participants
@ygree @mcculls