Skip to content

Increase smoke tests slots #10151

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
bric3 merged 1 commit into from
Dec 10, 2025
Merged

Increase smoke tests slots #10151

bric3 merged 1 commit into from
Dec 10, 2025

Conversation

@bric3
Copy link
Contributor

@bric3 bric3 commented Dec 10, 2025 •
edited
Loading

What Does This Do

Increase CI smoke tests slots, to reduce contention on preferences.

Motivation

The reason is twofold

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@bric3 bric3 requested a review from a team as a code owner December 10, 2025 10:48
@bric3 bric3 added the tag: no release notes Changes to exclude from release notes label Dec 10, 2025
@bric3 bric3 requested review from erikayasuda and removed request for a team December 10, 2025 10:48
@bric3 bric3 added the comp: tooling Build & Tooling label Dec 10, 2025
@pr-commenter
Copy link

pr-commenter bot commented Dec 10, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/increase-smoke-slots
git_commit_date 1765360118 1765363555
git_commit_sha 1807b63 3114d14
release_version 1.57.0-SNAPSHOT~1807b637bb 1.57.0-SNAPSHOT~3114d146d7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765365592 1765365592
ci_job_id 1283063801 1283063801
ci_pipeline_id 85868086 85868086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-kl6zegyw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-kl6zegyw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~3114d146d7, baseline=1.57.0-SNAPSHOT~1807b637bb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1083779
Total [baseline] (10.941 s) : 0, 10940812
Agent [candidate] (1.088 s) : 0, 1087586
Total [candidate] (10.839 s) : 0, 10838666
section appsec
Agent [baseline] (1.265 s) : 0, 1265381
Total [baseline] (11.099 s) : 0, 11098871
Agent [candidate] (1.265 s) : 0, 1264994
Total [candidate] (11.127 s) : 0, 11126677
section iast
Agent [baseline] (1.236 s) : 0, 1235556
Total [baseline] (11.206 s) : 0, 11206468
Agent [candidate] (1.223 s) : 0, 1223401
Total [candidate] (11.187 s) : 0, 11186671
section profiling
Agent [baseline] (1.207 s) : 0, 1206881
Total [baseline] (11.092 s) : 0, 11092312
Agent [candidate] (1.203 s) : 0, 1203335
Total [candidate] (10.961 s) : 0, 10961311
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent appsec 1.265 s 181.602 ms (16.8%)
Agent iast 1.236 s 151.778 ms (14.0%)
Agent profiling 1.207 s 123.102 ms (11.4%)
Total tracing 10.941 s -
Total appsec 11.099 s 158.06 ms (1.4%)
Total iast 11.206 s 265.656 ms (2.4%)
Total profiling 11.092 s 151.501 ms (1.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.088 s -
Agent appsec 1.265 s 177.408 ms (16.3%)
Agent iast 1.223 s 135.815 ms (12.5%)
Agent profiling 1.203 s 115.749 ms (10.6%)
Total tracing 10.839 s -
Total appsec 11.127 s 288.01 ms (2.7%)
Total iast 11.187 s 348.004 ms (3.2%)
Total profiling 10.961 s 122.644 ms (1.1%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~3114d146d7, baseline=1.57.0-SNAPSHOT~1807b637bb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (651.018 ms) : 0, 651018
BytebuddyAgent [candidate] (652.652 ms) : 0, 652652
GlobalTracer [baseline] (282.021 ms) : 0, 282021
GlobalTracer [candidate] (283.387 ms) : 0, 283387
AppSec [baseline] (32.185 ms) : 0, 32185
AppSec [candidate] (32.694 ms) : 0, 32694
Debugger [baseline] (68.368 ms) : 0, 68368
Debugger [candidate] (68.474 ms) : 0, 68474
Remote Config [baseline] (646.932 µs) : 0, 647
Remote Config [candidate] (659.454 µs) : 0, 659
Telemetry [baseline] (9.058 ms) : 0, 9058
Telemetry [candidate] (9.089 ms) : 0, 9089
Flare Poller [baseline] (3.73 ms) : 0, 3730
Flare Poller [candidate] (3.811 ms) : 0, 3811
section appsec
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (689.008 ms) : 0, 689008
BytebuddyAgent [candidate] (689.524 ms) : 0, 689524
GlobalTracer [baseline] (259.762 ms) : 0, 259762
GlobalTracer [candidate] (258.982 ms) : 0, 258982
AppSec [baseline] (175.232 ms) : 0, 175232
AppSec [candidate] (175.047 ms) : 0, 175047
Debugger [baseline] (66.313 ms) : 0, 66313
Debugger [candidate] (66.648 ms) : 0, 66648
Remote Config [baseline] (706.766 µs) : 0, 707
Remote Config [candidate] (712.521 µs) : 0, 713
Telemetry [baseline] (9.062 ms) : 0, 9062
Telemetry [candidate] (8.994 ms) : 0, 8994
Flare Poller [baseline] (3.944 ms) : 0, 3944
Flare Poller [candidate] (3.886 ms) : 0, 3886
IAST [baseline] (24.707 ms) : 0, 24707
IAST [candidate] (24.534 ms) : 0, 24534
section iast
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (801.006 ms) : 0, 801006
BytebuddyAgent [candidate] (790.24 ms) : 0, 790240
GlobalTracer [baseline] (257.09 ms) : 0, 257090
GlobalTracer [candidate] (256.082 ms) : 0, 256082
AppSec [baseline] (34.699 ms) : 0, 34699
AppSec [candidate] (35.527 ms) : 0, 35527
Debugger [baseline] (66.391 ms) : 0, 66391
Debugger [candidate] (65.527 ms) : 0, 65527
Remote Config [baseline] (541.107 µs) : 0, 541
Remote Config [candidate] (535.762 µs) : 0, 536
Telemetry [baseline] (8.426 ms) : 0, 8426
Telemetry [candidate] (8.339 ms) : 0, 8339
Flare Poller [baseline] (3.466 ms) : 0, 3466
Flare Poller [candidate] (3.433 ms) : 0, 3433
IAST [baseline] (27.194 ms) : 0, 27194
IAST [candidate] (27.219 ms) : 0, 27219
section profiling
ProfilingAgent [baseline] (98.352 ms) : 0, 98352
ProfilingAgent [candidate] (97.236 ms) : 0, 97236
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (702.609 ms) : 0, 702609
BytebuddyAgent [candidate] (701.252 ms) : 0, 701252
GlobalTracer [baseline] (221.183 ms) : 0, 221183
GlobalTracer [candidate] (220.461 ms) : 0, 220461
AppSec [baseline] (32.35 ms) : 0, 32350
AppSec [candidate] (32.343 ms) : 0, 32343
Debugger [baseline] (68.061 ms) : 0, 68061
Debugger [candidate] (68.123 ms) : 0, 68123
Remote Config [baseline] (669.482 µs) : 0, 669
Remote Config [candidate] (638.909 µs) : 0, 639
Telemetry [baseline] (9.008 ms) : 0, 9008
Telemetry [candidate] (8.896 ms) : 0, 8896
Flare Poller [baseline] (3.796 ms) : 0, 3796
Flare Poller [candidate] (3.771 ms) : 0, 3771
Profiling [baseline] (98.943 ms) : 0, 98943
Profiling [candidate] (97.802 ms) : 0, 97802
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~3114d146d7, baseline=1.57.0-SNAPSHOT~1807b637bb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1080678
Total [baseline] (8.722 s) : 0, 8721884
Agent [candidate] (1.081 s) : 0, 1081066
Total [candidate] (8.715 s) : 0, 8715394
section iast
Agent [baseline] (1.229 s) : 0, 1229418
Total [baseline] (9.521 s) : 0, 9521180
Agent [candidate] (1.229 s) : 0, 1228820
Total [candidate] (9.503 s) : 0, 9502957
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.229 s 148.741 ms (13.8%)
Total tracing 8.722 s -
Total iast 9.521 s 799.297 ms (9.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.229 s 147.754 ms (13.7%)
Total tracing 8.715 s -
Total iast 9.503 s 787.562 ms (9.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~3114d146d7, baseline=1.57.0-SNAPSHOT~1807b637bb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (648.73 ms) : 0, 648730
BytebuddyAgent [candidate] (649.589 ms) : 0, 649589
GlobalTracer [baseline] (281.851 ms) : 0, 281851
GlobalTracer [candidate] (281.81 ms) : 0, 281810
AppSec [baseline] (32.247 ms) : 0, 32247
AppSec [candidate] (32.266 ms) : 0, 32266
Debugger [baseline] (67.682 ms) : 0, 67682
Debugger [candidate] (67.286 ms) : 0, 67286
Remote Config [baseline] (652.053 µs) : 0, 652
Remote Config [candidate] (646.909 µs) : 0, 647
Telemetry [baseline] (8.972 ms) : 0, 8972
Telemetry [candidate] (9.007 ms) : 0, 9007
Flare Poller [baseline] (3.744 ms) : 0, 3744
Flare Poller [candidate] (3.757 ms) : 0, 3757
section iast
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (795.733 ms) : 0, 795733
BytebuddyAgent [candidate] (795.173 ms) : 0, 795173
GlobalTracer [baseline] (256.851 ms) : 0, 256851
GlobalTracer [candidate] (257.083 ms) : 0, 257083
IAST [baseline] (27.144 ms) : 0, 27144
IAST [candidate] (27.066 ms) : 0, 27066
AppSec [baseline] (35.706 ms) : 0, 35706
AppSec [candidate] (35.427 ms) : 0, 35427
Debugger [baseline] (64.899 ms) : 0, 64899
Debugger [candidate] (64.905 ms) : 0, 64905
Remote Config [baseline] (551.246 µs) : 0, 551
Remote Config [candidate] (545.686 µs) : 0, 546
Telemetry [baseline] (8.431 ms) : 0, 8431
Telemetry [candidate] (8.465 ms) : 0, 8465
Flare Poller [baseline] (3.459 ms) : 0, 3459
Flare Poller [candidate] (3.46 ms) : 0, 3460
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/increase-smoke-slots
git_commit_date 1765360118 1765363555
git_commit_sha 1807b63 3114d14
release_version 1.57.0-SNAPSHOT~1807b637bb 1.57.0-SNAPSHOT~3114d146d7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765366077 1765366077
ci_job_id 1283063802 1283063802
ci_pipeline_id 85868086 85868086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-4hjrcf04 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-4hjrcf04 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+57.305µs; +139.313µs] or [+2.353%; +5.721%]		 unsure
[+129.682µs; +509.488µs] or [+1.815%; +7.131%]		 unstable
[-194.309op/s; +97.747op/s] or [-13.353%; +6.717%]		 2.534ms 7.464ms 1406.906op/s 2.435ms 7.145ms 1455.188op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-413.603µs; -169.222µs] or [-7.987%; -3.268%]		 unsure
[-823.137µs; -226.252µs] or [-6.685%; -1.837%]		 unstable
[-39.028op/s; +121.153op/s] or [-4.932%; +15.310%]		 4.887ms 11.789ms 832.406op/s 5.179ms 12.313ms 791.344op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~3114d146d7, baseline=1.57.0-SNAPSHOT~1807b637bb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.244 ms) : 1233, 1256
.   : milestone, 1244,
iast (3.141 ms) : 3097, 3185
.   : milestone, 3141,
iast_FULL (5.843 ms) : 5784, 5901
.   : milestone, 5843,
iast_GLOBAL (3.605 ms) : 3545, 3666
.   : milestone, 3605,
profiling (2.328 ms) : 2305, 2350
.   : milestone, 2328,
tracing (1.809 ms) : 1792, 1825
.   : milestone, 1809,
section candidate
no_agent (1.209 ms) : 1197, 1221
.   : milestone, 1209,
iast (3.254 ms) : 3213, 3294
.   : milestone, 3254,
iast_FULL (5.551 ms) : 5497, 5605
.   : milestone, 5551,
iast_GLOBAL (3.606 ms) : 3554, 3658
.   : milestone, 3606,
profiling (2.255 ms) : 2233, 2278
.   : milestone, 2255,
tracing (1.789 ms) : 1775, 1804
.   : milestone, 1789,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.244 ms [1.233 ms, 1.256 ms] -
iast 3.141 ms [3.097 ms, 3.185 ms] 1.897 ms (152.5%)
iast_FULL 5.843 ms [5.784 ms, 5.901 ms] 4.598 ms (369.6%)
iast_GLOBAL 3.605 ms [3.545 ms, 3.666 ms] 2.361 ms (189.8%)
profiling 2.328 ms [2.305 ms, 2.35 ms] 1.084 ms (87.1%)
tracing 1.809 ms [1.792 ms, 1.825 ms] 564.481 µs (45.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.209 ms [1.197 ms, 1.221 ms] -
iast 3.254 ms [3.213 ms, 3.294 ms] 2.045 ms (169.2%)
iast_FULL 5.551 ms [5.497 ms, 5.605 ms] 4.342 ms (359.2%)
iast_GLOBAL 3.606 ms [3.554 ms, 3.658 ms] 2.397 ms (198.3%)
profiling 2.255 ms [2.233 ms, 2.278 ms] 1.046 ms (86.6%)
tracing 1.789 ms [1.775 ms, 1.804 ms] 580.76 µs (48.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~3114d146d7, baseline=1.57.0-SNAPSHOT~1807b637bb
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.118 ms) : 17930, 18306
.   : milestone, 18118,
appsec (18.724 ms) : 18535, 18914
.   : milestone, 18724,
code_origins (17.538 ms) : 17366, 17711
.   : milestone, 17538,
iast (17.739 ms) : 17566, 17913
.   : milestone, 17739,
profiling (18.712 ms) : 18525, 18899
.   : milestone, 18712,
tracing (17.729 ms) : 17550, 17909
.   : milestone, 17729,
section candidate
no_agent (18.258 ms) : 18071, 18445
.   : milestone, 18258,
appsec (18.758 ms) : 18565, 18951
.   : milestone, 18758,
code_origins (17.598 ms) : 17423, 17773
.   : milestone, 17598,
iast (17.615 ms) : 17439, 17791
.   : milestone, 17615,
profiling (19.124 ms) : 18938, 19311
.   : milestone, 19124,
tracing (17.61 ms) : 17436, 17783
.   : milestone, 17610,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.118 ms [17.93 ms, 18.306 ms] -
appsec 18.724 ms [18.535 ms, 18.914 ms] 606.342 µs (3.3%)
code_origins 17.538 ms [17.366 ms, 17.711 ms] -579.675 µs (-3.2%)
iast 17.739 ms [17.566 ms, 17.913 ms] -378.566 µs (-2.1%)
profiling 18.712 ms [18.525 ms, 18.899 ms] 594.096 µs (3.3%)
tracing 17.729 ms [17.55 ms, 17.909 ms] -389.025 µs (-2.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.258 ms [18.071 ms, 18.445 ms] -
appsec 18.758 ms [18.565 ms, 18.951 ms] 499.769 µs (2.7%)
code_origins 17.598 ms [17.423 ms, 17.773 ms] -660.363 µs (-3.6%)
iast 17.615 ms [17.439 ms, 17.791 ms] -643.062 µs (-3.5%)
profiling 19.124 ms [18.938 ms, 19.311 ms] 866.099 µs (4.7%)
tracing 17.61 ms [17.436 ms, 17.783 ms] -648.494 µs (-3.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/increase-smoke-slots
git_commit_date 1765360118 1765363555
git_commit_sha 1807b63 3114d14
release_version 1.57.0-SNAPSHOT~1807b637bb 1.57.0-SNAPSHOT~3114d146d7
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765365769 1765365769
ci_job_id 1283063803 1283063803
ci_pipeline_id 85868086 85868086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-a0x5jgyc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-a0x5jgyc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.444ms; -1.101ms] or [-38.871%; -29.642%]		 2.443ms 3.716ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~3114d146d7, baseline=1.57.0-SNAPSHOT~1807b637bb
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.954 s) : 14954000, 14954000
.   : milestone, 14954000,
appsec (14.546 s) : 14546000, 14546000
.   : milestone, 14546000,
iast (17.939 s) : 17939000, 17939000
.   : milestone, 17939000,
iast_GLOBAL (17.95 s) : 17950000, 17950000
.   : milestone, 17950000,
profiling (14.552 s) : 14552000, 14552000
.   : milestone, 14552000,
tracing (14.617 s) : 14617000, 14617000
.   : milestone, 14617000,
section candidate
no_agent (15.281 s) : 15281000, 15281000
.   : milestone, 15281000,
appsec (14.465 s) : 14465000, 14465000
.   : milestone, 14465000,
iast (18.196 s) : 18196000, 18196000
.   : milestone, 18196000,
iast_GLOBAL (17.814 s) : 17814000, 17814000
.   : milestone, 17814000,
profiling (14.857 s) : 14857000, 14857000
.   : milestone, 14857000,
tracing (14.632 s) : 14632000, 14632000
.   : milestone, 14632000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.954 s [14.954 s, 14.954 s] -
appsec 14.546 s [14.546 s, 14.546 s] -408.0 ms (-2.7%)
iast 17.939 s [17.939 s, 17.939 s] 2.985 s (20.0%)
iast_GLOBAL 17.95 s [17.95 s, 17.95 s] 2.996 s (20.0%)
profiling 14.552 s [14.552 s, 14.552 s] -402.0 ms (-2.7%)
tracing 14.617 s [14.617 s, 14.617 s] -337.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.281 s [15.281 s, 15.281 s] -
appsec 14.465 s [14.465 s, 14.465 s] -816.0 ms (-5.3%)
iast 18.196 s [18.196 s, 18.196 s] 2.915 s (19.1%)
iast_GLOBAL 17.814 s [17.814 s, 17.814 s] 2.533 s (16.6%)
profiling 14.857 s [14.857 s, 14.857 s] -424.0 ms (-2.8%)
tracing 14.632 s [14.632 s, 14.632 s] -649.0 ms (-4.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~3114d146d7, baseline=1.57.0-SNAPSHOT~1807b637bb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.716 ms) : 3496, 3935
.   : milestone, 3716,
iast (2.202 ms) : 2138, 2266
.   : milestone, 2202,
iast_GLOBAL (2.25 ms) : 2186, 2314
.   : milestone, 2250,
profiling (2.062 ms) : 2009, 2114
.   : milestone, 2062,
tracing (2.049 ms) : 1998, 2100
.   : milestone, 2049,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.443 ms) : 2392, 2494
.   : milestone, 2443,
iast (2.208 ms) : 2144, 2272
.   : milestone, 2208,
iast_GLOBAL (2.25 ms) : 2186, 2314
.   : milestone, 2250,
profiling (2.066 ms) : 2013, 2120
.   : milestone, 2066,
tracing (2.031 ms) : 1981, 2082
.   : milestone, 2031,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 3.716 ms [3.496 ms, 3.935 ms] 2.243 ms (152.2%)
iast 2.202 ms [2.138 ms, 2.266 ms] 729.035 µs (49.5%)
iast_GLOBAL 2.25 ms [2.186 ms, 2.314 ms] 776.87 µs (52.7%)
profiling 2.062 ms [2.009 ms, 2.114 ms] 588.498 µs (39.9%)
tracing 2.049 ms [1.998 ms, 2.1 ms] 575.606 µs (39.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.443 ms [2.392 ms, 2.494 ms] 966.675 µs (65.5%)
iast 2.208 ms [2.144 ms, 2.272 ms] 731.655 µs (49.6%)
iast_GLOBAL 2.25 ms [2.186 ms, 2.314 ms] 773.781 µs (52.4%)
profiling 2.066 ms [2.013 ms, 2.12 ms] 590.121 µs (40.0%)
tracing 2.031 ms [1.981 ms, 2.082 ms] 555.187 µs (37.6%)

@bric3 bric3 changed the title Increase smoke tests splits Increase smoke tests slots Dec 10, 2025
@bric3 bric3 merged commit c6297d4 into master Dec 10, 2025
559 checks passed
@bric3 bric3 deleted the bdu/increase-smoke-slots branch December 10, 2025 14:10
@github-actions github-actions bot added this to the 1.57.0 milestone Dec 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarziali amarziali amarziali approved these changes

@erikayasuda erikayasuda Awaiting requested review from erikayasuda erikayasuda is a code owner automatically assigned from DataDog/apm-release-platform

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.57.0

Development

Successfully merging this pull request may close these issues.

3 participants

@bric3 @amarziali