Attempt to fix the flaky StackedOperatorsTest on CI #9648

ygree · 2025-10-01T19:14:44Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

…the context if it is already attached.

datadog-datadog-prod-us1 · 2025-10-01T19:37:45Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 68.73% (+10.72%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: d49ccdb | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-10-01T19:48:58Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ygree/resilience4j-flaky-test
git_commit_date	1759341231	1759345792
git_commit_sha	`c096994`	`d49ccdb`
release_version	1.54.0-SNAPSHOT~c096994488	1.54.0-SNAPSHOT~d49ccdb3f5

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1759347792	1759347792
ci_job_id	1158384684	1158384684
ci_pipeline_id	78123894	78123894
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-ysgk4rje 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-ysgk4rje 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~d49ccdb3f5, baseline=1.54.0-SNAPSHOT~c096994488

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.016 s) : 0, 1015621
Total [baseline] (8.688 s) : 0, 8688483
Agent [candidate] (1.013 s) : 0, 1012954
Total [candidate] (8.701 s) : 0, 8701463
section iast
Agent [baseline] (1.154 s) : 0, 1153537
Total [baseline] (9.293 s) : 0, 9293325
Agent [candidate] (1.149 s) : 0, 1149350
Total [candidate] (9.289 s) : 0, 9288625

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.016 s	-
Agent	iast	1.154 s	137.916 ms (13.6%)
Total	tracing	8.688 s	-
Total	iast	9.293 s	604.842 ms (7.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.013 s	-
Agent	iast	1.149 s	136.396 ms (13.5%)
Total	tracing	8.701 s	-
Total	iast	9.289 s	587.162 ms (6.7%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~d49ccdb3f5, baseline=1.54.0-SNAPSHOT~c096994488

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.502 ms) : 0, 1502
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (693.837 ms) : 0, 693837
BytebuddyAgent [candidate] (691.865 ms) : 0, 691865
GlobalTracer [baseline] (237.881 ms) : 0, 237881
GlobalTracer [candidate] (237.82 ms) : 0, 237820
AppSec [baseline] (33.029 ms) : 0, 33029
AppSec [candidate] (33.345 ms) : 0, 33345
Debugger [baseline] (6.428 ms) : 0, 6428
Debugger [candidate] (6.391 ms) : 0, 6391
Remote Config [baseline] (684.877 µs) : 0, 685
Remote Config [candidate] (675.552 µs) : 0, 676
Telemetry [baseline] (9.154 ms) : 0, 9154
Telemetry [candidate] (9.078 ms) : 0, 9078
Flare Poller [baseline] (11.914 ms) : 0, 11914
Flare Poller [candidate] (11.161 ms) : 0, 11161
section iast
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (820.304 ms) : 0, 820304
BytebuddyAgent [candidate] (816.185 ms) : 0, 816185
GlobalTracer [baseline] (229.02 ms) : 0, 229020
GlobalTracer [candidate] (229.018 ms) : 0, 229018
AppSec [baseline] (35.478 ms) : 0, 35478
AppSec [candidate] (35.408 ms) : 0, 35408
Debugger [baseline] (6.067 ms) : 0, 6067
Debugger [candidate] (6.057 ms) : 0, 6057
Remote Config [baseline] (598.507 µs) : 0, 599
Remote Config [candidate] (585.74 µs) : 0, 586
Telemetry [baseline] (8.187 ms) : 0, 8187
Telemetry [candidate] (8.333 ms) : 0, 8333
Flare Poller [baseline] (4.311 ms) : 0, 4311
Flare Poller [candidate] (4.304 ms) : 0, 4304
IAST [baseline] (26.804 ms) : 0, 26804
IAST [candidate] (26.792 ms) : 0, 26792

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~d49ccdb3f5, baseline=1.54.0-SNAPSHOT~c096994488

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.013 s) : 0, 1012804
Total [baseline] (10.659 s) : 0, 10659319
Agent [candidate] (1.017 s) : 0, 1016898
Total [candidate] (10.675 s) : 0, 10674971
section appsec
Agent [baseline] (1.19 s) : 0, 1189577
Total [baseline] (11.092 s) : 0, 11092437
Agent [candidate] (1.194 s) : 0, 1194427
Total [candidate] (11.054 s) : 0, 11054213
section iast
Agent [baseline] (1.145 s) : 0, 1145294
Total [baseline] (10.965 s) : 0, 10965014
Agent [candidate] (1.148 s) : 0, 1148400
Total [candidate] (10.928 s) : 0, 10927954
section profiling
Agent [baseline] (1.158 s) : 0, 1157892
Total [baseline] (11.058 s) : 0, 11057971
Agent [candidate] (1.156 s) : 0, 1155971
Total [candidate] (10.057 s) : 0, 10056969

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.013 s	-
Agent	appsec	1.19 s	176.773 ms (17.5%)
Agent	iast	1.145 s	132.49 ms (13.1%)
Agent	profiling	1.158 s	145.088 ms (14.3%)
Total	tracing	10.659 s	-
Total	appsec	11.092 s	433.117 ms (4.1%)
Total	iast	10.965 s	305.695 ms (2.9%)
Total	profiling	11.058 s	398.651 ms (3.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.017 s	-
Agent	appsec	1.194 s	177.529 ms (17.5%)
Agent	iast	1.148 s	131.501 ms (12.9%)
Agent	profiling	1.156 s	139.073 ms (13.7%)
Total	tracing	10.675 s	-
Total	appsec	11.054 s	379.243 ms (3.6%)
Total	iast	10.928 s	252.984 ms (2.4%)
Total	profiling	10.057 s	-618.002 ms (-5.8%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~d49ccdb3f5, baseline=1.54.0-SNAPSHOT~c096994488

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.495 ms) : 0, 1495
BytebuddyAgent [baseline] (691.636 ms) : 0, 691636
BytebuddyAgent [candidate] (696.22 ms) : 0, 696220
GlobalTracer [baseline] (237.657 ms) : 0, 237657
GlobalTracer [candidate] (238.288 ms) : 0, 238288
AppSec [baseline] (32.986 ms) : 0, 32986
AppSec [candidate] (33.086 ms) : 0, 33086
Debugger [baseline] (6.392 ms) : 0, 6392
Debugger [candidate] (6.411 ms) : 0, 6411
Remote Config [baseline] (681.595 µs) : 0, 682
Remote Config [candidate] (684.535 µs) : 0, 685
Telemetry [baseline] (8.986 ms) : 0, 8986
Telemetry [candidate] (9.208 ms) : 0, 9208
Flare Poller [baseline] (11.648 ms) : 0, 11648
Flare Poller [candidate] (10.134 ms) : 0, 10134
section appsec
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (717.513 ms) : 0, 717513
BytebuddyAgent [candidate] (719.731 ms) : 0, 719731
GlobalTracer [baseline] (229.903 ms) : 0, 229903
GlobalTracer [candidate] (231.442 ms) : 0, 231442
IAST [baseline] (25.08 ms) : 0, 25080
IAST [candidate] (25.275 ms) : 0, 25275
AppSec [baseline] (173.892 ms) : 0, 173892
AppSec [candidate] (172.923 ms) : 0, 172923
Debugger [baseline] (6.087 ms) : 0, 6087
Debugger [candidate] (6.172 ms) : 0, 6172
Remote Config [baseline] (643.389 µs) : 0, 643
Remote Config [candidate] (648.049 µs) : 0, 648
Telemetry [baseline] (9.845 ms) : 0, 9845
Telemetry [candidate] (11.416 ms) : 0, 11416
Flare Poller [baseline] (3.988 ms) : 0, 3988
Flare Poller [candidate] (4.088 ms) : 0, 4088
section iast
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.482 ms) : 0, 1482
BytebuddyAgent [baseline] (814.162 ms) : 0, 814162
BytebuddyAgent [candidate] (816.532 ms) : 0, 816532
GlobalTracer [baseline] (227.353 ms) : 0, 227353
GlobalTracer [candidate] (228.366 ms) : 0, 228366
IAST [baseline] (26.561 ms) : 0, 26561
IAST [candidate] (26.567 ms) : 0, 26567
AppSec [baseline] (35.309 ms) : 0, 35309
AppSec [candidate] (34.983 ms) : 0, 34983
Debugger [baseline] (6.032 ms) : 0, 6032
Debugger [candidate] (6.102 ms) : 0, 6102
Remote Config [baseline] (591.44 µs) : 0, 591
Remote Config [candidate] (595.667 µs) : 0, 596
Telemetry [baseline] (8.257 ms) : 0, 8257
Telemetry [candidate] (8.118 ms) : 0, 8118
Flare Poller [baseline] (4.287 ms) : 0, 4287
Flare Poller [candidate] (4.284 ms) : 0, 4284
section profiling
crashtracking [baseline] (1.425 ms) : 0, 1425
crashtracking [candidate] (1.415 ms) : 0, 1415
BytebuddyAgent [baseline] (721.955 ms) : 0, 721955
BytebuddyAgent [candidate] (720.368 ms) : 0, 720368
GlobalTracer [baseline] (214.107 ms) : 0, 214107
GlobalTracer [candidate] (213.69 ms) : 0, 213690
AppSec [baseline] (32.591 ms) : 0, 32591
AppSec [candidate] (32.604 ms) : 0, 32604
Debugger [baseline] (6.548 ms) : 0, 6548
Debugger [candidate] (7.643 ms) : 0, 7643
Remote Config [baseline] (849.944 µs) : 0, 850
Remote Config [candidate] (751.875 µs) : 0, 752
Telemetry [baseline] (16.453 ms) : 0, 16453
Telemetry [candidate] (15.19 ms) : 0, 15190
Flare Poller [baseline] (4.225 ms) : 0, 4225
Flare Poller [candidate] (4.159 ms) : 0, 4159
ProfilingAgent [baseline] (104.557 ms) : 0, 104557
ProfilingAgent [candidate] (105.65 ms) : 0, 105650
Profiling [baseline] (107.852 ms) : 0, 107852
Profiling [candidate] (108.274 ms) : 0, 108274

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ygree/resilience4j-flaky-test
git_commit_date	1759341231	1759345792
git_commit_sha	`c096994`	`d49ccdb`
release_version	1.54.0-SNAPSHOT~c096994488	1.54.0-SNAPSHOT~d49ccdb3f5

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1759347498	1759347498
ci_job_id	1158384686	1158384686
ci_pipeline_id	78123894	78123894
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-ghomynxi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-ghomynxi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+298.841µs; +629.769µs] or [+3.217%; +6.779%]	unstable [-84.397op/s; +37.147op/s] or [-16.887%; +7.433%]	9.754ms	476.156op/s	9.290ms	499.781op/s
scenario:load:insecure-bank:iast:high_load	better [-693.045µs; -339.835µs] or [-6.889%; -3.378%]	unstable [-53.869op/s; +73.881op/s] or [-11.665%; +15.998%]	9.543ms	471.818op/s	10.060ms	461.812op/s
scenario:load:petclinic:code_origins:high_load	worse [+2.250ms; +3.056ms] or [+5.283%; +7.174%]	unstable [-13.925op/s; +1.100op/s] or [-12.677%; +1.002%]	45.243ms	103.438op/s	42.591ms	109.850op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~d49ccdb3f5, baseline=1.54.0-SNAPSHOT~c096994488
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.395 ms) : 4339, 4451
.   : milestone, 4395,
iast (10.06 ms) : 9889, 10230
.   : milestone, 10060,
iast_FULL (14.767 ms) : 14473, 15061
.   : milestone, 14767,
iast_GLOBAL (10.578 ms) : 10391, 10765
.   : milestone, 10578,
profiling (9.29 ms) : 9137, 9442
.   : milestone, 9290,
tracing (7.811 ms) : 7693, 7929
.   : milestone, 7811,
section candidate
no_agent (4.306 ms) : 4256, 4355
.   : milestone, 4306,
iast (9.543 ms) : 9385, 9701
.   : milestone, 9543,
iast_FULL (14.977 ms) : 14683, 15270
.   : milestone, 14977,
iast_GLOBAL (10.704 ms) : 10506, 10902
.   : milestone, 10704,
profiling (9.754 ms) : 9599, 9909
.   : milestone, 9754,
tracing (8.08 ms) : 7963, 8198
.   : milestone, 8080,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.395 ms [4.339 ms, 4.451 ms]	-
iast	10.06 ms [9.889 ms, 10.23 ms]	5.664 ms (128.9%)
iast_FULL	14.767 ms [14.473 ms, 15.061 ms]	10.372 ms (236.0%)
iast_GLOBAL	10.578 ms [10.391 ms, 10.765 ms]	6.183 ms (140.7%)
profiling	9.29 ms [9.137 ms, 9.442 ms]	4.894 ms (111.3%)
tracing	7.811 ms [7.693 ms, 7.929 ms]	3.416 ms (77.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.306 ms [4.256 ms, 4.355 ms]	-
iast	9.543 ms [9.385 ms, 9.701 ms]	5.237 ms (121.6%)
iast_FULL	14.977 ms [14.683 ms, 15.27 ms]	10.671 ms (247.8%)
iast_GLOBAL	10.704 ms [10.506 ms, 10.902 ms]	6.398 ms (148.6%)
profiling	9.754 ms [9.599 ms, 9.909 ms]	5.448 ms (126.5%)
tracing	8.08 ms [7.963 ms, 8.198 ms]	3.774 ms (87.7%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~d49ccdb3f5, baseline=1.54.0-SNAPSHOT~c096994488
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.598 ms) : 36296, 36900
.   : milestone, 36598,
appsec (49.566 ms) : 49128, 50004
.   : milestone, 49566,
code_origins (42.591 ms) : 42235, 42946
.   : milestone, 42591,
iast (45.136 ms) : 44741, 45530
.   : milestone, 45136,
profiling (48.31 ms) : 47899, 48721
.   : milestone, 48310,
tracing (44.313 ms) : 43935, 44691
.   : milestone, 44313,
section candidate
no_agent (37.515 ms) : 37219, 37812
.   : milestone, 37515,
appsec (48.145 ms) : 47726, 48564
.   : milestone, 48145,
code_origins (45.243 ms) : 44851, 45635
.   : milestone, 45243,
iast (44.41 ms) : 44037, 44784
.   : milestone, 44410,
profiling (48.121 ms) : 47655, 48587
.   : milestone, 48121,
tracing (44.897 ms) : 44500, 45294
.   : milestone, 44897,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.598 ms [36.296 ms, 36.9 ms]	-
appsec	49.566 ms [49.128 ms, 50.004 ms]	12.968 ms (35.4%)
code_origins	42.591 ms [42.235 ms, 42.946 ms]	5.992 ms (16.4%)
iast	45.136 ms [44.741 ms, 45.53 ms]	8.537 ms (23.3%)
profiling	48.31 ms [47.899 ms, 48.721 ms]	11.711 ms (32.0%)
tracing	44.313 ms [43.935 ms, 44.691 ms]	7.715 ms (21.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.515 ms [37.219 ms, 37.812 ms]	-
appsec	48.145 ms [47.726 ms, 48.564 ms]	10.63 ms (28.3%)
code_origins	45.243 ms [44.851 ms, 45.635 ms]	7.728 ms (20.6%)
iast	44.41 ms [44.037 ms, 44.784 ms]	6.895 ms (18.4%)
profiling	48.121 ms [47.655 ms, 48.587 ms]	10.606 ms (28.3%)
tracing	44.897 ms [44.5 ms, 45.294 ms]	7.382 ms (19.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	ygree/resilience4j-flaky-test
git_commit_date	1759341231	1759345792
git_commit_sha	`c096994`	`d49ccdb`
release_version	1.54.0-SNAPSHOT~c096994488	1.54.0-SNAPSHOT~d49ccdb3f5

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1759348043	1759348043
ci_job_id	1158384687	1158384687
ci_pipeline_id	78123894	78123894
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-ibh2o2fq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-ibh2o2fq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~d49ccdb3f5, baseline=1.54.0-SNAPSHOT~c096994488
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.953 s) : 14953000, 14953000
.   : milestone, 14953000,
appsec (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
iast (18.597 s) : 18597000, 18597000
.   : milestone, 18597000,
iast_GLOBAL (17.607 s) : 17607000, 17607000
.   : milestone, 17607000,
profiling (15.482 s) : 15482000, 15482000
.   : milestone, 15482000,
tracing (15.31 s) : 15310000, 15310000
.   : milestone, 15310000,
section candidate
no_agent (15.531 s) : 15531000, 15531000
.   : milestone, 15531000,
appsec (15.091 s) : 15091000, 15091000
.   : milestone, 15091000,
iast (18.667 s) : 18667000, 18667000
.   : milestone, 18667000,
iast_GLOBAL (17.977 s) : 17977000, 17977000
.   : milestone, 17977000,
profiling (15.538 s) : 15538000, 15538000
.   : milestone, 15538000,
tracing (15.221 s) : 15221000, 15221000
.   : milestone, 15221000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.953 s [14.953 s, 14.953 s]	-
appsec	15.049 s [15.049 s, 15.049 s]	96.0 ms (0.6%)
iast	18.597 s [18.597 s, 18.597 s]	3.644 s (24.4%)
iast_GLOBAL	17.607 s [17.607 s, 17.607 s]	2.654 s (17.7%)
profiling	15.482 s [15.482 s, 15.482 s]	529.0 ms (3.5%)
tracing	15.31 s [15.31 s, 15.31 s]	357.0 ms (2.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.531 s [15.531 s, 15.531 s]	-
appsec	15.091 s [15.091 s, 15.091 s]	-440.0 ms (-2.8%)
iast	18.667 s [18.667 s, 18.667 s]	3.136 s (20.2%)
iast_GLOBAL	17.977 s [17.977 s, 17.977 s]	2.446 s (15.7%)
profiling	15.538 s [15.538 s, 15.538 s]	7.0 ms (0.0%)
tracing	15.221 s [15.221 s, 15.221 s]	-310.0 ms (-2.0%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~d49ccdb3f5, baseline=1.54.0-SNAPSHOT~c096994488
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.515 ms) : 2462, 2569
.   : milestone, 2515,
iast (2.212 ms) : 2149, 2275
.   : milestone, 2212,
iast_GLOBAL (2.251 ms) : 2188, 2314
.   : milestone, 2251,
profiling (2.07 ms) : 2017, 2122
.   : milestone, 2070,
tracing (2.018 ms) : 1968, 2067
.   : milestone, 2018,
section candidate
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.47 ms) : 2419, 2521
.   : milestone, 2470,
iast (2.209 ms) : 2146, 2272
.   : milestone, 2209,
iast_GLOBAL (2.25 ms) : 2186, 2314
.   : milestone, 2250,
profiling (2.069 ms) : 2016, 2121
.   : milestone, 2069,
tracing (2.021 ms) : 1972, 2070
.   : milestone, 2021,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	2.515 ms [2.462 ms, 2.569 ms]	1.043 ms (70.8%)
iast	2.212 ms [2.149 ms, 2.275 ms]	739.446 µs (50.2%)
iast_GLOBAL	2.251 ms [2.188 ms, 2.314 ms]	778.88 µs (52.9%)
profiling	2.07 ms [2.017 ms, 2.122 ms]	597.598 µs (40.6%)
tracing	2.018 ms [1.968 ms, 2.067 ms]	545.234 µs (37.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.469 ms [1.458 ms, 1.481 ms]	-
appsec	2.47 ms [2.419 ms, 2.521 ms]	1.001 ms (68.1%)
iast	2.209 ms [2.146 ms, 2.272 ms]	739.472 µs (50.3%)
iast_GLOBAL	2.25 ms [2.186 ms, 2.314 ms]	780.577 µs (53.1%)
profiling	2.069 ms [2.016 ms, 2.121 ms]	599.116 µs (40.8%)
tracing	2.021 ms [1.972 ms, 2.07 ms]	551.814 µs (37.6%)

Attempt to fix the flaky StackedOperatorsTest on CI by not attaching …

d49ccdb

…the context if it is already attached.

ygree self-assigned this Oct 1, 2025

ygree added the tag: flaky test Flaky tests label Oct 1, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Attempt to fix the flaky StackedOperatorsTest on CI #9648

Attempt to fix the flaky StackedOperatorsTest on CI #9648

Uh oh!

ygree commented Oct 1, 2025

Uh oh!

datadog-datadog-prod-us1 bot commented Oct 1, 2025

Uh oh!

pr-commenter bot commented Oct 1, 2025

Uh oh!

Uh oh!

Attempt to fix the flaky StackedOperatorsTest on CI #9648

Are you sure you want to change the base?

Attempt to fix the flaky StackedOperatorsTest on CI #9648

Uh oh!

Conversation

ygree commented Oct 1, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-datadog-prod-us1 bot commented Oct 1, 2025

Uh oh!

pr-commenter bot commented Oct 1, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!