Skip to content

Conversation

sarahchen6
Copy link
Contributor

What Does This Do

Update instrumentation gradle file tasks to use lazy API formatting.

Motivation

Build improvements

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Sep 30, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Sep 30, 2025

🎯 Code Coverage
Patch Coverage: 100.00%
Total Coverage: 87.80% (+28.10%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 6a44eef | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 30, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759924549 1759936929
git_commit_sha a56894b 6a44eef
release_version 1.55.0-SNAPSHOT~a56894b54b 1.54.0-SNAPSHOT~6a44eef3fb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759938657 1759938657
ci_job_id 1169806570 1169806570
ci_pipeline_id 78744143 78744143
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-dqmt3s7u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-dqmt3s7u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~6a44eef3fb, baseline=1.55.0-SNAPSHOT~a56894b54b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.017 s) : 0, 1017249
Total [baseline] (10.744 s) : 0, 10743994
Agent [candidate] (1.021 s) : 0, 1021385
Total [candidate] (10.824 s) : 0, 10823927
section appsec
Agent [baseline] (1.193 s) : 0, 1193143
Total [baseline] (11.025 s) : 0, 11024891
Agent [candidate] (1.196 s) : 0, 1195559
Total [candidate] (11.074 s) : 0, 11073815
section iast
Agent [baseline] (1.147 s) : 0, 1146631
Total [baseline] (7.596 s) : 0, 7596035
Agent [candidate] (1.162 s) : 0, 1161613
Total [candidate] (11.091 s) : 0, 11091028
section profiling
Agent [baseline] (1.16 s) : 0, 1159581
Total [baseline] (11.043 s) : 0, 11042685
Agent [candidate] (1.167 s) : 0, 1166872
Total [candidate] (11.151 s) : 0, 11150907
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.017 s -
Agent appsec 1.193 s 175.894 ms (17.3%)
Agent iast 1.147 s 129.382 ms (12.7%)
Agent profiling 1.16 s 142.332 ms (14.0%)
Total tracing 10.744 s -
Total appsec 11.025 s 280.897 ms (2.6%)
Total iast 7.596 s -3.148 s (-29.3%)
Total profiling 11.043 s 298.691 ms (2.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent appsec 1.196 s 174.174 ms (17.1%)
Agent iast 1.162 s 140.227 ms (13.7%)
Agent profiling 1.167 s 145.486 ms (14.2%)
Total tracing 10.824 s -
Total appsec 11.074 s 249.888 ms (2.3%)
Total iast 11.091 s 267.101 ms (2.5%)
Total profiling 11.151 s 326.981 ms (3.0%)
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~6a44eef3fb, baseline=1.55.0-SNAPSHOT~a56894b54b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.475 ms) : 0, 1475
BytebuddyAgent [baseline] (694.3 ms) : 0, 694300
BytebuddyAgent [candidate] (696.942 ms) : 0, 696942
GlobalTracer [baseline] (241.999 ms) : 0, 241999
GlobalTracer [candidate] (243.226 ms) : 0, 243226
AppSec [baseline] (32.373 ms) : 0, 32373
AppSec [candidate] (32.463 ms) : 0, 32463
Debugger [baseline] (6.365 ms) : 0, 6365
Debugger [candidate] (6.449 ms) : 0, 6449
Remote Config [baseline] (699.523 µs) : 0, 700
Remote Config [candidate] (709.159 µs) : 0, 709
Telemetry [baseline] (9.258 ms) : 0, 9258
Telemetry [candidate] (9.182 ms) : 0, 9182
Flare Poller [baseline] (9.505 ms) : 0, 9505
Flare Poller [candidate] (9.623 ms) : 0, 9623
section appsec
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (717.399 ms) : 0, 717399
BytebuddyAgent [candidate] (718.01 ms) : 0, 718010
GlobalTracer [baseline] (234.228 ms) : 0, 234228
GlobalTracer [candidate] (235.183 ms) : 0, 235183
AppSec [baseline] (175.299 ms) : 0, 175299
AppSec [candidate] (175.728 ms) : 0, 175728
Debugger [baseline] (6.051 ms) : 0, 6051
Debugger [candidate] (6.087 ms) : 0, 6087
Remote Config [baseline] (643.067 µs) : 0, 643
Remote Config [candidate] (640.142 µs) : 0, 640
Telemetry [baseline] (8.39 ms) : 0, 8390
Telemetry [candidate] (8.434 ms) : 0, 8434
Flare Poller [baseline] (3.91 ms) : 0, 3910
Flare Poller [candidate] (3.992 ms) : 0, 3992
IAST [baseline] (24.662 ms) : 0, 24662
IAST [candidate] (24.856 ms) : 0, 24856
section iast
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (812.653 ms) : 0, 812653
BytebuddyAgent [candidate] (821.685 ms) : 0, 821685
GlobalTracer [baseline] (231.125 ms) : 0, 231125
GlobalTracer [candidate] (234.929 ms) : 0, 234929
AppSec [baseline] (34.638 ms) : 0, 34638
AppSec [candidate] (35.59 ms) : 0, 35590
Debugger [baseline] (6.104 ms) : 0, 6104
Debugger [candidate] (6.161 ms) : 0, 6161
Remote Config [baseline] (594.622 µs) : 0, 595
Remote Config [candidate] (632.27 µs) : 0, 632
Telemetry [baseline] (8.642 ms) : 0, 8642
Telemetry [candidate] (8.66 ms) : 0, 8660
Flare Poller [baseline] (4.206 ms) : 0, 4206
Flare Poller [candidate] (4.282 ms) : 0, 4282
IAST [baseline] (25.701 ms) : 0, 25701
IAST [candidate] (26.731 ms) : 0, 26731
section profiling
ProfilingAgent [baseline] (107.101 ms) : 0, 107101
ProfilingAgent [candidate] (108.252 ms) : 0, 108252
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (719.946 ms) : 0, 719946
BytebuddyAgent [candidate] (723.788 ms) : 0, 723788
GlobalTracer [baseline] (217.228 ms) : 0, 217228
GlobalTracer [candidate] (218.881 ms) : 0, 218881
AppSec [baseline] (32.542 ms) : 0, 32542
AppSec [candidate] (32.776 ms) : 0, 32776
Debugger [baseline] (6.463 ms) : 0, 6463
Debugger [candidate] (6.49 ms) : 0, 6490
Remote Config [baseline] (695.102 µs) : 0, 695
Remote Config [candidate] (705.457 µs) : 0, 705
Telemetry [baseline] (16.613 ms) : 0, 16613
Telemetry [candidate] (16.805 ms) : 0, 16805
Flare Poller [baseline] (4.21 ms) : 0, 4210
Flare Poller [candidate] (4.229 ms) : 0, 4229
Profiling [baseline] (108.496 ms) : 0, 108496
Profiling [candidate] (109.537 ms) : 0, 109537
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~6a44eef3fb, baseline=1.55.0-SNAPSHOT~a56894b54b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.022 s) : 0, 1022447
Total [baseline] (8.68 s) : 0, 8679954
Agent [candidate] (1.022 s) : 0, 1021622
Total [candidate] (8.737 s) : 0, 8737215
section iast
Agent [baseline] (1.151 s) : 0, 1151032
Total [baseline] (9.262 s) : 0, 9261527
Agent [candidate] (1.173 s) : 0, 1172557
Total [candidate] (9.347 s) : 0, 9347357
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.022 s -
Agent iast 1.151 s 128.585 ms (12.6%)
Total tracing 8.68 s -
Total iast 9.262 s 581.573 ms (6.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.022 s -
Agent iast 1.173 s 150.935 ms (14.8%)
Total tracing 8.737 s -
Total iast 9.347 s 610.142 ms (7.0%)
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~6a44eef3fb, baseline=1.55.0-SNAPSHOT~a56894b54b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (696.085 ms) : 0, 696085
BytebuddyAgent [candidate] (695.986 ms) : 0, 695986
GlobalTracer [baseline] (242.814 ms) : 0, 242814
GlobalTracer [candidate] (242.996 ms) : 0, 242996
AppSec [baseline] (32.61 ms) : 0, 32610
AppSec [candidate] (32.324 ms) : 0, 32324
Debugger [baseline] (6.438 ms) : 0, 6438
Debugger [candidate] (6.485 ms) : 0, 6485
Remote Config [baseline] (735.823 µs) : 0, 736
Remote Config [candidate] (708.182 µs) : 0, 708
Telemetry [baseline] (9.275 ms) : 0, 9275
Telemetry [candidate] (9.167 ms) : 0, 9167
Flare Poller [baseline] (11.792 ms) : 0, 11792
Flare Poller [candidate] (11.312 ms) : 0, 11312
section iast
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.475 ms) : 0, 1475
BytebuddyAgent [baseline] (815.925 ms) : 0, 815925
BytebuddyAgent [candidate] (830.694 ms) : 0, 830694
GlobalTracer [baseline] (231.816 ms) : 0, 231816
GlobalTracer [candidate] (235.842 ms) : 0, 235842
AppSec [baseline] (34.752 ms) : 0, 34752
AppSec [candidate] (35.534 ms) : 0, 35534
Debugger [baseline] (6.061 ms) : 0, 6061
Debugger [candidate] (6.247 ms) : 0, 6247
Remote Config [baseline] (623.182 µs) : 0, 623
Remote Config [candidate] (653.672 µs) : 0, 654
Telemetry [baseline] (8.493 ms) : 0, 8493
Telemetry [candidate] (8.998 ms) : 0, 8998
Flare Poller [baseline] (4.185 ms) : 0, 4185
Flare Poller [candidate] (4.325 ms) : 0, 4325
IAST [baseline] (26.351 ms) : 0, 26351
IAST [candidate] (27.296 ms) : 0, 27296
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759924549 1759936929
git_commit_sha a56894b 6a44eef
release_version 1.55.0-SNAPSHOT~a56894b54b 1.54.0-SNAPSHOT~6a44eef3fb
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759938417 1759938417
ci_job_id 1169806572 1169806572
ci_pipeline_id 78744143 78744143
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-4pt627gt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-4pt627gt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load worse
[+194.329µs; +446.642µs] or [+2.517%; +5.786%]
unstable
[-98.764op/s; +51.701op/s] or [-16.463%; +8.618%]
8.040ms 576.375op/s 7.720ms 599.906op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-945.430µs; -542.651µs] or [-8.640%; -4.959%]
unstable
[-21.946op/s; +83.258op/s] or [-5.164%; +19.592%]
10.199ms 455.625op/s 10.943ms 424.969op/s
scenario:load:insecure-bank:profiling:high_load worse
[+240.874µs; +530.345µs] or [+2.832%; +6.235%]
unstable
[-91.125op/s; +44.625op/s] or [-16.718%; +8.187%]
8.892ms 521.812op/s 8.507ms 545.062op/s
scenario:load:petclinic:profiling:high_load better
[-1.930ms; -0.992ms] or [-3.941%; -2.025%]
unstable
[-4.513op/s; +10.338op/s] or [-4.721%; +10.815%]
47.504ms 98.500op/s 48.965ms 95.588op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~6a44eef3fb, baseline=1.55.0-SNAPSHOT~a56894b54b
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.377 ms) : 4327, 4427
.   : milestone, 4377,
iast (9.648 ms) : 9488, 9809
.   : milestone, 9648,
iast_FULL (14.392 ms) : 14108, 14675
.   : milestone, 14392,
iast_GLOBAL (10.943 ms) : 10747, 11139
.   : milestone, 10943,
profiling (8.507 ms) : 8376, 8637
.   : milestone, 8507,
tracing (7.72 ms) : 7602, 7837
.   : milestone, 7720,
section candidate
no_agent (4.449 ms) : 4395, 4502
.   : milestone, 4449,
iast (10.007 ms) : 9838, 10176
.   : milestone, 10007,
iast_FULL (13.969 ms) : 13689, 14249
.   : milestone, 13969,
iast_GLOBAL (10.199 ms) : 10021, 10377
.   : milestone, 10199,
profiling (8.892 ms) : 8754, 9031
.   : milestone, 8892,
tracing (8.04 ms) : 7923, 8157
.   : milestone, 8040,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.377 ms [4.327 ms, 4.427 ms] -
iast 9.648 ms [9.488 ms, 9.809 ms] 5.271 ms (120.4%)
iast_FULL 14.392 ms [14.108 ms, 14.675 ms] 10.015 ms (228.8%)
iast_GLOBAL 10.943 ms [10.747 ms, 11.139 ms] 6.566 ms (150.0%)
profiling 8.507 ms [8.376 ms, 8.637 ms] 4.129 ms (94.3%)
tracing 7.72 ms [7.602 ms, 7.837 ms] 3.342 ms (76.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.449 ms [4.395 ms, 4.502 ms] -
iast 10.007 ms [9.838 ms, 10.176 ms] 5.559 ms (125.0%)
iast_FULL 13.969 ms [13.689 ms, 14.249 ms] 9.52 ms (214.0%)
iast_GLOBAL 10.199 ms [10.021 ms, 10.377 ms] 5.75 ms (129.3%)
profiling 8.892 ms [8.754 ms, 9.031 ms] 4.444 ms (99.9%)
tracing 8.04 ms [7.923 ms, 8.157 ms] 3.592 ms (80.7%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~6a44eef3fb, baseline=1.55.0-SNAPSHOT~a56894b54b
    dateFormat X
    axisFormat %s
section baseline
no_agent (35.98 ms) : 35690, 36271
.   : milestone, 35980,
appsec (49.197 ms) : 48756, 49639
.   : milestone, 49197,
code_origins (44.894 ms) : 44503, 45286
.   : milestone, 44894,
iast (44.492 ms) : 44112, 44872
.   : milestone, 44492,
profiling (48.965 ms) : 48528, 49401
.   : milestone, 48965,
tracing (44.644 ms) : 44262, 45025
.   : milestone, 44644,
section candidate
no_agent (35.87 ms) : 35582, 36159
.   : milestone, 35870,
appsec (49.175 ms) : 48745, 49606
.   : milestone, 49175,
code_origins (44.36 ms) : 43982, 44738
.   : milestone, 44360,
iast (44.978 ms) : 44588, 45368
.   : milestone, 44978,
profiling (47.504 ms) : 47069, 47939
.   : milestone, 47504,
tracing (45.006 ms) : 44618, 45394
.   : milestone, 45006,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 35.98 ms [35.69 ms, 36.271 ms] -
appsec 49.197 ms [48.756 ms, 49.639 ms] 13.217 ms (36.7%)
code_origins 44.894 ms [44.503 ms, 45.286 ms] 8.914 ms (24.8%)
iast 44.492 ms [44.112 ms, 44.872 ms] 8.512 ms (23.7%)
profiling 48.965 ms [48.528 ms, 49.401 ms] 12.984 ms (36.1%)
tracing 44.644 ms [44.262 ms, 45.025 ms] 8.663 ms (24.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 35.87 ms [35.582 ms, 36.159 ms] -
appsec 49.175 ms [48.745 ms, 49.606 ms] 13.305 ms (37.1%)
code_origins 44.36 ms [43.982 ms, 44.738 ms] 8.49 ms (23.7%)
iast 44.978 ms [44.588 ms, 45.368 ms] 9.108 ms (25.4%)
profiling 47.504 ms [47.069 ms, 47.939 ms] 11.634 ms (32.4%)
tracing 45.006 ms [44.618 ms, 45.394 ms] 9.136 ms (25.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759924549 1759936929
git_commit_sha a56894b 6a44eef
release_version 1.55.0-SNAPSHOT~a56894b54b 1.54.0-SNAPSHOT~6a44eef3fb
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1759938936 1759938936
ci_job_id 1169806574 1169806574
ci_pipeline_id 78744143 78744143
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-m92dx30p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-m92dx30p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~6a44eef3fb, baseline=1.55.0-SNAPSHOT~a56894b54b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.671 ms) : 3455, 3888
.   : milestone, 3671,
iast (2.197 ms) : 2134, 2261
.   : milestone, 2197,
iast_GLOBAL (2.246 ms) : 2182, 2311
.   : milestone, 2246,
profiling (2.068 ms) : 2015, 2120
.   : milestone, 2068,
tracing (2.018 ms) : 1969, 2068
.   : milestone, 2018,
section candidate
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (3.711 ms) : 3492, 3930
.   : milestone, 3711,
iast (2.202 ms) : 2139, 2266
.   : milestone, 2202,
iast_GLOBAL (2.247 ms) : 2183, 2311
.   : milestone, 2247,
profiling (2.064 ms) : 2012, 2117
.   : milestone, 2064,
tracing (2.029 ms) : 1979, 2080
.   : milestone, 2029,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.671 ms [3.455 ms, 3.888 ms] 2.2 ms (149.5%)
iast 2.197 ms [2.134 ms, 2.261 ms] 725.914 µs (49.3%)
iast_GLOBAL 2.246 ms [2.182 ms, 2.311 ms] 774.913 µs (52.7%)
profiling 2.068 ms [2.015 ms, 2.12 ms] 596.176 µs (40.5%)
tracing 2.018 ms [1.969 ms, 2.068 ms] 546.782 µs (37.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 3.711 ms [3.492 ms, 3.93 ms] 2.243 ms (152.7%)
iast 2.202 ms [2.139 ms, 2.266 ms] 734.153 µs (50.0%)
iast_GLOBAL 2.247 ms [2.183 ms, 2.311 ms] 779.081 µs (53.1%)
profiling 2.064 ms [2.012 ms, 2.117 ms] 596.068 µs (40.6%)
tracing 2.029 ms [1.979 ms, 2.08 ms] 561.134 µs (38.2%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~6a44eef3fb, baseline=1.55.0-SNAPSHOT~a56894b54b
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.967 s) : 14967000, 14967000
.   : milestone, 14967000,
appsec (15.086 s) : 15086000, 15086000
.   : milestone, 15086000,
iast (18.418 s) : 18418000, 18418000
.   : milestone, 18418000,
iast_GLOBAL (17.983 s) : 17983000, 17983000
.   : milestone, 17983000,
profiling (15.395 s) : 15395000, 15395000
.   : milestone, 15395000,
tracing (15.048 s) : 15048000, 15048000
.   : milestone, 15048000,
section candidate
no_agent (15.253 s) : 15253000, 15253000
.   : milestone, 15253000,
appsec (15.051 s) : 15051000, 15051000
.   : milestone, 15051000,
iast (18.641 s) : 18641000, 18641000
.   : milestone, 18641000,
iast_GLOBAL (18.032 s) : 18032000, 18032000
.   : milestone, 18032000,
profiling (15.075 s) : 15075000, 15075000
.   : milestone, 15075000,
tracing (15.132 s) : 15132000, 15132000
.   : milestone, 15132000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.967 s [14.967 s, 14.967 s] -
appsec 15.086 s [15.086 s, 15.086 s] 119.0 ms (0.8%)
iast 18.418 s [18.418 s, 18.418 s] 3.451 s (23.1%)
iast_GLOBAL 17.983 s [17.983 s, 17.983 s] 3.016 s (20.2%)
profiling 15.395 s [15.395 s, 15.395 s] 428.0 ms (2.9%)
tracing 15.048 s [15.048 s, 15.048 s] 81.0 ms (0.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.253 s [15.253 s, 15.253 s] -
appsec 15.051 s [15.051 s, 15.051 s] -202.0 ms (-1.3%)
iast 18.641 s [18.641 s, 18.641 s] 3.388 s (22.2%)
iast_GLOBAL 18.032 s [18.032 s, 18.032 s] 2.779 s (18.2%)
profiling 15.075 s [15.075 s, 15.075 s] -178.0 ms (-1.2%)
tracing 15.132 s [15.132 s, 15.132 s] -121.0 ms (-0.8%)

@pr-commenter
Copy link

pr-commenter bot commented Sep 30, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759924549 1759936929
git_commit_sha a56894b 6a44eef
See matching parameters
Baseline Candidate
ci_job_date 1759938099 1759938099
ci_job_id 1169806581 1169806581
ci_pipeline_id 78744143 78744143
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@pr-commenter
Copy link

pr-commenter bot commented Oct 1, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759924549 1759936929
git_commit_sha a56894b 6a44eef
See matching parameters
Baseline Candidate
ci_job_date 1759938037 1759938037
ci_job_id 1169806580 1169806580
ci_pipeline_id 78744143 78744143
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@sarahchen6 sarahchen6 marked this pull request as ready for review October 7, 2025 20:51
@sarahchen6 sarahchen6 requested review from a team as code owners October 7, 2025 20:51
@sarahchen6 sarahchen6 enabled auto-merge (squash) October 8, 2025 15:44
@sarahchen6 sarahchen6 merged commit 3da04c5 into master Oct 8, 2025
536 checks passed
@sarahchen6 sarahchen6 deleted the sarahchen6/lazy-api-instrumentations branch October 8, 2025 16:15
@github-actions github-actions bot added this to the 1.55.0 milestone Oct 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants