Skip to content

Conversation

sabrenner
Copy link
Contributor

Description

Fixes a broken test blocking CI. Additionally, one of telemetry tags was incorrect. doing a grep for span.kind now in ddtrace/llmobs and tests/llmobs only reveals one instance, in defining our span context item key, which is fine.

Testing

Fixes the test blocking CI

Risks

None

@sabrenner sabrenner requested a review from a team as a code owner September 26, 2025 15:04
@sabrenner sabrenner added the changelog/no-changelog A changelog entry is not required for this PR. label Sep 26, 2025
Copy link
Contributor

CODEOWNERS have been resolved as:

ddtrace/llmobs/_telemetry.py                                            @DataDog/ml-observability
tests/llmobs/test_llmobs.py                                             @DataDog/ml-observability

@sabrenner sabrenner enabled auto-merge (squash) September 26, 2025 15:06
@emmettbutler
Copy link
Collaborator

@sabrenner in which pull request was the issue introduced, and did it run the affected tests? If not we should figure out what's missing from the suitespec.

@sabrenner
Copy link
Contributor Author

i think it might've been because #14617 was merged yesterday, which introduced the test and passed at the time, and then #14600 was merged today w/o getting that change from main. i think merge queue could've been the solution here (since we got rid of need to be rebased on latest main as a requirement for merging manually)

Copy link
Contributor

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 241 ± 3 ms.

The average import time from base is: 243 ± 4 ms.

The import time difference between this PR and base is: -2.3 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.000 ms (0.83%)
ddtrace.bootstrap.sitecustomize 1.318 ms (0.55%)
ddtrace.bootstrap.preload 1.318 ms (0.55%)
ddtrace.internal.remoteconfig.client 0.628 ms (0.26%)
ddtrace 0.682 ms (0.28%)
ddtrace.internal._unpatched 0.029 ms (0.01%)
json 0.029 ms (0.01%)
json.decoder 0.029 ms (0.01%)
re 0.029 ms (0.01%)
enum 0.029 ms (0.01%)
types 0.029 ms (0.01%)

@pr-commenter
Copy link

pr-commenter bot commented Sep 26, 2025

Performance SLOs

Comparing candidate sabrenner/fix-llmobs-span.kind-stuff (3ad35d7) with baseline main (d7e6134)

📈 Performance Regressions (1 suite)
📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.157µs (SLO: <10.000µs 📉 -58.4%) vs baseline: +0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +5.0%


✅ ospathbasename_noaspect

Time: ✅ 1.074µs (SLO: <10.000µs 📉 -89.3%) vs baseline: -0.7%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.2%


✅ ospathjoin_aspect

Time: ✅ 6.040µs (SLO: <10.000µs 📉 -39.6%) vs baseline: -0.8%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%


✅ ospathjoin_noaspect

Time: ✅ 2.291µs (SLO: <10.000µs 📉 -77.1%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ ospathnormcase_aspect

Time: ✅ 3.967µs (SLO: <10.000µs 📉 -60.3%) vs baseline: 📈 +14.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%


✅ ospathnormcase_noaspect

Time: ✅ 0.563µs (SLO: <10.000µs 📉 -94.4%) vs baseline: -1.8%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%


✅ ospathsplit_aspect

Time: ✅ 4.719µs (SLO: <10.000µs 📉 -52.8%) vs baseline: -0.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ ospathsplit_noaspect

Time: ✅ 1.586µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.8%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ ospathsplitdrive_aspect

Time: ✅ 3.682µs (SLO: <10.000µs 📉 -63.2%) vs baseline: +0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ ospathsplitdrive_noaspect

Time: ✅ 0.693µs (SLO: <10.000µs 📉 -93.1%) vs baseline: -1.6%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%


✅ ospathsplitext_aspect

Time: ✅ 4.498µs (SLO: <10.000µs 📉 -55.0%) vs baseline: -0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ ospathsplitext_noaspect

Time: ✅ 1.381µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

🟡 Near SLO Breach (4 suites)
🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.540ms (SLO: <22.300ms -7.9%) vs baseline: +0.2%

Memory: ✅ 65.332MB (SLO: <67.000MB -2.5%) vs baseline: +4.6%


✅ exception-replay-enabled

Time: ✅ 1.345ms (SLO: <1.450ms -7.3%) vs baseline: -0.4%

Memory: ✅ 64.364MB (SLO: <67.000MB -3.9%) vs baseline: +4.7%


✅ iast

Time: ✅ 20.436ms (SLO: <22.250ms -8.2%) vs baseline: -0.2%

Memory: ✅ 65.357MB (SLO: <67.000MB -2.5%) vs baseline: +4.8%


✅ profiler

Time: ✅ 15.302ms (SLO: <16.550ms -7.5%) vs baseline: ~same

Memory: ✅ 53.801MB (SLO: <54.500MB 🟡 -1.3%) vs baseline: +5.2%


✅ resource-renaming

Time: ✅ 20.540ms (SLO: <21.750ms -5.6%) vs baseline: ~same

Memory: ✅ 65.412MB (SLO: <67.000MB -2.4%) vs baseline: +4.7%


✅ span-code-origin

Time: ✅ 26.079ms (SLO: <28.200ms -7.5%) vs baseline: -0.4%

Memory: ✅ 67.517MB (SLO: <69.500MB -2.9%) vs baseline: +4.8%


✅ tracer

Time: ✅ 20.500ms (SLO: <21.750ms -5.7%) vs baseline: ~same

Memory: ✅ 65.320MB (SLO: <67.000MB -2.5%) vs baseline: +4.6%


✅ tracer-and-profiler

Time: ✅ 21.968ms (SLO: <23.500ms -6.5%) vs baseline: -0.2%

Memory: ✅ 66.709MB (SLO: <67.500MB 🟡 -1.2%) vs baseline: +4.8%


✅ tracer-dont-create-db-spans

Time: ✅ 19.319ms (SLO: <21.500ms 📉 -10.1%) vs baseline: -0.1%

Memory: ✅ 65.362MB (SLO: <66.000MB 🟡 -1.0%) vs baseline: +4.7%


✅ tracer-minimal

Time: ✅ 16.626ms (SLO: <17.500ms -5.0%) vs baseline: +0.4%

Memory: ✅ 65.341MB (SLO: <66.000MB 🟡 -1.0%) vs baseline: +5.2%


✅ tracer-native

Time: ✅ 20.471ms (SLO: <21.750ms -5.9%) vs baseline: ~same

Memory: ✅ 71.269MB (SLO: <72.500MB 🟡 -1.7%) vs baseline: +4.7%


✅ tracer-no-caches

Time: ✅ 18.423ms (SLO: <19.650ms -6.2%) vs baseline: ~same

Memory: ✅ 65.343MB (SLO: <67.000MB -2.5%) vs baseline: +4.6%


✅ tracer-no-databases

Time: ✅ 18.790ms (SLO: <20.100ms -6.5%) vs baseline: ~same

Memory: ✅ 65.233MB (SLO: <67.000MB -2.6%) vs baseline: +4.9%


✅ tracer-no-middleware

Time: ✅ 20.164ms (SLO: <21.500ms -6.2%) vs baseline: ~same

Memory: ✅ 65.365MB (SLO: <67.000MB -2.4%) vs baseline: +4.7%


✅ tracer-no-templates

Time: ✅ 20.374ms (SLO: <22.000ms -7.4%) vs baseline: +0.5%

Memory: ✅ 65.382MB (SLO: <67.000MB -2.4%) vs baseline: +4.8%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.069ms (SLO: <19.850ms -9.0%) vs baseline: +0.2%

Memory: ✅ 65.313MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.9%


✅ errortracking-enabled-user

Time: ✅ 18.119ms (SLO: <19.400ms -6.6%) vs baseline: +0.4%

Memory: ✅ 65.352MB (SLO: <66.500MB 🟡 -1.7%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 18.053ms (SLO: <19.450ms -7.2%) vs baseline: ~same

Memory: ✅ 65.333MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.9%


🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.574ms (SLO: <4.750ms -3.7%) vs baseline: +0.4%

Memory: ✅ 61.991MB (SLO: <65.000MB -4.6%) vs baseline: +5.0%


✅ appsec-post

Time: ✅ 6.570ms (SLO: <6.750ms -2.7%) vs baseline: -0.3%

Memory: ✅ 61.971MB (SLO: <65.000MB -4.7%) vs baseline: +4.9%


✅ appsec-telemetry

Time: ✅ 4.563ms (SLO: <4.750ms -3.9%) vs baseline: ~same

Memory: ✅ 61.971MB (SLO: <65.000MB -4.7%) vs baseline: +5.1%


✅ debugger

Time: ✅ 1.865ms (SLO: <2.000ms -6.8%) vs baseline: +0.7%

Memory: ✅ 45.475MB (SLO: <47.000MB -3.2%) vs baseline: +5.0%


✅ iast-get

Time: ✅ 1.861ms (SLO: <2.000ms -7.0%) vs baseline: -0.3%

Memory: ✅ 42.271MB (SLO: <49.000MB 📉 -13.7%) vs baseline: +4.6%


✅ profiler

Time: ✅ 1.916ms (SLO: <2.100ms -8.8%) vs baseline: +0.1%

Memory: ✅ 46.498MB (SLO: <47.000MB 🟡 -1.1%) vs baseline: +5.1%


✅ resource-renaming

Time: ✅ 3.381ms (SLO: <3.650ms -7.4%) vs baseline: +0.2%

Memory: ✅ 52.298MB (SLO: <53.500MB -2.2%) vs baseline: +5.1%


✅ tracer

Time: ✅ 3.374ms (SLO: <3.650ms -7.6%) vs baseline: +0.2%

Memory: ✅ 52.199MB (SLO: <53.500MB -2.4%) vs baseline: +4.9%


✅ tracer-native

Time: ✅ 3.373ms (SLO: <3.650ms -7.6%) vs baseline: ~same

Memory: ✅ 58.034MB (SLO: <60.000MB -3.3%) vs baseline: +4.5%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 45.314ms (SLO: <47.150ms -3.9%) vs baseline: +0.1%

Memory: ✅ 45.272MB (SLO: <47.000MB -3.7%) vs baseline: +4.9%


✅ add-metrics

Time: ✅ 323.487ms (SLO: <344.800ms -6.2%) vs baseline: +0.9%

Memory: ✅ 553.533MB (SLO: <562.000MB 🟡 -1.5%) vs baseline: +5.1%


✅ add-tags

Time: ✅ 291.051ms (SLO: <314.000ms -7.3%) vs baseline: +0.2%

Memory: ✅ 554.836MB (SLO: <563.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ get-context

Time: ✅ 84.890ms (SLO: <92.350ms -8.1%) vs baseline: +2.7%

Memory: ✅ 40.249MB (SLO: <46.500MB 📉 -13.4%) vs baseline: +4.7%


✅ is-recording

Time: ✅ 43.116ms (SLO: <44.500ms -3.1%) vs baseline: +0.9%

Memory: ✅ 44.613MB (SLO: <47.500MB -6.1%) vs baseline: +4.7%


✅ record-exception

Time: ✅ 61.684ms (SLO: <67.650ms -8.8%) vs baseline: -0.4%

Memory: ✅ 40.616MB (SLO: <47.000MB 📉 -13.6%) vs baseline: +5.1%


✅ set-status

Time: ✅ 48.636ms (SLO: <50.400ms -3.5%) vs baseline: -0.2%

Memory: ✅ 44.605MB (SLO: <47.000MB -5.1%) vs baseline: +4.9%


✅ start

Time: ✅ 42.356ms (SLO: <43.450ms -2.5%) vs baseline: +0.6%

Memory: ✅ 44.597MB (SLO: <47.000MB -5.1%) vs baseline: +4.8%


✅ start-finish

Time: ✅ 84.555ms (SLO: <88.000ms -3.9%) vs baseline: +1.8%

Memory: ✅ 34.603MB (SLO: <46.500MB 📉 -25.6%) vs baseline: +4.9%


✅ start-finish-telemetry

Time: ✅ 84.706ms (SLO: <89.000ms -4.8%) vs baseline: -0.4%

Memory: ✅ 34.583MB (SLO: <46.500MB 📉 -25.6%) vs baseline: +4.9%


✅ update-name

Time: ✅ 44.051ms (SLO: <45.150ms -2.4%) vs baseline: ~same

Memory: ✅ 44.959MB (SLO: <47.000MB -4.3%) vs baseline: +4.8%

⚠️ Unstable Tests (1 suite)
⚠️ coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.267µs (SLO: <20.000µs 📉 -33.7%) vs baseline: -0.3%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +5.2%


✅ context_with_data_no_listeners

Time: ✅ 3.259µs (SLO: <10.000µs 📉 -67.4%) vs baseline: -0.2%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +5.1%


✅ get_item_exists

Time: ✅ 0.586µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.8%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.9%


✅ get_item_missing

Time: ✅ 0.640µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +0.1%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +5.0%


✅ set_item

Time: ✅ 24.174µs (SLO: <30.000µs 📉 -19.4%) vs baseline: +0.5%

Memory: ✅ 31.733MB (SLO: <33.500MB -5.3%) vs baseline: +3.4%

✅ All Tests Passing (18 suites)
errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.077ms (SLO: <2.300ms -9.7%) vs baseline: ~same

Memory: ✅ 52.101MB (SLO: <53.500MB -2.6%) vs baseline: +5.1%


✅ errortracking-enabled-user

Time: ✅ 2.081ms (SLO: <2.250ms -7.5%) vs baseline: +0.4%

Memory: ✅ 52.042MB (SLO: <53.500MB -2.7%) vs baseline: +4.8%


✅ tracer-enabled

Time: ✅ 2.076ms (SLO: <2.300ms -9.7%) vs baseline: -0.2%

Memory: ✅ 52.140MB (SLO: <53.500MB -2.5%) vs baseline: +5.1%


flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.928ms (SLO: <4.200ms -6.5%) vs baseline: -0.4%

Memory: ✅ 62.226MB (SLO: <66.000MB -5.7%) vs baseline: +5.0%


✅ iast-enabled

Time: ✅ 2.440ms (SLO: <2.800ms 📉 -12.8%) vs baseline: -0.6%

Memory: ✅ 58.648MB (SLO: <60.000MB -2.3%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 2.065ms (SLO: <2.250ms -8.2%) vs baseline: -0.4%

Memory: ✅ 52.239MB (SLO: <54.500MB -4.1%) vs baseline: +4.8%


httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 80.916µs (SLO: <100.000µs 📉 -19.1%) vs baseline: +0.5%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.3%


✅ b3_headers

Time: ✅ 14.288µs (SLO: <20.000µs 📉 -28.6%) vs baseline: +1.0%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


✅ b3_single_headers

Time: ✅ 13.422µs (SLO: <20.000µs 📉 -32.9%) vs baseline: +0.9%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 63.525µs (SLO: <80.000µs 📉 -20.6%) vs baseline: +0.5%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 65.946µs (SLO: <80.000µs 📉 -17.6%) vs baseline: +0.3%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%


✅ empty_headers

Time: ✅ 1.611µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.9%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%


✅ full_t_id_datadog_headers

Time: ✅ 22.778µs (SLO: <30.000µs 📉 -24.1%) vs baseline: +1.2%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.8%


✅ invalid_priority_header

Time: ✅ 6.592µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +1.8%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%


✅ invalid_span_id_header

Time: ✅ 6.556µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


✅ invalid_tags_header

Time: ✅ 6.584µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +1.4%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.5%


✅ invalid_trace_id_header

Time: ✅ 6.603µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.6%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


✅ large_header_no_matches

Time: ✅ 27.688µs (SLO: <30.000µs -7.7%) vs baseline: +0.9%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ large_valid_headers_all

Time: ✅ 28.769µs (SLO: <40.000µs 📉 -28.1%) vs baseline: +0.5%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


✅ medium_header_no_matches

Time: ✅ 9.772µs (SLO: <20.000µs 📉 -51.1%) vs baseline: -0.5%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ medium_valid_headers_all

Time: ✅ 11.336µs (SLO: <20.000µs 📉 -43.3%) vs baseline: +1.0%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%


✅ none_propagation_style

Time: ✅ 1.704µs (SLO: <10.000µs 📉 -83.0%) vs baseline: -0.2%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%


✅ tracecontext_headers

Time: ✅ 35.989µs (SLO: <40.000µs 📉 -10.0%) vs baseline: +4.5%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%


✅ valid_headers_all

Time: ✅ 6.500µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.5%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


✅ valid_headers_basic

Time: ✅ 6.195µs (SLO: <10.000µs 📉 -38.1%) vs baseline: +1.8%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ wsgi_empty_headers

Time: ✅ 1.582µs (SLO: <10.000µs 📉 -84.2%) vs baseline: -0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ wsgi_invalid_priority_header

Time: ✅ 6.569µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.583µs (SLO: <10.000µs 📉 -84.2%) vs baseline: -1.5%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%


✅ wsgi_invalid_tags_header

Time: ✅ 6.544µs (SLO: <10.000µs 📉 -34.6%) vs baseline: -0.5%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.564µs (SLO: <10.000µs 📉 -34.4%) vs baseline: -0.1%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


✅ wsgi_large_header_no_matches

Time: ✅ 28.521µs (SLO: <40.000µs 📉 -28.7%) vs baseline: -0.7%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.856µs (SLO: <40.000µs 📉 -25.4%) vs baseline: +0.1%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.192µs (SLO: <20.000µs 📉 -49.0%) vs baseline: -0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.619µs (SLO: <20.000µs 📉 -41.9%) vs baseline: -0.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ wsgi_valid_headers_all

Time: ✅ 6.598µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.4%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%


✅ wsgi_valid_headers_basic

Time: ✅ 6.100µs (SLO: <10.000µs 📉 -39.0%) vs baseline: ~same

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.905µs (SLO: <30.000µs 📉 -27.0%) vs baseline: +0.5%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.6%


✅ with_all

Time: ✅ 29.036µs (SLO: <40.000µs 📉 -27.4%) vs baseline: +0.5%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ with_dd_origin

Time: ✅ 25.518µs (SLO: <30.000µs 📉 -14.9%) vs baseline: ~same

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


✅ with_priority_and_origin

Time: ✅ 25.010µs (SLO: <40.000µs 📉 -37.5%) vs baseline: +1.0%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%


✅ with_sampling_priority

Time: ✅ 21.793µs (SLO: <30.000µs 📉 -27.4%) vs baseline: +0.1%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


✅ with_tags

Time: ✅ 27.454µs (SLO: <40.000µs 📉 -31.4%) vs baseline: +1.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%


✅ with_tags_invalid

Time: ✅ 28.630µs (SLO: <40.000µs 📉 -28.4%) vs baseline: +0.8%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%


✅ with_tags_max_size

Time: ✅ 27.666µs (SLO: <40.000µs 📉 -30.8%) vs baseline: +0.7%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 32.260µs (SLO: <40.000µs 📉 -19.4%) vs baseline: +0.9%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.6%


✅ re_expand_noaspect

Time: ✅ 29.860µs (SLO: <40.000µs 📉 -25.4%) vs baseline: +4.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%


✅ re_findall_aspect

Time: ✅ 2.904µs (SLO: <10.000µs 📉 -71.0%) vs baseline: -0.4%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.5%


✅ re_findall_noaspect

Time: ✅ 1.456µs (SLO: <10.000µs 📉 -85.4%) vs baseline: +3.1%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ re_finditer_aspect

Time: ✅ 4.441µs (SLO: <10.000µs 📉 -55.6%) vs baseline: +0.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_finditer_noaspect

Time: ✅ 1.402µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -1.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ re_fullmatch_aspect

Time: ✅ 2.694µs (SLO: <10.000µs 📉 -73.1%) vs baseline: -0.1%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%


✅ re_fullmatch_noaspect

Time: ✅ 1.285µs (SLO: <10.000µs 📉 -87.2%) vs baseline: -0.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ re_group_aspect

Time: ✅ 2.959µs (SLO: <10.000µs 📉 -70.4%) vs baseline: +0.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ re_group_noaspect

Time: ✅ 1.603µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ re_groups_aspect

Time: ✅ 3.137µs (SLO: <10.000µs 📉 -68.6%) vs baseline: +0.9%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%


✅ re_groups_noaspect

Time: ✅ 1.700µs (SLO: <10.000µs 📉 -83.0%) vs baseline: -0.4%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ re_match_aspect

Time: ✅ 2.748µs (SLO: <10.000µs 📉 -72.5%) vs baseline: +1.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ re_match_noaspect

Time: ✅ 1.297µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -1.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ re_search_aspect

Time: ✅ 2.630µs (SLO: <10.000µs 📉 -73.7%) vs baseline: +1.9%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_search_noaspect

Time: ✅ 1.188µs (SLO: <10.000µs 📉 -88.1%) vs baseline: -0.5%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ re_sub_aspect

Time: ✅ 3.489µs (SLO: <10.000µs 📉 -65.1%) vs baseline: +1.1%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ re_sub_noaspect

Time: ✅ 1.538µs (SLO: <10.000µs 📉 -84.6%) vs baseline: -0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ re_subn_aspect

Time: ✅ 3.734µs (SLO: <10.000µs 📉 -62.7%) vs baseline: -0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_subn_noaspect

Time: ✅ 1.631µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +1.7%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.5%


iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.403µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.5%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ add_inplace_aspect

Time: ✅ 0.411µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.5%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ add_inplace_noaspect

Time: ✅ 0.315µs (SLO: <10.000µs 📉 -96.8%) vs baseline: ~same

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%


✅ add_noaspect

Time: ✅ 0.279µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +1.1%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ bytearray_aspect

Time: ✅ 1.349µs (SLO: <10.000µs 📉 -86.5%) vs baseline: +0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ bytearray_extend_aspect

Time: ✅ 1.465µs (SLO: <10.000µs 📉 -85.3%) vs baseline: -0.9%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.5%


✅ bytearray_extend_noaspect

Time: ✅ 0.617µs (SLO: <10.000µs 📉 -93.8%) vs baseline: +0.1%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ bytearray_noaspect

Time: ✅ 0.477µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -0.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%


✅ bytes_aspect

Time: ✅ 1.315µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ bytes_noaspect

Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.6%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ bytesio_aspect

Time: ✅ 1.369µs (SLO: <10.000µs 📉 -86.3%) vs baseline: +0.8%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%


✅ bytesio_noaspect

Time: ✅ 0.499µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.9%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ capitalize_aspect

Time: ✅ 0.739µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ capitalize_noaspect

Time: ✅ 0.439µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +0.7%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ casefold_aspect

Time: ✅ 0.741µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%


✅ casefold_noaspect

Time: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.8%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ decode_aspect

Time: ✅ 0.725µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +0.5%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.5%


✅ decode_noaspect

Time: ✅ 0.418µs (SLO: <10.000µs 📉 -95.8%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ encode_aspect

Time: ✅ 0.712µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ encode_noaspect

Time: ✅ 0.402µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ format_aspect

Time: ✅ 3.473µs (SLO: <10.000µs 📉 -65.3%) vs baseline: +0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%


✅ format_map_aspect

Time: ✅ 3.624µs (SLO: <10.000µs 📉 -63.8%) vs baseline: +0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%


✅ format_map_noaspect

Time: ✅ 0.771µs (SLO: <10.000µs 📉 -92.3%) vs baseline: -0.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ format_noaspect

Time: ✅ 0.594µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.5%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ index_aspect

Time: ✅ 0.357µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.8%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ index_noaspect

Time: ✅ 0.275µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -1.5%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.8%


✅ join_aspect

Time: ✅ 1.317µs (SLO: <10.000µs 📉 -86.8%) vs baseline: -1.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ join_noaspect

Time: ✅ 0.489µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.7%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ ljust_aspect

Time: ✅ 2.605µs (SLO: <20.000µs 📉 -87.0%) vs baseline: +0.7%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%


✅ ljust_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%


✅ lower_aspect

Time: ✅ 2.267µs (SLO: <10.000µs 📉 -77.3%) vs baseline: +0.8%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ lower_noaspect

Time: ✅ 0.366µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.9%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ lstrip_aspect

Time: ✅ 2.230µs (SLO: <20.000µs 📉 -88.8%) vs baseline: +1.1%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ lstrip_noaspect

Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ modulo_aspect

Time: ✅ 0.987µs (SLO: <10.000µs 📉 -90.1%) vs baseline: -1.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.541µs (SLO: <10.000µs 📉 -84.6%) vs baseline: +0.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%


✅ modulo_aspect_for_bytes

Time: ✅ 0.973µs (SLO: <10.000µs 📉 -90.3%) vs baseline: +0.4%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.247µs (SLO: <10.000µs 📉 -87.5%) vs baseline: +1.0%

Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +5.2%


✅ modulo_noaspect

Time: ✅ 0.631µs (SLO: <10.000µs 📉 -93.7%) vs baseline: +0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ replace_aspect

Time: ✅ 5.062µs (SLO: <10.000µs 📉 -49.4%) vs baseline: +1.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ replace_noaspect

Time: ✅ 0.463µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -1.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ repr_aspect

Time: ✅ 0.907µs (SLO: <10.000µs 📉 -90.9%) vs baseline: -0.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ repr_noaspect

Time: ✅ 0.416µs (SLO: <10.000µs 📉 -95.8%) vs baseline: ~same

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.6%


✅ rstrip_aspect

Time: ✅ 1.928µs (SLO: <20.000µs 📉 -90.4%) vs baseline: +0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ rstrip_noaspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +2.2%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ slice_aspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.7%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ slice_noaspect

Time: ✅ 0.451µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +0.7%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%


✅ stringio_aspect

Time: ✅ 1.555µs (SLO: <10.000µs 📉 -84.4%) vs baseline: -1.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ stringio_noaspect

Time: ✅ 0.721µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +0.8%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ strip_aspect

Time: ✅ 2.216µs (SLO: <20.000µs 📉 -88.9%) vs baseline: +0.9%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%


✅ strip_noaspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%


✅ swapcase_aspect

Time: ✅ 2.441µs (SLO: <10.000µs 📉 -75.6%) vs baseline: -1.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ swapcase_noaspect

Time: ✅ 0.541µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ title_aspect

Time: ✅ 2.400µs (SLO: <10.000µs 📉 -76.0%) vs baseline: +0.5%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ title_noaspect

Time: ✅ 0.505µs (SLO: <10.000µs 📉 -94.9%) vs baseline: +1.1%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ translate_aspect

Time: ✅ 3.254µs (SLO: <10.000µs 📉 -67.5%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ translate_noaspect

Time: ✅ 1.049µs (SLO: <10.000µs 📉 -89.5%) vs baseline: +0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ upper_aspect

Time: ✅ 2.262µs (SLO: <10.000µs 📉 -77.4%) vs baseline: +0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ upper_noaspect

Time: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.3%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.5%


iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.404µs (SLO: <10.000µs 📉 -86.0%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ rsplit_noaspect

Time: ✅ 0.579µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.6%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ split_aspect

Time: ✅ 1.402µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +1.3%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%


✅ split_noaspect

Time: ✅ 0.571µs (SLO: <10.000µs 📉 -94.3%) vs baseline: ~same

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ splitlines_aspect

Time: ✅ 1.404µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -1.4%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ splitlines_noaspect

Time: ✅ 0.579µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.7%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


iastpropagation - 8/8

✅ no-propagation

Time: ✅ 49.465µs (SLO: <60.000µs 📉 -17.6%) vs baseline: -0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ propagation_enabled

Time: ✅ 174.959µs (SLO: <190.000µs -7.9%) vs baseline: +1.3%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ propagation_enabled_100

Time: ✅ 1.892ms (SLO: <2.300ms 📉 -17.7%) vs baseline: -0.5%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ propagation_enabled_1000

Time: ✅ 32.565ms (SLO: <34.550ms -5.7%) vs baseline: +0.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.579ms (SLO: <42.000ms -3.4%) vs baseline: ~same

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%


✅ add-link

Time: ✅ 36.299ms (SLO: <38.550ms -5.8%) vs baseline: -0.6%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.9%


✅ add-metrics

Time: ✅ 220.326ms (SLO: <232.000ms -5.0%) vs baseline: +0.2%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.8%


✅ add-tags

Time: ✅ 213.243ms (SLO: <221.600ms -3.8%) vs baseline: +0.7%

Memory: ✅ 34.583MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +5.0%


✅ get-context

Time: ✅ 29.360ms (SLO: <31.300ms -6.2%) vs baseline: +0.6%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.9%


✅ is-recording

Time: ✅ 29.163ms (SLO: <31.000ms -5.9%) vs baseline: -0.6%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.9%


✅ record-exception

Time: ✅ 63.442ms (SLO: <65.850ms -3.7%) vs baseline: +0.6%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +5.0%


✅ set-status

Time: ✅ 31.993ms (SLO: <34.150ms -6.3%) vs baseline: ~same

Memory: ✅ 34.446MB (SLO: <39.000MB 📉 -11.7%) vs baseline: +4.6%


✅ start

Time: ✅ 28.842ms (SLO: <30.150ms -4.3%) vs baseline: +0.4%

Memory: ✅ 34.446MB (SLO: <39.000MB 📉 -11.7%) vs baseline: +4.6%


✅ start-finish

Time: ✅ 34.150ms (SLO: <35.350ms -3.4%) vs baseline: ~same

Memory: ✅ 34.583MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +4.9%


✅ start-finish-telemetry

Time: ✅ 33.925ms (SLO: <35.450ms -4.3%) vs baseline: ~same

Memory: ✅ 34.564MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%


✅ update-name

Time: ✅ 31.081ms (SLO: <33.400ms -6.9%) vs baseline: -0.5%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +4.6%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 340.993ms (SLO: <354.300ms -3.8%) vs baseline: -0.8%

Memory: ✅ 38.520MB (SLO: <40.000MB -3.7%) vs baseline: +5.1%


✅ cache_on

Time: ✅ 0.380µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.7%

Memory: ✅ 37.227MB (SLO: <39.000MB -4.5%) vs baseline: +5.0%


packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 155.011µs (SLO: <170.000µs -8.8%) vs baseline: -0.5%

Memory: ✅ 37.379MB (SLO: <38.500MB -2.9%) vs baseline: +4.7%


✅ import_many_cached

Time: ✅ 120.768µs (SLO: <130.000µs -7.1%) vs baseline: +0.3%

Memory: ✅ 37.388MB (SLO: <38.500MB -2.9%) vs baseline: +5.0%


✅ import_many_stdlib

Time: ✅ 1.626ms (SLO: <1.750ms -7.1%) vs baseline: +0.5%

Memory: ✅ 37.522MB (SLO: <38.500MB -2.5%) vs baseline: +4.5%


✅ import_many_stdlib_cached

Time: ✅ 0.970ms (SLO: <1.100ms 📉 -11.8%) vs baseline: +0.3%

Memory: ✅ 37.556MB (SLO: <38.500MB -2.5%) vs baseline: +4.8%


✅ import_many_unknown

Time: ✅ 832.192µs (SLO: <890.000µs -6.5%) vs baseline: +0.3%

Memory: ✅ 37.566MB (SLO: <38.500MB -2.4%) vs baseline: +4.6%


✅ import_many_unknown_cached

Time: ✅ 787.069µs (SLO: <870.000µs -9.5%) vs baseline: -0.5%

Memory: ✅ 37.482MB (SLO: <38.500MB -2.6%) vs baseline: +4.4%


✅ import_one

Time: ✅ 19.854µs (SLO: <30.000µs 📉 -33.8%) vs baseline: +0.4%

Memory: ✅ 37.100MB (SLO: <39.000MB -4.9%) vs baseline: +3.8%


✅ import_one_cache

Time: ✅ 6.270µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.7%

Memory: ✅ 37.269MB (SLO: <38.500MB -3.2%) vs baseline: +4.7%


✅ import_one_stdlib

Time: ✅ 18.803µs (SLO: <20.000µs -6.0%) vs baseline: +0.1%

Memory: ✅ 37.322MB (SLO: <38.500MB -3.1%) vs baseline: +4.7%


✅ import_one_stdlib_cache

Time: ✅ 6.301µs (SLO: <10.000µs 📉 -37.0%) vs baseline: ~same

Memory: ✅ 37.346MB (SLO: <38.500MB -3.0%) vs baseline: +4.7%


✅ import_one_unknown

Time: ✅ 45.398µs (SLO: <50.000µs -9.2%) vs baseline: -0.3%

Memory: ✅ 37.430MB (SLO: <38.500MB -2.8%) vs baseline: +5.9%


✅ import_one_unknown_cache

Time: ✅ 6.345µs (SLO: <10.000µs 📉 -36.6%) vs baseline: +1.0%

Memory: ✅ 37.271MB (SLO: <38.500MB -3.2%) vs baseline: +4.6%


ratelimiter - 12/12

✅ defaults

Time: ✅ 2.379µs (SLO: <10.000µs 📉 -76.2%) vs baseline: +2.3%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +4.8%


✅ high_rate_limit

Time: ✅ 2.437µs (SLO: <10.000µs 📉 -75.6%) vs baseline: +1.2%

Memory: ✅ 31.752MB (SLO: <34.000MB -6.6%) vs baseline: +4.7%


✅ long_window

Time: ✅ 2.377µs (SLO: <10.000µs 📉 -76.2%) vs baseline: +1.3%

Memory: ✅ 31.811MB (SLO: <34.000MB -6.4%) vs baseline: +5.1%


✅ low_rate_limit

Time: ✅ 2.368µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +1.4%

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +4.7%


✅ no_rate_limit

Time: ✅ 0.830µs (SLO: <10.000µs 📉 -91.7%) vs baseline: -0.3%

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +4.9%


✅ short_window

Time: ✅ 2.505µs (SLO: <10.000µs 📉 -74.9%) vs baseline: +0.2%

Memory: ✅ 31.713MB (SLO: <34.000MB -6.7%) vs baseline: +4.9%


recursivecomputation - 8/8

✅ deep

Time: ✅ 309.432ms (SLO: <320.950ms -3.6%) vs baseline: +0.3%

Memory: ✅ 32.893MB (SLO: <34.500MB -4.7%) vs baseline: +5.1%


✅ deep-profiled

Time: ✅ 326.794ms (SLO: <359.150ms -9.0%) vs baseline: -0.1%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%


✅ medium

Time: ✅ 7.061ms (SLO: <7.400ms -4.6%) vs baseline: -0.2%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%


✅ shallow

Time: ✅ 0.951ms (SLO: <1.050ms -9.4%) vs baseline: -0.2%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%


samplingrules - 8/8

✅ average_match

Time: ✅ 148.039µs (SLO: <290.000µs 📉 -49.0%) vs baseline: -0.5%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%


✅ high_match

Time: ✅ 192.601µs (SLO: <480.000µs 📉 -59.9%) vs baseline: -0.9%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.4%


✅ low_match

Time: ✅ 99.077µs (SLO: <120.000µs 📉 -17.4%) vs baseline: -1.0%

Memory: ✅ 632.594MB (SLO: <700.000MB -9.6%) vs baseline: +4.9%


✅ very_low_match

Time: ✅ 2.895ms (SLO: <8.500ms 📉 -65.9%) vs baseline: -0.9%

Memory: ✅ 70.227MB (SLO: <75.000MB -6.4%) vs baseline: +4.9%


sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.451µs (SLO: <20.000µs 📉 -47.7%) vs baseline: -0.8%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%


✅ all-enabled

Time: ✅ 39.708µs (SLO: <50.000µs 📉 -20.6%) vs baseline: -0.5%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%


✅ collectipvariant_exists

Time: ✅ 40.383µs (SLO: <50.000µs 📉 -19.2%) vs baseline: -0.8%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%


✅ no-collectipvariant

Time: ✅ 40.659µs (SLO: <50.000µs 📉 -18.7%) vs baseline: +1.8%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%


✅ no-useragentvariant

Time: ✅ 38.327µs (SLO: <50.000µs 📉 -23.3%) vs baseline: -0.7%

Memory: ✅ 32.617MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%


✅ obfuscation-no-query

Time: ✅ 40.166µs (SLO: <50.000µs 📉 -19.7%) vs baseline: -0.5%

Memory: ✅ 32.519MB (SLO: <34.000MB -4.4%) vs baseline: +4.8%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 76.584µs (SLO: <90.000µs 📉 -14.9%) vs baseline: +1.6%

Memory: ✅ 32.952MB (SLO: <34.000MB -3.1%) vs baseline: +4.8%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 75.706µs (SLO: <90.000µs 📉 -15.9%) vs baseline: -0.3%

Memory: ✅ 32.932MB (SLO: <34.000MB -3.1%) vs baseline: +4.9%


✅ obfuscation-send-querystring-disabled

Time: ✅ 154.533µs (SLO: <170.000µs -9.1%) vs baseline: +0.8%

Memory: ✅ 32.971MB (SLO: <34.500MB -4.4%) vs baseline: +4.8%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 147.533µs (SLO: <160.000µs -7.8%) vs baseline: ~same

Memory: ✅ 32.971MB (SLO: <34.500MB -4.4%) vs baseline: +4.9%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.129µs (SLO: <170.000µs -8.7%) vs baseline: +0.8%

Memory: ✅ 33.010MB (SLO: <34.500MB -4.3%) vs baseline: +4.9%


✅ useragentvariant_exists_1

Time: ✅ 39.174µs (SLO: <50.000µs 📉 -21.7%) vs baseline: ~same

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.7%


✅ useragentvariant_exists_2

Time: ✅ 40.247µs (SLO: <50.000µs 📉 -19.5%) vs baseline: -0.5%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.8%


✅ useragentvariant_exists_3

Time: ✅ 39.807µs (SLO: <50.000µs 📉 -20.4%) vs baseline: +0.2%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%


✅ useragentvariant_not_exists_1

Time: ✅ 39.943µs (SLO: <50.000µs 📉 -20.1%) vs baseline: +1.5%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.8%


✅ useragentvariant_not_exists_2

Time: ✅ 39.110µs (SLO: <50.000µs 📉 -21.8%) vs baseline: -1.1%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.8%


span - 26/26

✅ add-event

Time: ✅ 24.328ms (SLO: <26.200ms -7.1%) vs baseline: +0.4%

Memory: ✅ 51.554MB (SLO: <53.000MB -2.7%) vs baseline: +4.8%


✅ add-metrics

Time: ✅ 92.634ms (SLO: <98.350ms -5.8%) vs baseline: -1.4%

Memory: ✅ 605.785MB (SLO: <961.000MB 📉 -37.0%) vs baseline: +4.8%


✅ add-tags

Time: ✅ 150.042ms (SLO: <168.550ms 📉 -11.0%) vs baseline: +0.3%

Memory: ✅ 605.833MB (SLO: <962.500MB 📉 -37.1%) vs baseline: +4.8%


✅ get-context

Time: ✅ 22.479ms (SLO: <23.700ms -5.2%) vs baseline: +0.5%

Memory: ✅ 50.343MB (SLO: <53.000MB -5.0%) vs baseline: +4.5%


✅ is-recording

Time: ✅ 22.655ms (SLO: <23.900ms -5.2%) vs baseline: ~same

Memory: ✅ 50.442MB (SLO: <53.000MB -4.8%) vs baseline: +4.9%


✅ record-exception

Time: ✅ 42.297ms (SLO: <44.500ms -5.0%) vs baseline: -0.1%

Memory: ✅ 43.392MB (SLO: <53.000MB 📉 -18.1%) vs baseline: +4.8%


✅ set-status

Time: ✅ 24.569ms (SLO: <26.000ms -5.5%) vs baseline: +0.8%

Memory: ✅ 50.459MB (SLO: <53.000MB -4.8%) vs baseline: +4.9%


✅ start

Time: ✅ 22.252ms (SLO: <23.500ms -5.3%) vs baseline: +0.2%

Memory: ✅ 50.392MB (SLO: <53.000MB -4.9%) vs baseline: +4.7%


✅ start-finish

Time: ✅ 51.929ms (SLO: <55.500ms -6.4%) vs baseline: +0.2%

Memory: ✅ 32.027MB (SLO: <34.000MB -5.8%) vs baseline: +4.5%


✅ start-finish-telemetry

Time: ✅ 53.240ms (SLO: <58.300ms -8.7%) vs baseline: ~same

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.6%


✅ start-finish-traceid128

Time: ✅ 55.691ms (SLO: <60.050ms -7.3%) vs baseline: +0.7%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%


✅ start-traceid128

Time: ✅ 22.708ms (SLO: <24.600ms -7.7%) vs baseline: ~same

Memory: ✅ 50.468MB (SLO: <53.000MB -4.8%) vs baseline: +5.0%


✅ update-name

Time: ✅ 23.292ms (SLO: <24.100ms -3.4%) vs baseline: +0.4%

Memory: ✅ 51.127MB (SLO: <53.000MB -3.5%) vs baseline: +4.8%


telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.226µs (SLO: <20.000µs 📉 -83.9%) vs baseline: +1.6%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.8%


✅ 1-count-metrics-100-times

Time: ✅ 213.215µs (SLO: <250.000µs 📉 -14.7%) vs baseline: -0.4%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%


✅ 1-distribution-metric-1-times

Time: ✅ 2.951µs (SLO: <20.000µs 📉 -85.2%) vs baseline: -0.5%

Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.5%


✅ 1-distribution-metrics-100-times

Time: ✅ 192.178µs (SLO: <220.000µs 📉 -12.6%) vs baseline: +1.1%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.8%


✅ 1-gauge-metric-1-times

Time: ✅ 2.097µs (SLO: <20.000µs 📉 -89.5%) vs baseline: -2.2%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +5.0%


✅ 1-gauge-metrics-100-times

Time: ✅ 127.158µs (SLO: <150.000µs 📉 -15.2%) vs baseline: +0.2%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%


✅ 1-rate-metric-1-times

Time: ✅ 3.177µs (SLO: <20.000µs 📉 -84.1%) vs baseline: +0.6%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%


✅ 1-rate-metrics-100-times

Time: ✅ 213.932µs (SLO: <250.000µs 📉 -14.4%) vs baseline: +1.1%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.6%


✅ 100-count-metrics-100-times

Time: ✅ 21.313ms (SLO: <23.500ms -9.3%) vs baseline: -1.2%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +5.0%


✅ 100-distribution-metrics-100-times

Time: ✅ 1.980ms (SLO: <2.250ms 📉 -12.0%) vs baseline: +0.9%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.286ms (SLO: <1.550ms 📉 -17.0%) vs baseline: -0.6%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%


✅ 100-rate-metrics-100-times

Time: ✅ 2.187ms (SLO: <2.550ms 📉 -14.2%) vs baseline: -0.4%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%


✅ flush-1-metric

Time: ✅ 4.136µs (SLO: <20.000µs 📉 -79.3%) vs baseline: +1.0%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%


✅ flush-100-metrics

Time: ✅ 180.609µs (SLO: <250.000µs 📉 -27.8%) vs baseline: +0.3%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%


✅ flush-1000-metrics

Time: ✅ 2.224ms (SLO: <2.500ms 📉 -11.0%) vs baseline: +0.2%

Memory: ✅ 32.932MB (SLO: <34.500MB -4.5%) vs baseline: +4.8%


tracer - 6/6

✅ large

Time: ✅ 30.245ms (SLO: <32.950ms -8.2%) vs baseline: +0.3%

Memory: ✅ 33.266MB (SLO: <34.500MB -3.6%) vs baseline: +4.9%


✅ medium

Time: ✅ 2.976ms (SLO: <3.200ms -7.0%) vs baseline: +1.7%

Memory: ✅ 31.693MB (SLO: <34.000MB -6.8%) vs baseline: +4.6%


✅ small

Time: ✅ 337.077µs (SLO: <370.000µs -8.9%) vs baseline: +0.7%

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +4.8%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline

@sabrenner sabrenner merged commit 1d49072 into main Sep 26, 2025
941 checks passed
@sabrenner sabrenner deleted the sabrenner/fix-llmobs-span.kind-stuff branch September 26, 2025 15:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
changelog/no-changelog A changelog entry is not required for this PR.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants