fix(ci_visibility): itr skipped counts suites or tests [backport 3.13] #14697
Conversation
![dd-octo-sts[bot]](https://avatars.githubusercontent.com/in/1157446?s=60&v=4){kind=small}
|
|
Bootstrap import analysisComparison of import times between this PR and base. SummaryThe average import time from this PR is: 267 ± 2 ms. The average import time from base is: 270 ± 3 ms. The import time difference between this PR and base is: -3.5 ± 0.1 ms. Import time breakdownThe following import paths have shrunk:
|
Performance SLOsComparing candidate backport-14681-to-3.13 (4de3136) with baseline 3.13 (f774a51) 📈 Performance Regressions (1 suite)📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.225µs (SLO: <20.000µs 📉 -83.9%) vs baseline: +1.3% Memory: ✅ 31.438MB (SLO: <34.000MB -7.5%) vs baseline: +4.9% ✅ 1-count-metrics-100-timesTime: ✅ 221.751µs (SLO: <250.000µs 📉 -11.3%) vs baseline: +1.7% Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +5.1% ✅ 1-distribution-metric-1-timesTime: ✅ 3.027µs (SLO: <20.000µs 📉 -84.9%) vs baseline: +2.1% Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +5.1% ✅ 1-distribution-metrics-100-timesTime: ✅ 209.570µs (SLO: <220.000µs -4.7%) vs baseline: +7.3% Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +4.6% ✅ 1-gauge-metric-1-timesTime: ✅ 2.172µs (SLO: <20.000µs 📉 -89.1%) vs baseline: +4.1% Memory: ✅ 31.398MB (SLO: <34.000MB -7.7%) vs baseline: +4.6% ✅ 1-gauge-metrics-100-timesTime: ✅ 124.514µs (SLO: <150.000µs 📉 -17.0%) vs baseline: -0.3% Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +5.0% ✅ 1-rate-metric-1-timesTime: ✅ 3.603µs (SLO: <20.000µs 📉 -82.0%) vs baseline: 📈 +12.9% Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +4.7% ✅ 1-rate-metrics-100-timesTime: ✅ 220.731µs (SLO: <250.000µs 📉 -11.7%) vs baseline: +1.9% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +5.1% ✅ 100-count-metrics-100-timesTime: ✅ 21.783ms (SLO: <23.500ms -7.3%) vs baseline: +0.3% Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +5.1% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.100ms (SLO: <2.250ms -6.7%) vs baseline: +2.7% Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +5.1% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.278ms (SLO: <1.550ms 📉 -17.5%) vs baseline: +0.2% Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +5.1% ✅ 100-rate-metrics-100-timesTime: ✅ 2.267ms (SLO: <2.550ms 📉 -11.1%) vs baseline: +1.5% Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +4.9% ✅ flush-1-metricTime: ✅ 4.695µs (SLO: <20.000µs 📉 -76.5%) vs baseline: 📈 +12.3% Memory: ✅ 31.418MB (SLO: <34.000MB -7.6%) vs baseline: +4.7% ✅ flush-100-metricsTime: ✅ 183.183µs (SLO: <250.000µs 📉 -26.7%) vs baseline: -0.2% Memory: ✅ 31.831MB (SLO: <34.000MB -6.4%) vs baseline: +4.7% ✅ flush-1000-metricsTime: ✅ 2.213ms (SLO: <2.500ms 📉 -11.5%) vs baseline: ~same Memory: ✅ 32.598MB (SLO: <34.500MB -5.5%) vs baseline: +4.8% 🟡 Near SLO Breach (5 suites)🟡 djangosimple - 24/24✅ appsecTime: ✅ 20.657ms (SLO: <22.300ms -7.4%) vs baseline: -0.1% Memory: ✅ 64.468MB (SLO: <66.000MB -2.3%) vs baseline: +4.9% ✅ exception-replay-enabledTime: ✅ 1.368ms (SLO: <1.450ms -5.6%) vs baseline: ~same Memory: ✅ 63.404MB (SLO: <66.000MB -3.9%) vs baseline: +4.9% ✅ iastTime: ✅ 20.707ms (SLO: <22.250ms -6.9%) vs baseline: +0.2% Memory: ✅ 64.387MB (SLO: <66.000MB -2.4%) vs baseline: +4.8% ✅ profilerTime: ✅ 15.182ms (SLO: <16.550ms -8.3%) vs baseline: -0.3% Memory: ✅ 52.829MB (SLO: <53.500MB 🟡 -1.3%) vs baseline: +4.9% ✅ span-code-originTime: ✅ 26.307ms (SLO: <28.200ms -6.7%) vs baseline: -0.1% Memory: ✅ 66.296MB (SLO: <68.500MB -3.2%) vs baseline: +4.5% ✅ tracerTime: ✅ 20.744ms (SLO: <21.750ms -4.6%) vs baseline: +0.4% Memory: ✅ 64.350MB (SLO: <66.000MB -2.5%) vs baseline: +4.8% ✅ tracer-and-profilerTime: ✅ 22.256ms (SLO: <23.500ms -5.3%) vs baseline: -0.1% Memory: ✅ 65.428MB (SLO: <67.000MB -2.3%) vs baseline: +4.9% ✅ tracer-dont-create-db-spansTime: ✅ 19.574ms (SLO: <21.500ms -9.0%) vs baseline: +0.5% Memory: ✅ 64.389MB (SLO: <66.000MB -2.4%) vs baseline: +4.8% ✅ tracer-no-cachesTime: ✅ 18.600ms (SLO: <19.650ms -5.3%) vs baseline: +0.4% Memory: ✅ 64.369MB (SLO: <66.000MB -2.5%) vs baseline: +5.0% ✅ tracer-no-databasesTime: ✅ 18.953ms (SLO: <20.100ms -5.7%) vs baseline: ~same Memory: ✅ 63.996MB (SLO: <66.000MB -3.0%) vs baseline: +4.8% ✅ tracer-no-middlewareTime: ✅ 20.362ms (SLO: <21.500ms -5.3%) vs baseline: ~same Memory: ✅ 64.409MB (SLO: <66.000MB -2.4%) vs baseline: +4.9% ✅ tracer-no-templatesTime: ✅ 20.477ms (SLO: <22.000ms -6.9%) vs baseline: -0.2% Memory: ✅ 64.310MB (SLO: <66.000MB -2.6%) vs baseline: +4.7% 🟡 errortrackingdjangosimple - 6/6✅ errortracking-enabled-allTime: ✅ 18.198ms (SLO: <19.850ms -8.3%) vs baseline: +0.8% Memory: ✅ 64.299MB (SLO: <65.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ errortracking-enabled-userTime: ✅ 18.270ms (SLO: <19.400ms -5.8%) vs baseline: +0.9% Memory: ✅ 64.317MB (SLO: <65.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ tracer-enabledTime: ✅ 18.202ms (SLO: <19.450ms -6.4%) vs baseline: +0.4% Memory: ✅ 64.188MB (SLO: <65.500MB -2.0%) vs baseline: +5.2% 🟡 flasksimple - 15/15✅ appsec-getTime: ✅ 4.601ms (SLO: <4.750ms -3.1%) vs baseline: -0.2% Memory: ✅ 61.873MB (SLO: <64.500MB -4.1%) vs baseline: +4.8% ✅ appsec-postTime: ✅ 6.633ms (SLO: <6.750ms 🟡 -1.7%) vs baseline: -0.3% Memory: ✅ 62.285MB (SLO: <64.500MB -3.4%) vs baseline: +4.8% ✅ appsec-telemetryTime: ✅ 4.591ms (SLO: <4.750ms -3.3%) vs baseline: -0.4% Memory: ✅ 61.794MB (SLO: <64.500MB -4.2%) vs baseline: +4.6% ✅ debuggerTime: ✅ 1.864ms (SLO: <2.000ms -6.8%) vs baseline: -0.2% Memory: ✅ 44.532MB (SLO: <45.000MB 🟡 -1.0%) vs baseline: +4.6% ✅ iast-getTime: ✅ 1.873ms (SLO: <2.000ms -6.4%) vs baseline: +0.4% Memory: ✅ 41.681MB (SLO: <49.000MB 📉 -14.9%) vs baseline: +5.2% ✅ profilerTime: ✅ 1.918ms (SLO: <2.100ms -8.7%) vs baseline: -0.2% Memory: ✅ 44.374MB (SLO: <46.500MB -4.6%) vs baseline: +4.9% ✅ tracerTime: ✅ 3.389ms (SLO: <3.650ms -7.2%) vs baseline: ~same Memory: ✅ 51.334MB (SLO: <53.500MB -4.0%) vs baseline: +4.8% 🟡 flasksqli - 6/6✅ appsec-enabledTime: ✅ 3.976ms (SLO: <4.200ms -5.3%) vs baseline: +0.6% Memory: ✅ 62.161MB (SLO: <66.000MB -5.8%) vs baseline: +4.8% ✅ iast-enabledTime: ✅ 2.544ms (SLO: <2.800ms -9.2%) vs baseline: +0.6% Memory: ✅ 57.941MB (SLO: <59.000MB 🟡 -1.8%) vs baseline: +5.0% ✅ tracer-enabledTime: ✅ 2.100ms (SLO: <2.250ms -6.7%) vs baseline: +0.2% Memory: ✅ 51.250MB (SLO: <53.500MB -4.2%) vs baseline: +4.8% 🟡 otelspan - 22/22✅ add-eventTime: ✅ 45.232ms (SLO: <47.150ms -4.1%) vs baseline: -0.5% Memory: ✅ 44.523MB (SLO: <46.500MB -4.3%) vs baseline: +4.8% ✅ add-metricsTime: ✅ 322.294ms (SLO: <344.800ms -6.5%) vs baseline: -0.1% Memory: ✅ 552.980MB (SLO: <562.000MB 🟡 -1.6%) vs baseline: +4.8% ✅ add-tagsTime: ✅ 294.403ms (SLO: <314.000ms -6.2%) vs baseline: +0.8% Memory: ✅ 554.500MB (SLO: <563.500MB 🟡 -1.6%) vs baseline: +4.5% ✅ get-contextTime: ✅ 86.197ms (SLO: <92.350ms -6.7%) vs baseline: +0.8% Memory: ✅ 39.717MB (SLO: <46.500MB 📉 -14.6%) vs baseline: +4.9% ✅ is-recordingTime: ✅ 43.091ms (SLO: <44.500ms -3.2%) vs baseline: +0.6% Memory: ✅ 43.903MB (SLO: <46.500MB -5.6%) vs baseline: +4.6% ✅ record-exceptionTime: ✅ 61.867ms (SLO: <67.650ms -8.5%) vs baseline: +0.3% Memory: ✅ 39.967MB (SLO: <46.500MB 📉 -14.1%) vs baseline: +4.8% ✅ set-statusTime: ✅ 49.715ms (SLO: <50.400ms 🟡 -1.4%) vs baseline: +2.0% Memory: ✅ 44.090MB (SLO: <46.500MB -5.2%) vs baseline: +5.0% ✅ startTime: ✅ 42.235ms (SLO: <43.450ms -2.8%) vs baseline: +0.6% Memory: ✅ 43.962MB (SLO: <46.500MB -5.5%) vs baseline: +4.8% ✅ start-finishTime: ✅ 82.615ms (SLO: <88.000ms -6.1%) vs baseline: +0.3% Memory: ✅ 33.856MB (SLO: <46.500MB 📉 -27.2%) vs baseline: +4.8% ✅ start-finish-telemetryTime: ✅ 84.247ms (SLO: <89.000ms -5.3%) vs baseline: +0.3% Memory: ✅ 33.915MB (SLO: <46.500MB 📉 -27.1%) vs baseline: +5.0% ✅ update-nameTime: ✅ 44.384ms (SLO: <45.150ms 🟡 -1.7%) vs baseline: +1.0% Memory: ✅ 44.232MB (SLO: <46.500MB -4.9%) vs baseline: +5.0%
|
gnufede
force-pushed
the
backport-14681-to-3.13
branch
from
55f5bd8 to
4de3136
Compare
Backport e239ca4 from #14681 to 3.13.
CI Visibility: Fixes some bad behavior in test skipping count, introduced in #14257
Checklist: