-
Notifications
You must be signed in to change notification settings - Fork 468
test(co): test for all snapshot IDs #15273
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
We improve the testing by checking that all the snapshots referenced in span tags have been collected.
|
|
Bootstrap import analysisComparison of import times between this PR and base. SummaryThe average import time from this PR is: 243 ± 3 ms. The average import time from base is: 252 ± 5 ms. The import time difference between this PR and base is: -8.9 ± 0.2 ms. Import time breakdownThe following import paths have shrunk:
|
Performance SLOsComparing candidate test/co-session-all-snapshots (2f1f732) with baseline main (39fef66) 📈 Performance Regressions (1 suite)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 0.403µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.6% Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7% ✅ add_inplace_aspectTime: ✅ 0.409µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.7% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.9% ✅ add_inplace_noaspectTime: ✅ 0.317µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +0.2% Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +5.0% ✅ add_noaspectTime: ✅ 0.280µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +1.2% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.8% ✅ bytearray_aspectTime: ✅ 1.304µs (SLO: <10.000µs 📉 -87.0%) vs baseline: ~same Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9% ✅ bytearray_extend_aspectTime: ✅ 1.501µs (SLO: <10.000µs 📉 -85.0%) vs baseline: +0.7% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +5.1% ✅ bytearray_extend_noaspectTime: ✅ 0.623µs (SLO: <10.000µs 📉 -93.8%) vs baseline: +1.7% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +5.1% ✅ bytearray_noaspectTime: ✅ 0.481µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -0.2% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.9% ✅ bytes_aspectTime: ✅ 1.277µs (SLO: <10.000µs 📉 -87.2%) vs baseline: +0.9% Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +5.1% ✅ bytes_noaspectTime: ✅ 0.489µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.7% Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.6% ✅ bytesio_aspectTime: ✅ 1.296µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -0.8% Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.9% ✅ bytesio_noaspectTime: ✅ 0.501µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.8% Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.9% ✅ capitalize_aspectTime: ✅ 0.735µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.2% Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +5.0% ✅ capitalize_noaspectTime: ✅ 0.432µs (SLO: <10.000µs 📉 -95.7%) vs baseline: -0.9% Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.5% ✅ casefold_aspectTime: ✅ 0.732µs (SLO: <10.000µs 📉 -92.7%) vs baseline: ~same Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +5.1% ✅ casefold_noaspectTime: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.8% Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.6% ✅ decode_aspectTime: ✅ 0.720µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -1.0% Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +5.1% ✅ decode_noaspectTime: ✅ 0.423µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +2.4% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +5.0% ✅ encode_aspectTime: ✅ 0.707µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.4% Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.8% ✅ encode_noaspectTime: ✅ 0.397µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.7% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.8% ✅ format_aspectTime: ✅ 3.298µs (SLO: <10.000µs 📉 -67.0%) vs baseline: +0.1% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.8% ✅ format_map_aspectTime: ✅ 3.443µs (SLO: <10.000µs 📉 -65.6%) vs baseline: -0.2% Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.0% ✅ format_map_noaspectTime: ✅ 0.771µs (SLO: <10.000µs 📉 -92.3%) vs baseline: ~same Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.7% ✅ format_noaspectTime: ✅ 0.598µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +0.7% Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9% ✅ index_aspectTime: ✅ 0.356µs (SLO: <10.000µs 📉 -96.4%) vs baseline: ~same Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7% ✅ index_noaspectTime: ✅ 0.277µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -1.0% Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.9% ✅ join_aspectTime: ✅ 1.345µs (SLO: <10.000µs 📉 -86.6%) vs baseline: ~same Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.7% ✅ join_noaspectTime: ✅ 0.490µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -1.0% Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.9% ✅ ljust_aspectTime: ✅ 2.730µs (SLO: <20.000µs 📉 -86.3%) vs baseline: 📈 +10.7% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +5.0% ✅ ljust_noaspectTime: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.3% Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +5.1% ✅ lower_aspectTime: ✅ 2.180µs (SLO: <10.000µs 📉 -78.2%) vs baseline: -0.7% Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.8% ✅ lower_noaspectTime: ✅ 0.365µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.3% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.7% ✅ lstrip_aspectTime: ✅ 2.225µs (SLO: <20.000µs 📉 -88.9%) vs baseline: +0.8% Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.0% ✅ lstrip_noaspectTime: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.6% Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.9% ✅ modulo_aspectTime: ✅ 0.993µs (SLO: <10.000µs 📉 -90.1%) vs baseline: -1.7% Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +5.0% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 1.538µs (SLO: <10.000µs 📉 -84.6%) vs baseline: +0.9% Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +5.2% ✅ modulo_aspect_for_bytesTime: ✅ 0.971µs (SLO: <10.000µs 📉 -90.3%) vs baseline: -0.5% Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 1.197µs (SLO: <10.000µs 📉 -88.0%) vs baseline: -0.3% Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +5.1% ✅ modulo_noaspectTime: ✅ 0.629µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.2% Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9% ✅ replace_aspectTime: ✅ 4.816µs (SLO: <10.000µs 📉 -51.8%) vs baseline: -0.3% Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.6% ✅ replace_noaspectTime: ✅ 0.466µs (SLO: <10.000µs 📉 -95.3%) vs baseline: +0.9% Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9% ✅ repr_aspectTime: ✅ 0.904µs (SLO: <10.000µs 📉 -91.0%) vs baseline: ~same Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +5.2% ✅ repr_noaspectTime: ✅ 0.417µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +1.4% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.9% ✅ rstrip_aspectTime: ✅ 1.869µs (SLO: <20.000µs 📉 -90.7%) vs baseline: ~same Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7% ✅ rstrip_noaspectTime: ✅ 0.377µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.3% Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +5.4% ✅ slice_aspectTime: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.2% Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7% ✅ slice_noaspectTime: ✅ 0.448µs (SLO: <10.000µs 📉 -95.5%) vs baseline: -1.2% Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9% ✅ stringio_aspectTime: ✅ 1.527µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +0.3% Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.8% ✅ stringio_noaspectTime: ✅ 0.713µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.2% Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9% ✅ strip_aspectTime: ✅ 2.204µs (SLO: <20.000µs 📉 -89.0%) vs baseline: +0.8% Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.6% ✅ strip_noaspectTime: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -0.2% Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.7% ✅ swapcase_aspectTime: ✅ 2.407µs (SLO: <10.000µs 📉 -75.9%) vs baseline: +0.7% Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9% ✅ swapcase_noaspectTime: ✅ 0.533µs (SLO: <10.000µs 📉 -94.7%) vs baseline: -0.7% Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7% ✅ title_aspectTime: ✅ 2.320µs (SLO: <10.000µs 📉 -76.8%) vs baseline: -0.5% Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9% ✅ title_noaspectTime: ✅ 0.501µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.4% Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.9% ✅ translate_aspectTime: ✅ 3.235µs (SLO: <10.000µs 📉 -67.7%) vs baseline: +0.9% Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7% ✅ translate_noaspectTime: ✅ 1.039µs (SLO: <10.000µs 📉 -89.6%) vs baseline: -0.6% Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.8% ✅ upper_aspectTime: ✅ 2.198µs (SLO: <10.000µs 📉 -78.0%) vs baseline: +0.2% Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9% ✅ upper_noaspectTime: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.9% Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.7% 🟡 Near SLO Breach (6 suites)🟡 djangosimple - 30/30✅ appsecTime: ✅ 19.228ms (SLO: <22.300ms 📉 -13.8%) vs baseline: -0.3% Memory: ✅ 65.937MB (SLO: <67.000MB 🟡 -1.6%) vs baseline: +4.7% ✅ exception-replay-enabledTime: ✅ 1.338ms (SLO: <1.450ms -7.7%) vs baseline: -0.7% Memory: ✅ 64.041MB (SLO: <67.000MB -4.4%) vs baseline: +4.7% ✅ iastTime: ✅ 19.224ms (SLO: <22.250ms 📉 -13.6%) vs baseline: -0.5% Memory: ✅ 66.058MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +5.1% ✅ profilerTime: ✅ 15.572ms (SLO: <16.550ms -5.9%) vs baseline: +1.6% Memory: ✅ 53.634MB (SLO: <54.500MB 🟡 -1.6%) vs baseline: +4.7% ✅ resource-renamingTime: ✅ 19.332ms (SLO: <21.750ms 📉 -11.1%) vs baseline: ~same Memory: ✅ 65.962MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.8% ✅ span-code-originTime: ✅ 22.822ms (SLO: <28.200ms 📉 -19.1%) vs baseline: -0.1% Memory: ✅ 67.114MB (SLO: <69.500MB -3.4%) vs baseline: +4.8% ✅ tracerTime: ✅ 19.239ms (SLO: <21.750ms 📉 -11.5%) vs baseline: -0.2% Memory: ✅ 66.068MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +5.0% ✅ tracer-and-profilerTime: ✅ 21.201ms (SLO: <23.500ms -9.8%) vs baseline: +0.2% Memory: ✅ 67.535MB (SLO: <68.000MB 🟡 -0.7%) vs baseline: +4.9% ✅ tracer-dont-create-db-spansTime: ✅ 19.264ms (SLO: <21.500ms 📉 -10.4%) vs baseline: ~same Memory: ✅ 66.016MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +5.0% ✅ tracer-minimalTime: ✅ 16.628ms (SLO: <17.500ms -5.0%) vs baseline: -0.2% Memory: ✅ 65.995MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.8% ✅ tracer-nativeTime: ✅ 19.225ms (SLO: <21.750ms 📉 -11.6%) vs baseline: ~same Memory: ✅ 67.613MB (SLO: <72.500MB -6.7%) vs baseline: +4.7% ✅ tracer-no-cachesTime: ✅ 17.307ms (SLO: <19.650ms 📉 -11.9%) vs baseline: ~same Memory: ✅ 65.898MB (SLO: <67.000MB 🟡 -1.6%) vs baseline: +4.7% ✅ tracer-no-databasesTime: ✅ 18.773ms (SLO: <20.100ms -6.6%) vs baseline: +0.1% Memory: ✅ 65.998MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.9% ✅ tracer-no-middlewareTime: ✅ 18.966ms (SLO: <21.500ms 📉 -11.8%) vs baseline: +0.1% Memory: ✅ 65.924MB (SLO: <67.000MB 🟡 -1.6%) vs baseline: +4.8% ✅ tracer-no-templatesTime: ✅ 19.097ms (SLO: <22.000ms 📉 -13.2%) vs baseline: -0.4% Memory: ✅ 66.048MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +5.0% 🟡 errortrackingdjangosimple - 6/6✅ errortracking-enabled-allTime: ✅ 16.297ms (SLO: <19.850ms 📉 -17.9%) vs baseline: -0.1% Memory: ✅ 65.661MB (SLO: <66.500MB 🟡 -1.3%) vs baseline: +5.0% ✅ errortracking-enabled-userTime: ✅ 16.287ms (SLO: <19.400ms 📉 -16.0%) vs baseline: -0.4% Memory: ✅ 65.735MB (SLO: <66.500MB 🟡 -1.1%) vs baseline: +5.1% ✅ tracer-enabledTime: ✅ 16.350ms (SLO: <19.450ms 📉 -15.9%) vs baseline: -0.1% Memory: ✅ 65.628MB (SLO: <66.500MB 🟡 -1.3%) vs baseline: +4.8% 🟡 errortrackingflasksqli - 6/6✅ errortracking-enabled-allTime: ✅ 2.095ms (SLO: <2.300ms -8.9%) vs baseline: +1.2% Memory: ✅ 52.396MB (SLO: <53.500MB -2.1%) vs baseline: +5.0% ✅ errortracking-enabled-userTime: ✅ 2.071ms (SLO: <2.250ms -8.0%) vs baseline: -0.3% Memory: ✅ 52.514MB (SLO: <53.500MB 🟡 -1.8%) vs baseline: +5.2% ✅ tracer-enabledTime: ✅ 2.071ms (SLO: <2.300ms -10.0%) vs baseline: +0.1% Memory: ✅ 52.553MB (SLO: <53.500MB 🟡 -1.8%) vs baseline: +5.1% 🟡 flasksimple - 18/18✅ appsec-getTime: ✅ 4.597ms (SLO: <4.750ms -3.2%) vs baseline: -0.5% Memory: ✅ 61.949MB (SLO: <65.000MB -4.7%) vs baseline: +4.6% ✅ appsec-postTime: ✅ 6.613ms (SLO: <6.750ms -2.0%) vs baseline: -0.2% Memory: ✅ 62.005MB (SLO: <65.000MB -4.6%) vs baseline: +4.6% ✅ appsec-telemetryTime: ✅ 4.588ms (SLO: <4.750ms -3.4%) vs baseline: -0.4% Memory: ✅ 62.048MB (SLO: <65.000MB -4.5%) vs baseline: +5.0% ✅ debuggerTime: ✅ 1.857ms (SLO: <2.000ms -7.2%) vs baseline: -0.2% Memory: ✅ 45.156MB (SLO: <47.000MB -3.9%) vs baseline: +5.0% ✅ iast-getTime: ✅ 1.858ms (SLO: <2.000ms -7.1%) vs baseline: -0.3% Memory: ✅ 41.787MB (SLO: <49.000MB 📉 -14.7%) vs baseline: +5.1% ✅ profilerTime: ✅ 1.911ms (SLO: <2.100ms -9.0%) vs baseline: -0.6% Memory: ✅ 46.436MB (SLO: <47.000MB 🟡 -1.2%) vs baseline: +4.9% ✅ resource-renamingTime: ✅ 3.369ms (SLO: <3.650ms -7.7%) vs baseline: +0.2% Memory: ✅ 52.416MB (SLO: <53.500MB -2.0%) vs baseline: +4.9% ✅ tracerTime: ✅ 3.359ms (SLO: <3.650ms -8.0%) vs baseline: -0.4% Memory: ✅ 52.291MB (SLO: <53.500MB -2.3%) vs baseline: +4.7% ✅ tracer-nativeTime: ✅ 3.359ms (SLO: <3.650ms -8.0%) vs baseline: ~same Memory: ✅ 53.888MB (SLO: <60.000MB 📉 -10.2%) vs baseline: +4.7% 🟡 otelspan - 22/22✅ add-eventTime: ✅ 38.744ms (SLO: <47.150ms 📉 -17.8%) vs baseline: +0.7% Memory: ✅ 36.461MB (SLO: <47.000MB 📉 -22.4%) vs baseline: +4.9% ✅ add-metricsTime: ✅ 259.176ms (SLO: <344.800ms 📉 -24.8%) vs baseline: ~same Memory: ✅ 40.639MB (SLO: <47.500MB 📉 -14.4%) vs baseline: +5.0% ✅ add-tagsTime: ✅ 317.912ms (SLO: <321.000ms 🟡 -1.0%) vs baseline: +0.9% Memory: ✅ 40.698MB (SLO: <47.500MB 📉 -14.3%) vs baseline: +5.0% ✅ get-contextTime: ✅ 78.449ms (SLO: <92.350ms 📉 -15.1%) vs baseline: +0.2% Memory: ✅ 36.626MB (SLO: <46.500MB 📉 -21.2%) vs baseline: +4.7% ✅ is-recordingTime: ✅ 35.966ms (SLO: <44.500ms 📉 -19.2%) vs baseline: +0.5% Memory: ✅ 36.195MB (SLO: <47.500MB 📉 -23.8%) vs baseline: +5.5% ✅ record-exceptionTime: ✅ 58.254ms (SLO: <67.650ms 📉 -13.9%) vs baseline: +2.2% Memory: ✅ 36.841MB (SLO: <47.000MB 📉 -21.6%) vs baseline: +5.3% ✅ set-statusTime: ✅ 42.465ms (SLO: <50.400ms 📉 -15.7%) vs baseline: ~same Memory: ✅ 36.200MB (SLO: <47.000MB 📉 -23.0%) vs baseline: +5.6% ✅ startTime: ✅ 35.770ms (SLO: <43.450ms 📉 -17.7%) vs baseline: +1.1% Memory: ✅ 36.187MB (SLO: <47.000MB 📉 -23.0%) vs baseline: +5.4% ✅ start-finishTime: ✅ 81.873ms (SLO: <88.000ms -7.0%) vs baseline: +0.4% Memory: ✅ 34.013MB (SLO: <46.500MB 📉 -26.9%) vs baseline: +5.1% ✅ start-finish-telemetryTime: ✅ 84.931ms (SLO: <89.000ms -4.6%) vs baseline: +1.5% Memory: ✅ 33.954MB (SLO: <46.500MB 📉 -27.0%) vs baseline: +4.8% ✅ update-nameTime: ✅ 37.674ms (SLO: <45.150ms 📉 -16.6%) vs baseline: +2.6% Memory: ✅ 36.333MB (SLO: <47.000MB 📉 -22.7%) vs baseline: +4.6% 🟡 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.034µs (SLO: <20.000µs 📉 -84.8%) vs baseline: +4.3% Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.7% ✅ 1-count-metrics-100-timesTime: ✅ 202.666µs (SLO: <220.000µs -7.9%) vs baseline: +1.3% Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.7% ✅ 1-distribution-metric-1-timesTime: ✅ 3.330µs (SLO: <20.000µs 📉 -83.3%) vs baseline: +1.3% Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.8% ✅ 1-distribution-metrics-100-timesTime: ✅ 217.306µs (SLO: <220.000µs 🟡 -1.2%) vs baseline: +1.1% Memory: ✅ 31.536MB (SLO: <34.000MB -7.2%) vs baseline: +5.0% ✅ 1-gauge-metric-1-timesTime: ✅ 2.205µs (SLO: <20.000µs 📉 -89.0%) vs baseline: -0.2% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ 1-gauge-metrics-100-timesTime: ✅ 138.481µs (SLO: <150.000µs -7.7%) vs baseline: -0.3% Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.9% ✅ 1-rate-metric-1-timesTime: ✅ 3.080µs (SLO: <20.000µs 📉 -84.6%) vs baseline: -0.1% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ 1-rate-metrics-100-timesTime: ✅ 215.887µs (SLO: <250.000µs 📉 -13.6%) vs baseline: +0.3% Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ 100-count-metrics-100-timesTime: ✅ 20.135ms (SLO: <22.000ms -8.5%) vs baseline: -0.2% Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.233ms (SLO: <2.300ms -2.9%) vs baseline: ~same Memory: ✅ 31.615MB (SLO: <34.000MB -7.0%) vs baseline: +4.1% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.422ms (SLO: <1.550ms -8.3%) vs baseline: +0.3% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9% ✅ 100-rate-metrics-100-timesTime: ✅ 2.197ms (SLO: <2.550ms 📉 -13.8%) vs baseline: -0.4% Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.7% ✅ flush-1-metricTime: ✅ 4.485µs (SLO: <20.000µs 📉 -77.6%) vs baseline: -0.9% Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.9% ✅ flush-100-metricsTime: ✅ 174.184µs (SLO: <250.000µs 📉 -30.3%) vs baseline: +0.3% Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +4.8% ✅ flush-1000-metricsTime: ✅ 2.108ms (SLO: <2.500ms 📉 -15.7%) vs baseline: ~same Memory: ✅ 32.696MB (SLO: <34.500MB -5.2%) vs baseline: +5.0%
|
Description
We improve the testing by checking that all the snapshots referenced in span tags have been collected.