-
Notifications
You must be signed in to change notification settings - Fork 464
ci(build_docs): improve build_docs build time [backport 3.16] #14931
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
|
## Description Improve build_docs runtime by enabling `DD_FAST_BUILD=1` and rotating the cache. The cache restore/saving time was taking about 8+ minutes. I updated the cache to be time bound, so it'll rotate once per-month. After clearing the cache, the build took 10 minutes. ## Testing <!-- Describe your testing strategy or note what tests are included --> ## Risks <!-- Note any risks associated with this change, or "None" if no risks --> ## Additional Notes <!-- Any other information that would be helpful for reviewers --> (cherry picked from commit 23fe9e1)
f9519d3 to
4388457
Compare
Bootstrap import analysisComparison of import times between this PR and base. SummaryThe average import time from this PR is: 238 ± 3 ms. The average import time from base is: 240 ± 2 ms. The import time difference between this PR and base is: -2.2 ± 0.1 ms. Import time breakdownThe following import paths have shrunk:
|
Performance SLOsComparing candidate backport-14912-to-3.16 (e19bee3) with baseline 3.16 (4479565) 📈 Performance Regressions (1 suite)📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.116µs (SLO: <20.000µs 📉 -84.4%) vs baseline: -0.4% Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.7% ✅ 1-count-metrics-100-timesTime: ✅ 213.294µs (SLO: <250.000µs 📉 -14.7%) vs baseline: +0.5% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9% ✅ 1-distribution-metric-1-timesTime: ✅ 2.876µs (SLO: <20.000µs 📉 -85.6%) vs baseline: -1.1% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0% ✅ 1-distribution-metrics-100-timesTime: ✅ 190.517µs (SLO: <220.000µs 📉 -13.4%) vs baseline: -1.7% Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +5.1% ✅ 1-gauge-metric-1-timesTime: ✅ 2.368µs (SLO: <20.000µs 📉 -88.2%) vs baseline: 📈 +14.8% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9% ✅ 1-gauge-metrics-100-timesTime: ✅ 125.242µs (SLO: <150.000µs 📉 -16.5%) vs baseline: +0.5% Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.4% ✅ 1-rate-metric-1-timesTime: ✅ 3.098µs (SLO: <20.000µs 📉 -84.5%) vs baseline: -0.7% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0% ✅ 1-rate-metrics-100-timesTime: ✅ 212.662µs (SLO: <250.000µs 📉 -14.9%) vs baseline: +0.3% Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.2% ✅ 100-count-metrics-100-timesTime: ✅ 21.399ms (SLO: <23.500ms -8.9%) vs baseline: -0.1% Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.8% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.008ms (SLO: <2.250ms 📉 -10.8%) vs baseline: +1.0% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.1% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.280ms (SLO: <1.550ms 📉 -17.5%) vs baseline: -1.5% Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.7% ✅ 100-rate-metrics-100-timesTime: ✅ 2.187ms (SLO: <2.550ms 📉 -14.2%) vs baseline: -0.2% Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9% ✅ flush-1-metricTime: ✅ 4.194µs (SLO: <20.000µs 📉 -79.0%) vs baseline: +1.6% Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.8% ✅ flush-100-metricsTime: ✅ 181.810µs (SLO: <250.000µs 📉 -27.3%) vs baseline: -0.1% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.1% ✅ flush-1000-metricsTime: ✅ 2.214ms (SLO: <2.500ms 📉 -11.4%) vs baseline: +0.6% Memory: ✅ 32.814MB (SLO: <34.500MB -4.9%) vs baseline: +4.7% 🟡 Near SLO Breach (5 suites)🟡 djangosimple - 30/30✅ appsecTime: ✅ 20.435ms (SLO: <22.300ms -8.4%) vs baseline: -0.2% Memory: ✅ 65.535MB (SLO: <67.000MB -2.2%) vs baseline: +5.0% ✅ exception-replay-enabledTime: ✅ 1.344ms (SLO: <1.450ms -7.3%) vs baseline: -0.3% Memory: ✅ 64.548MB (SLO: <67.000MB -3.7%) vs baseline: +4.8% ✅ iastTime: ✅ 20.451ms (SLO: <22.250ms -8.1%) vs baseline: ~same Memory: ✅ 65.593MB (SLO: <67.000MB -2.1%) vs baseline: +5.1% ✅ profilerTime: ✅ 15.303ms (SLO: <16.550ms -7.5%) vs baseline: +0.6% Memory: ✅ 53.730MB (SLO: <54.500MB 🟡 -1.4%) vs baseline: +4.7% ✅ resource-renamingTime: ✅ 20.542ms (SLO: <21.750ms -5.6%) vs baseline: -0.2% Memory: ✅ 65.464MB (SLO: <67.000MB -2.3%) vs baseline: +4.7% ✅ span-code-originTime: ✅ 26.191ms (SLO: <28.200ms -7.1%) vs baseline: ~same Memory: ✅ 67.694MB (SLO: <69.500MB -2.6%) vs baseline: +4.9% ✅ tracerTime: ✅ 20.462ms (SLO: <21.750ms -5.9%) vs baseline: -0.3% Memory: ✅ 65.564MB (SLO: <67.000MB -2.1%) vs baseline: +5.0% ✅ tracer-and-profilerTime: ✅ 22.081ms (SLO: <23.500ms -6.0%) vs baseline: +0.3% Memory: ✅ 66.563MB (SLO: <67.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ tracer-dont-create-db-spansTime: ✅ 19.310ms (SLO: <21.500ms 📉 -10.2%) vs baseline: -0.4% Memory: ✅ 65.476MB (SLO: <66.000MB 🟡 -0.8%) vs baseline: +5.0% ✅ tracer-minimalTime: ✅ 16.666ms (SLO: <17.500ms -4.8%) vs baseline: +0.4% Memory: ✅ 65.496MB (SLO: <66.000MB 🟡 -0.8%) vs baseline: +4.9% ✅ tracer-nativeTime: ✅ 20.400ms (SLO: <21.750ms -6.2%) vs baseline: ~same Memory: ✅ 71.389MB (SLO: <72.500MB 🟡 -1.5%) vs baseline: +4.8% ✅ tracer-no-cachesTime: ✅ 18.462ms (SLO: <19.650ms -6.0%) vs baseline: ~same Memory: ✅ 65.525MB (SLO: <67.000MB -2.2%) vs baseline: +5.0% ✅ tracer-no-databasesTime: ✅ 18.797ms (SLO: <20.100ms -6.5%) vs baseline: ~same Memory: ✅ 65.202MB (SLO: <67.000MB -2.7%) vs baseline: +4.9% ✅ tracer-no-middlewareTime: ✅ 20.146ms (SLO: <21.500ms -6.3%) vs baseline: -0.2% Memory: ✅ 65.527MB (SLO: <67.000MB -2.2%) vs baseline: +5.0% ✅ tracer-no-templatesTime: ✅ 20.281ms (SLO: <22.000ms -7.8%) vs baseline: -0.3% Memory: ✅ 65.463MB (SLO: <67.000MB -2.3%) vs baseline: +4.8% 🟡 errortrackingdjangosimple - 6/6✅ errortracking-enabled-allTime: ✅ 18.119ms (SLO: <19.850ms -8.7%) vs baseline: +0.5% Memory: ✅ 65.235MB (SLO: <66.500MB 🟡 -1.9%) vs baseline: +4.7% ✅ errortracking-enabled-userTime: ✅ 18.168ms (SLO: <19.400ms -6.4%) vs baseline: +0.8% Memory: ✅ 65.313MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.8% ✅ tracer-enabledTime: ✅ 18.155ms (SLO: <19.450ms -6.7%) vs baseline: +0.4% Memory: ✅ 65.274MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.8% 🟡 flasksimple - 18/18✅ appsec-getTime: ✅ 4.556ms (SLO: <4.750ms -4.1%) vs baseline: -0.2% Memory: ✅ 61.932MB (SLO: <65.000MB -4.7%) vs baseline: +4.9% ✅ appsec-postTime: ✅ 6.567ms (SLO: <6.750ms -2.7%) vs baseline: ~same Memory: ✅ 62.069MB (SLO: <65.000MB -4.5%) vs baseline: +5.0% ✅ appsec-telemetryTime: ✅ 4.558ms (SLO: <4.750ms -4.0%) vs baseline: -0.4% Memory: ✅ 61.892MB (SLO: <65.000MB -4.8%) vs baseline: +4.9% ✅ debuggerTime: ✅ 1.857ms (SLO: <2.000ms -7.1%) vs baseline: ~same Memory: ✅ 45.456MB (SLO: <47.000MB -3.3%) vs baseline: +5.2% ✅ iast-getTime: ✅ 1.885ms (SLO: <2.000ms -5.8%) vs baseline: +1.3% Memory: ✅ 42.330MB (SLO: <49.000MB 📉 -13.6%) vs baseline: +4.8% ✅ profilerTime: ✅ 1.912ms (SLO: <2.100ms -8.9%) vs baseline: ~same Memory: ✅ 46.517MB (SLO: <47.000MB 🟡 -1.0%) vs baseline: +4.9% ✅ resource-renamingTime: ✅ 3.374ms (SLO: <3.650ms -7.6%) vs baseline: -0.1% Memory: ✅ 52.316MB (SLO: <53.500MB -2.2%) vs baseline: +5.1% ✅ tracerTime: ✅ 3.364ms (SLO: <3.650ms -7.8%) vs baseline: -0.3% Memory: ✅ 52.180MB (SLO: <53.500MB -2.5%) vs baseline: +4.8% ✅ tracer-nativeTime: ✅ 3.372ms (SLO: <3.650ms -7.6%) vs baseline: +0.3% Memory: ✅ 58.317MB (SLO: <60.000MB -2.8%) vs baseline: +4.8% 🟡 otelspan - 22/22✅ add-eventTime: ✅ 42.333ms (SLO: <47.150ms 📉 -10.2%) vs baseline: -0.4% Memory: ✅ 44.439MB (SLO: <47.000MB -5.4%) vs baseline: +4.8% ✅ add-metricsTime: ✅ 315.163ms (SLO: <344.800ms -8.6%) vs baseline: -0.3% Memory: ✅ 594.899MB (SLO: <600.000MB 🟡 -0.9%) vs baseline: +4.8% ✅ add-tagsTime: ✅ 288.037ms (SLO: <314.000ms -8.3%) vs baseline: +0.5% Memory: ✅ 596.364MB (SLO: <600.000MB 🟡 -0.6%) vs baseline: +4.7% ✅ get-contextTime: ✅ 81.598ms (SLO: <92.350ms 📉 -11.6%) vs baseline: +1.3% Memory: ✅ 40.047MB (SLO: <46.500MB 📉 -13.9%) vs baseline: +5.2% ✅ is-recordingTime: ✅ 38.947ms (SLO: <44.500ms 📉 -12.5%) vs baseline: -0.4% Memory: ✅ 43.953MB (SLO: <47.500MB -7.5%) vs baseline: +4.9% ✅ record-exceptionTime: ✅ 60.088ms (SLO: <67.650ms 📉 -11.2%) vs baseline: +1.8% Memory: ✅ 40.326MB (SLO: <47.000MB 📉 -14.2%) vs baseline: +4.9% ✅ set-statusTime: ✅ 44.892ms (SLO: <50.400ms 📉 -10.9%) vs baseline: -0.1% Memory: ✅ 43.956MB (SLO: <47.000MB -6.5%) vs baseline: +4.8% ✅ startTime: ✅ 38.646ms (SLO: <43.450ms 📉 -11.1%) vs baseline: +1.6% Memory: ✅ 43.957MB (SLO: <47.000MB -6.5%) vs baseline: +4.7% ✅ start-finishTime: ✅ 82.763ms (SLO: <88.000ms -6.0%) vs baseline: ~same Memory: ✅ 34.583MB (SLO: <46.500MB 📉 -25.6%) vs baseline: +4.9% ✅ start-finish-telemetryTime: ✅ 84.147ms (SLO: <89.000ms -5.5%) vs baseline: ~same Memory: ✅ 34.623MB (SLO: <46.500MB 📉 -25.5%) vs baseline: +5.0% ✅ update-nameTime: ✅ 40.379ms (SLO: <45.150ms 📉 -10.6%) vs baseline: +0.5% Memory: ✅ 44.203MB (SLO: <47.000MB -6.0%) vs baseline: +4.6% 🟡 span - 26/26✅ add-eventTime: ✅ 20.670ms (SLO: <22.500ms -8.1%) vs baseline: -0.7% Memory: ✅ 50.233MB (SLO: <53.000MB -5.2%) vs baseline: +4.8% ✅ add-metricsTime: ✅ 91.408ms (SLO: <93.500ms -2.2%) vs baseline: +1.0% Memory: ✅ 661.073MB (SLO: <961.000MB 📉 -31.2%) vs baseline: +4.9% ✅ add-tagsTime: ✅ 148.120ms (SLO: <155.000ms -4.4%) vs baseline: ~same Memory: ✅ 660.750MB (SLO: <962.500MB 📉 -31.4%) vs baseline: +4.7% ✅ get-contextTime: ✅ 19.356ms (SLO: <20.500ms -5.6%) vs baseline: -0.5% Memory: ✅ 49.086MB (SLO: <53.000MB -7.4%) vs baseline: +4.9% ✅ is-recordingTime: ✅ 19.604ms (SLO: <20.500ms -4.4%) vs baseline: ~same Memory: ✅ 49.078MB (SLO: <53.000MB -7.4%) vs baseline: +4.9% ✅ record-exceptionTime: ✅ 38.271ms (SLO: <40.000ms -4.3%) vs baseline: -0.1% Memory: ✅ 42.713MB (SLO: <53.000MB 📉 -19.4%) vs baseline: +4.9% ✅ set-statusTime: ✅ 21.074ms (SLO: <22.000ms -4.2%) vs baseline: -0.7% Memory: ✅ 49.200MB (SLO: <53.000MB -7.2%) vs baseline: +5.0% ✅ startTime: ✅ 19.325ms (SLO: <20.500ms -5.7%) vs baseline: -0.2% Memory: ✅ 49.069MB (SLO: <53.000MB -7.4%) vs baseline: +4.8% ✅ start-finishTime: ✅ 51.621ms (SLO: <52.500ms 🟡 -1.7%) vs baseline: +0.5% Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9% ✅ start-finish-telemetryTime: ✅ 52.914ms (SLO: <54.500ms -2.9%) vs baseline: ~same Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.9% ✅ start-finish-traceid128Time: ✅ 54.895ms (SLO: <57.000ms -3.7%) vs baseline: +0.3% Memory: ✅ 32.027MB (SLO: <34.000MB -5.8%) vs baseline: +4.7% ✅ start-traceid128Time: ✅ 19.747ms (SLO: <22.500ms 📉 -12.2%) vs baseline: ~same Memory: ✅ 49.166MB (SLO: <53.000MB -7.2%) vs baseline: +5.2% ✅ update-nameTime: ✅ 20.160ms (SLO: <22.000ms -8.4%) vs baseline: +0.7% Memory: ✅ 49.752MB (SLO: <53.000MB -6.1%) vs baseline: +5.0%
|
Backport 23fe9e1 from #14912 to 3.16.
Description
Improve build_docs runtime by enabling
DD_FAST_BUILD=1and rotating the cache.The cache restore/saving time was taking about 8+ minutes.
I updated the cache to be time bound, so it'll rotate once per-month. After clearing the cache, the build took 10 minutes.
Testing
Risks
Additional Notes