Repository navigation
Commit 3a7c64b
committed
ci(codspeed): stop manufacturing spurious benchmark changes
Two CI causes of reports flagging benchmarks that the PR cannot affect.
Serialised develop baselines. All develop pushes shared one concurrency
group and never cancel, so they ran strictly one at a time. A burst of
merges leaves later commits without a finished baseline, and CodSpeed then
falls back to an older comparison base with its own footnote: "No
successful run was found on develop (X), so Y was used instead. There
might be some changes unrelated to this pull request in this report."
That footnote appears on four of twelve open-PR reports, and it lines up
with the benchmarks that flip between two fixed values in opposite
directions on unrelated PRs. Give each develop push its own group so
baselines still run on every commit, as the comment intends, without
queueing behind each other. Develop runs can now overlap, which raises
peak demand on a preemptible runner pool.
CUDA walltime suite triggered by any workflow edit. The paths filter
matched .github/workflows/**, so every dependency bump ran the walltime
CUDA benchmarks. Eleven CI-only PRs reported
cuda/bitpacked_u8/unpack/3bw[100M] improving 18-19% from an identical
base, each carrying CodSpeed's own warning that walltime on standard
hosted runners produces inconsistent data. Only this workflow defines
those jobs, so match just this file. Non-pull_request events still always
run the CUDA suite, so develop keeps full coverage.
Signed-off-by: Claude <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_015ypCZPxvLuJK9FgWKF8U4P1 parent 9d4ac37 commit 3a7c64b
1 file changed
Lines changed: 7 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
6 | | - | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
7 | 9 | | |
8 | 10 | | |
9 | | - | |
| 11 | + | |
10 | 12 | | |
11 | 13 | | |
12 | 14 | | |
| |||
40 | 42 | | |
41 | 43 | | |
42 | 44 | | |
43 | | - | |
| 45 | + | |
| 46 | + | |
44 | 47 | | |
45 | 48 | | |
46 | 49 | | |
| |||
0 commit comments