Commit 35112de
committed
ci(linux): build fat package — GGML_BACKEND_DL + GGML_CPU_ALL_VARIANTS
Replace the AVX2/FMA/F16C portable baseline (#3) with a fat-package build
that produces one libstable-diffusion.so plus a libggml-cpu-*.so per CPU
variant — sandybridge, haswell, skylakex (AVX-512F), icelake (AVX-512 +
VNNI), alderlake (AVX-512 + VNNI + DOTPROD), and a pure-x64 fallback.
At runtime ggml dlopens the variants and picks the highest-tier one the
host CPU supports. AVX-512 hosts get AVX-512 perf; older boxes fall back
gracefully — no -march=native runner lottery, no SIGILL.
Tradeoff: zip grows from ~12 MB → ~50–80 MB. Acceptable for a one-time
download, especially since downstream consumers (Lemonade) cache the
extracted directory across model loads.
Applied to ubuntu-latest-cmake (CPU) and ubuntu-latest-rocm (HIP), since
the HIPBLAS build still uses ggml CPU ops for parts of the pipeline.
Windows AVX2 already pins GGML_NATIVE=OFF + AVX2 only, and macOS arm64
shares a uniform NEON+DOTPROD+i8mm+bf16 baseline across all Apple Silicon
generations, so neither needs the same treatment.
Upstream PR leejet#1448 (commit b8079e2) wired the
runtime backend discovery code into libstable-diffusion.so already; this
just enables the build flag that produces the variant .so files.1 parent b6f38cd commit 35112de
1 file changed
Lines changed: 13 additions & 13 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
53 | 53 | | |
54 | 54 | | |
55 | 55 | | |
56 | | - | |
57 | | - | |
58 | | - | |
59 | | - | |
60 | | - | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
61 | 62 | | |
62 | 63 | | |
63 | | - | |
64 | | - | |
65 | | - | |
| 64 | + | |
| 65 | + | |
66 | 66 | | |
67 | 67 | | |
68 | 68 | | |
| |||
513 | 513 | | |
514 | 514 | | |
515 | 515 | | |
516 | | - | |
517 | | - | |
| 516 | + | |
| 517 | + | |
| 518 | + | |
518 | 519 | | |
519 | 520 | | |
520 | 521 | | |
521 | 522 | | |
522 | 523 | | |
523 | | - | |
524 | | - | |
525 | | - | |
| 524 | + | |
| 525 | + | |
526 | 526 | | |
527 | 527 | | |
528 | 528 | | |
| |||
0 commit comments