|
| 1 | +# RunAnywhere llama.cpp maintenance notes |
| 2 | + |
| 3 | +This is a direct fork of `ggml-org/llama.cpp`. The RunAnywhere integration |
| 4 | +branch carries the DeepGrove Maple model architecture and ternary expert graph |
| 5 | +from `deepgrove-ai/llama.cpp`; it does not wholesale-track that fork. |
| 6 | + |
| 7 | +## Backend status |
| 8 | + |
| 9 | +- CPU: Maple Preview, PrismML Bonsai `Q1_0`, and canonical `Q2_0` are supported. |
| 10 | +- Metal: Bonsai `Q1_0` and canonical `Q2_0` are supported. |
| 11 | +- Maple must use CPU execution. Its expert path requires a ternary |
| 12 | + `mul_mm_id` Metal pipeline that the current DeepGrove patch does not provide. |
| 13 | +- Prism's older `Q2_0` artifacts used a non-canonical 128-value block under the |
| 14 | + same GGUF type ID. Do not change the global type to accommodate them. Use the |
| 15 | + newer `Q2_0_g64` artifacts Prism publishes for canonical llama.cpp instead; |
| 16 | + this preserves CUDA, Vulkan, Metal, SYCL, WebGPU, and conversion compatibility. |
| 17 | + |
| 18 | +## Rebase and release checklist |
| 19 | + |
| 20 | +1. Rebase the integration branch onto a pinned canonical llama.cpp revision. |
| 21 | +2. Re-apply the two small Maple commits and resolve only their architecture |
| 22 | + registration/model graph surface. |
| 23 | +3. Build `llama-cli` on macOS with Metal and on Linux with the CPU backend. |
| 24 | +4. Run real inference with the pinned Maple Preview, Bonsai `Q1_0`, and Prism |
| 25 | + `Q2_0_g64` GGUF fixtures recorded in the RunAnywhere SDK runtime plan. |
| 26 | +5. Keep Maple CPU-only until a real GPU expert pipeline passes the same model |
| 27 | + smoke test. |
| 28 | +6. Tag the exact tested commit and pin the SDK to that immutable tag or SHA. |
| 29 | + |
| 30 | +The upstream remote for maintenance should always be |
| 31 | +`https://github.com/ggml-org/llama.cpp.git`. |
0 commit comments