Skip to content

Commit 0b1b2ff

Browse files
docs: define upstream-first fork policy
1 parent e28ea62 commit 0b1b2ff

1 file changed

Lines changed: 31 additions & 0 deletions

File tree

RUNANYWHERE.md

Lines changed: 31 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,31 @@
1+
# RunAnywhere llama.cpp maintenance notes
2+
3+
This is a direct fork of `ggml-org/llama.cpp`. The RunAnywhere integration
4+
branch carries the DeepGrove Maple model architecture and ternary expert graph
5+
from `deepgrove-ai/llama.cpp`; it does not wholesale-track that fork.
6+
7+
## Backend status
8+
9+
- CPU: Maple Preview, PrismML Bonsai `Q1_0`, and canonical `Q2_0` are supported.
10+
- Metal: Bonsai `Q1_0` and canonical `Q2_0` are supported.
11+
- Maple must use CPU execution. Its expert path requires a ternary
12+
`mul_mm_id` Metal pipeline that the current DeepGrove patch does not provide.
13+
- Prism's older `Q2_0` artifacts used a non-canonical 128-value block under the
14+
same GGUF type ID. Do not change the global type to accommodate them. Use the
15+
newer `Q2_0_g64` artifacts Prism publishes for canonical llama.cpp instead;
16+
this preserves CUDA, Vulkan, Metal, SYCL, WebGPU, and conversion compatibility.
17+
18+
## Rebase and release checklist
19+
20+
1. Rebase the integration branch onto a pinned canonical llama.cpp revision.
21+
2. Re-apply the two small Maple commits and resolve only their architecture
22+
registration/model graph surface.
23+
3. Build `llama-cli` on macOS with Metal and on Linux with the CPU backend.
24+
4. Run real inference with the pinned Maple Preview, Bonsai `Q1_0`, and Prism
25+
`Q2_0_g64` GGUF fixtures recorded in the RunAnywhere SDK runtime plan.
26+
5. Keep Maple CPU-only until a real GPU expert pipeline passes the same model
27+
smoke test.
28+
6. Tag the exact tested commit and pin the SDK to that immutable tag or SHA.
29+
30+
The upstream remote for maintenance should always be
31+
`https://github.com/ggml-org/llama.cpp.git`.

0 commit comments

Comments
 (0)