Skip to content

speed-bench: add Apple M5 Max results#584

Open
altdotboy wants to merge 1 commit into
antirez:mainfrom
altdotboy:add-m5-max-benchmark
Open

speed-bench: add Apple M5 Max results#584
altdotboy wants to merge 1 commit into
antirez:mainfrom
altdotboy:add-m5-max-benchmark

Conversation

@altdotboy

Copy link
Copy Markdown

Adds a ds4-bench sweep for the Apple M5 Max (128 GiB), which was not yet in speed-bench/.

Run with the canonical command from speed-bench/README.md:

./ds4-bench \
  -m ds4flash.gguf \
  --prompt-file speed-bench/promessi_sposi.txt \
  --ctx-start 2048 --ctx-max 65536 --step-incr 2048 --gen-tokens 128
  • Model: DeepSeek-V4-Flash IQ2XXS, Metal backend, full residency (~80.8 GiB).
  • Files: speed-bench/m5_max.csv (full 32-frontier sweep) and speed-bench/m5_max_ts.svg (plotted via plot_speed.py).

Representative points:

Context Prefill t/s Decode t/s (steady)
2,048 340 ~32
32,768 239 27.3
65,536 210 25.3

Decode stays nearly flat past 32k context.

🤖 Generated with Claude Code

Canonical ds4-bench sweep (2048..65536 ctx, step 2048, 128 gen tokens)
on Apple M5 Max, 128 GiB, Metal backend, DeepSeek-V4-Flash IQ2XXS.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
thomasjohnflaherty added a commit to thomasjohnflaherty/ds4 that referenced this pull request Jul 22, 2026
…nt vs antirez#584

Renames the M5 Max CSV/SVG to encode the Q2+Q4 quant mix so this run can coexist
with the pure-IQ2XXS M5 Max results in antirez#584 rather than colliding on the shared
m5_max.* filename. Content unchanged; SVG name follows the plot_speed.py _ts.svg
convention derived from the CSV basename.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant