Repository navigation
Commit fcb4d8e
Re-add vllm-project/vllm#58671's ROCm paged MXFP4 sparse indexer
Stacked on #3555. Re-adds the --attention-config flag enabling #58671's
ROCm paged MXFP4 sparse-logits indexer and the --block-size 128 workaround
its active fp4 indexer needs (vLLM's block-size auto-resolution otherwise
picks 64 across this model's 4+ attention backends). Draft until #58671
merges upstream and lands in a nightly image, so #3555 can run now and this
PR can re-sweep immediately once it's available.
Signed-off-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>1 parent 3e3ad54 commit fcb4d8e
3 files changed
Lines changed: 22 additions & 5 deletions
File tree
- inferencex-e2e
- benchmarks/single_node/srt-slurm-recipes/dsv41flash/vllm/mi355x-fp4-mtp
- configs
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
10 | | - | |
11 | | - | |
12 | | - | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
| |||
44 | 44 | | |
45 | 45 | | |
46 | 46 | | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
47 | 57 | | |
48 | 58 | | |
49 | 59 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1386 | 1386 | | |
1387 | 1387 | | |
1388 | 1388 | | |
1389 | | - | |
1390 | | - | |
| 1389 | + | |
| 1390 | + | |
1391 | 1391 | | |
1392 | 1392 | | |
1393 | 1393 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
9010 | 9010 | | |
9011 | 9011 | | |
9012 | 9012 | | |
| 9013 | + | |
| 9014 | + | |
| 9015 | + | |
| 9016 | + | |
| 9017 | + | |
| 9018 | + | |
| 9019 | + | |
0 commit comments