Skip to content

[DeepSeek][ROCm] V4.1-Flash: recommend the ROCm 10.0 nightly image #1068

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Fangzhou-Ai merged 1 commit into from
Oct 3, 2026
Merged

[DeepSeek][ROCm] V4.1-Flash: recommend the ROCm 10.0 nightly image #1068

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions models/deepseek-ai/DeepSeek-V4.1-Flash.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ meta:
provider: "DeepSeek"
description: "DeepSeek V4.1 Flash vision-language MoE (552B backbone; 8B active per prompt token, 16B per output token) combining sliding-window plus compressed sparse attention with a two-level indexer, engram n-gram memory, hyper-connections, and a DSpark multi-token draft head."
date_added: 2026-09-09
date_updated: 2026-10-02
date_updated: 2026-10-03
difficulty: advanced
tasks:
- text
Expand Down Expand Up @@ -37,8 +37,9 @@ model:
nightly_required: true
default_frontend: rust
docker_image:
# Includes the AITER mHC delayed-pre path from vllm-project/vllm#56503.
amd: "vllm/vllm-openai-rocm:nightly"
# ROCm 10.0 nightly channel; includes the AITER mHC delayed-pre path from
# vllm-project/vllm#56503.
amd: "vllm/vllm-openai-rocm:nightly-rocm100"
architecture: moe
parameter_count: "552B"
active_parameters: "8-16B"
Expand Down Expand Up @@ -537,7 +538,7 @@ guide: |
landed on `main` in [vllm-project/vllm#56228](https://github.com/vllm-project/vllm/pull/56228),
so any nightly from 2026-09-10 on serves it, and the launch-day
`deepseekv41-flash-0909` tag is no longer needed. On AMD it is
`vllm/vllm-openai-rocm:nightly`, which also carries
`vllm/vllm-openai-rocm:nightly-rocm100`, the ROCm 10.0 nightly, which also carries
[vllm-project/vllm#56503](https://github.com/vllm-project/vllm/pull/56503) — the change
that moves the mHC delayed pre block off the eager Torch reference and onto AITER
and postdates the 0909 tag.
Expand Down