Skip to content

Add Qwen3.5 MTP speculative decoding#351

Open
aleroot wants to merge 1 commit into
ml-explore:mainfrom
aleroot:Qwen3MTP
Open

Add Qwen3.5 MTP speculative decoding#351
aleroot wants to merge 1 commit into
ml-explore:mainfrom
aleroot:Qwen3MTP

Conversation

@aleroot

@aleroot aleroot commented Jun 15, 2026

Copy link
Copy Markdown
Contributor

Proposed changes

Adds Qwen3.5/Qwen3.6 MTP speculative decoding support for text and VLM models.

Checklist

Put an x in the boxes that apply.

  • I have read the CONTRIBUTING document
  • I have run pre-commit run --all-files to format my code / installed pre-commit prior to committing changes
  • I have added tests that prove my fix is effective or that my feature works
  • I have updated the necessary documentation (if needed)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant