Skip to content

Vllm playbook - #167

Merged
sreeram-11 merged 15 commits into
mainfrom
vllm-playbook
Apr 16, 2026
Merged

Vllm playbook#167
sreeram-11 merged 15 commits into
mainfrom
vllm-playbook

Conversation

@eddierichter-amd

Copy link
Copy Markdown
Collaborator

No description provided.

@danielholanda danielholanda left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added some initial comments

Comment thread playbooks/supplemental/vllm-inference/playbook.json
Comment thread playbooks/supplemental/vllm-inference/README.md
Comment thread playbooks/supplemental/vllm-inference/README.md Outdated
@eddierichter-amd
eddierichter-amd marked this pull request as ready for review March 28, 2026 22:11
@danielholanda
danielholanda requested a review from sreeram-11 April 1, 2026 21:58
Comment thread playbooks/supplemental/vllm-inference/README.md Outdated
Comment thread playbooks/supplemental/vllm-inference/README.md
Comment thread playbooks/supplemental/vllm-inference/README.md Outdated

@adamlam2-amd adamlam2-amd left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

left a couple comments above

@eddierichter-amd

Copy link
Copy Markdown
Collaborator Author

Hi @adamlam2-amd and @sreeram-11 thanks for the great comments! I just went through them. Please let me know anymore feedback you have and there are additional changes that I should make.

@adamlam2-amd adamlam2-amd left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can merge it but this might require significant changing and monitoring of the versions of:

  • vllm
  • pytorch
  • rocm
  • model versions
  • python

We also have to wait for rocm 7.13 and py3.13, at least for the halo box.

@sreeram-11
sreeram-11 merged commit 301e42b into main Apr 16, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants