Skip to content

Conversation

@dagil-nvidia
Copy link
Contributor

Summary

Cherry-pick of PR #3828 to release/0.6.0

Original PR

Changes

Adds comprehensive Kubernetes deployment documentation to the KV router guide including:

  • Kubernetes deployment section with DYN_ROUTER_MODE environment variable configuration
  • CLI argument to K8s environment variable mapping table
  • Links to working K8s examples (TRT-LLM, vLLM, SGLang, distributed inference)
  • Reference to KV Router A/B Benchmarking Guide
  • Advanced configuration examples

Type

  • Documentation update
  • Low risk (docs-only change)

Checklist

  • Cherry-picked from main with DCO sign-off
  • Clean cherry-pick (no conflicts)
  • Updated Cherry Pick table in release canvas

@dagil-nvidia dagil-nvidia requested a review from PeaBrane October 22, 2025 22:59
@copy-pr-bot
Copy link

copy-pr-bot bot commented Oct 22, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@dagil-nvidia dagil-nvidia self-assigned this Oct 22, 2025
@github-actions github-actions bot added the docs label Oct 22, 2025
@dagil-nvidia
Copy link
Contributor Author

/ok to test cda7f41

@github-actions
Copy link

github-actions bot commented Oct 22, 2025

📚 Documentation Preview

📖 View Latest Documentation: https://crispy-winner-3jnj38w.pages.github.io/release/0.6.0/pr-3836/

Latest Deployment:

  • Commit: 7132a1ec (latest push)
  • Target: release/0.6.0
  • Updated: 10/22/25, 11:01 PM UTC

Note: This link always shows the documentation for the latest commit. It may take a few minutes for GitHub Pages to update after each push.


Auto-updated by the documentation deployment workflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants