Skip to content

fix: use the configured network interface for SGLang distributed initialization - #497

Merged
ishandhanani merged 1 commit into
NVIDIA:mainfrom
SemiAnalysisAI:fix/sglang-distributed-init-interface
Sep 23, 2026
Merged

ishandhanani merged 1 commit into
NVIDIA:mainfrom
SemiAnalysisAI:fix/sglang-distributed-init-interface

Conversation

@cquil11

@cquil11 cquil11 commented Sep 23, 2026

Copy link
Copy Markdown
Contributor

Pass the configured network_interface when resolving SGLang’s distributed-init leader address, for regular and sidecar launches. Previously these calls ignored the cluster setting and could select a default-route address unreachable by peer nodes.

Applies when one SGLang worker spans multiple nodes, not merely when prefill and decode occupy separate nodes. Includes interface-selection tests.

Extracted from #433; independent of ATOM/AToMesh and the AMD stack. 331 focused tests pass. No E2E failure is attributed to this change and no new E2E run was launched.

@cquil11 cquil11 changed the title Fix SGLang distributed initialization to use the configured network interface fix: use the configured network interface for SGLang distributed initialization Sep 23, 2026
@ishandhanani
ishandhanani merged commit 9a85c2c into NVIDIA:main Sep 23, 2026
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants