Skip to content

Commit 6358406

Browse files
authored
[Fix] fix mla bug when no broadcast in wait for save (#398)
1 parent 63c916b commit 6358406

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ucm/integration/vllm/ucm_connector.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -482,7 +482,7 @@ def save_kv_layer(
482482

483483
def wait_for_save(self) -> None:
484484

485-
if self.load_only_first_rank and self.rank != 0:
485+
if self.is_mla and self.rank != 0:
486486
return
487487

488488
metadata = self._get_connector_metadata()

0 commit comments

Comments
 (0)