Skip to content

Commit b8f00a8

Browse files
author
bzgoogle
committed
update interface of original_set_lora based on vllm side change
1 parent 600c1f5 commit b8f00a8

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

tpu_inference/models/vllm/vllm_model_wrapper.py

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -255,11 +255,9 @@ def _tpu_set_lora(
255255
lora_a: torch.Tensor,
256256
lora_b: torch.Tensor,
257257
embeddings_tensor: Optional[torch.Tensor],
258-
bias: Optional[torch.Tensor] = None,
259258
):
260259
with torchax.default_env():
261-
self._original_set_lora(index, lora_a, lora_b, embeddings_tensor,
262-
bias)
260+
self._original_set_lora(index, lora_a, lora_b, embeddings_tensor)
263261

264262
def _tpu_reset_lora(self, index: int):
265263
with torchax.default_env():

0 commit comments

Comments
 (0)