Skip to content

Commit 7f753d9

Browse files
committed
Update modeling_gpt_oss.py
Signed-off-by: dongfengy <[email protected]>
1 parent 9ae47b7 commit 7f753d9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tensorrt_llm/_torch/models/modeling_gpt_oss.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -227,7 +227,7 @@ def _create_ideal_expert_load_balanced_logits(
227227

228228
def compute_gate_output(self, x: torch.Tensor) -> torch.Tensor:
229229
if get_sm_version() in [
230-
90, 100
230+
90, 100, 103
231231
] and x.shape[0] <= MIN_LATENCY_TINYGEMM_NUM_TOKENS:
232232
weight = self.gate.weight
233233
bias = self.gate.bias

0 commit comments

Comments
 (0)