Skip to content

Commit 30b1bdf

Browse files
committed
fix: 修复openai计算token错误
(cherry picked from commit 3d1b3ea)
1 parent d1e9081 commit 30b1bdf

File tree

1 file changed

+2
-2
lines changed
  • apps/setting/models_provider/impl/openai_model_provider/model

1 file changed

+2
-2
lines changed

apps/setting/models_provider/impl/openai_model_provider/model/llm.py

+2-2
Original file line numberDiff line numberDiff line change
@@ -46,14 +46,14 @@ def new_instance(model_type, model_name, model_credential: Dict[str, object], **
4646

4747
def get_num_tokens_from_messages(self, messages: List[BaseMessage]) -> int:
4848
try:
49-
super().get_num_tokens_from_messages(messages)
49+
return super().get_num_tokens_from_messages(messages)
5050
except Exception as e:
5151
tokenizer = TokenizerManage.get_tokenizer()
5252
return sum([len(tokenizer.encode(get_buffer_string([m]))) for m in messages])
5353

5454
def get_num_tokens(self, text: str) -> int:
5555
try:
56-
super().get_num_tokens(text)
56+
return super().get_num_tokens(text)
5757
except Exception as e:
5858
tokenizer = TokenizerManage.get_tokenizer()
5959
return len(tokenizer.encode(text))

0 commit comments

Comments
 (0)