Repository navigation
Commit 7d29ebe
committed
[#21014][fix] DeepSeek DSML tool parsers: match closing tags structurally
A DSML parameter, invoke or calls closing tag only ends its element when the
text after it is a valid continuation, so parameter values may contain the
literal tags. The V3.2 parser derives every tag from class attributes so the
V4 and V4.1 parsers inherit the fix. finish() also emits an invoke whose
closing tag ends the stream, parse_partial reports only confirmed calls, and
the non-streaming path keeps the end-of-sentence token inside parameter
values.
Signed-off-by: Zihua Wu <13583761+lucifer1004@users.noreply.github.com>1 parent 7587cc8 commit 7d29ebe
4 files changed
Lines changed: 541 additions & 100 deletions
File tree
- tensorrt_llm/serve/tool_parser
- tests/unittest/llmapi/apps
0 commit comments