-
Notifications
You must be signed in to change notification settings - Fork 20
Open
Labels
good first issueGood for newcomersGood for newcomers
Description
We had to add a dependency on transformers in order to perform client-side tokenization when using fmperf with vLLM. Since vLLM recently added support for server-side truncation, this is no longer necessary. We should be able to adapt the load generator to use this new feature, removing that dependency completely.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
good first issueGood for newcomersGood for newcomers