Skip to content

update to TensorRT LLM 0.15.0 #9

@mmoskal

Description

@mmoskal

Things to look for:

  • enable_max_num_tokens_tuning
  • examples/prompt_lookup/README.md
  • executorExampleFastLogits

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions