Files

.github
3rdparty
benchmarks
cpp
docker
docs
examples
- apps
- arctic
- baichuan
- bert
- bindings/executor
- blip2
- bloom
- chatglm
- cogvlm
- commandr
- cpp/executor
- cpp_library
- dbrx
- deepseek_v1
- deepseek_v2
- dit
- draft_target_model
- eagle
- enc_dec
- exaone
- falcon
- gemma
- gpt
- gptj
- gptneox
- grok
- infinitebench
- internlm
- internlm2
- jais
- llama
- llm-api
- lookahead
- mamba
- medusa
- mixtral
- mllama
- model_api
- mpt
- multimodal
- nemotron
- nemotron_nas
- openai_triton
- opt
- phi
- prompt_lookup
- python_plugin
- quantization
- qwen
- qwenvl
- recurrentgemma
- redrafter
- sample_weight_stripping
- sdxl
- skywork
- smaug
- whisper
- eval_long_context.py
- generate_checkpoint_config.py
- hf_lora_convert.py
- mmlu.py
- run.py
- summarize.py
- utils.py
scripts
tensorrt_llm
tests
windows
.clang-format
.dockerignore
.gitattributes
.gitignore
.gitmodules
.pre-commit-config.yaml
LICENSE
README.md
requirements-dev-windows.txt
requirements-dev.txt
requirements-windows.txt
requirements.txt
setup.cfg
setup.py

examples

kaiyux

Update TensorRT-LLM (NVIDIA#2582 )

Dec 17, 2024

be17881 · Dec 17, 2024

History

This branch is 288 commits behind NVIDIA/TensorRT-LLM:main.

Name	Name	Last commit message	Last commit date
parent directory ..
apps	apps	Update TensorRT-LLM (NVIDIA#2532 )	Dec 4, 2024
arctic	arctic	Update TensorRT-LLM (NVIDIA#1793 )	Jun 18, 2024
baichuan	baichuan	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
bert	bert	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
bindings/executor	bindings/executor	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
blip2	blip2	Update TensorRT-LLM (NVIDIA#1168 )	Feb 27, 2024
bloom	bloom	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
chatglm	chatglm	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
cogvlm	cogvlm	Update TensorRT-LLM (NVIDIA#2562 )	Dec 11, 2024
commandr	commandr	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
cpp/executor	cpp/executor	Update TensorRT-LLM (NVIDIA#2562 )	Dec 11, 2024
cpp_library	cpp_library	Update TensorRT-LLM (NVIDIA#1274 )	Mar 12, 2024
dbrx	dbrx	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
deepseek_v1	deepseek_v1	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
deepseek_v2	deepseek_v2	Update TensorRT-LLM (NVIDIA#2562 )	Dec 11, 2024
dit	dit	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
draft_target_model	draft_target_model	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
eagle	eagle	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
enc_dec	enc_dec	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
exaone	exaone	Update TensorRT-LLM (NVIDIA#2333 )	Oct 15, 2024
falcon	falcon	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
gemma	gemma	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
gpt	gpt	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
gptj	gptj	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
gptneox	gptneox	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
grok	grok	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
infinitebench	infinitebench	Update TensorRT-LLM (NVIDIA#1725 )	Jun 4, 2024
internlm	internlm	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
internlm2	internlm2	Update TensorRT-LLM (NVIDIA#2562 )	Dec 11, 2024
jais	jais	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
llama	llama	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
llm-api	llm-api	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
lookahead	lookahead	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
mamba	mamba	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
medusa	medusa	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
mixtral	mixtral	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
mllama	mllama	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
model_api	model_api	Update TensorRT-LLM (NVIDIA#2502 )	Nov 26, 2024
mpt	mpt	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
multimodal	multimodal	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
nemotron	nemotron	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
nemotron_nas	nemotron_nas	Update TensorRT-LLM (NVIDIA#2562 )	Dec 11, 2024
openai_triton	openai_triton	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
opt	opt	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
phi	phi	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
prompt_lookup	prompt_lookup	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
python_plugin	python_plugin	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
quantization	quantization	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
qwen	qwen	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
qwenvl	qwenvl	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
recurrentgemma	recurrentgemma	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
redrafter	redrafter	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
sample_weight_stripping	sample_weight_stripping	Update TensorRT-LLM (NVIDIA#2008 )	Jul 23, 2024
sdxl	sdxl	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
skywork	skywork	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
smaug	smaug	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
whisper	whisper	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
eval_long_context.py	eval_long_context.py	Update TensorRT-LLM (NVIDIA#2008 )	Jul 23, 2024
generate_checkpoint_config.py	generate_checkpoint_config.py	Update TensorRT-LLM (NVIDIA#2562 )	Dec 11, 2024
hf_lora_convert.py	hf_lora_convert.py	Update TensorRT-LLM (NVIDIA#2389 )	Oct 29, 2024
mmlu.py	mmlu.py	Update TensorRT-LLM (NVIDIA#2460 )	Nov 19, 2024
run.py	run.py	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
summarize.py	summarize.py	Update TensorRT-LLM (NVIDIA#2582 )	Dec 17, 2024
utils.py	utils.py	Update TensorRT-LLM (NVIDIA#2532 )	Dec 4, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Files

examples

examples

Files

examples

Directory actions

More options

Directory actions

More options

Latest commit

History

examples

Folders and files

parent directory