Skip to content

Commit 936c720

Browse files
VALLIS-NERIAgovind-ramnarayan
authored andcommitted
[https://nvbugs/5532789] [doc] Add documents about CUDA 12.9 (NVIDIA#8411)
Signed-off-by: Xiwen Yu <[email protected]>
1 parent 5fac3d2 commit 936c720

File tree

2 files changed

+10
-0
lines changed

2 files changed

+10
-0
lines changed

docs/source/installation/build-from-source-linux.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -147,6 +147,11 @@ check <https://github.com/NVIDIA/TensorRT-LLM/tree/main/docker>.
147147

148148
## Build TensorRT LLM
149149

150+
```{tip}
151+
:name: build-from-source-tip-cuda-version
152+
TensorRT LLM 1.1 supports both CUDA 12.9 and 13.0 while some dependency changes are required. The `requirements.txt` contains dependencies needed by CUDA 13.0. If you are using CUDA 12.9, please uncomment lines end with `# <For CUDA 12.9>` and comment out the next lines.
153+
```
154+
150155
### Option 1: Full Build with C++ Compilation
151156
152157
The following command compiles the C++ code and packages the compiled libraries along with the Python files into a wheel. When developing C++ code, you need this full build command to apply your code changes.

docs/source/installation/linux.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,11 @@
1212
Install CUDA Toolkit following the [CUDA Installation Guide for Linux](https://docs.nvidia.com/cuda/cuda-installation-guide-linux/) and
1313
make sure `CUDA_HOME` environment variable is properly set.
1414

15+
```{tip}
16+
:name: installation-linux-tip-cuda-version
17+
TensorRT LLM 1.1 supports both CUDA 12.9 and 13.0. The wheel package release only supports CUDA 12.9, while CUDA 13.0 is only supported through NGC container release.
18+
```
19+
1520
```bash
1621
# Optional step: Only required for NVIDIA Blackwell GPUs and SBSA platform
1722
pip3 install torch==2.7.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu128

0 commit comments

Comments
 (0)