Skip to content

[TRTLLM-8464][infra] use script for triton WAR code #8191

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

[TRTLLM-8464][infra] use script for triton WAR code #8191

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
7985fff
[TRTLLM-8464] use script for triton WAR code
ZhanruiSunCh Oct 10, 2025
6b672dc
Update rename_pytorch_triton_to_triton.sh
ZhanruiSunCh Oct 14, 2025
20917b9
Update Dockerfile.multi
ZhanruiSunCh Oct 14, 2025
285af1c
Update Dockerfile.multi
ZhanruiSunCh Oct 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 3 additions & 11 deletions docker/Dockerfile.multi
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -73,20 +73,12 @@ RUN bash ./install.sh --opencv && bash ./install.sh --protobuf && rm install.sh

# wait for new triton to be published
# Rename pytorch_triton package to triton
COPY docker/common/rename_pytorch_triton_to_triton.sh rename_pytorch_triton_to_triton.sh
RUN if [ -f /etc/redhat-release ]; then \
echo "Rocky8 detected, skipping symlink and ldconfig steps"; \
rm rename_pytorch_triton_to_triton.sh; \
else \
cd /usr/local/lib/python3.12/dist-packages/ && \
ls -la | grep pytorch_triton && \
mv pytorch_triton-3.3.1+gitc8757738.dist-info triton-3.3.1+gitc8757738.dist-info && \
cd triton-3.3.1+gitc8757738.dist-info && \
echo "Current directory: $(pwd)" && \
echo "Files in directory:" && \
ls -la && \
sed -i 's/^Name: pytorch-triton/Name: triton/' METADATA && \
sed -i 's|pytorch_triton-3.3.1+gitc8757738.dist-info/|triton-3.3.1+gitc8757738.dist-info/|g' RECORD && \
echo "METADATA after update:" && \
grep "^Name:" METADATA; \
bash ./rename_pytorch_triton_to_triton.sh && rm rename_pytorch_triton_to_triton.sh \
fi


Expand Down
13 changes: 13 additions & 0 deletions docker/common/rename_pytorch_triton_to_triton.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
#!/usr/bin/env bash

cd /usr/local/lib/python3.12/dist-packages/
ls -la | grep pytorch_triton
mv pytorch_triton-3.3.1+gitc8757738.dist-info triton-3.3.1+gitc8757738.dist-info
cd triton-3.3.1+gitc8757738.dist-info
echo "Current directory: $(pwd)"
echo "Files in directory:"
ls -la
sed -i 's/^Name: pytorch-triton/Name: triton/' METADATA
sed -i 's|pytorch_triton-3.3.1+gitc8757738.dist-info/|triton-3.3.1+gitc8757738.dist-info/|g' RECORD
echo "METADATA after update:"
grep "^Name:" METADATA;
15 changes: 1 addition & 14 deletions jenkins/L0_Test.groovy
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2433,20 +2433,7 @@ def launchTestJobs(pipeline, testFilter)

// TODO: Remove this after public triton supports CUDA 13.
if (key == "PY312-DLFW" && values[2] == X86_64_TRIPLE) {
trtllm_utils.llmExecStepWithRetry(pipeline, script: "pip3 install https://download.pytorch.org/whl/nightly/pytorch_triton-3.3.1%2Bgitc8757738-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl")
sh """
cd /usr/local/lib/python3.12/dist-packages/ && \
ls -la | grep pytorch_triton && \
mv pytorch_triton-3.3.1+gitc8757738.dist-info triton-3.3.1+gitc8757738.dist-info && \
cd triton-3.3.1+gitc8757738.dist-info && \
echo "Current directory: \$(pwd)" && \
echo "Files in directory:" && \
ls -la && \
sed -i 's/^Name: pytorch-triton/Name: triton/' METADATA && \
sed -i 's|pytorch_triton-3.3.1+gitc8757738.dist-info/|triton-3.3.1+gitc8757738.dist-info/|g' RECORD && \
echo "METADATA after update:" && \
grep "^Name:" METADATA
"""
trtllm_utils.llmExecStepWithRetry(pipeline, script: "bash ${LLM_ROOT}/docker/common/rename_pytorch_triton_to_triton.sh")
}

def libEnv = []
Expand Down