Skip to content

Commit

Permalink
AMD: Use bash to call run scripts
Browse files Browse the repository at this point in the history
AMD's internal repo had execution permissions enabled on scripts
for launching the workload, but the execuctable permission was
lost in the submission package.  Switch to using bash to execute
these scripts so that they will work properly without being
executable.
  • Loading branch information
JArnoldAMD committed Sep 29, 2024
1 parent 8e59f1a commit d252efa
Show file tree
Hide file tree
Showing 8 changed files with 28 additions and 28 deletions.
8 changes: 4 additions & 4 deletions closed/AMD/code/llama2-70b-99.9/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,17 +48,17 @@ KV cache scales for the quantized model weights are used and were downloaded fro
To generate results for the full submission, running the command below in an inference container. Logs can be found in `/lab-hist/mlperf-results/$datetime1/$datetime2`.
``` bash
cd /lab-mlperf-inference/code/llama2-70b-99.9/test_VllmFp8
./run_scenarios.sh
bash ./run_scenarios.sh
```

To generate results for the Offline scenario only, run the command below in an inference container. Logs can be found in `/lab-hist/mlperf-results/$datetime1/$datetime2/Offline`.
``` bash
cd /lab-mlperf-inference/code/llama2-70b-99.9/test_VllmFp8
./run_tests_Offline.sh
bash ./run_tests_Offline.sh
```

To generate results for the Server scenario only, run the command below in an inference container. Logs can be found in `/lab-hist/mlperf-results/$datetime1/$datetime2/Server`.
``` bash
cd /lab-mlperf-inference/code/llama2-70b-99.9/test_VllmFp8
./run_tests_Server.sh
```
bash ./run_tests_Server.sh
```
4 changes: 2 additions & 2 deletions closed/AMD/code/llama2-70b-99.9/test_VllmFp8/run_scenarios.sh
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,11 @@ export RESULTS_DIR=${LAB_CLOG}/${TS_START_BENCHMARKS}
echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"

echo "Running Offline"
./run_tests_Offline.sh
bash run_tests_Offline.sh
echo "Done Offline"

echo "Running Server"
./run_tests_Server.sh
bash run_tests_Server.sh
echo "Done Server"

echo "Done Benchmarks"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,11 @@ echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
for i in $(seq 1 ${NUM_ITERS})
do
echo "Running $SCENARIO - Performance run $i/$NUM_ITERS"
ITER=$i ./test_VllmFp8_Offline_perf.sh
ITER=$i bash test_VllmFp8_Offline_perf.sh
done
echo "Running $SCENARIO - Accuracy"
./test_VllmFp8_Offline_acc.sh
bash test_VllmFp8_Offline_acc.sh
echo "Running $SCENARIO - Audit"
./test_VllmFp8_Offline_audit.sh
bash test_VllmFp8_Offline_audit.sh
echo "Done"
echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,11 @@ echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
for i in $(seq 1 ${NUM_ITERS})
do
echo "Running $SCENARIO - Performance run $i/$NUM_ITERS"
ITER=$i ./test_VllmFp8_SyncServer_perf.sh
ITER=$i bash test_VllmFp8_SyncServer_perf.sh
done
echo "Running $SCENARIO - Accuracy"
./test_VllmFp8_SyncServer_acc.sh
bash test_VllmFp8_SyncServer_acc.sh
echo "Running $SCENARIO - Audit"
./test_VllmFp8_SyncServer_audit.sh
bash test_VllmFp8_SyncServer_audit.sh
echo "Done SyncServer"
echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
8 changes: 4 additions & 4 deletions closed/AMD/code/llama2-70b-99/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,17 +48,17 @@ KV cache scales for the quantized model weights are used and were downloaded fro
To generate results for the full submission, running the command below in an inference container. Logs can be found in `/lab-hist/mlperf-results/$datetime1/$datetime2`.
``` bash
cd /lab-mlperf-inference/code/llama2-70b-99.9/test_VllmFp8
./run_scenarios.sh
bash ./run_scenarios.sh
```

To generate results for the Offline scenario only, run the command below in an inference container. Logs can be found in `/lab-hist/mlperf-results/$datetime1/$datetime2/Offline`.
``` bash
cd /lab-mlperf-inference/code/llama2-70b-99.9/test_VllmFp8
./run_tests_Offline.sh
bash ./run_tests_Offline.sh
```

To generate results for the Server scenario only, run the command below in an inference container. Logs can be found in `/lab-hist/mlperf-results/$datetime1/$datetime2/Server`.
``` bash
cd /lab-mlperf-inference/code/llama2-70b-99.9/test_VllmFp8
./run_tests_Server.sh
```
bash ./run_tests_Server.sh
```
4 changes: 2 additions & 2 deletions closed/AMD/code/llama2-70b-99/test_VllmFp8/run_scenarios.sh
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,11 @@ export RESULTS_DIR=${LAB_CLOG}/${TS_START_BENCHMARKS}
echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"

echo "Running Offline"
./run_tests_Offline.sh
bash run_tests_Offline.sh
echo "Done Offline"

echo "Running Server"
./run_tests_Server.sh
bash run_tests_Server.sh
echo "Done Server"

echo "Done Benchmarks"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,11 @@ echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
for i in $(seq 1 ${NUM_ITERS})
do
echo "Running $SCENARIO - Performance run $i/$NUM_ITERS"
ITER=$i ./test_VllmFp8_Offline_perf.sh
ITER=$i bash test_VllmFp8_Offline_perf.sh
done
echo "Running $SCENARIO - Accuracy"
./test_VllmFp8_Offline_acc.sh
bash test_VllmFp8_Offline_acc.sh
echo "Running $SCENARIO - Audit"
./test_VllmFp8_Offline_audit.sh
bash test_VllmFp8_Offline_audit.sh
echo "Done"
echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
Original file line number Diff line number Diff line change
Expand Up @@ -11,11 +11,11 @@ echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
for i in $(seq 1 ${NUM_ITERS})
do
echo "Running $SCENARIO - Performance run $i/$NUM_ITERS"
ITER=$i ./test_VllmFp8_SyncServer_perf.sh
ITER=$i bash test_VllmFp8_SyncServer_perf.sh
done
echo "Running $SCENARIO - Accuracy"
./test_VllmFp8_SyncServer_acc.sh
bash test_VllmFp8_SyncServer_acc.sh
echo "Running $SCENARIO - Audit"
./test_VllmFp8_SyncServer_audit.sh
bash test_VllmFp8_SyncServer_audit.sh
echo "Done SyncServer"
echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"
echo "TS_START_BENCHMARKS=${TS_START_BENCHMARKS}"

0 comments on commit d252efa

Please sign in to comment.