Skip to content

Commit 4e773f6

Browse files
authored
Update performance section in README.md
1 parent 3e7db19 commit 4e773f6

1 file changed

Lines changed: 15 additions & 15 deletions

File tree

‎README.md‎

Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -99,24 +99,24 @@ cargo run -r --example yolo -- --help
9999

100100
>**Environment:** NVIDIA RTX 3060Ti (TensorRT-10.11.0.33, CUDA 12.8, TensorRT-RTX-1.3.0.35) / Intel i5-12400F
101101
>
102-
>**Setup:** COCO2017 validation set (5,000 images), Resolution: 640x640, Conf thresholds: [0.35, 0.3, ..]
102+
>**Setup:** YOLO26n, COCO2017 validation set (5,000 images), Resolution: 640x640, Conf thresholds: [0.35, 0.3, ..]
103103
>
104104
> ***Results are for rough reference only.***
105105
106106

107-
| Model | EP | ImageProcessor | DType | Batch Size | Preprocess | Inference | Postprocess | Total |
108-
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
109-
| **YOLO26n** | TensorRT | CUDA | FP16 | 1 | ~233µs | ~1.3ms | ~14µs | **~1.55ms** |
110-
| **YOLO26n** | TensorRT-RTX | CUDA | FP32 | 1 | ~233µs | ~2.0ms | ~10µs | **~2.24ms** |
111-
| **YOLO26n** | TensorRT-RTX | CUDA | FP16 | 1 | ❓ | ❓ | ❓ | ❓ |
112-
| **YOLO26n** | CUDA | CUDA | FP32 | 1 | ~233µs | ~5.0ms | ~17µs | **~5.25ms** |
113-
| **YOLO26n** | CUDA | CUDA | FP16 | 1 | ~233µs | ~3.6ms | ~17µs | **~3.85ms** |
114-
| **YOLO26n** | CUDA | CPU | FP32 | 1 | ~800µs | ~6.5ms | ~14µs | **~7.31ms** |
115-
| **YOLO26n** | CUDA | CPU | FP16 | 1 | ~800µs | ~5.0ms | ~14µs | **~5.81ms** |
116-
| **YOLO26n** | CPU | CPU | FP32 | 1 | ~970µs | ~20.5ms | ~14µs | **~21.48ms** |
117-
| **YOLO26n** | CPU | CPU | FP16 | 1 | ~970µs | ~25.0ms | ~14µs | **~25.98ms** |
118-
| **YOLO26n** | TensorRT | CUDA | FP16 | 8 | ~1.2ms | ~6.0ms | ~55µs | **~7.26ms** |
119-
| **YOLO26n** | TensorRT | CPU | FP16 | 8 | ~18.0ms | ~25.5ms | ~55µs | **~43.56ms** |
107+
| EP | Image<br>Processor | DType | Batch | Preprocess | Inference | Postprocess | Total |
108+
| --- | --- | --- | --- | --- | --- | --- | --- |
109+
| TensorRT | CUDA | FP16 | 1 | ~233µs | ~1.3ms | ~14µs | **~1.55ms** |
110+
| TensorRT-RTX | CUDA | FP32 | 1 | ~233µs | ~2.0ms | ~10µs | **~2.24ms** |
111+
| TensorRT-RTX | CUDA | FP16 | 1 | ❓ | ❓ | ❓ | ❓ |
112+
| CUDA | CUDA | FP32 | 1 | ~233µs | ~5.0ms | ~17µs | **~5.25ms** |
113+
| CUDA | CUDA | FP16 | 1 | ~233µs | ~3.6ms | ~17µs | **~3.85ms** |
114+
| CUDA | CPU | FP32 | 1 | ~800µs | ~6.5ms | ~14µs | **~7.31ms** |
115+
| CUDA | CPU | FP16 | 1 | ~800µs | ~5.0ms | ~14µs | **~5.81ms** |
116+
| CPU | CPU | FP32 | 1 | ~970µs | ~20.5ms | ~14µs | **~21.48ms** |
117+
| CPU | CPU | FP16 | 1 | ~970µs | ~25.0ms | ~14µs | **~25.98ms** |
118+
| TensorRT | CUDA | FP16 | **8** | ~1.2ms | ~6.0ms | ~55µs | **~7.26ms** |
119+
| TensorRT | CPU | FP16 | **8** | ~18.0ms | ~25.5ms | ~55µs | **~43.56ms** |
120120

121121

122122

@@ -476,4 +476,4 @@ Thanks to all the open-source libraries and their maintainers that make this pro
476476

477477
## 📜 License
478478

479-
This project is licensed under [LICENSE](LICENSE).
479+
This project is licensed under [LICENSE](LICENSE).

0 commit comments

Comments
 (0)