@@ -99,24 +99,24 @@ cargo run -r --example yolo -- --help
9999
100100> ** Environment:** NVIDIA RTX 3060Ti (TensorRT-10.11.0.33, CUDA 12.8, TensorRT-RTX-1.3.0.35) / Intel i5-12400F
101101>
102- > ** Setup:** COCO2017 validation set (5,000 images), Resolution: 640x640, Conf thresholds: [ 0.35, 0.3, ..]
102+ > ** Setup:** YOLO26n, COCO2017 validation set (5,000 images), Resolution: 640x640, Conf thresholds: [ 0.35, 0.3, ..]
103103>
104104> *** Results are for rough reference only.***
105105
106106
107- | Model | EP | ImageProcessor | DType | Batch Size | Preprocess | Inference | Postprocess | Total |
108- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
109- | ** YOLO26n ** | TensorRT | CUDA | FP16 | 1 | ~ 233µs | ~ 1.3ms | ~ 14µs | ** ~ 1.55ms** |
110- | ** YOLO26n ** | TensorRT-RTX | CUDA | FP32 | 1 | ~ 233µs | ~ 2.0ms | ~ 10µs | ** ~ 2.24ms** |
111- | ** YOLO26n ** | TensorRT-RTX | CUDA | FP16 | 1 | ❓ | ❓ | ❓ | ❓ |
112- | ** YOLO26n ** | CUDA | CUDA | FP32 | 1 | ~ 233µs | ~ 5.0ms | ~ 17µs | ** ~ 5.25ms** |
113- | ** YOLO26n ** | CUDA | CUDA | FP16 | 1 | ~ 233µs | ~ 3.6ms | ~ 17µs | ** ~ 3.85ms** |
114- | ** YOLO26n ** | CUDA | CPU | FP32 | 1 | ~ 800µs | ~ 6.5ms | ~ 14µs | ** ~ 7.31ms** |
115- | ** YOLO26n ** | CUDA | CPU | FP16 | 1 | ~ 800µs | ~ 5.0ms | ~ 14µs | ** ~ 5.81ms** |
116- | ** YOLO26n ** | CPU | CPU | FP32 | 1 | ~ 970µs | ~ 20.5ms | ~ 14µs | ** ~ 21.48ms** |
117- | ** YOLO26n ** | CPU | CPU | FP16 | 1 | ~ 970µs | ~ 25.0ms | ~ 14µs | ** ~ 25.98ms** |
118- | ** YOLO26n ** | TensorRT | CUDA | FP16 | 8 | ~ 1.2ms | ~ 6.0ms | ~ 55µs | ** ~ 7.26ms** |
119- | ** YOLO26n ** | TensorRT | CPU | FP16 | 8 | ~ 18.0ms | ~ 25.5ms | ~ 55µs | ** ~ 43.56ms** |
107+ | EP | Image< br >Processor | DType | Batch | Preprocess | Inference | Postprocess | Total |
108+ | --- | --- | --- | --- | --- | --- | --- | --- |
109+ | TensorRT | CUDA | FP16 | 1 | ~ 233µs | ~ 1.3ms | ~ 14µs | ** ~ 1.55ms** |
110+ | TensorRT-RTX | CUDA | FP32 | 1 | ~ 233µs | ~ 2.0ms | ~ 10µs | ** ~ 2.24ms** |
111+ | TensorRT-RTX | CUDA | FP16 | 1 | ❓ | ❓ | ❓ | ❓ |
112+ | CUDA | CUDA | FP32 | 1 | ~ 233µs | ~ 5.0ms | ~ 17µs | ** ~ 5.25ms** |
113+ | CUDA | CUDA | FP16 | 1 | ~ 233µs | ~ 3.6ms | ~ 17µs | ** ~ 3.85ms** |
114+ | CUDA | CPU | FP32 | 1 | ~ 800µs | ~ 6.5ms | ~ 14µs | ** ~ 7.31ms** |
115+ | CUDA | CPU | FP16 | 1 | ~ 800µs | ~ 5.0ms | ~ 14µs | ** ~ 5.81ms** |
116+ | CPU | CPU | FP32 | 1 | ~ 970µs | ~ 20.5ms | ~ 14µs | ** ~ 21.48ms** |
117+ | CPU | CPU | FP16 | 1 | ~ 970µs | ~ 25.0ms | ~ 14µs | ** ~ 25.98ms** |
118+ | TensorRT | CUDA | FP16 | ** 8 ** | ~ 1.2ms | ~ 6.0ms | ~ 55µs | ** ~ 7.26ms** |
119+ | TensorRT | CPU | FP16 | ** 8 ** | ~ 18.0ms | ~ 25.5ms | ~ 55µs | ** ~ 43.56ms** |
120120
121121
122122
@@ -476,4 +476,4 @@ Thanks to all the open-source libraries and their maintainers that make this pro
476476
477477## 📜 License
478478
479- This project is licensed under [ LICENSE] ( LICENSE ) .
479+ This project is licensed under [ LICENSE] ( LICENSE ) .
0 commit comments