Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The GPU is not working. onnxruntime-gpu does not seem to be activated in any case. #664

Closed
thuongvovan opened this issue Aug 7, 2024 · 3 comments
Labels
bug Something isn't working stale

Comments

@thuongvovan
Copy link

Describe the bug
The GPU is not working. onnxruntime-gpu does not seem to be activated in any case.

To Reproduce
Steps to reproduce the behavior:

Here is the English translation of your text:


I am running the rembg library in Docker and have tried different scenarios, but it seems the GPU is still not working. onnxruntime-gpu does not appear to be called in any case. Nothing happens.

The Docker image nvidia/cuda:11.8.0-cudnn8-runtime-ubi8 has CUDA 11 and cuDNN 8, which are compatible with the default onnxruntime-gpu==1.18.1 version.

The Docker image nvidia/cuda:12.3.2-cudnn9-runtime-ubuntu22.04 has CUDA 12 and cuDNN 9, which are compatible with the default onnxruntime-gpu==1.18.1 version distributed in the Azure DevOps Feed.

Strangely, even when using an image without integrated CUDA or cuDNN, nothing happens. Usually, if using an environment that doesn't support onnxruntime-gpu, there would be an error log like the one below:

*************** EP Error ***************
EP Error /onnxruntime_src/onnxruntime/python/onnxruntime_pybind_state.cc:456 void onnxruntime::python::RegisterTensorRTPluginsAsCustomOps(onnxruntime::python::PySessionOptions&, const ProviderOptions&) Please install TensorRT libraries as mentioned in the GPU requirements page, make sure they're in the PATH or LD_LIBRARY_PATH, and that your GPU is supported.
when using ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'AzureExecutionProvider', 'CPUExecutionProvider']
Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying.


Please check again!!

Rembg version:
v2.0.58

@thuongvovan thuongvovan added the bug Something isn't working label Aug 7, 2024
Copy link

github-actions bot commented Sep 7, 2024

This issue is stale because it has been open for 30 days with no activity.

@github-actions github-actions bot added the stale label Sep 7, 2024
Copy link

This issue was closed because it has been inactive for 14 days since being marked as stale.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Sep 21, 2024
@sasachen
Copy link

how to fix?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working stale
Projects
None yet
Development

No branches or pull requests

2 participants