Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Polygraphy unable to switch context to driver api instead of default context from run time api #4326

Open
yshvrdhn opened this issue Jan 15, 2025 · 1 comment
Assignees
Labels
Module:Polygraphy Issues with Polygraphy question Further information is requested triaged Issue has been triaged by maintainers waiting for feedback Requires more information from user to make progress on the issue.

Comments

@yshvrdhn
Copy link

yshvrdhn commented Jan 15, 2025

Looking for guidance on how to override Polygraphy's default Runtime API CUDA context management to use a custom Driver API context instead. Currently, Polygraphy automatically creates and manages CUDA context using Runtime API, but our custom trt plugin requires integration with specific Driver API context management.

@poweiw poweiw added triaged Issue has been triaged by maintainers Module:Polygraphy Issues with Polygraphy labels Feb 10, 2025
@poweiw poweiw assigned poweiw and LeoZDong and unassigned poweiw Feb 11, 2025
@LeoZDong
Copy link
Collaborator

Could you clarify what you mean by this? Are you referring to the CUDA stream and other wrappers defined in cuda.py? If so, there's no out-of-the-box way to swap out those wrappers, but you could modify source and build from source.

Providing a concrete example might help.

@LeoZDong LeoZDong added question Further information is requested waiting for feedback Requires more information from user to make progress on the issue. labels Feb 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Module:Polygraphy Issues with Polygraphy question Further information is requested triaged Issue has been triaged by maintainers waiting for feedback Requires more information from user to make progress on the issue.
Projects
None yet
Development

No branches or pull requests

3 participants