Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Can the model run on Jetson embedded devices? #139

Open
Mi-gua opened this issue Mar 10, 2025 · 1 comment
Open

Can the model run on Jetson embedded devices? #139

Mi-gua opened this issue Mar 10, 2025 · 1 comment

Comments

@Mi-gua
Copy link

Mi-gua commented Mar 10, 2025

I tried running the demo program from the Hugging Face demo page on my laptop's RTX 2050, but the inference response time took over 100 seconds. I'm a beginner, so I'm wondering if there's something wrong. Can embedded devices run this model quickly?
@snakeztc
Copy link
Contributor

Is the device set to use GPU?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@snakeztc @Mi-gua