Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SFace: Quantized model is slower #248

Open
yjpak0608 opened this issue Mar 25, 2024 · 2 comments
Open

SFace: Quantized model is slower #248

yjpak0608 opened this issue Mar 25, 2024 · 2 comments
Assignees
Labels
question It is not an issue but rather a user question

Comments

@yjpak0608
Copy link

Thank you for great work.
I tested SFace recognition.
Surprisingly, face_recognition_sface_2021dec_int8.onnx is slower about 50% than face_recognition_sface_2021dec.onnx.
Is it normal?
Initially I wanted to speed up this model by converting TF Lite.
I wonder if this would be effective or not.

@fengyuentau
Copy link
Member

Surprisingly, face_recognition_sface_2021dec_int8.onnx is slower about 50% than face_recognition_sface_2021dec.onnx.

OpenCV dnn supports int8 quantized models but is not optimized good enough for that. I would suggest using non quantized version if it meets your need.

@fengyuentau fengyuentau self-assigned this Mar 26, 2024
@fengyuentau fengyuentau added the question It is not an issue but rather a user question label Mar 26, 2024
@MuskanYadavPro
Copy link

The int8 version can be slower because of how it processes data. Converting to TF Lite might speed things up, especially on devices that work well with TF Lite.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question It is not an issue but rather a user question
Projects
None yet
Development

No branches or pull requests

3 participants