-
Notifications
You must be signed in to change notification settings - Fork 191
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Will gRPC be supported in future? #77
Comments
Actually we has the Python grpc server in this project https://github.com/tobegit3hub/tensorflow_template_application . But I do not think the Python grpc server is better than the one in C++ which is how TensorFlow Serving works. So we may not add Python grpc server in this project. But you can implement the simple one like this project does. |
Thanks for your reply, I have implemented a grpc version using simple_tensorflow_serving. This is mainly because I want to use the features of custom op, however, tensorflow serving is not very well implemented. |
After using custom ops, the speed of inference is 1.5 times faster than tensorflow serving. This op is fastertransformer,which implemented by Nvidia. I tried many ways to use it as a custom op in the tensorflow serving but failed. If I can add this op to tensorflow serving, the inference speed should be faster. Have a good weekend. |
Thank you for your work and sharing.I want to ask a question, when will this project support grpc?@tobegit3hub
The text was updated successfully, but these errors were encountered: