-
Notifications
You must be signed in to change notification settings - Fork 19
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The bike-rentals-auto-ml image has 1.6 GiB #95
Comments
Can you elaborate? Both include the serving runtime and model. The serving runtime image alone for
The
See #27 for |
Our discussions typically revolved around the model being huge. In this case though, the model is small (54 MB) and the runtime is huge. I wonder if we are able to demonstrate the behaviour with a runtime that might not be so generic but whose size would be more palatable. |
We can take the KServe approach and write our own runtimes if we want many smaller runtimes instead of a couple of large ones ¯\(ツ)/¯. |
Unlike the
tensorflow-housing
image that has 120.6 MiB (at https://quay.io/repository/rhoai-edge/tensorflow-housing?tab=tags&tag=latest, and also reproduced in my setup), thebike-rentals-auto-ml
reported size is 1.6 GiB, at https://quay.io/repository/rhoai-edge/bike-rentals-auto-ml?tab=tags and again in my setup -- see #93 (comment) and #93 (comment).Assuming both just ship a runtime without bundling the AI model, there seems to be some serious bloat in
bike-rentals-auto-ml
.The
pipelines/README.md
should likely explain why those container images differ by an order of magnitude in size, what is so special about the second one that it warrants the extra bits.The text was updated successfully, but these errors were encountered: