Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow computer vision task models to run without tf.data #2128

Open
mattdangerw opened this issue Mar 6, 2025 · 1 comment
Open

Allow computer vision task models to run without tf.data #2128

mattdangerw opened this issue Mar 6, 2025 · 1 comment
Assignees
Labels
stat:contributions welcome Add this label to feature request issues so they are separated out from bug reporting issues

Comments

@mattdangerw
Copy link
Member

First step (of a few), to slowly relax our reliance on tf.data for preprocessing.

Our text models are more heavily reliant on tf.data because of the tf-text dependency. Our image models do not have this constraint.

We could try to allow running preprocessing without tf.data when running on the torch and jax backends. To do so, we would need to stop always converting to a tf.data.Dataset in our pipeline model helper here and find a way to still apply preprocessing to the iterator efficiently.

@mattdangerw mattdangerw changed the title Allow CV task models to run without tf.data Allow computer vision task models to run without tf.data Mar 6, 2025
@mattdangerw
Copy link
Member Author

Contributions are welcome here, but this is a fairly abstract problem that would need some scouting out first. We could try to leverage Keras' DataAdapter here, I'm not sure how to best iterate over the dataset and apply the Keras layer. This is probably something best prototyped for a number of vision tasks first (classification, detection, segmentation).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stat:contributions welcome Add this label to feature request issues so they are separated out from bug reporting issues
Projects
None yet
Development

No branches or pull requests

2 participants