feat(deployment): add example datasets, workflows and the dockerfile for the loader image #3754
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
bobbai00
changed the title
bobbai00
force-pushed
the
feat/texera-examples-loader
branch
from
b543591 to
47f6ad7
Compare
Contributor
|
@kunwp1 Can you also review this PR? |
bobbai00
force-pushed
the
feat/texera-examples-loader
branch
from
47f6ad7 to
df90d03
Compare
kunwp1
reviewed
Sep 23, 2025
Contributor
There was a problem hiding this comment.
Right now we keep two example workflows as hard-coded JSON in the repo. If the workflow JSON spec changes, these files can silently break. To avoid regressions, could we adopt one of these approaches?
- Generate on setup: Dynamically create the two example JSONs from the current schema or a small generator during the setup script.
- Enforce consistency in CI: Add a guard that fails when the JSON spec (or template) changes without updating the example workflows.
Contributor
There was a problem hiding this comment.
Could we add brief docs for each setup script: what it does and when to run it?
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Overview
This PR introduces a set of example workflows and datasets, as well as the dockerfile for building an image to load these data. This image is being used to load example data since April 2025 but is separately managed in another repo. Adding it to the main repo can make it easier to manage, and we can later curate more example datasets and workflows.
Changes
texera-example-data-loader.dockerfile