Repository navigation
refactor(robocasa): consolidate the current Target50 protocol - #236
Merged
Merged
Conversation
Documentation build overview
21 files changed ·
|
Documentation build overview
21 files changed ·
|
ye1457
marked this pull request as ready for review
September 29, 2026 17:57
Collaborator
wilburx813
reviewed
Sep 30, 2026
Collaborator
Author
|
Removed the SSE implementation and loopback tests covered by #229, and the global-memory fixture covered by #235, in 85ce6f2. This PR now only covers the Target50 v2 dependencies, manifest, installation guides and compatibility test. Validation: 744 tests passed here; 746 passed with #229 and #235 applied (3 optional-dependency skips in each run). |
ye1457
force-pushed
the
fix/robocasa-e2e-global-memory
branch
from
October 1, 2026 16:55
85ce6f2 to
ebd7adf
Compare
ye1457
force-pushed
the
fix/robocasa-e2e-global-memory
branch
from
October 8, 2026 06:18
ebd7adf to
f5bcb35
Compare
Sonorous281
reviewed
Oct 10, 2026
wilburx813
approved these changes
Oct 10, 2026
ye1457
force-pushed
the
fix/robocasa-e2e-global-memory
branch
from
October 10, 2026 12:33
7b5853c to
a7e80e0
Compare
ye1457
marked this pull request as draft
October 10, 2026 16:01
ye1457
marked this pull request as ready for review
October 10, 2026 18:38
Sonorous281
approved these changes
Oct 11, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
RoboCasa's historical
pydantic-ai-slim==2.1.0constraints conflict with main's Pydantic AI2.53.0/ Harness0.53.0requirements. The guides now install.[robocasa]frompyproject.toml, and the current task-specific + global evaluation uses a singletarget50.json.target50_v2.json. Keep the v2 protocol ID, result schema 1.1, 50-task/340-run matrix, resource references and evaluation rules; drop unused environment version records.Compatibility
Scripts that reference
target50_v2.jsonshould usetarget50.json. Historical v1 results require their matching code and manifest. Moving reproduction tooling remains a follow-up once a RoboCasa reproduction branch exists.Shared dependency pins are unchanged. The streaming fix belongs to #229 and the offline memory fixture to #235; their E2E changes are not duplicated here.
Validation
On main
ff91f14, October 11:Earlier installation checks on main
068cd64, October 8: fresh Python 3.10 RoboCasa installation,uv pip check, CLI/import checks and all four simulator smoke tests passed with Pydantic AI2.53.0/ Harness0.53.0. The 91 existing v2 results remained compatible. This documentation revision changes no runtime code or experiment data.Documentation Preview
The Atomic experiment remains paused. This PR does not change HF memory or run robot experiments.