Skip to content

refactor(robocasa): consolidate the current Target50 protocol - #236

Merged
Sonorous281 merged 11 commits into
RLinf:mainfrom
ye1457:fix/robocasa-e2e-global-memory
Oct 11, 2026
Merged

Sonorous281 merged 11 commits into
RLinf:mainfrom
ye1457:fix/robocasa-e2e-global-memory

Conversation

@ye1457

@ye1457 ye1457 commented Sep 29, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

RoboCasa's historical pydantic-ai-slim==2.1.0 constraints conflict with main's Pydantic AI 2.53.0 / Harness 0.53.0 requirements. The guides now install .[robocasa] from pyproject.toml, and the current task-specific + global evaluation uses a single target50.json.

  • Remove the old constraints, v1 manifest and duplicate target50_v2.json. Keep the v2 protocol ID, result schema 1.1, 50-task/340-run matrix, resource references and evaluation rules; drop unused environment version records.
  • Point result generation and validation at the single manifest. Existing v2 results and custom v2 task/planner configurations remain supported.
  • Keep the English and Chinese walkthroughs to three steps: prepare, run, check. Keep current file-selection rules, the task-specific + global protocol and published scores in collapsed sections on the same page. Remove the retired task-only instructions, historical validation command and Codex reproduction table from both guides and related pages. Current commands, task coverage and published leaderboard values are unchanged.
  • Match LIBERO’s installation table and separate VLA configuration from environment setup. Group troubleshooting by symptom, put simulator/VLA checks together, and collapse optional installation and developer details. Keep a single simulator page in both languages. Remove the two redundant protocol/score-history paragraphs from both guides; the published score table and its source links are unchanged.

Compatibility

Scripts that reference target50_v2.json should use target50.json. Historical v1 results require their matching code and manifest. Moving reproduction tooling remains a follow-up once a RoboCasa reproduction branch exists.

Shared dependency pins are unchanged. The streaming fix belongs to #229 and the offline memory fixture to #235; their E2E changes are not duplicated here.

Validation

On main ff91f14, October 11:

  • 1209 unit tests passed, 7 skipped: three require optional RoboTwin/LeRobot dependencies; four are inapplicable single-arm cases. Localhost bypass is scoped to the test process.
  • Repository-wide pre-commit and clean, strict English/Chinese Sphinx builds passed.
  • Browser checks passed in both languages on desktop, narrow screens and dark mode. Confirmed LIBERO, RoboCasa365 and RoboTwin are sibling navigation entries without child pages. Checked installation tables, VLA setup, troubleshooting, collapsed details, keyboard access, memory/task-list/protocol links, old preview redirection and Chinese inline markup. All 30 shell commands, resource revisions, 50 task names and current published table values are retained; retired task-only content is absent from the rendered guides.

Earlier installation checks on main 068cd64, October 8: fresh Python 3.10 RoboCasa installation, uv pip check, CLI/import checks and all four simulator smoke tests passed with Pydantic AI 2.53.0 / Harness 0.53.0. The 91 existing v2 results remained compatible. This documentation revision changes no runtime code or experiment data.

Documentation Preview

The Atomic experiment remains paused. This PR does not change HF memory or run robot experiments.

@ye1457
ye1457 marked this pull request as ready for review September 29, 2026 17:57
@wilburx813

wilburx813 commented Sep 30, 2026 •

Copy link
Copy Markdown
Collaborator

this pr mostly overlap with #229 and #235, please check.

Comment thread robots/robocasa/eval/target50_v2.json Outdated
@ye1457 ye1457 changed the title fix(robocasa): align current setup and GPU smoke tests fix(robocasa): align Target50 v2 dependency constraints Sep 30, 2026
@ye1457

ye1457 commented Sep 30, 2026

Copy link
Copy Markdown
Collaborator Author

Removed the SSE implementation and loopback tests covered by #229, and the global-memory fixture covered by #235, in 85ce6f2. This PR now only covers the Target50 v2 dependencies, manifest, installation guides and compatibility test. Validation: 744 tests passed here; 746 passed with #229 and #235 applied (3 optional-dependency skips in each run).

@ye1457
ye1457 force-pushed the fix/robocasa-e2e-global-memory branch from 85ce6f2 to ebd7adf Compare October 1, 2026 16:55
@ye1457 ye1457 changed the title fix(robocasa): align Target50 v2 dependency constraints refactor(robocasa): consolidate the current Target50 protocol Oct 1, 2026
@ye1457
ye1457 force-pushed the fix/robocasa-e2e-global-memory branch from ebd7adf to f5bcb35 Compare October 8, 2026 06:18
Comment thread docs/source-zh/rst_source/simulators/robocasa.rst Outdated
@ye1457
ye1457 force-pushed the fix/robocasa-e2e-global-memory branch from 7b5853c to a7e80e0 Compare October 10, 2026 12:33
@ye1457
ye1457 marked this pull request as draft October 10, 2026 16:01
@ye1457
ye1457 marked this pull request as ready for review October 10, 2026 18:38
@Sonorous281
Sonorous281 merged commit a8c5311 into RLinf:main Oct 11, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants