Summary
Add a HarnessBench adapter for All-Hands-AI/OpenHands (formerly OpenDevin). Surfaced by the 2026-04-16 scout pass.
Scout snapshot
- stars: 71,293
- license: MIT
- language: Python
- last_commit: 2026-04-16
- shape: BrowsingAgent backed by BrowserGym drives Chromium via CDP.
Work to do
src/harnessbench/harnesses/openhands/spec.py — HarnessSpec (runtime: python, requires_credentials: none — LLM_API_KEY is the generic harness-wide one, not OpenHands-specific, container_isolation: dedicated).src/harnessbench/harnesses/openhands/Dockerfile — FROM clawbench/base:<ver> + OpenHands runtime install (pinned).setup.sh + run.sh — instantiate BrowsingAgent with the task, capture the EventStream for the 5-layer recording.- Register entry point.
- Smoke run on bundled fixture.
Notes
OpenHands ships its own Docker runtime — the adapter Dockerfile may need to slim it down so one harness run isn't 10 minutes of image pulls.
Summary
Add a HarnessBench adapter for All-Hands-AI/OpenHands (formerly OpenDevin). Surfaced by the 2026-04-16 scout pass.
Scout snapshot
Work to do
src/harnessbench/harnesses/openhands/spec.py—HarnessSpec(runtime: python, requires_credentials: none — LLM_API_KEY is the generic harness-wide one, not OpenHands-specific, container_isolation: dedicated).src/harnessbench/harnesses/openhands/Dockerfile—FROM clawbench/base:<ver>+ OpenHands runtime install (pinned).setup.sh+run.sh— instantiateBrowsingAgentwith the task, capture the EventStream for the 5-layer recording.Notes
OpenHands ships its own Docker runtime — the adapter Dockerfile may need to slim it down so one harness run isn't 10 minutes of image pulls.