Skip to content

Allow external usage proxy concurrency#569

Draft
bingran-you wants to merge 2 commits into
benchflow-ai:mainfrom
bingran-you:bry/daytona-usage-proxy-mux
Draft

Allow external usage proxy concurrency#569
bingran-you wants to merge 2 commits into
benchflow-ai:mainfrom
bingran-you:bry/daytona-usage-proxy-mux

Conversation

@bingran-you
Copy link
Copy Markdown
Collaborator

@bingran-you bingran-you commented May 27, 2026

Summary

  • multiplex external usage-proxy routes over one fixed local listener using secret path prefixes
  • allow high concurrency for external usage tracking in a single BenchFlow process while still rejecting multi-worker fixed-port sharing
  • persist rollout cleanup failures into result.json so downstream experiment health gates cannot treat failed teardown as a reusable healthy slot
  • update docs and add regression coverage for concurrent Daytona-style external proxy usage and cleanup telemetry

Tests

  • uv run ruff check .
  • uv run ty check src
  • uv run python -m pytest tests/test_usage_tracking.py tests/test_trajectory_proxy_path_prefix.py tests/test_usage_proxy.py tests/test_acp.py::TestSandboxStartupDiagnostics -q
  • uv run python -m pytest tests/ -q

Notes

  • Follow-up to PR Add Daytona usage tracking proxy support #568: fixed-port external usage tracking can now support concurrent rollouts in one process; sharded workers still need separate ports/tunnels.
  • Kept as draft because the requested live Daytona E2E for deepseek-v4-flash is blocked by the current provider proxy model list: no healthy deepseek-v4-flash model ID is exposed.

Open in Devin Review

@bingran-you bingran-you marked this pull request as draft May 27, 2026 00:49
Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Open in Devin Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant