Skip to content

tests: add live Codex probe coverage#53

Merged
gaelic-ghost merged 3 commits into
mainfrom
tests/live-server-request-families
May 3, 2026
Merged

tests: add live Codex probe coverage#53
gaelic-ghost merged 3 commits into
mainfrom
tests/live-server-request-families

Conversation

@gaelic-ghost

Copy link
Copy Markdown
Owner

Summary

  • closes the stale v1 audit/roadmap drift now that v1.0.1 is shipped
  • adds an opt-in live Codex behavior matrix for approval policy, sandbox, history, same-thread, and CLI diagnostics probes
  • adds an opt-in server-request family coverage report and wrapper script, with live command/permissions coverage and explicit blockers for tool user input and MCP elicitation live reproducers

Remaining gaps

  • Tool user input still needs a reliable current mock Responses reproducer for item/tool/requestUserInput.
  • MCP elicitation still needs a local MCP server fixture that deterministically requests elicitation during a live turn.

Verification

  • swift test
  • git diff --check
  • bash scripts/repo-maintenance/validate-all.sh
  • scripts/run-live-codex-behavior-matrix.sh
  • scripts/run-live-codex-server-request-probes.sh

@gaelic-ghost gaelic-ghost added the enhancement New feature or request label May 3, 2026
@gaelic-ghost gaelic-ghost merged commit 3bcbf40 into main May 3, 2026
1 check passed
@gaelic-ghost gaelic-ghost deleted the tests/live-server-request-families branch May 3, 2026 15:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant