Skip to content

Close residual SkillStore audit gaps and publish a fresh assessment #114

Description

@cagdasyurekli

Context

SkillStore audit v1 assessed source commit 6fd2c55 and reported four confirmed concerns plus a capped static review:

Current origin/main is v0.12.0 at 165fd10. PR #112 already closed or materially reduced several findings:

  • provider children now receive an allowlisted environment with exact-name opt-ins;
  • verifier children run from an env -i baseline with exact-name opt-ins passed through a private descriptor;
  • packaged personas no longer present themselves as system instructions or use You are authority framing;
  • whole-worktree provider readability and transmission consent are documented explicitly.

Do not regress these controls or duplicate their completed implementation.

Remaining work

  • Design and implement a structured-argv verification path for ordinary checks. If compatibility requires retaining shell commands, make shell execution an explicit, separately documented mode with the same minimal environment and clear confirmation requirements for secrets or network access.
  • Add a provider-free dry-run transmission preview that reports the resolved disposable-worktree root and a bounded, privacy-safe manifest or digest of worker-readable paths before launch. It must not contact AGY or the provider.
  • Review and record dispositions for the 324 static analyzer matches omitted by the capped 400/724 review, or reduce generated, bundled, or reference content from the submitted audit corpus with a documented rationale.
  • After the code and review work is complete, update the SkillStore listing from the old 6fd2c55 source and request a fresh immutable assessment for the exact published commit.

Acceptance criteria

  • Freeze user journeys, acceptance tests, and authority/privacy constraints before implementation; use a suitable planning expert and a different independent final reviewer as required by repository policy.
  • Existing provider and verifier environment-isolation regression coverage remains green.
  • Structured verification covers positive and negative cases, including argument boundaries, unsupported shell constructs, secret-variable absence, exact-name opt-in, and network/credential confirmation behavior.
  • Dry-run preview is deterministic, bounded, excludes file contents and secret values, accurately represents the worker-readable worktree, and provably performs no provider launch.
  • Update SECURITY_AND_COMPATIBILITY.md, SKILL.md, the relevant REPO_MAP row, and durable lessons only where behavior or trust claims change.
  • Run the owning focused suites, ground-truth checks when AGY-facing behavior or claims change, one stable full scripts/ci-offline.sh run, git diff --check, and agents-md-auditor after material changes.
  • Obtain separate action-time approval before updating SkillStore or requesting the new audit; record the resulting exact source commit and audit URL.
  • The new audit clearly distinguishes inherent external-provider transmission from remediable scope-preview and consent controls.

References

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions