Skip to content

AI-178: Convert reviewing-github-actions skill into a custom agent#223

Draft
roberthunterjr with Copilot wants to merge 2 commits into
mainfrom
copilot/ai-178-convert-reviewing-github-actions-skill
Draft

AI-178: Convert reviewing-github-actions skill into a custom agent#223
roberthunterjr with Copilot wants to merge 2 commits into
mainfrom
copilot/ai-178-convert-reviewing-github-actions-skill

Conversation

Copilot AI commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Converts the existing reviewing-github-actions skill into a custom agent that can be assigned to GitHub issues, automatically reviews third-party action source code, and creates a PR to approve safe actions — replacing a manual, human-driven process.

Relates to: https://edfi.atlassian.net/browse/AI-178

Changes

.claude/agents/review-github-action.md — New custom agent

A Claude subagent that drives the full review-and-approve workflow when assigned to an issue:

  1. Parses the issue for action identifier (owner/action-name), version/tag, and optional commit hash
  2. Reviews in isolation — clones to a temp dir, checks out the exact tag, records the commit SHA, then deletes the clone after review
  3. Systematic security audit covering: action.yml metadata, entrypoint scripts (JS/Python/Bash), Dockerfile (for Docker actions), dependencies/supply chain, secret/env access, network calls, file path traversal, and input validation — classified as CRITICAL / HIGH / MEDIUM / LOW
  4. Posts review summary as an issue comment (also to stdout for workflow log visibility)
  5. Creates a PR updating action-allowedlist/approved.json with the exact commit hash — only if no CRITICAL or HIGH findings; includes the full review summary in the PR body for human review before merge

.github/ISSUE_TEMPLATE/approve-github-action.yml — New issue template

Structured form to request an action review, collecting action identifier, version, optional commit hash, repository URL, and use case. Includes a prompt to assign the issue to GitHub Copilot to trigger the agent.

- Add .claude/agents/review-github-action.md: custom agent that reviews
  third-party GitHub Actions for security and creates PRs to approve safe ones
- Add .github/ISSUE_TEMPLATE/approve-github-action.yml: issue template for
  requesting action review and approval

The agent can be assigned to a GitHub issue requesting action approval. It:
1. Parses the issue to find the action to review
2. Performs a systematic security review using the reviewing-github-actions skill methodology
3. Posts the review summary as a comment on the original issue
4. Creates a PR to update action-allowedlist/approved.json if the action is safe

Relates to https://edfi.atlassian.net/browse/AI-178
Copilot AI changed the title [WIP] Create custom agent for reviewing GitHub Actions AI-178: Convert reviewing-github-actions skill into a custom agent Jul 23, 2026
Copilot AI requested a review from roberthunterjr July 23, 2026 15:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants