Smoke Test: Claude - 25432297510

[github-actions]

Test Summary

Overall Status: PARTIAL (18/19 tests pass, 1 skipped)

Run URL: https://github.com/github/gh-aw/actions/runs/25432297510
Timestamp: 2026-05-06T11:26:34Z
PR Used for Review Tests: #30500 (copilot/update-copilot-harness-js)

Core Test Results

#	Test	Status
1	GitHub MCP Testing	✅
2	MCP Scripts GH CLI Testing	✅
3	Serena MCP Testing	✅
4	Make Build Testing	✅
5	Playwright Testing	✅
6	Tavily Web Search Testing	✅
7	File Writing Testing	✅
8	Bash Tool Testing	✅
9	Discussion Interaction Testing	✅
10	Agentic Workflows MCP Testing	✅
11	Slack Script Safe Output Testing	✅
12	Code Scanning Alert Safe Output Testing	✅

PR Review Safe Outputs Test Results

#	Test	Status
13	Update PR Testing	✅
14	PR Review Comment Testing	✅
15	Submit PR Review Testing	✅
16	Resolve Review Thread Testing	✅
17	Add Reviewer Testing	✅
18	Push to PR Branch Testing	✅
19	Close PR Testing	⚠️ Skipped (no safe PR to close)

Test Details

Test 1 – GitHub MCP: Found 2 merged PRs: #30568 (glossary daily update), #30565 (spec extractor)

Test 2 – MCP Scripts GH CLI: Found open PRs #30579, #30577

Test 3 – Serena: Activated project at /home/runner/work/gh-aw/gh-aw. Found symbols in compiler.go: MaxLockFileSize, MaxExpressionSize, CompileWorkflow, validateWorkflowData, generateAndValidateYAML, and more.

Test 4 – Make Build: make build succeeded — go build -ldflags "-s -w -X main.version=9f2fd5a4e-dirty" -o gh-aw ./cmd/gh-aw

Test 5 – Playwright: Navigated to (github.com/redacted) Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" ✅ contains "GitHub"

Test 6 – Tavily: 5 results for "GitHub Agentic Workflows" including githubnext.com, github.blog, itnext.io

Test 7/8 – File Writing/Bash: Created and verified /tmp/gh-aw/agent/smoke-test-claude-25432297510.txt

Test 9 – Discussion: Found discussion #30574 and added comic-book comment

Test 10 – Agentic Workflows MCP: smoke-claude workflow found: active, compiled: Yes, engine: claude

Test 11 – Slack: Posted to #smoke-tests channel

Test 12 – Code Scanning: Created dummy warning alert on README.md:1

Test 13 – Update PR: Appended "✨ PR Review Safe Output Test - Run 25432297510" to PR #30500

Test 14 – Review Comments: Added 2 inline comments on copilot_steering_hook.cjs:46 and copilot_harness.cjs:440

Test 15 – Submit Review: Submitted COMMENT review with "💥 Automated smoke test review - all systems nominal!"

Test 16 – Resolve Thread: Resolved thread PRRT_kwDOPc1QR85_28rq (github-actions, line 44 in copilot_steering_hook.cjs)

Test 17 – Add Reviewer: Added copilot as reviewer to PR #30500

Test 18 – Push to Branch: Created smoke-test-files/smoke-claude-push-test.md and pushed to PR branch

Test 19 – Close PR: ⚠️ Skipped — no safe test/bot PR identified to close without risk

Warning

Firewall blocked 6 domains

The following domains were blocked by the firewall during workflow execution:

• accounts.google.com
• android.clients.google.com
• clients2.google.com
• contentautofill.googleapis.com
• safebrowsingohttpgateway.googleapis.com
• www.google.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "accounts.google.com"
    - "android.clients.google.com"
    - "clients2.google.com"
    - "contentautofill.googleapis.com"
    - "safebrowsingohttpgateway.googleapis.com"
    - "www.google.com"

See Network Configuration for more information.

💥 [THE END] — Illustrated by Smoke Claude · ● 405K · ◷

• expires on May 6, 2026, 1:35 PM UTC

[github-actions]

This issue was automatically closed because it expired on 2026-05-06T13:35:04.666Z.

Closed by Workflow