Smoke Test: Claude - 25212030870

[github-actions]

Summary

Overall status: PARTIAL — 15 passed, 2 failed (mcpscripts server error), 2 skipped

• Run URL: https://github.com/github/gh-aw/actions/runs/25212030870
• Timestamp: 2026-05-01
• PR used for review tests: Add TruffleHog shared agentic workflow for secret detection in smoke-codex #29512 (Add TruffleHog shared agentic workflow)

---

Core Tests (#1–12)

#	Test	Result	Notes
1	GitHub MCP (last 2 merged PRs)	✅	PR #29516, #29518
2	MCP Scripts GH CLI	❌	tool.handler is not a function — mcpscripts server error
3	Serena MCP (activate + find symbols)	✅	100+ symbols found in pkg/
4	Make Build	✅	gh-aw binary built successfully
5	Playwright (github.com)	✅	Title confirmed "GitHub · Change is constant..."
6	Tavily Web Search	✅	5 results for "GitHub Agentic Workflows"
7	File Writing	✅	/tmp/gh-aw/agent/smoke-test-claude-25212030870.txt
8	Bash Tool	✅	File content verified via cat
9	Discussion Interaction	❌	tool.handler is not a function — mcpscripts server error
10	Agentic Workflows MCP Status	✅	smoke-claude active, triggers: PR label, reaction, status-comment
11	Slack Safe Output	✅	Posted to #smoke-tests
12	Code Scanning Alert	✅	Dummy warning posted to README.md:1

PR Review Tests (#13–19)

#	Test	Result	Notes
13	Update PR Body	✅	Appended test message to PR #29512
14	PR Review Comments	✅	2 inline comments on trufflehog.md (lines 5, 153)
15	Submit PR Review	✅	COMMENT review submitted with summary
16	Resolve Review Thread	⚠️	Skipped — thread node IDs (PRRT_kwDO...) not obtainable from GitHub MCP get_review_comments
17	Add Reviewer	✅	Added copilot as reviewer
18	Push to PR Branch	✅	smoke-test-files/smoke-claude-push-test.md committed and pushed
19	Close PR	⚠️	Skipped — no safe test PR to close

---

Failures

Tests 2 & 9 both failed due to the same root cause: the mcpscripts MCP server returned Error [-32603]: calling "tools/call": tool.handler is not a function for the gh and github_discussion_query tools. This is a server-side tool registration issue.

Error details

[info] [mcpscripts] Calling tool 'gh' with args: {"args":"pr list ..."}
Error [-32603]: calling "tools/call": tool.handler is not a function

Both MCP tool calls and CLI invocations (mcpscripts gh, mcpscripts github_discussion_query) produced the identical error.

💥 [THE END] — Illustrated by Smoke Claude · ● 283.7K · ◷

• expires on May 1, 2026, 1:17 PM UTC

[github-actions]

This issue was automatically closed because it expired on 2026-05-01T13:17:10.506Z.

Closed by Workflow