You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Split out of #190 so the structural hook-scoping fix in #188 can land without losing this.
The gap
#188 moves the Stop hook into skill frontmatter and deletes hooks/hooks.json outright, which fixes hooks firing in unrelated sessions and the main-agent loop. It carries the existing prompt over unchanged, and that prompt demands the full deep-path output for every bug:
Scan the conversation for evidence of ALL of the following for EVERY bug […] Phase 5 (Devil's Advocate): All 13 challenge questions addressed […] Phase 4 (PoC Creation): Pseudocode PoC created […]
A verification that legitimately took the standard path has none of that, so the hook reports {"ok": false} and the run is told it is incomplete when it isn't. A completeness gate that fires on correct output trains people to ignore it.
Proposed fix
@GotenJBZ proposed this in #190 — ordered rules rather than one flat checklist:
Check only the phases the path actually used — standard vs deep — instead of requiring all five unconditionally.
Rule 2 matters more after #188 than before: with per-agent Stop hooks on data-flow-analyzer, exploitability-verifier, and poc-builder, a delegated run is already checked agent-by-agent, and re-checking at the top level is both redundant and wrong (the coordinator's transcript won't contain the subagents' phase output).
Credit
The diagnosis and the rule ordering are @GotenJBZ's, from #190. #188 was already open with the frontmatter-scoping approach and is CI-validated and version-correct, so it goes in first; this issue is the remainder.
Split out of #190 so the structural hook-scoping fix in #188 can land without losing this.
The gap
#188 moves the
Stophook into skill frontmatter and deleteshooks/hooks.jsonoutright, which fixes hooks firing in unrelated sessions and the main-agent loop. It carries the existing prompt over unchanged, and that prompt demands the full deep-path output for every bug:A verification that legitimately took the standard path has none of that, so the hook reports
{"ok": false}and the run is told it is incomplete when it isn't. A completeness gate that fires on correct output trains people to ignore it.Proposed fix
@GotenJBZ proposed this in #190 — ordered rules rather than one flat checklist:
Rule 2 matters more after #188 than before: with per-agent
Stophooks ondata-flow-analyzer,exploitability-verifier, andpoc-builder, a delegated run is already checked agent-by-agent, and re-checking at the top level is both redundant and wrong (the coordinator's transcript won't contain the subagents' phase output).Credit
The diagnosis and the rule ordering are @GotenJBZ's, from #190. #188 was already open with the frontmatter-scoping approach and is CI-validated and version-correct, so it goes in first; this issue is the remainder.
cc @ahpaleus (fp-check owner)