Skip to content

fix(owasp-agent): index/router fixes (board, events, chapters, Top 10) + regression rows - #1159

Draft
northdpole wants to merge 5 commits into
fix/ask-embedding-retrievalfrom
claude/fix-agent-index-80b1a2
Draft

northdpole wants to merge 5 commits into
fix/ask-embedding-retrievalfrom
claude/fix-agent-index-80b1a2

Conversation

@northdpole

Copy link
Copy Markdown
Collaborator

Agent-index fixes found by the private eval and Prateek's synth_v2 files: board name parsing, indexed event lookup, metro chapter aliases, meta-lane grounding floor, compound questions, nearest-to place, whole-name project match, ambiguous first-name candidates. Regression rows added; all 187 owasp_agent tests pass. Multi-suite eval 107/190 strict in-process (baseline before deploy).

Stacked on #1155. Deploys to staging together with the comprehension branch.

🤖 Generated with Claude Code

northdpole and others added 5 commits October 17, 2026 15:57
…s and multi-suite eval

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
…prompt cap, leader noise/email

- resolve any indexed chapter/place (no hardcoded city lists), qualifier mismatch
  (Athens, Georgia) no longer answers Athens, Greece; Oakland != Oakland County
- drop template leaders (Meeting Location, Everyone, Speaker name) at sync + read
- strip email from public payloads
- refusal gate: current turn only, attack-material only (not prevent/mitigate/
  phishing-resistant), droppable injection clause in compound turns
- cap prompt at 4 KB; typo repair + 'number of' for chapter counts

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
…pter aliases

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
…est-to place

- single-entity sim cards must name the entity; counts/compares/lists/refusals never get one
- ask owasp_meta no-match returns a short 'what I can answer' fallback
- two-part prompts answer every agent-answerable clause and name the one handed back

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
…e lists candidates

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
@coderabbitai

coderabbitai Bot commented Oct 17, 2026

Copy link
Copy Markdown
Contributor

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant