Skip to content

feat(report): gecko report — the Agent-Readiness Scorecard (first provider delivery) - #212

Merged
ernanibmurtinho merged 1 commit into
mainfrom
feat/gecko-report-scorecard
Jul 26, 2026
Merged

feat(report): gecko report — the Agent-Readiness Scorecard (first provider delivery)#212
ernanibmurtinho merged 1 commit into
mainfrom
feat/gecko-report-scorecard

Conversation

@ernanibmurtinho

Copy link
Copy Markdown
Contributor

The first provider delivery from the strategy panel (docs/provider-delivery.md): gecko report <openapi.json> → a self-contained Agent-Readiness Scorecard (HTML) — the a-ha, the surface, and the leave-behind in one file. No server, no external deps, control-plane clean.

Sections

  • Header — the big grade + score, framed in the "stop guessing" voice: "96/100 — how often an agent calls your API right, the first try."
  • Dimension breakdown — the 4 inspect dims (first-call-correct 0.4, hygiene, agent-friendliness, security) as bars.
  • The call graphsurfaceviz.render_svg embedded inline ("your API as an agent traverses it").
  • Fixable findings — ranked, each dimension · location · the fix.
  • The Playground — a scripted, deterministic chat transcript: User: plain-English intent → Gecko: the derived tool + first-call-correct call. No live LLM, no network — it replays the real derivation (search/plan_for), showing the call shape only.
  • Correlation teaser — one line, only when the graph has cross-op feeds.

Drift-watch

InspectionReport.to_dict() + surface_rev + report_diff(old, new) + gecko report --since <prior.json> → the drift delta ("score 100 → 96, broke 9 agent call-paths"). The recurring value.

Verified

Real run on pegana → grade A / 96, inline graph, Playground, findings; --since drift delta works. Control-plane: a test asserts no Authorization/Bearer/secret-shaped value in the HTML (grep on the real output empty). Deterministic (same spec → identical HTML). Gate: ruff + mypy clean · full suite 1909 passed / 1 skipped · tests/test_report.py 8 passed.

Next: --since GitHub-Action trigger (PR-comment bot, V1.1) and the live Playground (V2, WTP-gated).

🤖 Generated with Claude Code

Self-contained HTML scorecard (inline CSS + inline SVG, no server, no deps):
header grade+score, dimension bars, embedded call-graph SVG, ranked fixable
findings checklist, a scripted Playground (deterministic intent -> derived tool
-> first-call-correct call, no live LLM/network), and a correlation teaser.
Deterministic and control-plane clean (structure/scores only, never a payload
or secret). Adds InspectionReport.to_dict()+surface_rev and report_diff drift.
CLI: gecko report <spec> [-o] [--intent]... [--since <prior.json>].

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@ernanibmurtinho ernanibmurtinho self-assigned this Jul 26, 2026
@ernanibmurtinho
ernanibmurtinho merged commit dcdc23c into main Jul 26, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant