Skip to content

feat: add score-by-model and cost-vs-score charts - #6

Merged
tmimmanuel merged 1 commit into
mainfrom
feat/admin-benchmark-chart
Jul 23, 2026
Merged

feat: add score-by-model and cost-vs-score charts#6
tmimmanuel merged 1 commit into
mainfrom
feat/admin-benchmark-chart

Conversation

@tmimmanuel

Copy link
Copy Markdown
Contributor

Summary

  • New "Score by model" chart (grouped bar, faceted by benchmark) under the provider-tests section — mirrors the chart shipped to the public site (companion PR: feat: Model benchmarks chart on public site + admin dashboard minirouter#244).
  • New admin-only "Cost vs. score" scatter (log-scale x-axis; marker shape encodes benchmark, direct text labels for model identity instead of color, since a scatter is an all-pairs form and categorical color caps at 3 series there).
  • Hand-rolled SVG, no new dependency. Categorical palette validated against this app's dark surface with the dataviz skill's validator script.

Test plan

  • npm run build passes
  • npm run lint passes
  • Verified live via a local dev server + Playwright screenshot: both charts render with correct data matching the provider-tests table; iterated on the scatter's x-axis (linear → log scale) after seeing label overlap in the first pass

Two new charts under the provider-tests section: a grouped bar chart
(score by model, faceted by benchmark) and an admin-only cost-vs-score
scatter (log-scale x-axis, since cost spans ~2 orders of magnitude
across models). Hand-rolled SVG, no charting dependency added. Uses
the dataviz skill's validated dark-mode categorical palette for the
bar chart; the scatter uses a neutral color + direct labels instead of
per-model color, since a scatter is an all-pairs form that caps
categorical color at 3 series and this data has up to 7+ models.

The score chart mirrors the one shipped to the public site (companion
PR in minirouter) so both surfaces show the same picture; the cost
chart stays admin-only since it's an operational/spend view.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
@tmimmanuel
tmimmanuel merged commit 2503882 into main Jul 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant