Frontend AI triage insights

[prathmeshpatel]

TL;DR

Added AI-powered failure analysis to CI evaluation runs with automatic classification of failures as regressions, flaky tests, or new failures, plus intelligent triage summaries.

What changed?

• AI Triage System: New ai-insights.ts module that classifies test failures by analyzing historical run data across commits to identify regressions (previously passing, now failing), flaky tests (alternating pass/fail patterns), and new failures
• Commit Detail View Enhancements: Added AI-generated triage summaries that automatically analyze failures when any test cases fail, with visual failure classification tags and regeneration controls
• Overview Panel Intelligence: Integrated AI insights at the suite overview level to provide high-level analysis of all failing suites with their failure patterns
• Failure Classification Tags: Visual badges showing "regression", "flaky", or "new" status for failed test runs based on historical analysis
• Auto-generation: AI triage automatically triggers when failures are detected, with manual refresh capabilities
• Comprehensive Test Coverage: Added 442 lines of tests covering failure classification logic, history analysis, and context building functions
• UI Improvements: Changed default sidebar mode to "runs" and moved overview button to always be visible regardless of sidebar mode

[chelojimenez]

✅ Snyk checks have passed. No issues have been found so far.

Status	Scan Engine	Critical	High	Medium	Low	Total (0)
✅	Open Source Security	0	0	0	0	0 issues
✅	Code Security	0	0	0	0	0 issues

💻 Catch issues earlier using the plugins for VS Code, JetBrains IDEs, Visual Studio, and Eclipse.

[prathmeshpatel]

• Remove CI evals overview panel and tag filtering #1623
• Auto-switch to suite view for manual runs + add progress bars and pagination to failures #1614
• Simplify evals dash cont. #1613
• Clean up sidebar and other top improves #1612
• Hide AI triage panel when unavailable and prevent auto-requests #1611
• Remove AI triage frontend call logic and cleanup AI look #1610
• Group runs by commit SHA, update chip labels with commit time and pass fail overview #1609
• Frontend AI triage insights #1608 👈 (View in Graphite)
• Improve commit detail view #1607
• Evals CI/CD UX overview improves pt. 1 #1602
• [SDK] Add group filtering #1595
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[graphite-app]

Merge activity

• Mar 16, 9:11 AM UTC: Graphite rebased this pull request, because this pull request is set to merge when ready.