Skip to content

Commit 25da321

Browse files
authored
Updates (#8)
* Added subtitle to hero section, deleted description. Added affiliation of routers on leaderboard page and leaderboard preview. Changed leaderboard preview text Principled dataset -> diverse dataset Larger text on the dataset composition graph Removed contact us button Removed blue bars New color scheme for top 3, and new icons Two decimal metrics. Larger text on spider and deferral graph More specific information on evaluation metrics Fixed github repo link * Added affliations for irt router
1 parent abd70e9 commit 25da321

4 files changed

Lines changed: 18 additions & 8 deletions

File tree

‎src/data/mockData.ts‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -84,7 +84,7 @@ export const routers: Router[] = [
8484
name: 'MIRT-BERT',
8585
type: 'academic',
8686
description: 'Multi-item response theory with BERT embeddings',
87-
affiliation: 'Unknown',
87+
affiliation: 'USTC',
8888
metrics: {
8989
arenaScore: 0.78,
9090
costRatioScore: 0.75,
@@ -102,7 +102,7 @@ export const routers: Router[] = [
102102
name: 'NIRT-BERT',
103103
type: 'academic',
104104
description: 'Neural item response theory with BERT-based routing',
105-
affiliation: 'Unknown',
105+
affiliation: 'USTC',
106106
metrics: {
107107
arenaScore: 0.76,
108108
costRatioScore: 0.70,

‎src/pages/HomePage.tsx‎

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -37,6 +37,9 @@ const HomePage: React.FC = () => {
3737
<p className="hero-subtitle-short">
3838
Diverse dataset, extensive metrics, and live leaderboard
3939
</p>
40+
<p className="hero-subtitle-short">
41+
Diverse dataset, extensive metrics, and live leaderboard
42+
</p>
4043
<div className="hero-actions">
4144
<Link to="/leaderboard" className="btn btn-primary">
4245
<Trophy className="btn-icon" />
@@ -58,6 +61,7 @@ const HomePage: React.FC = () => {
5861
<span className="rank">{index + 1}</span>
5962
<span className="name">{router.name}</span>
6063
<span className="affiliation">{router.affiliation}</span>
64+
<span className="affiliation">{router.affiliation}</span>
6165
</div>
6266
))}
6367
</div>
@@ -66,7 +70,7 @@ const HomePage: React.FC = () => {
6670
<div className="cta-card">
6771
<h3 className="cta-heading">Want to see your router on the leaderboard?</h3>
6872
<p className="cta-description">
69-
Open a GitHub issue on our RouterArena platform.
73+
Email us or open a GitHub issue on RouterArena.
7074
</p>
7175
<a href="#contact" className="btn btn-primary">
7276
Get Started →
@@ -91,6 +95,7 @@ const HomePage: React.FC = () => {
9195
>
9296
<BookOpen className="tab-icon" />
9397
Diverse Dataset
98+
Diverse Dataset
9499
</button>
95100
<button
96101
className={`tab-button ${activeTab === 'metrics' ? 'active' : ''}`}
@@ -124,6 +129,7 @@ const HomePage: React.FC = () => {
124129
<BookOpen />
125130
</div>
126131
<div>
132+
<h3>Diverse Dataset</h3>
127133
<h3>Diverse Dataset</h3>
128134
<p className="tab-subtitle">
129135
{datasetInfo.totalQueries.toLocaleString()} queries across {datasetInfo.domains} domains
@@ -242,7 +248,7 @@ const HomePage: React.FC = () => {
242248
<div className="container">
243249
<h2 className="section-title">Research Team</h2>
244250
<p className="contact-description">
245-
Contact us or open a GitHub issue to evaluate your router with RouterArena
251+
Contact us or submit a GitHub issue to evaluate your router with RouterArena
246252
</p>
247253

248254
{/* Action Buttons */}

‎src/pages/LeaderboardPage.css‎

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -166,6 +166,10 @@
166166
--lb-grid: 60px minmax(140px, 1.4fr) minmax(120px, 1fr) 0.8fr repeat(5, minmax(90px, 1fr));
167167
}
168168

169+
:root {
170+
--lb-grid: 60px minmax(140px, 1.4fr) minmax(120px, 1fr) 0.8fr repeat(5, minmax(90px, 1fr));
171+
}
172+
169173
.leaderboard-header {
170174
display: grid;
171175
grid-template-columns: var(--lb-grid);

‎src/pages/LeaderboardPage.tsx‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -295,16 +295,16 @@ const LeaderboardPage: React.FC = () => {
295295
<div className="metric-card">
296296
<h3>Cost Ratio Score</h3>
297297
<p>
298-
Evaluates the cost of the router's choices relative to an oracle that always selects the cheapest correct model.
299-
Routers with higher scores achieve comparable accuracy at lower inference cost.
298+
Measures the performance a router achieves per unit of cost compared to the benchmarked routers.
299+
A high score means it maintains strong accuracy while spending less on average across all queries.
300300
</p>
301301
</div>
302302

303303
<div className="metric-card">
304304
<h3>Optimality Score</h3>
305305
<p>
306-
Measures how often a router selects the optimal model (i.e., the model answers the question correctly with the lowest cost).
307-
Higher values reflect closer alignment to cost-optimal routing behavior.
306+
Captures how the router's ability to select the cheapest model that still produces a correct response.
307+
High values indicate decisions that closely match ideal, cost-minimizing routing behavior.
308308
</p>
309309
</div>
310310

0 commit comments

Comments
 (0)