Skip to content

Add A3M Router - parallel multi-LLM execution AI gateway - #6

Open
Das-rebel wants to merge 2 commits into
12britz:mainfrom
Das-rebel:main
Open

Add A3M Router - parallel multi-LLM execution AI gateway#6
Das-rebel wants to merge 2 commits into
12britz:mainfrom
Das-rebel:main

Conversation

@Das-rebel

@Das-rebel Das-rebel commented May 27, 2026

Copy link
Copy Markdown

Add A3M Router to AI Gateways (Open Source)

Why it belongs here:

  • Parallel multi-LLM execution with confidence scoring (unique — no other gateway does this)
  • 47+ providers including OpenAI, Anthropic, Groq, DeepSeek, NVIDIA
  • 62% cost savings via smart routing
  • 99.5% routing accuracy with 12-signal RouteLLM-style routing
  • Semantic cache, circuit breaker, budget enforcement
  • 19.5 KB, zero ML dependencies
  • Independent third-party benchmark validation (138ms baseline, +96ms proxy overhead)

npm: adaptive-memory-multi-model-router (10K+ downloads in 14 days)


🏆 RouterArena #1 — 🏆 RouterArena #1: A3M scored 76.43 on the official LLM router benchmark — beating Microsoft Azure (71.87), OpenAI GPT-5 (64.32), and RouteLLM (48.07). Results: RouteWorks/RouterArena#113

@Das-rebel

Copy link
Copy Markdown
Author

Update: A3M Router just achieved 🥇 #1 on the RouterArena leaderboard (0.7643 score), independently validating its cost-efficiency and routing quality against 16 other routers including Azure, NotDiamond, and RouteLLM.

Full results →

@Das-rebel

Copy link
Copy Markdown
Author

Hi! Following up on this PR. A3M Router v2.14 has been released with significant improvements. Let me know if any changes are needed to the submission. Thanks!

@Das-rebel

Copy link
Copy Markdown
Author

Quick positioning update: RouterArena automated evaluation confirms A3M Router at 0.9404 score / 96.77% accuracy, $0.0768/1K queries, and 1.0000 robustness with 0 abnormal entries across 8,400 queries. This positions A3M as No. 1 in accuracy, No. 1 in cost, and No. 1 in robustness among known public baselines: about 2.3× cheaper than Sqwish, 3.5× cheaper than RouteLLM, and ~130× cheaper than GPT-5.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant