diff --git a/.env.example b/.env.example index 1b7b853..331d8e1 100644 --- a/.env.example +++ b/.env.example @@ -52,7 +52,10 @@ LONGCAT_API_KEY= # --------------------------------------------------------------------------- # Zero-setup providers (no key needed — included automatically): +# • Pollinations (anonymous/keyless) # • OVHcloud AI Endpoints (anonymous/keyless) +# • Kilo Gateway (anonymous/keyless) +# • OpenCode Zen (anonymous/keyless) # • LLM7 (works without a key; set LLM7_API_KEY for more) # So freellmpool works out of the box even with this whole file empty. # --------------------------------------------------------------------------- diff --git a/CHANGELOG.md b/CHANGELOG.md index af296e1..bba341a 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -4,6 +4,12 @@ All notable changes to this project are documented here. The format is based on [Keep a Changelog](https://keepachangelog.com/), and the project aims to follow [Semantic Versioning](https://semver.org/). +## [Unreleased] + +### Added +- Experimental metaswarm review adapter integration, with setup docs and no-key + smoke coverage for fail-closed `auth_missing` behavior. + ## [0.11.4] — 2026-06-17 MCP Registry verification metadata release. diff --git a/FAQ.md b/FAQ.md index 7d92ac1..cdf2bea 100644 --- a/FAQ.md +++ b/FAQ.md @@ -18,6 +18,7 @@ not encode data residency, this table says so instead of guessing. | `llm7` | `https://api.llm7.io/v1` | Key optional | LLM7's privacy policy says it operates from the United Kingdom. | Optional-token gateway; prompts go to LLM7 and whatever upstream serving path it uses. | | `ovh` | `https://oai.endpoints.kepler.ai.cloud.ovh.net/v1` | Keyless | OVHcloud describes AI Endpoints as a privacy-focused OVHcloud service; the catalog does not pin a region. | Strongest keyless privacy posture in this catalog, but still a third-party hosted API. | | `kilo` | `https://api.kilo.ai/api/gateway` | Keyless | Kilo Code Inc.; endpoint region is not stated in the catalog. | Gateway docs warn not to submit personal or confidential data; treat free routes as logged. | +| `opencode` | `https://opencode.ai/zen/v1` | Keyless | OpenCode Zen endpoint region is not stated in the catalog. | Anonymous gateway; live free routes may change quickly, so do not send secrets unless OpenCode's current policy fits your use case. | | `huggingface` | `https://router.huggingface.co/v1` | `HF_TOKEN` | Hugging Face says the company and servers are in the United States and data may be processed elsewhere. | Router endpoint; your key and prompt go to Hugging Face's routed inference service. | | `groq` | `https://api.groq.com/openai/v1` | `GROQ_API_KEY` | Groq, Inc.; endpoint region is not stated in the catalog. | Direct provider API using your Groq key; check Groq's current service/privacy terms for retention. | | `cerebras` | `https://api.cerebras.ai/v1` | `CEREBRAS_API_KEY` | Cerebras Systems Inc.; endpoint region is not stated in the catalog. | Direct provider API using your Cerebras key; check Cerebras' current policy before sensitive prompts. | diff --git a/README.md b/README.md index 420e7b2..f83c865 100644 --- a/README.md +++ b/README.md @@ -4,9 +4,9 @@ ![freellmpool tokenmax terminal demo](assets/demo.svg) -![200+ models, 18 providers, $0 to start](assets/tokenmax-results.svg) +![200+ models, 19 providers, $0 to start](assets/tokenmax-results.svg) -Pool the free tiers of 18 LLM providers (200+ live-validated, 300+ cataloged +Pool the free tiers of 19 LLM providers (200+ live-validated, 300+ cataloged models) behind one OpenAI-compatible endpoint — as a CLI, a Python library, or a local proxy. Works with no API keys. @@ -39,8 +39,9 @@ rate limits, and daily cap. freellmpool puts them in one pool: it sends each request to a provider you have access to, fails over to the next when one is rate limited or down, and tracks per-day usage so you get the most out of every tier. -Several providers (Pollinations, OVHcloud, and Kilo Gateway) need no API key, so -the quickstart above answers immediately. +Several providers (Pollinations, OVHcloud, Kilo Gateway, and OpenCode Zen) need +no API key, and LLM7 works without one, so the quickstart above answers +immediately. Add keys for the other providers to unlock more models and higher limits. @@ -168,7 +169,9 @@ Endpoints: `/v1/chat/completions` (token streaming, tool calling), `/v1/embeddin `/v1/audio/transcriptions` (Whisper, multipart upload), `/v1/responses`, `/v1/messages`, `/v1/models`, and a `/dashboard` page showing usage. Setup snippets for specific tools are in [docs/INTEGRATIONS.md](docs/INTEGRATIONS.md) -and [docs/AGENTS.md](docs/AGENTS.md). +and [docs/AGENTS.md](docs/AGENTS.md). The repo also includes an experimental +[metaswarm review adapter](integrations/metaswarm) for using `freellmpool` as an +external-tools reviewer/second opinion. ## As a library @@ -353,7 +356,7 @@ Architecture notes: [docs/ARCHITECTURE.md](docs/ARCHITECTURE.md). | Tool | Keyless start | # providers | Failover | MCP server | CLI | Transcription | Local/self-hosted | License | |---|---|---:|---|---|---|---|---|---| -| **freellmpool** | Yes: Pollinations, OVHcloud, Kilo Gateway; LLM7 is key-optional | 18 built-in chat providers | Yes: tries the next provider on rate limits, timeouts, 5xx, empty replies, and transport errors | Yes: `freellmpool mcp` | Yes: `freellmpool ask`, `tokenmax`, `providers`, `proxy`, and more | Yes: OpenAI-compatible `/v1/audio/transcriptions` with provider failover | Yes: local Python package and local proxy | MIT | +| **freellmpool** | Yes: Pollinations, OVHcloud, Kilo Gateway, OpenCode Zen; LLM7 is key-optional | 19 built-in chat providers | Yes: tries the next provider on rate limits, timeouts, 5xx, empty replies, and transport errors | Yes: `freellmpool mcp` | Yes: `freellmpool ask`, `tokenmax`, `providers`, `proxy`, and more | Yes: OpenAI-compatible `/v1/audio/transcriptions` with provider failover | Yes: local Python package and local proxy | MIT | | OpenRouter free models | No: OpenRouter account/API key required | One hosted OpenRouter account routing across many upstreams; the free-model router currently lists free variants | Yes: OpenRouter handles provider routing/fallbacks | Not a native MCP server; OpenRouter docs show MCP-client/tool patterns | No first-party local CLI in the docs checked | Yes: OpenRouter now documents audio transcription APIs | No: hosted service | Proprietary service | | LiteLLM | No: bring provider keys or hosted LiteLLM credentials | 100+ LLM providers | Yes: router/fallbacks, including transcription fallbacks | Yes: LiteLLM Proxy includes an MCP Gateway | Yes: SDK/proxy command surface, not a one-shot free-model CLI | Yes: `/audio/transcriptions` support | Yes: self-host the proxy or use hosted LiteLLM | MIT for core repo; commercial license for enterprise-only pieces | | FreeLLMAPI | No: add your own free-tier provider keys; keyless providers can be configured after setup | 16 free-tier providers plus custom OpenAI-compatible endpoints | Yes: fallback chain on 429, 5xx, and timeouts | No native MCP server in the README checked | Dashboard/server, desktop app, and Docker; no first-class one-shot CLI in the README checked | No: `/v1/audio/*` is listed as not yet supported | Yes: self-hosted Node/Docker proxy | MIT | @@ -373,7 +376,7 @@ audio transcription docs; FreeLLMAPI's README. **Is there a free, OpenAI-compatible LLM API gateway?** Yes — freellmpool is a free, MIT-licensed gateway that exposes one OpenAI-compatible endpoint backed by the free -tiers of 18 providers. `pip install freellmpool` and point any OpenAI client at the +tiers of 19 providers. `pip install freellmpool` and point any OpenAI client at the local proxy. **How do I use multiple free LLM APIs at once?** freellmpool pools them: each request @@ -387,9 +390,10 @@ Code, set `CLAUDE_CODE_ENABLE_GATEWAY_MODEL_DISCOVERY=1` so `/v1/models` is disc through the Anthropic bridge. See `freellmpool code `. (Claude Code path is experimental: text + tools, no vision.) -**Do I need an API key?** No — Pollinations, OVHcloud, and Kilo Gateway work with no key, so a fresh -install answers immediately. Add free keys for the other providers for more models and -higher limits. +**Do I need an API key?** No — Pollinations, OVHcloud, Kilo Gateway, and OpenCode +Zen work with no key, and LLM7 is key-optional, so a fresh install answers +immediately. Add free keys for the other providers for more models and higher +limits. **Is it free and open source?** Yes, MIT-licensed. More at the [project page](https://0xzr.github.io/freellmpool/). diff --git a/assets/demo.svg b/assets/demo.svg index 4265a40..bf13ccf 100644 --- a/assets/demo.svg +++ b/assets/demo.svg @@ -47,7 +47,7 @@ kilo/openrouter/free "ZeroKey" llm7/qwen3-235b "PoolPilot" SYNTHESIS freellmpool: one local API over the free tiers. - freellmpool catalog: 18 providers, 236 models - 18 free tiers - $0 to start + freellmpool catalog: 19 providers, 238 models - 19 free tiers - $0 to start diff --git a/assets/social-preview.png b/assets/social-preview.png index 3de9a5f..d7a6da6 100644 Binary files a/assets/social-preview.png and b/assets/social-preview.png differ diff --git a/assets/social-preview.svg b/assets/social-preview.svg index 3fd5bb2..d024840 100644 --- a/assets/social-preview.svg +++ b/assets/social-preview.svg @@ -1,6 +1,6 @@ freellmpool social preview - Free LLM API pool with zero keys to start, 18 providers, 200+ models, OpenAI and Anthropic proxy support, failover, MCP, rate limits, and transcription. + Free LLM API pool with zero keys to start, 19 providers, 200+ models, OpenAI and Anthropic proxy support, failover, MCP, rate limits, and transcription. @@ -37,7 +37,7 @@ to first reply - 18 providers + 19 providers 200+ models diff --git a/assets/tokenmax-results.svg b/assets/tokenmax-results.svg index 181b71c..ce8f999 100644 --- a/assets/tokenmax-results.svg +++ b/assets/tokenmax-results.svg @@ -1,6 +1,6 @@ freellmpool tokenmax results screenshot - Static launch card showing 200 plus models, 18 providers, zero dollars, keyless start, and automatic failover. + Static launch card showing 200 plus models, 19 providers, zero dollars, keyless start, and automatic failover.

For using free LLM tiers specifically, the best free, open-source gateway is -freellmpool: it pools the free tiers of 18 providers +freellmpool: it pools the free tiers of 19 providers behind one OpenAI-compatible endpoint, installs with pip, works with no API key to start, and ships as a CLI, a Python library, a local proxy, and an MCP server. LiteLLM is the best choice if you bring your own keys and want a mature multi-provider SDK; OpenRouter is best if you want one paid bill for diff --git a/docs/capacity-management.html b/docs/capacity-management.html index 502421f..c2d52e0 100644 --- a/docs/capacity-management.html +++ b/docs/capacity-management.html @@ -43,7 +43,7 @@

Know which free LLM tiers are usable right now

daily caps fill up. freellmpool ships capacity tools that tell you, locally, which of your free providers are usable right now, which are near their quota, and which keys to add next. freellmpool is a free, open-source tool that pools the free -tiers of 18 LLM providers behind one OpenAI-compatible endpoint; these commands keep that pool healthy.

+tiers of 19 LLM providers behind one OpenAI-compatible endpoint; these commands keep that pool healthy.

pip install freellmpool
 freellmpool capacity status --target 5
diff --git a/docs/free-alternative-to-openrouter.html b/docs/free-alternative-to-openrouter.html index 83f1d89..ea87933 100644 --- a/docs/free-alternative-to-openrouter.html +++ b/docs/free-alternative-to-openrouter.html @@ -38,7 +38,7 @@

How they differ

OpenRouterfreellmpool CostPay per token (some free models)Free — pools providers' free tiers HostingHosted serviceLocal, open source (MIT) -Keyless startNo (account + key)Yes (3 keyless providers) +Keyless startNo (account + key)Yes (4 keyless providers, plus LLM7 key-optional) InterfaceAPICLI + Python library + proxy + MCP server FailoverYesYes @@ -62,7 +62,7 @@

Is there a free version of OpenRouter?

open-source path, freellmpool pools the LLM providers' own free tiers behind one OpenAI-compatible endpoint and is keyless to start.

Can freellmpool use OpenRouter too?

-

Yes — OpenRouter is one of the 18 providers freellmpool can pool, so its free models become part of +

Yes — OpenRouter is one of the 19 providers freellmpool can pool, so its free models become part of the failover pool alongside Groq, Cerebras, Gemini and the rest.

Part of freellmpool (MIT, free, open source). Updated 2026-06-03.

diff --git a/docs/free-claude-api.html b/docs/free-claude-api.html index cd25ebf..e8ddc2f 100644 --- a/docs/free-claude-api.html +++ b/docs/free-claude-api.html @@ -61,7 +61,7 @@

Use the Anthropic API from your own code

Why use freellmpool for this

diff --git a/docs/free-llm-api-providers-list.html b/docs/free-llm-api-providers-list.html index 03a5853..5ba492e 100644 --- a/docs/free-llm-api-providers-list.html +++ b/docs/free-llm-api-providers-list.html @@ -7,7 +7,7 @@ - +