Skip to content

feat(friendli): fetch model list dynamically from /v1/models - #2

Draft
Lee-Si-Yoon wants to merge 8 commits into
feat/friendli-reasoning-params-cleanfrom
feat/friendli-dynamic-models
Draft

feat(friendli): fetch model list dynamically from /v1/models#2
Lee-Si-Yoon wants to merge 8 commits into
feat/friendli-reasoning-params-cleanfrom
feat/friendli-dynamic-models

Conversation

@Lee-Si-Yoon

Copy link
Copy Markdown
Owner

Stacked on Zoo-Code-Org#886. Merge Zoo-Code-Org#886 first, then this one.

Friendli model list is now fetched live from GET /v1/models instead of being hardcoded. The endpoint is public (no auth), same as Vercel AI Gateway and OpenRouter in this repo.

  • New fetcher (fetchers/friendli.ts): zod-validated axios call, maps API fields to ModelInfo (pricing, cache, reasoning effort, image modality, deprecation)
  • FriendliHandler fire-and-forgets a model fetch in constructor; getModel() prefers dynamic data, falls back to static friendliModels
  • "friendli" moved to dynamicProviders; UI uses routerModels.friendli for the model picker
  • 14 fetcher tests, 3 webview tests, 29 existing handler tests pass

WebMad and others added 8 commits July 26, 2026 12:21
* refactor(api): use canonical provider identifiers

* test(api): cover canonical provider routing

* test(api): enforce exhaustive provider routing

* test(api): avoid concrete Vertex model IDs
…de-Org#991)

* refactor(types): use canonical identifiers for default models

* test(types): cover international ZAI default

* refactor(types): name absent provider default

* test(types): cover defaults preserved during rebase

* test(types): document identical Zai defaults
…de-Org#1020)

* refactor(api): use canonical model cache provider identifiers

* test(api): address model cache review feedback

* refactor(api): retain auth-scoped provider set

---------

Co-authored-by: edelauna <54631123+edelauna@users.noreply.github.com>
…e-Org#1019)

* refactor(shared): use canonical profile provider identifiers

* test(shared): strengthen profile validator coverage

* test(shared): avoid mutating provider identifiers

* chore(lint): prune profile validator suppressions
* refactor(core): use canonical provider identifiers

* test(core): tighten canonical provider coverage

* test(core): avoid mutating provider identifiers

* test(core): address canonical identifier review feedback

* chore(lint): update test suppression counts

* test(core): keep existing non-null assertions
…oo-Code-Org#1024) (Zoo-Code-Org#1032)

* fix(ripgrep): resolve platform-specific binary for @vscode/ripgrep >=1.18

* fix(environment): gracefully handle ripgrep not found during file listing

* fix(ripgrep): use npm_config_arch for platform-package resolution

* refactor(ripgrep): replace createRequire resolver with static candidate paths

* fix(ripgrep): evaluate npm_config_arch at call time in candidate paths

---------

Co-authored-by: Naved  Merchant <naved.merchant@gmail.com>
Convert Friendli from a static provider (4 hardcoded models) to a dynamic
provider that fetches the live model list from the public
https://api.friendli.ai/serverless/v1/models endpoint at runtime.

- Add getFriendliModels() fetcher with zod schema validation
- Wire friendli into modelCache, webviewMessageHandler, and dynamicProviders
- FriendliHandler loads dynamic models in constructor, falls back to static
  friendliModels for cold-start and API lag
- UI model picker uses routerModels.friendli instead of static list
- Add fetcher spec (14 tests) and update Friendli.spec.tsx with ModelPicker mock
@Lee-Si-Yoon
Lee-Si-Yoon force-pushed the feat/friendli-dynamic-models branch from bab25e8 to 3ec8de5 Compare July 29, 2026 01:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants