Skip to content

fix: add provider fallback for offload LLMs#938

Open
COM0Dover4N9 wants to merge 1 commit into
colbymchenry:mainfrom
COM0Dover4N9:agent/provider-fallback-chain
Open

fix: add provider fallback for offload LLMs#938
COM0Dover4N9 wants to merge 1 commit into
colbymchenry:mainfrom
COM0Dover4N9:agent/provider-fallback-chain

Conversation

@COM0Dover4N9

Copy link
Copy Markdown

Summary

  • add ordered provider fallback chains for reasoning offload
  • keep legacy single-endpoint offload config compatible
  • fall through from Ollama/provider 429s or failures to OpenAI/Gemini-style OpenAI-compatible endpoints

Test Plan

  • npm test -- tests/offload.test.ts
  • npm run build
  • npm test (one mcp-daemon timeout; focused rerun passed)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant