Skip to content

Feat/optimize local models#112

Merged
DocRoms merged 1 commit into
mainfrom
feat/optimize-local-models
Jul 7, 2026
Merged

Feat/optimize local models#112
DocRoms merged 1 commit into
mainfrom
feat/optimize-local-models

Conversation

@DocRoms

@DocRoms DocRoms commented Jul 1, 2026

Copy link
Copy Markdown
Owner

Summary

On fixe tous les soucis pour améliorer drastiquement l'utilisation des modèles locaux dans les étapes de Workflows. On soihaite utliser des modèles différents pour différents steps croisé à des modèles payant pour du raisonement (ou autre).

Changes

  • Local-model usability pass (bench-driven).
  • Ollama: pick a model per tier (economy / default / reasoning), like every other agent.
  • The configured Ollama model is now used at every tier.
  • Ollama economy default is now qwen3:8b, not qwen3:4b.
  • Each message shows the concrete model it ran on.
  • KRONN_OLLAMA_NUM_CTX_CAP — raise the local context window on capable hardware.
  • Ollama streaming actually finishes, and messages render correctly.

@DocRoms
DocRoms force-pushed the feat/optimize-local-models branch 3 times, most recently from fb78cf2 to fe2e70d Compare July 6, 2026 06:19
@DocRoms DocRoms added the ci-test Start all the CI Test steps label Jul 6, 2026
@DocRoms DocRoms self-assigned this Jul 6, 2026
@DocRoms
DocRoms force-pushed the feat/optimize-local-models branch from fe2e70d to 6ed07cf Compare July 7, 2026 06:24
@DocRoms DocRoms added ci-test Start all the CI Test steps and removed ci-test Start all the CI Test steps labels Jul 7, 2026
…tx cap, fresh fallbacks

Signed-off-by: Romuald Priol <romuald.priol@protonmail.com>
@DocRoms
DocRoms force-pushed the feat/optimize-local-models branch from 6ed07cf to b133900 Compare July 7, 2026 07:35
@DocRoms DocRoms added ci-test Start all the CI Test steps and removed ci-test Start all the CI Test steps labels Jul 7, 2026
@DocRoms
DocRoms merged commit 85e6c0f into main Jul 7, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci-test Start all the CI Test steps

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant