forked from cline/cline
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
owao
committed
Feb 9, 2025
1 parent
263aa0a
commit 473ae41
Showing
5 changed files
with
40 additions
and
40 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,5 +1,18 @@ | ||
# Cline - AI Assistant for CLI and Editor | ||
|
||
This fork focuses on shortening the system prompt to make it accessible even in local inference environments with context restrictions (e.g., 16k tokens). The fork has no plan for further advancement apart from keeping up to date with the upstream repository. | ||
This fork focuses solely on compressing the system prompt to make Cline accessible to local inference. The prompt has been shorten as much as possible while preserving the original information. | ||
|
||
For more details, visit [Cline repository](https://github.com/cline/cline). | ||
With this lightened system prompt, locally loaded models such as: | ||
|
||
- **[Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct)**: Tested with Q4_K_M quantization and offering good overall performance. | ||
- **[Mistral-Small-24B-Instruct](https://huggingface.co/bartowski/Mistral-Small-24B-Instruct)**: Finetuned for tools use, making it a useful "Jarvis" assistant. Tested with Q5_K_L quantization. | ||
|
||
Additionally, reasoning models like: | ||
|
||
- **[FuseO1's models](https://huggingface.co/collections/FuseAI/fuseo1-preview-678eb56093649b2688bc9977)**: Tested with Q4_K_M quantization. Flash and coder variants can complement each other. | ||
|
||
can now power Cline too! | ||
|
||
For more about Cline, visit their [repository](https://github.com/cline/cline). | ||
|
||
PS: Note that web scraping is only available for Claude. |
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters