Skip to content

Commit

Permalink
refactor: updated some strings
Browse files Browse the repository at this point in the history
  • Loading branch information
owao committed Feb 9, 2025
1 parent 263aa0a commit 473ae41
Show file tree
Hide file tree
Showing 5 changed files with 40 additions and 40 deletions.
17 changes: 15 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,18 @@
# Cline - AI Assistant for CLI and Editor

This fork focuses on shortening the system prompt to make it accessible even in local inference environments with context restrictions (e.g., 16k tokens). The fork has no plan for further advancement apart from keeping up to date with the upstream repository.
This fork focuses solely on compressing the system prompt to make Cline accessible to local inference. The prompt has been shorten as much as possible while preserving the original information.

For more details, visit [Cline repository](https://github.com/cline/cline).
With this lightened system prompt, locally loaded models such as:

- **[Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct)**: Tested with Q4_K_M quantization and offering good overall performance.
- **[Mistral-Small-24B-Instruct](https://huggingface.co/bartowski/Mistral-Small-24B-Instruct)**: Finetuned for tools use, making it a useful "Jarvis" assistant. Tested with Q5_K_L quantization.

Additionally, reasoning models like:

- **[FuseO1's models](https://huggingface.co/collections/FuseAI/fuseo1-preview-678eb56093649b2688bc9977)**: Tested with Q4_K_M quantization. Flash and coder variants can complement each other.

can now power Cline too!

For more about Cline, visit their [repository](https://github.com/cline/cline).

PS: Note that web scraping is only available for Claude.
4 changes: 2 additions & 2 deletions package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion src/core/Cline.ts
Original file line number Diff line number Diff line change
Expand Up @@ -2908,7 +2908,7 @@ export class Cline {
"mistake_limit_reached",
this.api.getModel().id.includes("claude")
? `This may indicate a failure in his thought process or inability to use a tool properly, which can be mitigated with some user guidance (e.g. "Try breaking down the task into smaller steps").`
: "Cline uses complex prompts and iterative task execution that may be challenging for less capable models. For best results, it's recommended to use Claude 3.5 Sonnet for its advanced agentic coding capabilities.",
: "Cline uses complex prompts and iterative task execution that may be challenging for less capable models. For best results, it's recommended to use a model specifically tuned for agentic coding capabilities.",
)
if (response === "messageResponse") {
userContent.push(
Expand Down
23 changes: 11 additions & 12 deletions webview-ui/src/components/chat/ChatView.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -761,27 +761,26 @@ const ChatView = ({ isHidden, showAnnouncement, hideAnnouncement, showHistoryVie
<div style={{ padding: "0 20px", flexShrink: 0 }}>
<h2>What can I do for you?</h2>
<p>
Thanks to Claude's system prompt compression, locally loaded, and even reasonning models like{" "}
This Cline fork only focuses on prompt compression, to make it usable on memory restricted
environments. Locally loaded models like
<VSCodeLink
href="https://huggingface.co/FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF"
href="https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct-GGUF"
style={{ display: "inline" }}>
FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF
Qwen2.5-Coder-32B-Instruct
</VSCodeLink>
can now fuel Cline too. Web scraping mode is only available for Claude. The tested quant level was
Q4_K_M, and you can find more details on the original model creators' GGUF quants page:{" "}
and
<VSCodeLink
href="https://huggingface.co/FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF"
href="https://huggingface.co/bartowski/Mistral-Small-24B-Instruct-2501-GGUF"
style={{ display: "inline" }}>
GGUF Quant Page
Mistral-Small-24B-Instruct
</VSCodeLink>
. Additionally,{" "}
, and even reasoning models like
<VSCodeLink
href="https://huggingface.co/FuseAI/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-GGUF"
href="https://huggingface.co/collections/FuseAI/fuseo1-preview-678eb56093649b2688bc9977"
style={{ display: "inline" }}>
FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview
FuseO1's models
</VSCodeLink>
scored a bit lower on the bench results and may not follow instructions as closely; That said, both
models can be complementary.
can now power Cline too! But note web scraping mode is only available for Claude.
</p>
</div>
{taskHistory.length > 0 && <HistoryPreview showHistoryView={showHistoryView} />}
Expand Down
34 changes: 11 additions & 23 deletions webview-ui/src/components/welcome/WelcomeView.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -60,40 +60,28 @@ const WelcomeView = () => {
<div style={{ padding: "0 20px", flexShrink: 0 }}>
<h2>What can I do for you?</h2>
<p>
Thanks to Claude's system prompt compression, locally loaded, and even reasoning models like{" "}
This Cline fork only focuses on prompt compression, to make it usable on memory restricted environments.
Locally loaded models like
<VSCodeLink
href="https://huggingface.co/FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF"
href="https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct-GGUF"
style={{ display: "inline" }}>
FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF
Qwen2.5-Coder-32B-Instruct
</VSCodeLink>
can now fuel Cline too. Web scraping mode is only available for Claude. The tested quant level was Q4_K_M,
and you can find more details on the original model creators' GGUF quants page:{" "}
and
<VSCodeLink
href="https://huggingface.co/FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF"
href="https://huggingface.co/bartowski/Mistral-Small-24B-Instruct-2501-GGUF"
style={{ display: "inline" }}>
GGUF Quant Page
Mistral-Small-24B-Instruct
</VSCodeLink>
. Additionally,{" "}
and even reasoning models like
<VSCodeLink
href="https://huggingface.co/FuseAI/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-GGUF"
href="https://huggingface.co/collections/FuseAI/fuseo1-preview-678eb56093649b2688bc9977"
style={{ display: "inline" }}>
FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview
FuseO1's models
</VSCodeLink>
scored a bit lower on the bench results and may not follow instructions as closely; That said, both models
can be complementary.
can now power Cline too! But note web scraping mode is only available for Claude.
</p>
</div>

<p style={{ marginTop: "10px" }}>
Local models like <strong>FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF</strong> (tested with Q4_K_M
quantization) can be run directly on your machine. This model is available from{" "}
<VSCodeLink href="https://huggingface.co/FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-GGUF">
Hugging Face
</VSCodeLink>
and provides similar capabilities to Claude, with slight differences in output style between flash and coder
versions.
</p>

<div
style={{
marginTop: "15px",
Expand Down

0 comments on commit 473ae41

Please sign in to comment.