Skip to content

Commit 7fa437b

Browse files
authored
chore(model gallery): add huihui-ai_qwen3-14b-abliterated (#5324)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 4a27c99 commit 7fa437b

File tree

1 file changed

+16
-0
lines changed

1 file changed

+16
-0
lines changed

gallery/index.yaml

+16
Original file line numberDiff line numberDiff line change
@@ -511,6 +511,22 @@
511511
- filename: allura-org_remnant-qwen3-8b-Q4_K_M.gguf
512512
sha256: 94e179bb1f1fe0069804a7713bd6b1343626ef11d17a67c6990be7b813d26aeb
513513
uri: huggingface://bartowski/allura-org_remnant-qwen3-8b-GGUF/allura-org_remnant-qwen3-8b-Q4_K_M.gguf
514+
- !!merge <<: *qwen3
515+
name: "huihui-ai_qwen3-14b-abliterated"
516+
urls:
517+
- https://huggingface.co/huihui-ai/Qwen3-14B-abliterated
518+
- https://huggingface.co/bartowski/huihui-ai_Qwen3-14B-abliterated-GGUF
519+
description: |
520+
This is an uncensored version of Qwen/Qwen3-14B created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
521+
522+
Ablation was performed using a new and faster method, which yields better results.
523+
overrides:
524+
parameters:
525+
model: huihui-ai_Qwen3-14B-abliterated-Q4_K_M.gguf
526+
files:
527+
- filename: huihui-ai_Qwen3-14B-abliterated-Q4_K_M.gguf
528+
sha256: d76889059a3bfab30bc565012a0184827ff2bdc10197f6babc24541b98451dbe
529+
uri: huggingface://bartowski/huihui-ai_Qwen3-14B-abliterated-GGUF/huihui-ai_Qwen3-14B-abliterated-Q4_K_M.gguf
514530
- &gemma3
515531
url: "github:mudler/LocalAI/gallery/gemma.yaml@master"
516532
name: "gemma-3-27b-it"

0 commit comments

Comments
 (0)