Search results

[REQUEST]Please support Torch 2.8

Status: Open.

#804 In turboderp-org/exllamav2;

· pivtienduc opened on Aug 16, 2025

[BUG] [Cause Identified & Workarounds Proposed] Infinite Generation for Llama3 & Other Models with Multiple EOS IDs

bugSomething isn't workingSomething isn't working

Status: Open.

#803 In turboderp-org/exllamav2;

· abgulati opened on Jul 29, 2025

[BUG] Unable to run examples/chat.py

bugSomething isn't workingSomething isn't working

Status: Open.

#802 In turboderp-org/exllamav2;

· homeworkace opened on Jul 29, 2025

[REQUEST] Support for Hunyuan-A13B-Instruct

Status: Open.

#798 In turboderp-org/exllamav2;

· RodriMora opened on Jun 27, 2025

[BUG] ExLlamaV2Generator import broken across WHL & source repo — Windows 11 + RTX 5090 + CUDA 12.8 build inconsistencies

bugSomething isn't workingSomething isn't working

Status: Open.

#797 In turboderp-org/exllamav2;

· mindworksmanagement opened on Jun 16, 2025

[BUG] ExllamaV2 version >0.2.8 broken for mistral 7b(v0.2) models on Nvidia 2060

bugSomething isn't workingSomething isn't working

Status: Open.

#795 In turboderp-org/exllamav2;

· IceFog72 opened on Jun 9, 2025

[BUG] Exllamav2 quickly devolves into endless repetition in versions newer than 2.8.0

bugSomething isn't workingSomething isn't working

Status: Open.

#793 In turboderp-org/exllamav2;

· ZhenyaPav opened on May 28, 2025

[QUESTION] Estimate measurements and quantization peak VRAM use in advance

Status: Open.

#792 In turboderp-org/exllamav2;

· ThomasBaruzier opened on May 26, 2025

[BUG] Silent crash in safetensors call when compiling shards

bugSomething isn't workingSomething isn't working

Status: Open.

#790 In turboderp-org/exllamav2;

· r0mar0ma opened on May 25, 2025

[BUG] Quits without obvious error during model load

bugSomething isn't workingSomething isn't working

Status: Open.

#787 In turboderp-org/exllamav2;

· thigger opened on May 7, 2025

[BUG] Runtime error when trying to load Qwen3 32B

bugSomething isn't workingSomething isn't working

Status: Open.

#784 In turboderp-org/exllamav2;

· umar-mq opened on Apr 30, 2025

[REQUEST] Qwen3 Architecture Support

Status: Open.

#781 In turboderp-org/exllamav2;

· Thireus opened on Apr 29, 2025