Optimized to run on 8Gb vram without OOM, Dynamic quantization [Do not Merge]#76
Open
nalexand wants to merge 2 commits intoHeartMuLa:mainfrom
Open
Optimized to run on 8Gb vram without OOM, Dynamic quantization [Do not Merge]#76nalexand wants to merge 2 commits intoHeartMuLa:mainfrom
nalexand wants to merge 2 commits intoHeartMuLa:mainfrom