Skip to content

feat: INT4/INT8 quantization + expert offloading for consumer hardware#74

Open
oyi77 wants to merge 2 commits into
kyegomez:mainfrom
oyi77:feature/int4-quantization
Open

feat: INT4/INT8 quantization + expert offloading for consumer hardware#74
oyi77 wants to merge 2 commits into
kyegomez:mainfrom
oyi77:feature/int4-quantization

fix: Code quality improvements for quantization and expert offloading

20a998d
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs