I can't understand how to run this line ./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0.bin 2

[SCHIZ0FRENIA]

I called it like this
python3 ./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0.bin 2

Like this
./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0.bin 2

but nothing works, please help me.

[heroofhyla]

The second one should be correct. What errors are you getting?