How to limit slots to 1?

[cztomsik]

Is -np 1 supposed to work? I was trying to run llama-server with Qwen3 embedding (their official 4B GGUF) model and I couldn't get it working with only one slot. -np 0 does not work at all (and probably should be an error) and -np 1 seems to be what default is (which is 4 in my case)

[ggerganov]

For now you can use -np 1 -kvu to force 1 slot. We'll likely improve this configuration as I can see it is a bit confusing.

Btw, what is the reason to want to use 1 slot instead of the default?

[cztomsik]

Thanks! I was getting weird malloc errors (and server crashed) so I thought I'd first reduce n_slots. I'm not yet sure what's causing it, it could be also HW but so far I had no issues running much larger models. It seems to only happen for longer inputs. I can report but I just wanted to find out as much as I can first :)