Support for new IBM Granite 3.

[BradHutchings]

Can we get that supported? Llama.cpp has it. Granite is exciting, mainly as IBM is claiming to have fully vetted the training data.

-Brad

[DK013]

+1
I thought since the underlying llama.cpp supports it, even ollama is supporting it so it must have a supported architecture but to my surprise it wasn't. it'd be really nice to have it supported.

[DK013]

and seems like there's a PR #608 open for this. By the same person who added Granite support in ollama and llama.cpp itself