The model is quantized to Q4_K
Whenever the model was asked to describe the image in a specific structure, there were repetitive answers. I tried playing around with the sampling strategies and the same result. Could this be solved with fine tuning with image and required structured response.
When prompted to give the response in json format,
When asked to describe,
The model is quantized to Q4_K
Whenever the model was asked to describe the image in a specific structure, there were repetitive answers. I tried playing around with the sampling strategies and the same result. Could this be solved with fine tuning with image and required structured response.
When prompted to give the response in json format,
When asked to describe,