Add support for local LLM models (Ollama, LM Studio)

[TejasS1233]

currently only llms with api keys are being taken add support for local llms

[45hv1n]

@TejasS1233, I would like to work on this. Could you please assign this issue to me.

[krushnamohod]

@TejasS1233, I would like to work on this, Could you plz assign this issue to me, i have worked on llm integration and can get your job done

[Sd-space]

@TejasS1233 I would like to work on this issue. Could you please assign me this issue.

[Vishal-74]

Hey
Is it still open? And do you want that whatever model we have locally we can run it by renaming variables values?