Replies: 1 comment 2 replies
-
Parameters like Temperature and TopK are set on the sampling pipeline, for example: InferenceParams inferenceParams = new InferenceParams()
{
SamplingPipeline = new DefaultSamplingPipeline()
{
Temperature = 1,
TopK = 10,
},
}; The |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello! I am using LLamaSharp 0.21.0, I get the error "InferenceParams" does not contain a definition for "Temperature".
I installed the LLamaSharp and LLamaSharp.Backend.Cpu using PM. I get an error like "InferenceParams" does not contain a definition for "Temperature" or "InferenceParams" does not contain a definition for "TopK".
Beta Was this translation helpful? Give feedback.
All reactions