Labels

• bug

  bug

  Something isn't working

• correctness

  correctness

• cuda

  cuda

• distributed-inference

  distributed-inference

• documentation

  documentation

  Improvements or additions to documentation

• duplicate

  duplicate

  This issue or pull request already exists

• help wanted

  help wanted

  Extra attention is needed

• http-api

  http-api

• ideas-to-explore

  ideas-to-explore

• invalid

  invalid

  This doesn't seem right

• kv-cache

  kv-cache

• likely-risky

  likely-risky

• metal

  metal

• new-capability

  new-capability

• no-brainer 💃

  no-brainer 💃

• operations / integration

  operations / integration

• priority

  priority

• question

  question

  Further information is requested

• speed

  speed

• steering

  steering

• tools-calling

  tools-calling

• waiting-user-acknowledge

  waiting-user-acknowledge

• weights loading or handling

  weights loading or handling

  New feature or request

• would-skip-this

  would-skip-this

  This will not be worked on