Skip to content

First release v0.0.1

Compare
Choose a tag to compare
@kerthcet kerthcet released this 23 Jul 04:02
· 206 commits to main since this release
878203b

What's Changed

  • Add new core APIs, e.g. Model
  • Add new inference APIs, e.g.Playground, Inference
  • Support serving models from huggingface
  • Support sharing models weights on the same node
  • Integrate with vllm by default
  • Add webhooks for APIs
  • Add installation documents and examples

New Contributors