Popular repositories Loading

1. kvcached kvcached Public

   Forked from ovg-project/kvcached

   kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python

4. maxtext maxtext Public

   Forked from AI-Hypercomputer/maxtext

   A simple, performant and scalable Jax LLM!

   Python

5. sglang-jax sglang-jax Public

   Forked from sgl-project/sglang-jax

   JAX backend for SGL

   Python

6. pallas-kernel pallas-kernel Public

   Forked from sdh1014/pallas-kernel

   A set of pallas kernels for learning and tutorials

   Python