Popular repositories Loading

1. attention-is-all-you-need-pytorch attention-is-all-you-need-pytorch Public

   Forked from jadore801120/attention-is-all-you-need-pytorch

   A PyTorch implementation of the Transformer model in "Attention is All You Need".

   Python

2. server server Public

   Forked from triton-inference-server/server

   The Triton Inference Server provides an optimized cloud and edge inferencing solution.

   Python

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. specinfer-ae specinfer-ae Public

   Forked from goliaro/specinfer-ae

   Shell

5. PowerInfer PowerInfer Public

   Forked from SJTU-IPADS/PowerInfer

   High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

   C++

6. OS-PKE OS-PKE Public

   C