Pinned Loading

1. lite.ai.toolkit lite.ai.toolkit Public

   🛠 A lite C++ AI toolkit: 100+🎉 models (Stable-Diffusion, FaceFusion, YOLO series, Det, Seg, Matting) with MNN, ORT and TensorRT.

   C++ 4.1k 739

2. LeetCUDA LeetCUDA Public

   📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA/Tensor Cores Kernels, HGEMM, FA-2 MMA etc.🔥

   Cuda 4.4k 470

3. Awesome-LLM-Inference Awesome-LLM-Inference Public

   📚A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, Parallelism, MLA, etc.

   Python 4k 277

4. lihang-notes lihang-notes Public

   📚《统计学习方法-李航: 笔记-从原理到实现》 这是一份非常详细的学习笔记，200页PDF，各种手推公式细节讲解以及R语言实现. 🎉

   Shell 461 55

5. torchlm torchlm Public

   💎A high level pipeline for face landmarks detection: train, eval, inference (Python/C++) and 100+ data augmentations.

   Python 258 24

6. ffpa-attn ffpa-attn Public

   📚FFPA(Split-D): Extend FlashAttention with Split-D for large headdim, O(1) GPU SRAM complexity, 1.8x~3x↑🎉 faster than SDPA EA.

   Cuda 180 8