Skip to content
@hao-ai-lab

Hao AI Lab

Popular repositories Loading

  1. LookaheadDecoding LookaheadDecoding Public

    [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

    Python 1.2k 73

  2. FastVideo FastVideo Public

    FastVideo is a lightweight framework for accelerating large video diffusion models.

    Python 1.2k 72

  3. Consistency_LLM Consistency_LLM Public

    [ICML 2024] CLLMs: Consistency Large Language Models

    Python 383 18

  4. Dynasor Dynasor Public

    Simple extension on vLLM to help you speed up reasoning model without training.

    Python 127 17

  5. MuxServe MuxServe Public

    Jupyter Notebook 52 4

  6. vllm-ltr vllm-ltr Public

    [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank

    Python 41 8

Repositories

Showing 10 of 13 repositories
  • cse234-w25-PA Public
    hao-ai-lab/cse234-w25-PA’s past year of commit activity
    Python 24 37 0 0 Updated Mar 10, 2025
  • cse234-w25 Public Forked from hao-ai-lab/dsc291-s24

    Website for CSE 234, Winter 2025

    hao-ai-lab/cse234-w25’s past year of commit activity
    SCSS 7 46 0 2 Updated Mar 10, 2025
  • vllm Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    hao-ai-lab/vllm’s past year of commit activity
    Python 0 Apache-2.0 6,238 0 1 Updated Mar 10, 2025
  • FastVideo Public

    FastVideo is a lightweight framework for accelerating large video diffusion models.

    hao-ai-lab/FastVideo’s past year of commit activity
    Python 1,209 Apache-2.0 72 29 6 Updated Mar 8, 2025
  • Dynasor Public

    Simple extension on vLLM to help you speed up reasoning model without training.

    hao-ai-lab/Dynasor’s past year of commit activity
    Python 127 MIT 17 6 1 Updated Mar 8, 2025
  • LookaheadDecoding Public

    [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

    hao-ai-lab/LookaheadDecoding’s past year of commit activity
    Python 1,209 Apache-2.0 73 32 1 Updated Mar 6, 2025
  • hao-ai-lab.github.io Public
    hao-ai-lab/hao-ai-lab.github.io’s past year of commit activity
    HTML 1 8 1 0 Updated Feb 22, 2025
  • Consistency_LLM Public

    [ICML 2024] CLLMs: Consistency Large Language Models

    hao-ai-lab/Consistency_LLM’s past year of commit activity
    Python 383 Apache-2.0 18 7 0 Updated Nov 16, 2024
  • vllm-ltr Public

    [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank

    hao-ai-lab/vllm-ltr’s past year of commit activity
    Python 41 Apache-2.0 8 0 0 Updated Nov 4, 2024
  • MuxServe Public
    hao-ai-lab/MuxServe’s past year of commit activity
    Jupyter Notebook 52 4 2 0 Updated Jun 13, 2024
View all repositories

Most used topics

Loading…