Repositories list

• ARIES

  Public
  ARIES is an open-source experimentation framework for agent serving systems research.

  Go

  •

  Creative Commons Attribution 4.0 International

  •1010 forks in hyscale-lab/ARIES•3737 stars in hyscale-lab/ARIES•1616 issues in hyscale-lab/ARIES•1313 pull requests in hyscale-lab/ARIES•Updated Oct 17, 2026Oct 17, 2026

• scholar-scout

  Public
  Python

  •

  MIT License

  •33 forks in hyscale-lab/scholar-scout•33 stars in hyscale-lab/scholar-scout•55 issues in hyscale-lab/scholar-scout•11 pull request in hyscale-lab/scholar-scout•Updated Oct 12, 2026Oct 12, 2026

• hyscale-lab.github.io

  Public
  Astro

  •

  MIT License

  •00 forks in hyscale-lab/hyscale-lab.github.io•00 stars in hyscale-lab/hyscale-lab.github.io•00 issues in hyscale-lab/hyscale-lab.github.io•22 pull requests in hyscale-lab/hyscale-lab.github.io•Updated Oct 12, 2026Oct 12, 2026

• lmcache

  Public
  LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

  Python

  •

  Apache License 2.0

  •2.1k2.1k forks in hyscale-lab/lmcache•00 stars in hyscale-lab/lmcache•00 issues in hyscale-lab/lmcache•00 pull requests in hyscale-lab/lmcache•Updated Sep 14, 2026Sep 14, 2026

• vllm-multimodal

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •24k24k forks in hyscale-lab/vllm-multimodal•00 stars in hyscale-lab/vllm-multimodal•00 issues in hyscale-lab/vllm-multimodal•00 pull requests in hyscale-lab/vllm-multimodal•Updated Sep 14, 2026Sep 14, 2026

• kubedirect

  Public
  This repository includes the artifacts of our NSDI '26 paper "KUBEDIRECT: Unleashing the Full Power of the Cluster Manager for Serverless Computing".

  Go

  •

  MIT License

  •11 fork in hyscale-lab/kubedirect•00 stars in hyscale-lab/kubedirect•00 issues in hyscale-lab/kubedirect•00 pull requests in hyscale-lab/kubedirect•Updated Sep 3, 2026Sep 3, 2026

• rdma-demo

  Public
  Go

  •00 forks in hyscale-lab/rdma-demo•00 stars in hyscale-lab/rdma-demo•00 issues in hyscale-lab/rdma-demo•00 pull requests in hyscale-lab/rdma-demo•Updated Aug 27, 2026Aug 27, 2026

• vllm-thought-eviction

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •24k24k forks in hyscale-lab/vllm-thought-eviction•00 stars in hyscale-lab/vllm-thought-eviction•00 issues in hyscale-lab/vllm-thought-eviction•00 pull requests in hyscale-lab/vllm-thought-eviction•Updated Jul 17, 2026Jul 17, 2026

• flashinfer

  Public
  FlashInfer: Kernel Library for LLM Serving

  Python

  •

  Apache License 2.0

  •1.6k1.6k forks in hyscale-lab/flashinfer•00 stars in hyscale-lab/flashinfer•00 issues in hyscale-lab/flashinfer•00 pull requests in hyscale-lab/flashinfer•Updated Jun 24, 2026Jun 24, 2026

• hermes-agent_agent_bench

  Public
  The agent that grows with you

  Python

  •

  MIT License

  •55k55k forks in hyscale-lab/hermes-agent_agent_bench•00 stars in hyscale-lab/hermes-agent_agent_bench•00 issues in hyscale-lab/hermes-agent_agent_bench•00 pull requests in hyscale-lab/hermes-agent_agent_bench•Updated Jun 15, 2026Jun 15, 2026

• openclaw_agent_bench

  Public
  Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞

  TypeScript

  •

  Other

  •82k82k forks in hyscale-lab/openclaw_agent_bench•00 stars in hyscale-lab/openclaw_agent_bench•00 issues in hyscale-lab/openclaw_agent_bench•00 pull requests in hyscale-lab/openclaw_agent_bench•Updated Jun 14, 2026Jun 14, 2026

• OpenHands_agent_bench

  Public
  🙌 OpenHands: AI-Driven Development

  Python

  •

  Other

  •12k12k forks in hyscale-lab/OpenHands_agent_bench•00 stars in hyscale-lab/OpenHands_agent_bench•00 issues in hyscale-lab/OpenHands_agent_bench•00 pull requests in hyscale-lab/OpenHands_agent_bench•Updated Jun 14, 2026Jun 14, 2026

• sglang-diffusion

  Public
  SGLang is a high-performance serving framework for large language models and multimodal models.

  Python

  •

  Apache License 2.0

  •9.7k9.7k forks in hyscale-lab/sglang-diffusion•00 stars in hyscale-lab/sglang-diffusion•00 issues in hyscale-lab/sglang-diffusion•00 pull requests in hyscale-lab/sglang-diffusion•Updated May 15, 2026May 15, 2026

• LLM-Benchmarking

  Public
  Benchmarking different llm models from various cloud service providers

  Python

  •22 forks in hyscale-lab/LLM-Benchmarking•55 stars in hyscale-lab/LLM-Benchmarking•1212 issues in hyscale-lab/LLM-Benchmarking•77 pull requests in hyscale-lab/LLM-Benchmarking•Updated May 2, 2026May 2, 2026

• serving

  Public
  Kubernetes-based, scale-to-zero, request-driven compute

  Go

  •

  Apache License 2.0

  •1.2k1.2k forks in hyscale-lab/serving•00 stars in hyscale-lab/serving•00 issues in hyscale-lab/serving•00 pull requests in hyscale-lab/serving•Updated May 1, 2026May 1, 2026

• vllm-worker-controller

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •24k24k forks in hyscale-lab/vllm-worker-controller•00 stars in hyscale-lab/vllm-worker-controller•00 issues in hyscale-lab/vllm-worker-controller•00 pull requests in hyscale-lab/vllm-worker-controller•Updated Mar 22, 2026Mar 22, 2026

• aws-sdk-go-v2

  Public
  AWS SDK for the Go programming language.

  Go

  •

  Apache License 2.0

  •825825 forks in hyscale-lab/aws-sdk-go-v2•00 stars in hyscale-lab/aws-sdk-go-v2•00 issues in hyscale-lab/aws-sdk-go-v2•00 pull requests in hyscale-lab/aws-sdk-go-v2•Updated Mar 21, 2026Mar 21, 2026

• verl

  Public
  verl: Volcano Engine Reinforcement Learning for LLMs

  Python

  •

  Apache License 2.0

  •4.8k4.8k forks in hyscale-lab/verl•00 stars in hyscale-lab/verl•00 issues in hyscale-lab/verl•00 pull requests in hyscale-lab/verl•Updated Feb 26, 2026Feb 26, 2026

• vllm-kvcache

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •24k24k forks in hyscale-lab/vllm-kvcache•00 stars in hyscale-lab/vllm-kvcache•00 issues in hyscale-lab/vllm-kvcache•00 pull requests in hyscale-lab/vllm-kvcache•Updated Sep 19, 2025Sep 19, 2025

• slimsc

  Public
  Official repository for the EMNLP 2025 paper "Slim-SC: Thought Pruning for Efficient Scaling with Self-Consistency".

  Jupyter Notebook

  •

  MIT License

  •00 forks in hyscale-lab/slimsc•1414 stars in hyscale-lab/slimsc•00 issues in hyscale-lab/slimsc•00 pull requests in hyscale-lab/slimsc•Updated Sep 18, 2025Sep 18, 2025

• ntu-icl-hackathon

  Public
  Scripts and docs for self-hosting infrastructure for hackathon

  Shell

  •00 forks in hyscale-lab/ntu-icl-hackathon•00 stars in hyscale-lab/ntu-icl-hackathon•00 issues in hyscale-lab/ntu-icl-hackathon•00 pull requests in hyscale-lab/ntu-icl-hackathon•Updated Feb 14, 2025Feb 14, 2025