Skip to content

@CentML CentML

All

    Repositories list

    47 repositories

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •23k•0•0•86•Updated Oct 11, 2026Oct 11, 2026

    • flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      Cuda
      •
      Apache License 2.0
      •1.6k•0•0•0•Updated Oct 7, 2026Oct 7, 2026

    • dynamo

      Public
      A Datacenter Scale Distributed Inference Serving Framework
      Rust
      •
      Other
      •1.7k•0•0•3•Updated Oct 7, 2026Oct 7, 2026

    • platform_api_python_client

      Public
      Python
      •0•0•0•2•Updated Oct 5, 2026Oct 5, 2026

    • centml_platform_docs

      Public
      JavaScript
      •0•0•0•10•Updated Sep 24, 2026Sep 24, 2026

    • centml-python-client

      Public
      Python
      •
      Apache License 2.0
      •2•1•2•0•Updated Sep 24, 2026Sep 24, 2026

    • spiffe-jwt

      Public
      Go
      •
      Apache License 2.0
      •1•0•0•1•Updated Sep 23, 2026Sep 23, 2026

    • ecr-anywhere

      Public
      Pull from private ECR repos... anywhere
      Go
      •
      Apache License 2.0
      •1•1•0•0•Updated Sep 23, 2026Sep 23, 2026

    • simple-sidecar

      Public
      A simple configurable kubernetes sidecar injector.
      Go
      •
      Apache License 2.0
      •1•1•0•0•Updated Sep 23, 2026Sep 23, 2026

    • MSA

      Public
      Python
      •
      MIT License
      •65•0•0•0•Updated Sep 11, 2026Sep 11, 2026

    • HAMi

      Public
      Heterogeneous GPU Sharing on Kubernetes
      Go
      •
      Apache License 2.0
      •855•0•0•3•Updated Sep 2, 2026Sep 2, 2026

    • mlperf-endpoints

      Public
      MLCommons Inference Endpoints repository
      Python
      •
      Apache License 2.0
      •29•0•0•7•Updated Aug 4, 2026Aug 4, 2026

    • flexible-inference-bench

      Public archive
      A modular, extensible LLM inference benchmarking framework that supports multiple benchmarking frameworks and paradigms.
      Python
      •
      Apache License 2.0
      •2•12•9•1•Updated Aug 4, 2026Aug 4, 2026

    • lorafusion

      Public
      LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
      Python
      •3•30•1•1•Updated Jul 2, 2026Jul 2, 2026

    • mlperf-inference

      Public
      Reference implementations of MLPerf™ inference benchmarks
      Python
      •
      Apache License 2.0
      •653•0•0•16•Updated Jun 11, 2026Jun 11, 2026

    • Mist

      Public
      [EuroSys'25] Mist: Efficient Distributed Training of Large Language Models via Memory-Parallelism Co-Optimization
      Python
      •
      Apache License 2.0
      •6•24•0•3•Updated Apr 13, 2026Apr 13, 2026

    • cloudflare-operator

      Public
      A Kubernetes Operator to create and manage Cloudflare Tunnels and DNS records for (HTTP/TCP/UDP*) Service Resources
      Go
      •
      Apache License 2.0
      •69•0•0•2•Updated Apr 8, 2026Apr 8, 2026

    • codex

      Public archive
      A comprehensive collection of integration examples for CentML. This repository serves as a resource hub for developers looking to seamlessly incorporate CentML'…
      Python
      •
      Apache License 2.0
      •1•5•0•10•Updated Feb 11, 2026Feb 11, 2026

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •3.1k•0•0•0•Updated Jan 22, 2026Jan 22, 2026

    • pydantic-typer

      Public
      Typer extension to enable pydantic support
      Python
      •
      MIT License
      •3•0•0•0•Updated Dec 18, 2025Dec 18, 2025

    • openai-python

      Public archive
      The official Python library for the OpenAI API
      Python
      •
      Apache License 2.0
      •7.8k•0•0•0•Updated Dec 9, 2025Dec 9, 2025

    • adk-python

      Public archive
      An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
      Python
      •
      Apache License 2.0
      •4.1k•0•0•0•Updated Jun 5, 2025Jun 5, 2025

    • aisuite

      Public
      Simple, unified interface to multiple Generative AI providers
      Python
      •
      MIT License
      •1.7k•0•0•8•Updated Apr 29, 2025Apr 29, 2025

    • Sylva

      Public
      Boost fine-tuning performance with sparse embedded adapters and hierarchical approximate second-order information.
      Python
      •
      Apache License 2.0
      •0•2•0•2•Updated Apr 29, 2025Apr 29, 2025

    • paper-of-the

      Public
      An Agent that reviews the papers published on a given day and picks the one most aligned with our mission.
      TypeScript
      •
      Apache License 2.0
      •1•0•0•0•Updated Mar 14, 2025Mar 14, 2025

    • ai-benchmarks

      Public archive
      Benchmarking suite for popular AI APIs
      Python
      •
      MIT License
      •15•0•0•3•Updated Feb 12, 2025Feb 12, 2025

    • DeepView.Profile

      Public archive
      🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
      machine-learningdeep-neural-networksdeep-learning
      machine-learningdeep-neural-networksdeep-learningneural-network
      Python
      •
      Apache License 2.0
      •11•65•0•0•Updated Jan 21, 2025Jan 21, 2025

    • llama-stack

      Public archive
      Composable building blocks to build Llama Apps
      Python
      •
      MIT License
      •1.4k•0•0•0•Updated Jan 2, 2025Jan 2, 2025

    • DeepView.Predict

      Public archive
      🔮 Execution time predictions for deep neural network training iterations across different GPUs.
      Python
      •
      Apache License 2.0
      •3•14•3•0•Updated Dec 16, 2024Dec 16, 2024

    • DeepView.Explore

      Public archive
      🛠 VSCode plugin that provides visual interface for CentML Tools
      TypeScript
      •2•15•2•0•Updated Dec 5, 2024Dec 5, 2024
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.