Skip to content
@inference-gateway

Inference Gateway

An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers

Pinned Loading

  1. inference-gateway inference-gateway Public

    An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

    Go 21 1

  2. rust-sdk rust-sdk Public

    An SDK written in Rust for the Inference Gateway

    Rust 2

  3. sdk sdk Public

    An SDK written in Go for the Inference Gateway

    Go

  4. typescript-sdk typescript-sdk Public

    An SDK written in Typescript for the Inference Gateway

    TypeScript

  5. docs docs Public

    Extensive documentation of the inference-gateway

    MDX

  6. ui ui Public

    The UI for the inference-gateway, providing a user-friendly interface to interact with and visualize inference results and manage models

    TypeScript 2

Repositories

Showing 9 of 9 repositories
  • operator Public

    This project provides a Kubernetes Operator for managing the lifecycle of the inference-gateway and its related components. It simplifies deployment, configuration, and scaling of the gateway within Kubernetes clusters, enabling seamless integration of machine learning inference workflows.

    inference-gateway/operator’s past year of commit activity
    Go 0 MIT 0 0 0 Updated May 2, 2025
  • inference-gateway Public

    An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

    inference-gateway/inference-gateway’s past year of commit activity
    Go 21 MIT 1 3 1 Updated May 1, 2025
  • sdk Public

    An SDK written in Go for the Inference Gateway

    inference-gateway/sdk’s past year of commit activity
    Go 0 MIT 0 1 0 Updated Apr 30, 2025
  • ui Public

    The UI for the inference-gateway, providing a user-friendly interface to interact with and visualize inference results and manage models

    inference-gateway/ui’s past year of commit activity
    TypeScript 2 MIT 0 7 0 Updated Apr 30, 2025
  • typescript-sdk Public

    An SDK written in Typescript for the Inference Gateway

    inference-gateway/typescript-sdk’s past year of commit activity
    TypeScript 0 MIT 0 0 0 Updated Apr 30, 2025
  • docs Public

    Extensive documentation of the inference-gateway

    inference-gateway/docs’s past year of commit activity
    MDX 0 MIT 0 0 0 Updated Apr 15, 2025
  • python-sdk Public

    An SDK written in Python for the Inference Gateway

    inference-gateway/python-sdk’s past year of commit activity
    Python 0 MIT 0 0 1 Updated Mar 25, 2025
  • rust-sdk Public

    An SDK written in Rust for the Inference Gateway

    inference-gateway/rust-sdk’s past year of commit activity
    Rust 2 MIT 0 0 0 Updated Mar 21, 2025
  • coder-playground Public

    A repository for coder playground, testing etc

    inference-gateway/coder-playground’s past year of commit activity
    Rust 0 0 1 0 Updated Feb 15, 2025

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…