1 Pull request merged by 1 person

• [Fix] Fix gemma 3 conv template stop token

  #3191 merged Mar 27, 2025

2 Pull requests opened by 2 people

• [Serving] Support tool function calls under strict format constraints

  #3190 opened Mar 26, 2025

• [Model] Deepseek-v3 support

  #3192 opened Mar 29, 2025

1 Issue closed by 1 person

• [Bug] Failed to compile model on aarch64 platform with cuda12.8

  #3110 closed Apr 1, 2025

2 Issues opened by 2 people

• [Model Request] SmolDocling-256M-preview

  #3194 opened Apr 1, 2025

• [Question] no convert Qwen2.5-Omni-7B

  #3193 opened Apr 1, 2025

7 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [Bug] Mlc cli server gets stuck

  #3145 commented on Mar 27, 2025 • 0 new comments

• [Bug] Binary was created using {relax.Executable} but a loader of that name is not registered. Available loaders are relax.VMExecutable, const_loader, static_library, metal. Perhaps you need to recompile with this runtime enabled.

  #3186 commented on Mar 28, 2025 • 0 new comments

• [Bug] clang linker error upon running any model in Windows

  #3177 commented on Mar 30, 2025 • 0 new comments

• Error with LLVM Configuration on Windows for GPU Inference in mlc-llm

  #2969 commented on Mar 30, 2025 • 0 new comments

• [Bug] Running Quick Start Example in Windows gives Error: `'MLCEngine' object has no attribute '_ffi'`

  #2979 commented on Mar 30, 2025 • 0 new comments

• [Feature Request] run the LLM model on the Qualcomm Hexagon NPU in Android OS

  #1689 commented on Mar 31, 2025 • 0 new comments

• [Serving] Add Structural-Tag api to RequestResponseFormat

  #3187 commented on Mar 26, 2025 • 0 new comments