All pull requests

Pull requests

• perf(attention): split the KV range across CTAs in nvfp4 tiled prefill

  #355·DuncanBetts opened Oct 1, 2026Contributor·

  ·

• ci(kvmem): add manual self-hosted GPU regression workflow

  #347·qzshch opened Sep 30, 2026·

  ·

• test(kvmem): add inference, replay and quality regression tooling

  #346·qzshch opened Sep 30, 2026·

  ·

• feat(qwen): add per-lane retrieval KV windows with media replay

  #345·qzshch opened Sep 30, 2026·

  ·

• feat(attention): support nonresident pages in causal KV tables

  #344·qzshch opened Sep 30, 2026·

  ·

• feat(ops): accumulate represented feature spans for retrieval

  #343·qzshch opened Sep 30, 2026·

  ·

• feat(serve): expose per-lane throughput and request identities in JSONL

  #342·qzshch opened Sep 30, 2026·

  ·

• fix(serve): set SO_REUSEADDR on the HTTP listener

  #340·DuncanBetts opened Sep 30, 2026Contributor·

  ·

• fix(runtime): report payload bytes for state-image transfers

  #338·qzshch opened Sep 30, 2026·

  ·
  1

• feat(tools): attach encoded DFlash2 components to compatible v3 artifacts

  #337·qzshch opened Sep 30, 2026·

  ·
  1

• feat(prefix-cache): replace the checkpoint catalog with a hybrid prefix cache

  #335·Wallawalla47 opened Sep 30, 2026·

  ·
  1

• feat(ops): add FP8 TMA pilot for the attn Prefill route

  #324·DuncanBetts opened Sep 26, 2026Contributor·

  ·
  1

• fix(models): recover tool calls after a quoted open marker

  #318·adubkov opened Sep 25, 2026Contributor·

  ·
  1

  1

• serve: safely recover Qwen tool calls and accept Copilot/OpenAI agent tool shapes

  #316·paq85 opened Sep 24, 2026·

  ·
  3

• perf(ops): pipeline Q4/Q5 Attention groups at T32

  #311·MOVIBALE opened Sep 23, 2026Contributor·

  ·

• refactor(ops): single-pass online log-sum-exp in target_logprobs

  #307·DuncanBetts opened Sep 23, 2026Contributor·

  ·
  1

• bench: add inference speed-of-light estimator

  #304·DuncanBetts opened Sep 23, 2026Contributor·

  ·
  2

• fix(frontend): keep the last value on a duplicate tool-call parameter

  #299·adubkov opened Sep 21, 2026Contributor·

  ·
  1

• fix(core): preserve workspace layout state after allocation overflow

  #297·DuncanBetts opened Sep 20, 2026Contributor·

  ·
  2

• feat(serve): accept reasoning.summary and include:reasoning.encrypted_content

  #295·Macasacker opened Sep 20, 2026·

  ·
  1

• feat: add XGrammar structured output with speculative decoding

  #294·magnetism87 opened Sep 19, 2026·

  ·
  1

• perf(ops): shared Q5 K-split MMA for small-batch linear and linear_add (+11% MTP3 decode)

  #292·giveen opened Sep 19, 2026·

  ·

• [5/5] feat(convert): build the published Qwen3.6-35B-A3B NVFP4 checkpoint into an artifact

  #290·MichaelDementii opened Sep 19, 2026Contributor·

  ·
  1

• [4/5] feat(engine): accept NVFP4 sparse-MoE expert banks

  #289·MichaelDementii opened Sep 19, 2026Contributor·

  ·
  1

• [3/5] feat(ops): add an NVFP4 expert profile to sparse_moe

  #288·MichaelDementii opened Sep 19, 2026Contributor·

  ·
  1