All pull requests

Pull requests

• Fuse small-batch THD metadata setup

  area:frostarea:global_attentioncat-enhancementsorig-nv-eng
  #1831·YangXu1990uiuc opened Oct 24, 2026Collaborator·

  ·

  · Frontend 1.32.0
  1

• Add native SM107 D128 PackGQA

  area:frostarea:global_attentioncat-enhancementsorig-nv-eng
  #1830·YangXu1990uiuc opened Oct 24, 2026Collaborator·4 tasks done·

  ·

  · Frontend 1.32.0
  22

• frost(sdpa fwd): Rubin FP8 d128 packs first past one Q tile; lead d512 sliding window

  area:frostarea:global_attentioncat-enhancementsorig-nv-eng
  #1829·YangXu1990uiuc opened Oct 24, 2026Collaborator·4 tasks done·

  ·

  · Frontend 1.32.0
  19

• frost(sdpa fwd sm107): lead paged bf16 d128 GQA prefill chunks; two-wave split budget

  area:frostarea:global_attentioncat-enhancementsorig-nv-eng
  #1828·YangXu1990uiuc opened Oct 24, 2026Collaborator·4 tasks done·

  ·

  · Frontend 1.32.0
  5

• fix(sdpa bwd sm100 d128): pass skv through the grouped kernel's softmax loop call

  area:frostarea:global_attentioncat-bugfixorig-nv-eng
  #1827·YangXu1990uiuc opened Oct 24, 2026Collaborator·4 tasks done·

  ·

  · Frontend 1.32.0
  4

• QSA backward: one two-pass engine for SM100, SM103 and SM107

  area:sparse_attentioncat-enhancementsorig-nv-eng
  #1825·Adnios opened Oct 24, 2026Collaborator·4 tasks done·

  ·
  1

• perf(sdpa): coalesce D128 THD split partial output stores

  area:frostarea:global_attentioncat-enhancementsorig-nv-eng
  #1824·YangXu1990uiuc opened Oct 23, 2026Collaborator·

  ·

  · Frontend 1.32.0
  5

• feat(dsa): paged K for the SM100 indexer forward (block_table + kv_lens page pools)

  area:sparse_attentioncat-featureop: DSAorig-nv-eng
  #1823·Adnios opened Oct 23, 2026Collaborator·4 tasks done·

  ·

  · Frontend 1.32.0
  13

• sdpa fwd placement (sm100): FROST leads nonpaged d256 THD prefill at GQA8; packed paged D128 full prefill also on cc 10.3 and page 64

  area:frostarea:global_attentioncat-perf-bugmod-cutedslmod-frostorig-nv-eng
  #1822·yanzhuo607 opened Oct 23, 2026Collaborator·

  ·

  · Frontend 1.32.0
  10

• build: raise CuTe DSL minimum to 4.8.0

  area:packagingcat-routine-updatemod-cutedslorig-nv-eng
  #1820·YangXu1990uiuc opened Oct 23, 2026Collaborator·4 tasks done·

  ·
  3

• build: require CuTeDSL 4.7.1 and JAX 0.6.0

  area:packagingcat-routine-updatemod-cutedslorig-nv-eng
  #1819·mgoldfarb-nvidia opened Oct 23, 2026·3 of 4 tasks·

  ·

  · Frontend 1.32.0
  3

• Add JAX LayerNorm and RMSNorm with native gradients

  area:frostcat-featuremod-cutedslorig-nv-eng
  #1812·mgoldfarb-nvidia opened Oct 23, 2026·3 of 4 tasks·

  ·

  · Frontend 1.32.0
  7

• fix(kda): reduce rounding error in Kimi CP state updates

  area:linear_attentioncat-bugfixmod-cutedslmod-frostorig-external
  #1804·icavan opened Oct 23, 2026Contributor·3 of 4 tasks·

  ·

  · Frontend 1.32.0
  6

• Grouped GEMM wrappers: drop-in C++ execution

  cat-enhancementsmod-cutedslorig-nv-eng
  #1795·hwanseoc opened Oct 22, 2026Member·

  ·
  26

• QSA: expose packed causal-top-k backward through the indexed API

  area:sparse_attentioncat-featuremod-cutedslorig-nv-eng
  #1787·YangXu1990uiuc opened Oct 22, 2026Collaborator·4 tasks done·

  ·

  · Frontend 1.32.0
  11

• Gate unified SDPA compute type on cuDNN 9.29

  area:global_attentioncat-bugmod-frontendorig-nv-eng
  #1786·scottyokim opened Oct 22, 2026Contributor·3 of 4 tasks·

  ·

  · Frontend 1.32.0
  4

• test(sdpa): round the MXFP8 backward P exponent once and budget E4M3 flips

  area:global_attentioncat-bugfixmod-infraorig-external
  #1784·0z5a opened Oct 22, 2026Contributor·3 of 4 tasks·

  ·

  · Frontend 1.32.0
  12

• aot: prebuilt sm_120a attention (FROST prefill/split-KV + quantized-KV decode) behind a header-only C++ API, no runtime compilation

  area:frostarea:global_attentionarea:packagingcat-featureorig-nv-eng
  #1782·YangXu1990uiuc opened Oct 22, 2026Collaborator·4 tasks done·

  ·
  1

• ops: add JAX ops for NSA

  #1777·hwanseoc opened Oct 21, 2026Member·

  ·

• fix(pygraph): tensor_like declares the dtype of non-torch buffers

  cat-bugfixmod-frontendorig-external
  #1772·v0ropaev opened Oct 21, 2026·3 of 4 tasks·

  ·

  · Frontend 1.32.0
  14

• ops: add JAX ops for HSTU attention and HSTU LMSD

  #1769·hwanseoc opened Oct 21, 2026Member·

  ·

• perf(dsa): FP16-derived coarse key for wide BF16 rows in indexer_top_k

  cat-enhancementsmod-cutedslorig-nv-eng
  #1764·buptzyb opened Oct 21, 2026·2 of 4 tasks·

  ·

  · Frontend 1.32.0
  2

• feat(dsa): add clean_logits opt-out of the dense indexer -inf prefill

  #1761·buptzyb opened Oct 21, 2026·3 of 4 tasks·

  ·
  1

• feat(dsa): BF16 dense indexer scores (out_dtype) on SM100/SM103

  #1757·buptzyb opened Oct 21, 2026·2 of 4 tasks·

  ·
  1

• Preserve head-major GDP K/V gradients for channel views

  area:linear_attentioncat-featureorig-external
  #1748·bmac3 opened Oct 20, 2026·3 of 4 tasks·

  ·

  · Frontend 1.32.0
  1

  2