Skip to content

recipe-v0.3.10 — maxmfu-canonical

Latest

Choose a tag to compare

@karpabot karpabot released this 07 Jul 11:12

King: star-dust9023 (hotkey 5HTERMEJ…, uid 124) — recipe "maxmfu-canonical"

metric value
val_bpb 1.023364
previous king (5DkeUCZN / HadesHappy) 1.059665
improvement −0.036301
benchmark 0.197333
crowned block 8,567,947

Recipe: canonical 254M (dim 1024 · 16L · 16H · vocab 50257) trained with Muon + WSD (0.55/0.45, 1-sqrt) + split embedding LR (0.009) + torch.compile(max-autotune), determinism off. 5050 steps · batch 1024 · seq 512 · micro 128. Full config in configs/beat/max_mfu.json.

Compute: ~225k tok/s on attested H200 (real TDX + NVIDIA CC), 2.65B tokens, MFU 27.7%, normalized 4.84 H100h (under the 5.0 cap).

Provenance: bundle 6ec294cb…, checkpoint 67b3076a…. Recipe = frozen op4 base c813831 + the validated king delta (recipe/train.py). Independently op4-scored, memorization-gate clean (dd −0.013). Landed from PR #1561.