Skip to content

fix(docs): point the landing page at the real 8192 reference regime (Fixes #248)#249

Merged
zeokin merged 1 commit into
zeokin:mainfrom
luciferlive112116:fix/landing-page-reference-regime-8192
Jul 15, 2026
Merged

fix(docs): point the landing page at the real 8192 reference regime (Fixes #248)#249
zeokin merged 1 commit into
zeokin:mainfrom
luciferlive112116:fix/landing-page-reference-regime-8192

Conversation

@luciferlive112116

Copy link
Copy Markdown
Contributor

Fixes #248.

PR kind

  • fix
  • feat

Summary

index/index.html still advertised the pre-8192 reference regime. The engines
and every other surface say 8192, so the project's front door disagreed with the
code it describes:

surface says
strategy/cli.py / matmul/cli.py --n default 8192
README.md:33, BENCHMARKS.md:3 "Reference setup: 8192 × 8192"
README.md:37, BENCHMARKS.md:58 python -m eval --n 8192 --pairs 3
index/index.html (before) N = 12,000 — CCO's reference regime, tag N=12000, python -m eval --n 12000 --pairs 3

Three stale claims, all re-derived from the shipped default:

spot before after
KPI card 3.5 TFLOP (2·12000³ = 3.456e12) 1.1 TFLOP (2·8192³ = 1.0995e12)
KPI sub N = 12,000 — CCO's reference regime N = 8,192 — …
arena tag N=12000 N=8192
quickstart python -m eval --n 12000 --pairs 3 --n 8192

The KPI was right for the stale N, which is exactly why it had to move with it.
The neighbouring N=1,000 → 2 GFLOP and N=128,000 → 4.2 PFLOP cards are already
correct decimal-N (the #102/#230 convention) and are untouched.

Same class as the landing-page repair in #128.

Changes

  • index/index.html — the three stale claims above (+4/−4).
  • tests/test_landing_page_reference_regime.py (new) — CPU-only: re-derives the
    page's advertised N, quickstart command and KPI from strategy/matmul's --n
    default (asserting both engines agree), so the front page cannot silently drift
    from the shipped default again.

Validation

$ python -m pytest tests/test_landing_page_reference_regime.py -v
  4 passed

$ python -m pytest tests/ strategy/tests/ eval/tests/ -q     # CI-equivalent (no torch → GPU tests skip)
  315 passed, 24 skipped

No protected paths touched — index/ is outside the guard regex / CODEOWNERS set
(eval/, docs/, .github/, dashboard/).

Result

Documentation-consistency fix on the landing page; no code path changed, so no
accuracy / latency / VRAM delta.

metric value
accuracy unchanged (static page + consistency test only)
time complexity unchanged
latency N/A
VRAM usage N/A

index/index.html named N = 12,000 as CCO's reference regime and shipped a
copy-pasteable 'python -m eval --n 12000 --pairs 3' quickstart, but the engines
and every other surface moved to 8192: strategy/matmul --n default is 8192, and
README.md / BENCHMARKS.md both state 'Reference setup: 8192 x 8192'.

The KPI beside it (3.5 TFLOP) was right only for the stale N -- 2*12000**3 =
3.456e12 -- so at the real default it must read 2*8192**3 = 1.0995e12 -> 1.1
TFLOP. The neighbouring 1,000 -> 2 GFLOP and 128,000 -> 4.2 PFLOP cards already
use decimal N and stay as they are.

Re-derive the three stale claims from the shipped default and add a CPU test
that pins the page's advertised N, quickstart and KPI to strategy/matmul's --n
default so the front page cannot drift away from the engines again.
@github-actions github-actions Bot added area:tests Correctness gates and test suites (tests/) status:needs-review Awaiting maintainer review type:bug Something is incorrect or broken status:ready-non-gpu Fix/docs PR cleared non-GPU triage; maintainer review only labels Jul 15, 2026

@zeokin zeokin left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved. The landing page had stale 12000 reference-regime claims despite the shipped 8192 default. This corrects the associated FLOP display and pins the page to both CLI defaults with regression tests. Merged-state tests, strategy smoke, and the full CPU-safe suite pass; required GitHub checks are green.

@zeokin zeokin merged commit d46d394 into zeokin:main Jul 15, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:tests Correctness gates and test suites (tests/) status:needs-review Awaiting maintainer review status:ready-non-gpu Fix/docs PR cleared non-GPU triage; maintainer review only type:bug Something is incorrect or broken

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[docs] landing page still advertises the pre-8192 reference regime (N=12,000) and a --n 12000 quickstart

2 participants