Skip to content

docs(leaderboard): disclose September 2026 evaluation dates - #261

Open
ye1457 wants to merge 2 commits into
RLinf:mainfrom
ye1457:docs/leaderboard-september-results-20261010
Open

ye1457 wants to merge 2 commits into
RLinf:mainfrom
ye1457:docs/leaderboard-september-results-20261010

Conversation

@ye1457

@ye1457 ye1457 commented Oct 10, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • Add one shared September 2026 evaluation notice to the bottom-left footer, above RPent Leaderboard, in the English/Chinese native Performance and Time & Token Costs pages. Remove the notice from the top.
  • Pin only leaderboard resources to the companion misc revision, including the updated English/Chinese light/dark overview images. Do not change the public theme, runtime, memory or evaluation protocols.
  • Preserve all 181 performance records and 11 cost rows, including their ordering and CSV format. The 35-case Astra retest belongs in a separate issue, not in the full-run leaderboard.

Companion assets: RLinf/misc#70

Retest report: #260 (not a replacement for full-run leaderboard metrics).

Leaderboard resource revision: 756ab5ee0667f658332a34a72910df5e6448dfea.

Validation

  • English and Chinese strict Sphinx builds passed (126 pages).
  • pre-commit run --all-files passed.
  • All 543 local data/CSV, exact footer positioning, desktop/mobile, light/dark, collapse/navigation, keyboard tooltip and no-JavaScript fallback checks passed.
  • 27 immutable CDN/Raw checks passed with byte-for-byte equality, including standalone assets and the sanitized OpenDrawer ZIP linked in the issue.
  • Focused tests/unit_tests/rpent: 600 passed, 2 skipped, excluding the optional PyTorch component contract. Local HTTP fixtures use NO_PROXY=127.0.0.1,localhost,::1 to avoid the host proxy. Full CPU collection is blocked by absent optional PyTorch dependencies in this isolated environment; this is not a complete CI matrix result. No robot experiments rerun.
  • 103 updated browser screenshots cover all score/cost views, six footer captures, desktop/mobile, themes, fallback and the bilingual retest issue draft.

Issue #260 is shortened to results, configuration and a one-sentence ZIP overview; removed token-accounting prose, audit/limitations, ZIP size/checksum and Follow-up. Matching configuration/code/memory are attributed to the experiment owner's confirmation, not presented as a new artifact verification.

The Chinese preview has been accepted. Removed the local approval banner and the issue's privacy-processing prose without changing the evidence archive. Marked Ready for review at the user's request; not merged.

@read-the-docs-community

read-the-docs-community Bot commented Oct 10, 2026 •

Copy link
Copy Markdown

Documentation build overview

📚 RPent | 🛠️ Build #35063789 | 📁 Comparing 2c27e03 against latest (ff91f14)

  🔍 Preview build  

2 files changed
± rst_source/leaderboard/performance.html
± rst_source/leaderboard/time-token-costs.html

@read-the-docs-community

read-the-docs-community Bot commented Oct 10, 2026 •

Copy link
Copy Markdown

Documentation build overview

📚 RPent-cn | 🛠️ Build #35063790 | 📁 Comparing 2c27e03 against latest (ff91f14)

  🔍 Preview build  

2 files changed
± rst_source/leaderboard/performance.html
± rst_source/leaderboard/time-token-costs.html

@ye1457
ye1457 marked this pull request as ready for review October 10, 2026 18:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant