chore(deps): bump renderers (tokenizer config-build fallback for Laguna)#2657
Merged
Merged
Conversation
Bumps the deps/renderers submodule 2ec28a8 (v0.1.8.dev28) -> 89ab3f0 (v0.1.8.dev35), pulling in PrimeIntellect-ai/renderers#72: when AutoTokenizer.from_pretrained fails while building the model config (e.g. HF RoPE validation rejecting nested rope_parameters for poolside/Laguna-XS.2), fall back to loading the repo's self-contained tokenizer.json directly. Fixes the tokenizer load crash for the Laguna model series; loads under the fastokens fast path. Re-locks uv.lock: renderers now floors openai-harmony at >=0.0.4 (renderers#69). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
0699f3a to
2ecd1db
Compare
rasdani
approved these changes
May 27, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Bumps the
deps/rendererssubmodule from2ec28a8→89ab3f0, pulling in renderers#72.Why
Loading a tokenizer for the Laguna model series (
poolside/Laguna-XS.2) crashed renderers with:AutoTokenizer.from_pretrainedalways builds the model config first (to resolve the tokenizer class), even for a plain fast tokenizer. Building Laguna's config runs HF's RoPE validator, which rejects its nestedrope_parameters(full_attention/sliding_attention, no top-levelrope_theta) when constructed outside vLLM'spatch_rope_parameters. TheKeyErrorescaped and killed the tokenizer load — a modeling-layer concern breaking something the tokenizer never needed.What changed in renderers#72
When
AutoTokenizerfails building the config, fall back to loading the repo's self-containedtokenizer.jsondirectly viaPreTrainedTokenizerFast(no model config, no RoPE). Modeling-agnostic, runs under the fastokens patch (Laguna keeps the Rust speedup), excludes customauto_maptokenizers, and re-raises the original error otherwise.With this bump, Laguna runs no longer need
--no-renderersas a workaround.🤖 Generated with Claude Code
Note
Low Risk
Dependency and lockfile updates with a localized tokenizer-load fallback; no auth, data, or core training-path changes in this diff.
Overview
Updates
deps/renderers(renderers#72) so tokenizer loading no longer dies on Laguna-style models when Hugging Face config build hits RoPE validation (rope_theta/ nestedrope_parameters). Renderers now falls back totokenizer.jsonviaPreTrainedTokenizerFastwhenAutoTokenizerfails on config, so Laguna runs can use renderers without--no-renderers.The visible diff refreshes
uv.lock: advancesexclude-newer, and relaxes theverifiersdev metadata constraint onopenai-harmonyfrom>=0.0.8to>=0.0.4(likely from re-locking after the bump).Reviewed by Cursor Bugbot for commit 2ecd1db. Bugbot is set up for automated code reviews on this repo. Configure here.