Skip to content

Prefilter long decimal scans before keyword searches - #1325

Merged
charliermarsh merged 1 commit into
mainfrom
charlie/codex-prefilter-oversized-decimal-scans-20261018
Oct 18, 2026
Merged

charliermarsh merged 1 commit into
mainfrom
charlie/codex-prefilter-oversized-decimal-scans-20261018

Conversation

@charliermarsh

Copy link
Copy Markdown
Member

We prefilter the decimal-limit prescan using aligned blocks of digits and underscores, before searching for soft keywords. Every qualifying digit run contains a complete block; candidates retain the existing precise scan and error ordering.

Matched project profiles use 1.13-1.29% fewer instructions for Mypy across the sampled Python 3.12-3.15 configurations, and 0.58% fewer for SymPy on Python 3.15 O2. The 177-case instruction geometric mean improves by 0.06%, with individual changes from -0.93% to +0.63%. All measured project outputs are byte-identical.

Mypy native CPU time decreases 1.09%, with peak RSS effectively flat; those samples retain two timing warnings. SymPy remains inconclusive across two studies: pooled CPU changes +0.42% and +0.30%, with opposite directions by order; peak RSS changes -0.92% and +0.16%. We make no SymPy native speed or memory claim.

Compatibility checks pass across Python 3.12 through 3.15 at all three optimization levels, with unchanged results.

@charliermarsh
charliermarsh merged commit 0ca506c into main Oct 18, 2026
14 checks passed
@charliermarsh
charliermarsh deleted the charlie/codex-prefilter-oversized-decimal-scans-20261018 branch October 18, 2026 02:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant