Skip to content

racer-dataplane: demand-sized buffer pools and memory-pressure response - #950

Closed
Jordan Olshevski (jveski) wants to merge 18 commits into
mainfrom
racer-adaptive-pools
Closed

Jordan Olshevski (jveski) wants to merge 18 commits into
mainfrom
racer-adaptive-pools

Conversation

@jveski

Copy link
Copy Markdown
Contributor

Racer-dataplane's idle buffer pools (the flow recycler and the slab staging pool) now size themselves from recent demand instead of always holding up to 8 buffers per worker: they grow when requests miss a full pool and decay back down after 10 idle seconds, and the recycler caps idle retention at half of each class quota. A new cgroup v2 monitor watches memory usage against memory.high/memory.max and PSI, and on Elevated pressure shrinks pools, releases retained buffers and idle connections, and trims the glibc heap; on Critical pressure it also evicts idle cached pages. It can be disabled with RACER_MEMORY_PRESSURE=false. The binary also pins glibc's mmap threshold to 1 MiB so large freed buffers return to the OS, the operator now requests 1Gi of memory for the dataplane container (no default limit), and new metrics cover RSS, cgroup memory, pressure level, pool sizes, and per-class admission usage. The reference docs are corrected where they described per-worker defaults as node-wide.

@jveski
Jordan Olshevski (jveski) deleted the racer-adaptive-pools branch October 20, 2026 17:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant