Repository navigation
racer-dataplane: demand-sized buffer pools and memory-pressure response - #950
Closed
Jordan Olshevski (jveski) wants to merge 18 commits into
Closed
Jordan Olshevski (jveski) wants to merge 18 commits into
Jordan Olshevski (jveski) wants to merge 18 commits into
Conversation
…ed metrics response
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Racer-dataplane's idle buffer pools (the flow recycler and the slab staging pool) now size themselves from recent demand instead of always holding up to 8 buffers per worker: they grow when requests miss a full pool and decay back down after 10 idle seconds, and the recycler caps idle retention at half of each class quota. A new cgroup v2 monitor watches memory usage against memory.high/memory.max and PSI, and on Elevated pressure shrinks pools, releases retained buffers and idle connections, and trims the glibc heap; on Critical pressure it also evicts idle cached pages. It can be disabled with RACER_MEMORY_PRESSURE=false. The binary also pins glibc's mmap threshold to 1 MiB so large freed buffers return to the OS, the operator now requests 1Gi of memory for the dataplane container (no default limit), and new metrics cover RSS, cgroup memory, pressure level, pool sizes, and per-class admission usage. The reference docs are corrected where they described per-worker defaults as node-wide.