Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

topology-aware: exclude isolated CPUs from policy-picked reserved cpusets. #474

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

klihub
Copy link
Collaborator

@klihub klihub commented Mar 5, 2025

This PR updates the reserved cpuset setup code to

  • accept a reserved cpuset if it consists of only a single hand-picked isolated CPU
  • exclude isolated CPUs from policy-picked reserved cpusets

@klihub klihub requested review from askervin and fmuyassarov March 5, 2025 15:24
@klihub klihub changed the title topology-aware: avoid isolated CPUs in automatically picked reserved cpusets. topology-aware: exclude isolated CPUs from policy-picked picked reserved cpusets. Mar 5, 2025
@fmuyassarov fmuyassarov changed the title topology-aware: exclude isolated CPUs from policy-picked picked reserved cpusets. topology-aware: exclude isolated CPUs from policy-picked reserved cpusets. Mar 5, 2025
@klihub klihub force-pushed the fixes/avoid-isolated-reserved branch from 0edeb25 to caea3ee Compare March 5, 2025 15:58
Copy link
Collaborator

@fmuyassarov fmuyassarov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.
One small nit: would it make sense to include this logging commit caea3ee in a related commit (598ec9c) instead of a separate one? Just thinking about keeping the commit history clean, but I'm okay to keep as it is as well if there is a reason behind.

Just to clarify for myself, you are not allowing to have more than one isolated CPU for the reserved cpuset because isolated CPUs don't participate in load balancing right?

I wonder if we should do the similar check in Balloons as well...

@klihub
Copy link
Collaborator Author

klihub commented Mar 6, 2025

Looks good. One small nit: would it make sense to include this logging commit caea3ee in a related commit (598ec9c) instead of a separate one? Just thinking about keeping the commit history clean, but I'm okay to keep as it is as well if there is a reason behind.

The reason was mostly that even if I left one of those other commits out, I'd want to log the effective reserved CPU set on startup/reconfiguration, so based on that it did not seem to fit that clearly into either of those. But I can squash it, but I it think it fits better to the latter one, not the former.

Just to clarify for myself, you are not allowing to have more than one isolated CPU for the reserved cpuset because isolated CPUs don't participate in load balancing right?

I wonder if we should do the similar check in Balloons as well...

For policy-allocated reserved cpuset, I think we should have similar restrictions for isolated CPUs. They try to avoid setups which are problematic from a scheduler/load-balancing point of view.

klihub added 2 commits March 6, 2025 08:23
Accept a single hand-picked isolated CPU as the reserved cpuset,
but give a warning about it being isolated. Reject the reserved
cpuset if it mixes isolated with normal CPUs or if it contains
more than a single isolated CPU.

Signed-off-by: Krisztian Litkey <[email protected]>
Exclude isolated CPUs if we pick reserved CPUs by CPU (resource)
quantity. Log effective reserved cpuset.

Signed-off-by: Krisztian Litkey <[email protected]>
@klihub klihub force-pushed the fixes/avoid-isolated-reserved branch from caea3ee to 954d61c Compare March 6, 2025 06:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants