Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How do I set MAXPOD in EKS ? #90

Open
HanHoRang31 opened this issue Mar 19, 2024 · 6 comments
Open

How do I set MAXPOD in EKS ? #90

HanHoRang31 opened this issue Mar 19, 2024 · 6 comments

Comments

@HanHoRang31
Copy link

How can I set maxpod on a node group in Terraform?
In the Terraform module, ㅑ can proceed through the options below, but I cannot find it in the module you used.
bootstrap_extra_args = "--container-runtime containerd --kubelet-extra-args '--max-pods=20'"
https://github.com/terraform-aws-modules/terraform-aws-eks/blob/master/docs/user_data.md

@ajayvohra2005
Copy link
Contributor

The solution uses two ways to automate the life-cycle of the K8s nodes. There is a system managed node group that manages all CPU only nodes via Cluster Autoscaler. And Karpenter manages the accelerator (GPU, or Neuron) resources . What is your objective in using max-pods option, i.e. what are you trying to accomplish? If you share that, I may be able to shed some more light.

@HanHoRang31
Copy link
Author

Thank you so much for your reply, but the options you mentioned are not what I want.
I want to set max_pod via bootstrap_extra_args option like in the example in the link below.
https://awslabs.github.io/data-on-eks/docs/bestpractices/networking#limit-the-number-of-ips-per-node-on-large-instance-types-with-max_eni-and-max-pods
But there is no such option in the Terraform module.

@ajayvohra2005
Copy link
Contributor

ajayvohra2005 commented Mar 21, 2024

Thanks for the elaboration. I understand the request. One could possibly specify max pods for the managed node groups, and the Karpenter managed nodes. Would it be sufficient if I provided variables for those two options, e.g. managed_ng_max_pods, and karpenter_max_pods? Thanks for your input.

@HanHoRang31
Copy link
Author

Yes, that's right, I would appreciate it if you could add it.

@ajayvohra2005
Copy link
Contributor

Hash commit a70db6b adds support for Karpenter kubelet maxPods.

Since the aws_eks_node_group.system_ng node group is only used for system pods, I have not made any changes to the system node group.

If you need a node group other than systems node group, in addition to what Karpenter provides, please share the use case. Karpenter is configured in this solution to provide all resources for data processing and training.

Note: aws_eks_node_group.this node group is only there for legacy reasons, and is not used, or recommended, because Karpenter replaces its functionality.

@ajayvohra2005
Copy link
Contributor

Can this issue be closed? Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants