Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kepler container_package does not equal total of kepler_process_package #1928

Open
sthaha opened this issue Feb 20, 2025 · 0 comments
Open

Comments

@sthaha
Copy link
Collaborator

sthaha commented Feb 20, 2025

Steps to reproduce on a Baremetal

  • deploy kepler
  • run a container that stresses the cpu
  • curl /metrics
  • grep for container_package_joules where container_id is not system_processes or kernel_processes
  • grep for kepler_process_package_joules related to that container id
  • find sum of rate the values of processes
  • see if the total is different to container_package

Expected: there shouldn't be any significant difference
Actual: The difference quite large and grows over time

Using Prometheus

sum by(job, container_id)(rate(kepler_container_package_joules_total{job=~"host|dev|latest", container_id!~"system_processes|kernel_processes"}[$rate])) 

Image

  • red is the containers' power
  • yellow is the processes power summed up.

This also means the pod's consumption reported is also wrong

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant