Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Non-default domain name causing cilium hubble enable Hubble Relay to fail #1513

Open
abcxcba opened this issue Jun 4, 2024 · 0 comments
Open

Comments

@abcxcba
Copy link

abcxcba commented Jun 4, 2024

------------------------------------------ Environment -----------------------------------------
kubernets Version: v1.30.1

kubeadm.conf:
networking:
dnsDomain: cluster.myk8s

install cilium:
cilium install --version 1.15.5

cilium status
/¯¯
/¯¯_/¯¯\ Cilium: OK
_
/¯¯_/ Operator: OK
/¯¯_
/¯¯\ Envoy DaemonSet: disabled (using embedded mode)
_/¯¯_/ Hubble Relay: disabled
__/ ClusterMesh: disabled

DaemonSet cilium Desired: 5, Ready: 5/5, Available: 5/5
Deployment cilium-operator Desired: 1, Ready: 1/1, Available: 1/1
Containers: cilium Running: 5
cilium-operator Running: 1
Cluster Pods: 2/2 managed by Cilium

cilium config view
...
hubble-disable-tls false
hubble-export-file-max-backups 5
hubble-export-file-max-size-mb 10
hubble-listen-address :4244
hubble-socket-path /var/run/cilium/hubble.sock
hubble-tls-cert-file /var/lib/cilium/tls/hubble/server.crt
hubble-tls-client-ca-files /var/lib/cilium/tls/hubble/client-ca.crt
hubble-tls-key-file /var/lib/cilium/tls/hubble/server.key
...

------------------------------------- Hubble ------------------------------
cilium hubble enable --relay --ui

kubectl get pod -A -o wide
kube-system hubble-relay-6446b75c8c-wh2vr 0/1 CrashLoopBackOff

log errors :
evel=info msg="Starting gRPC server..." options="{peerTarget:hubble-peer.kube-system.svc.cluster.local:443 dialTimeout:5000000000 ...

Direct cause of the error: ----> hubble-peer.kube-system.svc.cluster.local

==================Trying to solve problems=========================
cilium hubble disable
cilium config set hubble.peerService.clusterDomain "cluster.myk8s"
cilium config view | grep clusterDomain
hubble.peerService.clusterDomain cluster.myk8s

cilium hubble enable --relay --ui

The problem remains.

==================Solve problems=========================

cilium hubble disable

helm upgrade cilium cilium/cilium --version 1.15.5
--namespace kube-system
--reuse-values
--set hubble.peerService.clusterDomain="cluster.myk8s"
--set hubble.relay.enabled=true
--set hubble.ui.enabled=true

cilium hubble enable --relay --ui

kubectl get pod -A -o wide
kube-system hubble-relay-6446b75c8c-hcg2d 1/1 Running 0 32s

Hubble Relay pod is running successfully.

I don't know what the root cause of the problem is.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant