download crictl at preload and runtime #18362

ComradeProgrammer · 2024-03-12T00:48:00Z

Before:

minikube use the crictl installed in the kic image

After:

sudo crictl --version is executed on the host to check whether the version of crictl corresponds to k8s version
when starting the minikubeif preload is false, and the crictl version is not correct, we download the crictl and replace the original crictl in the host. When k8s verison is v1.a.b, then crictl v1.a.0 will be downloaded. When generating the preload, we shall detect the latest matching version of crictl and download it.
if crictl has been downloaded before and found in the cache in ~/.minikube then the cached binary will be used
crictl is also downloaded and transfered in the preload, in the same way as kubectl and kubelet
e.g. under such circumstance, after starting minikube cluster, use minikube ssh and we can see that


docker@minikube:$ sudo crictl --version
crictl version v1.28.0
docker@minikube:$ sudo crictl  ps
CONTAINER           IMAGE                                                                                                CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
8eae2728f85d3       97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108                                     46 minutes ago      Running             coredns                   0                   0a580df21c36b       coredns-5dd5756b68-bc2dw
dbe2b7b442f48       66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51                                     46 minutes ago      Running             storage-provisioner       0                   5e63873caa6c9       storage-provisioner
53383548192c3       docker.io/kindest/kindnetd@sha256:61f9956af8019caf6dcc4d39b31857b868aaab80521432ddcc216b805c4f7988   46 minutes ago      Running             kindnet-cni               0                   7e29f779adce9       kindnet-fg6j2
905443e23b753       3ca3ca488cf13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39                                     47 minutes ago      Running             kube-proxy                0                   b521393332a9e       kube-proxy-c5wxp
1825671293c0f       9961cbceaf234d59b7dcf8a197a024f3e3ce4b7fe2b67c2378efd3d209ca994b                                     47 minutes ago      Running             kube-controller-manager   0                   aa296e1d2ffe9       kube-controller-manager-minikube
8489b99abcd33       04b4c447bb9d4840af3bf7e836397379d65df87c86e55dcd27f31a8d11df2419                                     47 minutes ago      Running             kube-apiserver            0                   d90bf0f26db9f       kube-apiserver-minikube
50b93cafff067       05c284c929889d88306fdb3dd14ee2d0132543740f9e247685243214fc3d2c54                                     47 minutes ago      Running             kube-scheduler            0                   852b3009621c4       kube-scheduler-minikube
dbc57b61ae284       9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace                                     47 minutes ago      Running             etcd                      0                   75c186d1ea62b       etcd-minikube

@spowelljr @medyagh

minikube-bot · 2024-03-12T00:48:02Z

Can one of the admins verify this patch?

k8s-ci-robot · 2024-03-12T00:48:09Z

Hi @ComradeProgrammer. Thanks for your PR.

I'm waiting for a kubernetes member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

hack/preload-images/generate.go

pkg/minikube/bootstrapper/bsutil/binaries.go

pkg/minikube/download/binary.go

pkg/minikube/bootstrapper/kubeadm/kubeadm.go

pkg/minikube/bootstrapper/bsutil/binaries.go

hack/preload-images/generate.go

pkg/minikube/bootstrapper/kubeadm/kubeadm.go

pkg/minikube/download/binary.go

ComradeProgrammer · 2024-03-18T13:13:15Z

revised. now we use ssh to run crictl --version to check the crictl version, and we also use checkcache

pkg/minikube/cruntime/cri.go

pkg/minikube/download/binary.go

pkg/minikube/bootstrapper/bsutil/binaries.go

pkg/minikube/bootstrapper/kubeadm/kubeadm.go

pkg/minikube/download/binary.go

pkg/minikube/bootstrapper/bsutil/binaries.go

pkg/minikube/cruntime/cri.go

k8s-ci-robot · 2024-07-04T15:16:53Z

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: ComradeProgrammer
Once this PR has been reviewed and has the lgtm label, please assign medyagh for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

hack/update/github.go

Co-authored-by: Steven Powell <[email protected]>

hack/preload-images/generate.go

pkg/minikube/download/binary.go

pkg/minikube/bootstrapper/bsutil/binaries.go

Co-authored-by: Steven Powell <[email protected]>

medyagh

@ComradeProgrammer

it is much better if we convert this PR into two PRS
1- adding the critcle to the preload genreation
2- Folow up PR that will use that, so we can test it and see if it is making anything slower

medyagh · 2024-09-18T18:47:11Z

pkg/minikube/download/binary.go

@@ -86,3 +87,32 @@ func Binary(binary, version, osName, archName, binaryURL string) (string, error)
 	}
 	return targetFilepath, nil
 }
+
+// CrictlBinary download the crictl tar archive to the cache folder and untar it


is this for only when --preload is false? if yes please add it to the comment

medyagh · 2024-09-18T18:52:26Z

pkg/minikube/bootstrapper/kubeadm/kubeadm.go

+	sm := sysinit.New(k.c)
+
+	if err := bsutil.TransferBinaries(cfg.KubernetesConfig, k.c, sm, cfg.BinaryMirror); err != nil {
+		return errors.Wrap(err, "downloading binaries")


shouldnt this be tranferring crictlc? make it more specific, so when the error bubles up we find it easier

medyagh · 2024-09-18T18:53:46Z

pkg/minikube/bootstrapper/kubeadm/kubeadm.go

@@ -945,6 +946,27 @@ func (k *Bootstrapper) UpdateNode(cfg config.ClusterConfig, n config.Node, r cru

 	klog.Infof("kubelet %s config:\n%+v", kubeletCfg, cfg.KubernetesConfig)

+	sm := sysinit.New(k.c)
+
+	if err := bsutil.TransferBinaries(cfg.KubernetesConfig, k.c, sm, cfg.BinaryMirror); err != nil {


why this is added ? I thought this was downloading critctl, why this was needed to be added here?

k8s-triage-robot · 2024-12-17T19:13:53Z

The Kubernetes project currently lacks enough contributors to adequately respond to all PRs.

This bot triages PRs according to the following rules:

After 90d of inactivity, lifecycle/stale is applied
After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
After 30d of inactivity since lifecycle/rotten was applied, the PR is closed

You can:

Mark this PR as fresh with /remove-lifecycle stale
Close this PR with /close
Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot · 2025-01-16T19:48:12Z

The Kubernetes project currently lacks enough active contributors to adequately respond to all PRs.

This bot triages PRs according to the following rules:

After 90d of inactivity, lifecycle/stale is applied
After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
After 30d of inactivity since lifecycle/rotten was applied, the PR is closed

You can:

Mark this PR as fresh with /remove-lifecycle rotten
Close this PR with /close
Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Mar 12, 2024

k8s-ci-robot added needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Mar 12, 2024

k8s-ci-robot requested review from medyagh and prezha March 12, 2024 00:48

liangyuanpeng reviewed Mar 12, 2024

View reviewed changes

hack/preload-images/generate.go Outdated Show resolved Hide resolved

spowelljr requested changes Mar 12, 2024

View reviewed changes

ComradeProgrammer force-pushed the crictl branch 3 times, most recently from c654883 to 46cd29d Compare March 13, 2024 20:00

k8s-ci-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Mar 13, 2024

ComradeProgrammer force-pushed the crictl branch from 46cd29d to 69da930 Compare March 13, 2024 20:02

k8s-ci-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Mar 13, 2024

ComradeProgrammer force-pushed the crictl branch from 69da930 to ef27662 Compare March 13, 2024 20:03

k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Mar 13, 2024

ComradeProgrammer force-pushed the crictl branch from ef27662 to 10bfc7a Compare March 13, 2024 20:31

spowelljr requested changes Mar 15, 2024

View reviewed changes

pkg/minikube/bootstrapper/kubeadm/kubeadm.go Outdated Show resolved Hide resolved

pkg/minikube/bootstrapper/bsutil/binaries.go Outdated Show resolved Hide resolved

spowelljr reviewed Mar 15, 2024

View reviewed changes

hack/preload-images/generate.go Show resolved Hide resolved

spowelljr reviewed Mar 15, 2024

View reviewed changes

pkg/minikube/bootstrapper/kubeadm/kubeadm.go Outdated Show resolved Hide resolved

spowelljr reviewed Mar 15, 2024

View reviewed changes

pkg/minikube/download/binary.go Show resolved Hide resolved

ComradeProgrammer force-pushed the crictl branch from 10bfc7a to 0efd831 Compare March 18, 2024 13:06

spowelljr requested changes Mar 18, 2024

View reviewed changes

pkg/minikube/cruntime/cri.go Outdated Show resolved Hide resolved

spowelljr reviewed Mar 18, 2024

View reviewed changes

pkg/minikube/download/binary.go Outdated Show resolved Hide resolved

spowelljr reviewed Mar 18, 2024

View reviewed changes

pkg/minikube/bootstrapper/bsutil/binaries.go Outdated Show resolved Hide resolved

k8s-ci-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Apr 20, 2024

spowelljr requested changes Jul 4, 2024

View reviewed changes

k8s-ci-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jul 17, 2024

spowelljr reviewed Jul 18, 2024

View reviewed changes

hack/update/github.go Outdated Show resolved Hide resolved

ComradeProgrammer force-pushed the crictl branch from 6ec8370 to e53ddb1 Compare August 26, 2024 18:25

ComradeProgrammer and others added 11 commits August 26, 2024 20:31

feat: download crictl at preload and runtime

c9d5681

Co-authored-by: Steven Powell <[email protected]>

Update hack/preload-images/generate.go

674be08

Co-authored-by: Steven Powell <[email protected]>

Update pkg/minikube/bootstrapper/kubeadm/kubeadm.go

dddb10f

Co-authored-by: Steven Powell <[email protected]>

Update pkg/minikube/download/binary.go

d2f88fb

Co-authored-by: Steven Powell <[email protected]>

Update pkg/minikube/bootstrapper/bsutil/binaries.go

7495730

Co-authored-by: Steven Powell <[email protected]>

Update pkg/minikube/cruntime/cri.go

9127dc4

Co-authored-by: Steven Powell <[email protected]>

feat: auto detect crictl's newest patch number for preload

78c5f85

Update pkg/minikube/bootstrapper/kubeadm/kubeadm.go

1c1b094

Co-authored-by: Steven Powell <[email protected]>

Update pkg/minikube/download/binary.go

424e95f

Co-authored-by: Steven Powell <[email protected]>

Update pkg/minikube/bootstrapper/bsutil/binaries.go

e950164

Co-authored-by: Steven Powell <[email protected]>

Update pkg/minikube/cruntime/cri.go

fa93c5a

Co-authored-by: Steven Powell <[email protected]>

ComradeProgrammer force-pushed the crictl branch from e53ddb1 to 4305e2f Compare August 26, 2024 18:31

spowelljr requested changes Aug 26, 2024

View reviewed changes

hack/preload-images/generate.go Outdated Show resolved Hide resolved

hack/preload-images/generate.go Show resolved Hide resolved

pkg/minikube/download/binary.go Show resolved Hide resolved

pkg/minikube/bootstrapper/bsutil/binaries.go Show resolved Hide resolved

k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Aug 27, 2024

Update hack/update/github.go

fa495bf

Co-authored-by: Steven Powell <[email protected]>

ComradeProgrammer force-pushed the crictl branch from 54c3c0b to fa495bf Compare August 30, 2024 21:09

medyagh changed the title ~~feat: download crictl at preload and runtime~~ download crictl at preload and runtime Sep 18, 2024

medyagh requested changes Sep 18, 2024

View reviewed changes

k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Dec 17, 2024

k8s-ci-robot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Jan 16, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

download crictl at preload and runtime #18362

download crictl at preload and runtime #18362

ComradeProgrammer commented Mar 12, 2024 •

edited

Loading

minikube-bot commented Mar 12, 2024

k8s-ci-robot commented Mar 12, 2024

ComradeProgrammer commented Mar 18, 2024

k8s-ci-robot commented Jul 4, 2024

medyagh left a comment

medyagh Sep 18, 2024

medyagh Sep 18, 2024

medyagh Sep 18, 2024

k8s-triage-robot commented Dec 17, 2024

k8s-triage-robot commented Jan 16, 2025

download crictl at preload and runtime #18362

Are you sure you want to change the base?

download crictl at preload and runtime #18362

Conversation

ComradeProgrammer commented Mar 12, 2024 • edited Loading

minikube-bot commented Mar 12, 2024

k8s-ci-robot commented Mar 12, 2024

ComradeProgrammer commented Mar 18, 2024

k8s-ci-robot commented Jul 4, 2024

medyagh left a comment

Choose a reason for hiding this comment

medyagh Sep 18, 2024

Choose a reason for hiding this comment

medyagh Sep 18, 2024

Choose a reason for hiding this comment

medyagh Sep 18, 2024

Choose a reason for hiding this comment

k8s-triage-robot commented Dec 17, 2024

k8s-triage-robot commented Jan 16, 2025

ComradeProgrammer commented Mar 12, 2024 •

edited

Loading