Skip to content

parallel e2e testing with different kubeconfigs #701

parallel e2e testing with different kubeconfigs

parallel e2e testing with different kubeconfigs #701

This check has been archived and is scheduled for deletion. Learn more about checks retention
GitHub Actions / E2E test report failed Jul 25, 2023 in 0s

2 fail, 26 skipped, 10 pass in 4m 44s

  1 files  +  1    1 suites  +1   4m 44s ⏱️ + 4m 44s
38 tests +38  10 ✔️ +10  26 💤 +26  2 +2 
96 runs  +96  15 ✔️ +15  79 💤 +79  2 +2 

Results for commit 5f1da38. ± Comparison against earlier commit 637e2ca.

Annotations

Check warning on line 0 in ---------------------------------------------------------------------------------------------------- Configurations: ReportDir: reports CreateTestReportFile: true MaxTimeout: 2h AllowedOverrunDuration: 5m TestStrategy: complete LabelFilter: KubeConfigDirectoryPath: platforms/kind/kubeconfigs ---------------------------------------------------------------------------------------------------- PoolInfo: NumberOfTests: 2 NumberOfK8sClusters: 2 NumberOfK8sVersions: NumberOfK8sProviders: TestK8sMapping: [ALL_TESTCASE(kind-kind2) ALL_TESTCASE(kind-kind1)] TestStrategy: complete ExpectedDurationSerial: 3600.000000 ExpectedDurationParallel: 1800.000000 ----------------------------------------------------------------------------------------------------

See this annotation in the file changed.

@github-actions github-actions / E2E test report

1 out of 2 runs failed: [It] ALL_TESTCASE(kind-kind1) when Installing Koperator and dependencies when Installing cert-manager…ionParallel: 1800.000000 ---------------------------------------------------------------------------------------------------- )

tests/e2e/reports/e2e_complete_2023-07-25T10:09:15Z.xml [took 3s]
Raw output
	Error Trace:	/home/runner/go/pkg/mod/github.com/gruntwork-io/[email protected]/modules/helm/install.go:16
	            				/home/runner/work/koperator/koperator/tests/e2e/helm.go:178
	            				/home/runner/work/koperator/koperator/tests/e2e/test_install.go:37
	            				/home/runner/go/pkg/mod/github.com/onsi/ginkgo/[email protected]/internal/node.go:463
	            				/home/runner/go/pkg/mod/github.com/onsi/ginkgo/[email protected]/internal/suite.go:865
	            				/opt/hostedtoolcache/go/1.19.11/x64/src/runtime/asm_amd64.s:1594
	Error:      	Received unexpected error:
	            	error while running command: exit status 1; Error: INSTALLATION FAILED: release: already exists
	Test:       	  ALL_TESTCASE(kind-kind1) when Installing Koperator and dependencies when Installing cert-manager Installing cert-manager Helm chart
[FAILED] 
	Error Trace:	/home/runner/go/pkg/mod/github.com/gruntwork-io/[email protected]/modules/helm/install.go:16
	            				/home/runner/work/koperator/koperator/tests/e2e/helm.go:178
	            				/home/runner/work/koperator/koperator/tests/e2e/test_install.go:37
	            				/home/runner/go/pkg/mod/github.com/onsi/ginkgo/[email protected]/internal/node.go:463
	            				/home/runner/go/pkg/mod/github.com/onsi/ginkgo/[email protected]/internal/suite.go:865
	            				/opt/hostedtoolcache/go/1.19.11/x64/src/runtime/asm_amd64.s:1594
	Error:      	Received unexpected error:
	            	error while running command: exit status 1; Error: INSTALLATION FAILED: release: already exists
	Test:       	  ALL_TESTCASE(kind-kind1) when Installing Koperator and dependencies when Installing cert-manager Installing cert-manager Helm chart
In [It] at: /home/runner/go/pkg/mod/github.com/gruntwork-io/[email protected]/modules/helm/install.go:16 @ 07/25/23 10:04:37.403
  ALL_TESTCASE(kind-kind1) when Installing Koperator and dependencies when Installing cert-manager Installing cert-manager Helm chart 2023-07-25T10:04:33Z logger.go:66: Running command helm with args [list --kube-context kind-kind1 --kubeconfig platforms/kind/kubeconfigs/kind1.conf --namespace cert-manager --output json]
  ALL_TESTCASE(kind-kind1) when Installing Koperator and dependencies when Installing cert-manager Installing cert-manager Helm chart 2023-07-25T10:04:34Z logger.go:66: []
  ALL_TESTCASE(kind-kind1) when Installing Koperator and dependencies when Installing cert-manager Installing cert-manager Helm chart 2023-07-25T10:04:34Z logger.go:66: Running command helm with args [install --kube-context kind-kind1 --kubeconfig platforms/kind/kubeconfigs/kind1.conf --namespace cert-manager --repo https://charts.jetstack.io --create-namespace --atomic --version v1.11.0 --set installCRDs=true cert-manager cert-manager]
  ALL_TESTCASE(kind-kind1) when Installing Koperator and dependencies when Installing cert-manager Installing cert-manager Helm chart 2023-07-25T10:04:37Z logger.go:66: Error: INSTALLATION FAILED: release: already exists
> Enter [It] Installing cert-manager Helm chart - /home/runner/work/koperator/koperator/tests/e2e/test_install.go:36 @ 07/25/23 10:04:33.789
STEP: Checking for existing Helm release named cert-manager - /home/runner/work/koperator/koperator/tests/e2e/helm.go:119 @ 07/25/23 10:04:33.789
STEP: Listing Helm releases - /home/runner/work/koperator/koperator/tests/e2e/helm.go:307 @ 07/25/23 10:04:33.789
STEP: Installing Helm chart cert-manager from https://charts.jetstack.io with version v1.11.0 by name cert-manager - /home/runner/work/koperator/koperator/tests/e2e/helm.go:154 @ 07/25/23 10:04:34.19
[FAILED] 
	Error Trace:	/home/runner/go/pkg/mod/github.com/gruntwork-io/[email protected]/modules/helm/install.go:16
	            				/home/runner/work/koperator/koperator/tests/e2e/helm.go:178
	            				/home/runner/work/koperator/koperator/tests/e2e/test_install.go:37
	            				/home/runner/go/pkg/mod/github.com/onsi/ginkgo/[email protected]/internal/node.go:463
	            				/home/runner/go/pkg/mod/github.com/onsi/ginkgo/[email protected]/internal/suite.go:865
	            				/opt/hostedtoolcache/go/1.19.11/x64/src/runtime/asm_amd64.s:1594
	Error:      	Received unexpected error:
	            	error while running command: exit status 1; Error: INSTALLATION FAILED: release: already exists
	Test:       	  ALL_TESTCASE(kind-kind1) when Installing Koperator and dependencies when Installing cert-manager Installing cert-manager Helm chart
In [It] at: /home/runner/go/pkg/mod/github.com/gruntwork-io/[email protected]/modules/helm/install.go:16 @ 07/25/23 10:04:37.403
< Exit [It] Installing cert-manager Helm chart - /home/runner/work/koperator/koperator/tests/e2e/test_install.go:36 @ 07/25/23 10:04:37.403 (3.614s)

Check warning on line 0 in ---------------------------------------------------------------------------------------------------- Configurations: ReportDir: reports CreateTestReportFile: true MaxTimeout: 2h AllowedOverrunDuration: 5m TestStrategy: complete LabelFilter: KubeConfigDirectoryPath: platforms/kind/kubeconfigs ---------------------------------------------------------------------------------------------------- PoolInfo: NumberOfTests: 2 NumberOfK8sClusters: 2 NumberOfK8sVersions: NumberOfK8sProviders: TestK8sMapping: [ALL_TESTCASE(kind-kind2) ALL_TESTCASE(kind-kind1)] TestStrategy: complete ExpectedDurationSerial: 3600.000000 ExpectedDurationParallel: 1800.000000 ----------------------------------------------------------------------------------------------------

See this annotation in the file changed.

@github-actions github-actions / E2E test report

1 out of 4 runs failed: [It] ALL_TESTCASE(kind-kind1) when Externally produce and consume message to/from Kafka cluster Produ…ionParallel: 1800.000000 ---------------------------------------------------------------------------------------------------- )

tests/e2e/reports/e2e_complete_2023-07-25T10:09:15Z.xml [took 0s]
Raw output
BeEmpty matcher expects a string/array/map/channel/slice.  Got:
    <func(k8s.KubectlOptions, string) ([]string, error)>: 0x1913b40
[FAILED] BeEmpty matcher expects a string/array/map/channel/slice.  Got:
    <func(k8s.KubectlOptions, string) ([]string, error)>: 0x1913b40
In [It] at: /home/runner/work/koperator/koperator/tests/e2e/produce_consume.go:160 @ 07/25/23 10:09:15.686
  ALL_TESTCASE(kind-kind1) when Externally produce and consume message to/from Kafka cluster Producing and consuming messages 2023-07-25T10:09:15Z logger.go:66: Running command kubectl with args [--context kind-kind1 --kubeconfig platforms/kind/kubeconfigs/kind1.conf --namespace kafka get kafkaclusters.kafka.banzaicloud.io kafka -o=go-template='{{range $key,$value := .status.listenerStatuses.externalListeners}}{{$key}}{{"\n"}}{{end}}]
  ALL_TESTCASE(kind-kind1) when Externally produce and consume message to/from Kafka cluster Producing and consuming messages 2023-07-25T10:09:15Z logger.go:66: '
> Enter [It] Producing and consuming messages - /home/runner/work/koperator/koperator/tests/e2e/produce_consume.go:100 @ 07/25/23 10:09:15.445
STEP: Getting Kafka cluster 'kafka' external listener addresses - /home/runner/work/koperator/koperator/tests/e2e/produce_consume.go:154 @ 07/25/23 10:09:15.445
STEP: Getting external listener names from KafkaCluster status - /home/runner/work/koperator/koperator/tests/e2e/produce_consume.go:138 @ 07/25/23 10:09:15.445
STEP: Get K8S resources: '[kafkaclusters.kafka.banzaicloud.io]' name(s): 'kafka' namespace: 'kafka' extraArgs: '[-o=go-template='{{range $key,$value := .status.listenerStatuses.externalListeners}}{{$key}}{{"\n"}}{{end}}]' - /home/runner/work/koperator/koperator/tests/e2e/k8s.go:530 @ 07/25/23 10:09:15.445
[FAILED] BeEmpty matcher expects a string/array/map/channel/slice.  Got:
    <func(k8s.KubectlOptions, string) ([]string, error)>: 0x1913b40
In [It] at: /home/runner/work/koperator/koperator/tests/e2e/produce_consume.go:160 @ 07/25/23 10:09:15.686
< Exit [It] Producing and consuming messages - /home/runner/work/koperator/koperator/tests/e2e/produce_consume.go:100 @ 07/25/23 10:09:15.686 (241ms)