Skip to content

CNTRLPLANE-353: Add test which verifes that only short duration tests are present #29629

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

vrutkovs
Copy link
Member

@vrutkovs vrutkovs commented Mar 31, 2025

This test would run only when ShortCertRotation is enabled

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Mar 31, 2025
@openshift-ci-robot
Copy link

openshift-ci-robot commented Mar 31, 2025

@vrutkovs: This pull request references CNTRLPLANE-353 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the sub-task to target the "4.19.0" version, but no target version was set.

In response to this:

This test would run only when ShortCertRotation is enabled

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci bot requested review from JoelSpeed and p0lyn0mial March 31, 2025 08:09
@vrutkovs vrutkovs changed the title CNTRLPLANE-353: Add test which verifes that only short duration tests are present WIP CNTRLPLANE-353: Add test which verifes that only short duration tests are present Apr 1, 2025
@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Apr 1, 2025
@openshift-ci-robot
Copy link

openshift-ci-robot commented Apr 1, 2025

@vrutkovs: This pull request references CNTRLPLANE-353 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the sub-task to target the "4.19.0" version, but no target version was set.

In response to this:

This test would run only when ShortCertRotation is enabled.
TODO: skip ingress certificates - these are not refreshed automatically and refreshing them will break tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@vrutkovs vrutkovs force-pushed the short-cert-rotation-cert-duration branch from 9e222f6 to 2f2c637 Compare April 2, 2025 09:20
@openshift-ci-robot
Copy link

openshift-ci-robot commented Apr 2, 2025

@vrutkovs: This pull request references CNTRLPLANE-353 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the sub-task to target the "4.19.0" version, but no target version was set.

In response to this:

This test would run only when ShortCertRotation is enabled

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

Copy link

openshift-trt bot commented Apr 2, 2025

Job Failure Risk Analysis for sha: 2f2c637

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-gcp-disruptive Medium
[sig-node] static pods should start after being created
Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-vsphere-ovn IncompleteTests
Tests for this run (102) are below the historical average (2667): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New tests seen in this PR at sha: 2f2c637

  • "[sig-trt] Skipped annotations present" [Total: 39, Pass: 39, Fail: 0, Flake: 40]

@vrutkovs vrutkovs force-pushed the short-cert-rotation-cert-duration branch 2 times, most recently from 219fa1d to add29d4 Compare April 3, 2025 11:12
Copy link

openshift-trt bot commented Apr 3, 2025

Job Failure Risk Analysis for sha: add29d4

Job Name Failure Risk
pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback IncompleteTests
Tests for this run (93) are below the historical average (217): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling Low
[bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded
This test has passed 50.00% of 2 runs on release 4.19 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week.
pull-ci-openshift-origin-main-e2e-azure-ovn-etcd-scaling Medium
[bz-openshift-apiserver] clusteroperator/openshift-apiserver should not change condition/Available
Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-gcp-disruptive Medium
[bz-openshift-apiserver] clusteroperator/openshift-apiserver should not change condition/Available
Potential external regression detected for High Risk Test analysis
---
[sig-node] static pods should start after being created
Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-gcp-ovn-etcd-scaling Medium
[sig-architecture] platform pods in ns/openshift-multus should not exit an excessive amount of times
Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-bgp-techpreview IncompleteTests
Tests for this run (21) are below the historical average (2564): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-openstack-serial IncompleteTests
Tests for this run (104) are below the historical average (1617): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-okd-e2e-gcp IncompleteTests
Tests for this run (15) are below the historical average (64): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@vrutkovs vrutkovs force-pushed the short-cert-rotation-cert-duration branch from add29d4 to 7e35839 Compare April 8, 2025 15:54
Copy link

openshift-trt bot commented Apr 8, 2025

Job Failure Risk Analysis for sha: 7e35839

Job Name Failure Risk
pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback IncompleteTests
Tests for this run (12) are below the historical average (221): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-azure-ovn-etcd-scaling Low
[bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded
This test has passed 0.00% of 1 runs on release 4.19 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:azure SecurityMode:default Topology:ha Upgrade:none] in the last week.
---
[bz-kube-storage-version-migrator] clusteroperator/kube-storage-version-migrator should not change condition/Available
This test has passed 69.01% of 4602 runs on release 4.19 [Overall] in the last week.

Open Bugs
[CI] e2e-openstack-ovn-etcd-scaling job permanent fails at many openshift-test tests
pull-ci-openshift-origin-main-e2e-gcp-disruptive Medium
[sig-node] static pods should start after being created
Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-gcp-ovn-etcd-scaling Low
[bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded
This test has passed 0.00% of 1 runs on release 4.19 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:gcp SecurityMode:default Topology:ha Upgrade:none] in the last week.
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn IncompleteTests
Tests for this run (11) are below the historical average (2297): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-okd-e2e-gcp IncompleteTests
Tests for this run (15) are below the historical average (42): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@vrutkovs vrutkovs force-pushed the short-cert-rotation-cert-duration branch from 7e35839 to f53dffc Compare April 10, 2025 07:37
@vrutkovs vrutkovs changed the title WIP CNTRLPLANE-353: Add test which verifes that only short duration tests are present CNTRLPLANE-353: Add test which verifes that only short duration tests are present Apr 10, 2025
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Apr 10, 2025
Copy link

openshift-trt bot commented Apr 10, 2025

Job Failure Risk Analysis for sha: f53dffc

Job Name Failure Risk
pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback IncompleteTests
Tests for this run (14) are below the historical average (225): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn IncompleteTests
Tests for this run (102) are below the historical average (2042): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-okd-e2e-gcp IncompleteTests
Tests for this run (15) are below the historical average (32): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

@vrutkovs vrutkovs force-pushed the short-cert-rotation-cert-duration branch from f53dffc to f785c25 Compare April 22, 2025 07:44
Copy link

openshift-trt bot commented May 3, 2025

Job Failure Risk Analysis for sha: f785c25

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-aws IncompleteTests
Tests for this run (24) are below the historical average (2650): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-disruptive IncompleteTests
Tests for this run (24) are below the historical average (1179): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-gcp-disruptive High
[sig-arch] events should not repeat pathologically for ns/openshift-kube-apiserver-operator
This test has passed 100.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:hidden Network:ovn NetworkStack:ipv4 Owner:eng Platform:gcp SecurityMode:default Topology:ha Upgrade:micro-downgrade] in the last week.
---
[sig-node] static pods should start after being created
This test has passed 99.09% of 3197 runs on release 4.20 [Overall] in the last week.
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn IncompleteTests
Tests for this run (96) are below the historical average (1904): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-local-gateway IncompleteTests
Tests for this run (103) are below the historical average (2001): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (103) are below the historical average (1916): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (103) are below the historical average (1027): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-serial IncompleteTests
Tests for this run (103) are below the historical average (957): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-metal-ipi-virtualmedia IncompleteTests
Tests for this run (103) are below the historical average (1824): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-okd-scos-e2e-aws-ovn IncompleteTests
Tests for this run (97) are below the historical average (2130): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

This test would run only when ShortCertRotation is enabled
@vrutkovs vrutkovs force-pushed the short-cert-rotation-cert-duration branch from f785c25 to 41aecca Compare May 14, 2025 08:21
@vrutkovs
Copy link
Member Author

/retest-request

@gangwgr
Copy link
Contributor

gangwgr commented May 19, 2025

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label May 19, 2025
@sosiouxme
Copy link
Member

/approve

Copy link
Contributor

openshift-ci bot commented May 27, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: gangwgr, sosiouxme, vrutkovs

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label May 27, 2025
@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 94a4d2a and 2 for PR HEAD 41aecca in total

Copy link

openshift-trt bot commented May 27, 2025

Job Failure Risk Analysis for sha: 41aecca

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-azure-ovn-etcd-scaling Low
[bz-kube-storage-version-migrator] clusteroperator/kube-storage-version-migrator should not change condition/Available
This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:azure SecurityMode:default Topology:ha Upgrade:none] in the last week.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 1e79d36 and 2 for PR HEAD 41aecca in total

Copy link
Contributor

openshift-ci bot commented May 28, 2025

@vrutkovs: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-metal-ipi-ovn-dualstack-bgp-techpreview f785c25 link false /test e2e-metal-ipi-ovn-dualstack-bgp-techpreview
ci/prow/e2e-aws-ovn-serial f785c25 link true /test e2e-aws-ovn-serial
ci/prow/e2e-gcp-ovn-etcd-scaling 41aecca link false /test e2e-gcp-ovn-etcd-scaling
ci/prow/4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback 41aecca link false /test 4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback
ci/prow/e2e-aws-ovn-etcd-scaling 41aecca link false /test e2e-aws-ovn-etcd-scaling
ci/prow/e2e-gcp-disruptive 41aecca link false /test e2e-gcp-disruptive
ci/prow/e2e-openstack-serial 41aecca link false /test e2e-openstack-serial
ci/prow/e2e-gcp-fips-serial 41aecca link false /test e2e-gcp-fips-serial
ci/prow/e2e-aws-ovn-single-node-upgrade 41aecca link false /test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-aws-ovn-serial-publicnet 41aecca link true /test e2e-aws-ovn-serial-publicnet
ci/prow/okd-e2e-gcp 41aecca link false /test okd-e2e-gcp
ci/prow/e2e-azure-ovn-etcd-scaling 41aecca link false /test e2e-azure-ovn-etcd-scaling
ci/prow/e2e-aws-ovn-kube-apiserver-rollout 41aecca link false /test e2e-aws-ovn-kube-apiserver-rollout
ci/prow/e2e-vsphere-ovn-dualstack-primaryv6 41aecca link false /test e2e-vsphere-ovn-dualstack-primaryv6
ci/prow/e2e-openstack-ovn 41aecca link false /test e2e-openstack-ovn
ci/prow/e2e-aws-disruptive 41aecca link false /test e2e-aws-disruptive
ci/prow/e2e-azure-ovn-upgrade 41aecca link false /test e2e-azure-ovn-upgrade
ci/prow/e2e-vsphere-ovn-etcd-scaling 41aecca link false /test e2e-vsphere-ovn-etcd-scaling

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD b1ee297 and 1 for PR HEAD 41aecca in total

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 2836632 and 0 for PR HEAD 41aecca in total

@openshift-merge-bot openshift-merge-bot bot merged commit e39730d into openshift:main May 28, 2025
41 of 55 checks passed
@openshift-bot
Copy link
Contributor

[ART PR BUILD NOTIFIER]

Distgit: openshift-enterprise-tests
This PR has been included in build openshift-enterprise-tests-container-v4.20.0-202505282215.p0.ge39730d.assembly.stream.el9.
All builds following this will include this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants