Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Analyze testsuite failures and create tasks to fix the areas #626

Open
zkraus opened this issue Jan 29, 2025 · 1 comment
Open

Analyze testsuite failures and create tasks to fix the areas #626

zkraus opened this issue Jan 29, 2025 · 1 comment
Assignees

Comments

@zkraus
Copy link
Contributor

zkraus commented Jan 29, 2025

Version RHCL 1.0.0

create new task per logical failures area.
Just analyze, no fixing.

@zkraus zkraus moved this to 📋 Backlog in Kuadrant QE Jan 29, 2025
@zkraus zkraus assigned zkraus and azgabur and unassigned zkraus Jan 29, 2025
@azgabur
Copy link
Contributor

azgabur commented Feb 3, 2025

make test:
local fails:
testsuite/tests/singlecluster/gateway/dnspolicy/test_dnspolicy_removal.py
- Test fails due to DNS TTL sleep being too short or DNS caching
- It fails when run localy, but did not fail when run in pipeline. It doesnt fail when run outside RH network = DNS shenanigans

pipeline fails:
testsuite/tests/singlecluster/authorino/identity/auth/test_auth_identity.py:37: in test_correct_auth
testsuite/tests/singlecluster/authorino/identity/anonymous/test_anonymous_identity.py:38: in test_anonymous_identity
testsuite/tests/singlecluster/gateway/test_basic.py:18: in test_smoke
testsuite/tests/singlecluster/reconciliation/test_httproute_delete.py:30: in test_delete

make authorino-standalone:
testsuite/tests/singlecluster/authorino/conditions/test_top_level_condition.py:29: in test_skip_auth_config
testsuite/tests/singlecluster/authorino/operator/tracing/test_tracing.py
testsuite/tests/singlecluster/authorino/operator/tracing/test_tracing_tags.py:31: in test_tracing_tags
- missing tracing setup in cluster?
testsuite/tests/singlecluster/authorino/response/test_deny_with.py
- tests fail on XPASS, maybe we need to remove xfail?

make multicluster:
test_load_balanced_geo
test_change_lb_strategy
- both fail on "TlsPolicy not ready"
- in pipelines they sometimes pass sometimes no, so this is timeout problem
- locally all multicluster tests pass

make dnstls:
gcp:
testsuite/tests/singlecluster/gateway/dnspolicy/health_check/test_unhealthy_endpoint.py::test_unhealthy_endpoint

azure:
testsuite/tests/singlecluster/gateway/reconciliation/listeners/test_gateway_basic_listeners.py:35: in test_listeners
testsuite/tests/singlecluster/gateway/test_scale_listeners.py:76: in test_gateway_max_listeners
testsuite/tests/singlecluster/gateway/dnspolicy/health_check/test_unhealthy_endpoint.py::test_unhealthy_endpoint

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: 📋 Backlog
Development

No branches or pull requests

2 participants