CI: run e2e tests against all supported Kubernetes versions

[skriss]

Closes #323.

Signed-off-by: Steve Kriss [email protected]

[skriss]

Having trouble getting all the jobs to pass at the same time, we may need to do some more flake-fighting here.

[danehans]

The operator upgrade test is failing with “found error message in operator contour-operator/contour-operator logs”. I'm going to try locally reproducing and I created #338 for tracking the need to capture the operator logs.

[danehans]

@skriss It appears CI is failing for this PR due to #341.

[danehans]

@skriss do you know why the test-e2e-linux and test-example-linux CI jobs are reporting "Waiting for status to be reported"?

[skriss]

@skriss do you know why the test-e2e-linux and test-example-linux CI jobs are reporting "Waiting for status to be reported"?

Yeah, each of those have now been replaced by the three matrix jobs (e.g. test-e2e-linux (kubernetes:latest), test-e2e-linux (kubernetes:n-1), ...), but the original non-matrix jobs are still marked as required. Once we're happy with this PR, I'll update the branch protection rules to require the matrix jobs and not require the old jobs.

[danehans]

@skriss this PR has 2 approvals but I'll let you merge as I don't fully understand the steps for changing the branch protection rules.

[skriss]

@skriss this PR has 2 approvals but I'll let you merge as I don't fully understand the steps for changing the branch protection rules.

Sounds good, will see if we can get a few of the other open PRs in first since once this goes in and I change the rules all open PRs will have to be rebased.

[skriss]

OK, I'm going to get this in now and other PRs will have to update.

[codecov]

Codecov Report

Merging #332 (3770027) into main (06e1c44) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #332   +/-   ##
=======================================
  Coverage   55.66%   55.66%           
=======================================
  Files          19       19           
  Lines        1775     1775           
=======================================
  Hits          988      988           
  Misses        761      761           
  Partials       26       26           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 06e1c44...3770027. Read the comment docs.