Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move "Bazel Test" GitHub action to a large runner. #4119

Closed
wants to merge 1 commit into from

Conversation

copybara-service[bot]
Copy link

@copybara-service copybara-service bot commented Oct 31, 2023

Move "Bazel Test" GitHub action to a large runner.

"Bazel Test" has been the bottleneck of our builds for a while now. A large part of that is due to the default GitHub runner only having 2 cores and thus only being able to run at most 2 Bazel actions at a time. Things have also gotten worse due to the increasing number of tests in Dagger's codebase and the slowing down of tests due to the move to XProcessing Testing and possibly increased I/O due to golden files, though these issues aren't addressed in this CL.

This CL moves our "Bazel Test" GitHub actions onto the large test runner. This runner now has 16 cores which should allow 8x more tests to run in parallel and we should see a similar improvement in the time it takes these GitHub actions to run.

RELNOTES=N/A

@copybara-service copybara-service bot force-pushed the test_578232997 branch 16 times, most recently from 6d63c03 to 01bd4b2 Compare November 2, 2023 23:05
@copybara-service copybara-service bot changed the title Test tuning Bazel local_test_jobs. Move "Bazel Build" and "Bazel Test" GitHub actions to large runners. Nov 3, 2023
@copybara-service copybara-service bot force-pushed the test_578232997 branch 2 times, most recently from 426492d to bcff98c Compare November 3, 2023 06:07
@copybara-service copybara-service bot changed the title Move "Bazel Build" and "Bazel Test" GitHub actions to large runners. Move "Bazel Test" GitHub action to a large runner. Nov 6, 2023
@copybara-service copybara-service bot force-pushed the test_578232997 branch 2 times, most recently from 9538e16 to fde4828 Compare November 6, 2023 16:55
"Bazel Test" has been the bottleneck of our builds for a while now. A large part of that is due to the default GitHub runner only having 2 cores and thus only being able to run at most 2 Bazel actions at a time. Things have also gotten worse due to the increasing number of tests in Dagger's codebase and the slowing down of tests due to the move to XProcessing Testing and possibly increased I/O due to golden files, though these issues aren't addressed in this CL.

This CL moves our "Bazel Test" GitHub actions onto the large test runner. This runner now has 16 cores which should allow 8x more tests to run in parallel and we should see a similar improvement in the time it takes these GitHub actions to run.

RELNOTES=N/A
PiperOrigin-RevId: 578232997
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant