Skip to content

[libc] Libc premerge testing is flaky #144131

Open
@michaelrj-google

Description

@michaelrj-google

Example: https://github.com/llvm/llvm-project/actions/runs/15640136104/job/44065277309?pr=144114

The end of the build logs:

[6786/6786] Running unit test libc.test.src.math.smoke.lrintf128_test.__unit__
[==========] Running 3 tests from 1 test suite.
[ RUN      ] LlvmLibcRoundToIntegerTest.InfinityAndNaN
[       OK ] LlvmLibcRoundToIntegerTest.InfinityAndNaN (7 us)
[ RUN      ] LlvmLibcRoundToIntegerTest.RoundNumbers
[       OK ] LlvmLibcRoundToIntegerTest.RoundNumbers (6 us)
[ RUN      ] LlvmLibcRoundToIntegerTest.SubnormalRange
[       OK ] LlvmLibcRoundToIntegerTest.SubnormalRange (1114 ms)
Ran 3 tests.  PASS: 3  FAIL: 0
ninja: build stopped: cannot make progress due to previous errors.
+ at-exit
+ retcode=1
+ ccache --print-stats
+ cp /home/gha/actions-runner/_work/llvm-project/llvm-project/build/.ninja_log artifacts/.ninja_log
+ cp '/home/gha/actions-runner/_work/llvm-project/llvm-project/build/test-results.*.xml' artifacts/
cp: cannot stat '/home/gha/actions-runner/_work/llvm-project/llvm-project/build/test-results.*.xml': No such file or directory
+ :
+ shopt -s nullglob
+ command -v buildkite-agent
+ python3 /home/gha/actions-runner/_work/llvm-project/llvm-project/.ci/generate_test_report_github.py ':penguin: Linux x64 Test Results' 1
Error: Process completed with exit code 1.

My guess as to what's happening: Since libc isn't using lit it doesn't create the test-results.<whatever>.xml that the premerge testing is expecting. That would explain the failures, but not why it sometimes passes. Maybe there are sometimes leftovers from previous runs?

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions