Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] EESSI compatibility layer for next version (2025.02) #209

Draft
wants to merge 40 commits into
base: main
Choose a base branch
from

Conversation

bedroge
Copy link
Collaborator

@bedroge bedroge commented Dec 20, 2024

Using 2025.01 for now, not sure if that's going to be final version, but I'm using this to do some test runs/installations.

Copy link

eessi-bot bot commented Dec 20, 2024

Instance eessi-bot-mc-aws is configured to build for:

  • architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
  • repositories: eessi.io-2023.06-compat, eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software

@bedroge bedroge marked this pull request as draft December 20, 2024 15:53
Copy link

eessi-bot bot commented Dec 20, 2024

Instance eessi-bot-mc-azure is configured to build for:

  • architectures: x86_64/amd/zen4
  • repositories: eessi.io-2023.06-compat, eessi.io-2023.06-software

@bedroge
Copy link
Collaborator Author

bedroge commented Dec 20, 2024

First runs went quite well, it failed (as expected) in the step that installs our package set, which we don't have yet for this version. The prefix bootstrap completed without issues though.

# gentoo_git_commit: 29492845e41ea6a0a4a9769c7e0ce287d106079b
# June 8 (aab8473aa90e0287553b3348a5c5b17872df4b7b) commit that was current when fetching luaposix
gentoo_git_commit: aab8473aa90e0287553b3348a5c5b17872df4b7b
gentoo_git_commit: db21a802e879f713cdb8a80235c5982ca257b63f
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Include a comment with some info on why this commit was picked (even if it simply was the latest at the time)

Once your PR to bump Lmod to latest has been merged, we'll have a clear reason...

prefix_required_space: 15 GB
prefix_user_defined_trusted_dirs:
- "/cvmfs/{{ cvmfs_repository }}/host_injections/{{ eessi_version }}/compat/{{ eessi_host_os }}/{{ eessi_host_arch }}/lib"
prefix_mask_packages: |
# stick to GCC 10.x; using a too recent compiler in the compat layer complicates stuff in the software layer,
# stick to GCC 11.x; using a too recent compiler in the compat layer may complicate stuff in the software layer,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would go with at least GCC 13, perhaps GCC 14 (unless that causes trouble to build GCC 13.x in software layer)

@boegel
Copy link
Contributor

boegel commented Dec 21, 2024

First runs went quite well, it failed (as expected) in the step that installs our package set, which we don't have yet for this version. The prefix bootstrap completed without issues though.

On both x86_64 and aarch64? Shall we also try riscv64?

@bedroge
Copy link
Collaborator Author

bedroge commented Dec 24, 2024

bot: build arch:generic repo:compat

Copy link

eessi-bot bot commented Dec 24, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)

Copy link

eessi-bot bot commented Dec 24, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build arch:generic repo:compat from bedroge

    • expanded format: build architecture:generic repository:compat
  • handling command build architecture:generic repository:compat resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Dec 24, 2024

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-generic for repository eessi-hpc.org-2023.06-compat in job dir /project/def-users/SHARED/jobs/2024.12/pr_209/36529

date job status comment
Dec 24 14:21:38 UTC 2024 submitted job id 36529 awaits release by job manager
Dec 24 14:22:33 UTC 2024 released job awaits launch by Slurm scheduler
Dec 24 14:29:44 UTC 2024 running job 36529 is running
Dec 24 14:41:27 UTC 2024 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job36529.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.
Dec 24 14:41:27 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job36529.test does not exist in job directory or reading it failed.

Copy link

eessi-bot bot commented Dec 24, 2024

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-generic for repository eessi.io-2023.06-compat in job dir /project/def-users/SHARED/jobs/2024.12/pr_209/36530

date job status comment
Dec 24 14:21:39 UTC 2024 submitted job id 36530 awaits release by job manager
Dec 24 14:22:31 UTC 2024 released job awaits launch by Slurm scheduler
Dec 24 14:29:42 UTC 2024 running job 36530 is running
Dec 24 14:47:41 UTC 2024 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job36530.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.
Dec 24 14:47:41 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job36530.test does not exist in job directory or reading it failed.

Copy link

eessi-bot bot commented Dec 24, 2024

New job on instance eessi-bot-mc-aws for CPU micro-architecture aarch64-generic for repository eessi-hpc.org-2023.06-compat in job dir /project/def-users/SHARED/jobs/2024.12/pr_209/36531

date job status comment
Dec 24 14:21:40 UTC 2024 submitted job id 36531 awaits release by job manager
Dec 24 14:22:29 UTC 2024 released job awaits launch by Slurm scheduler
Dec 24 14:28:38 UTC 2024 running job 36531 is running
Dec 24 14:41:25 UTC 2024 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job36531.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.
Dec 24 14:41:25 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job36531.test does not exist in job directory or reading it failed.

Copy link

eessi-bot bot commented Dec 24, 2024

New job on instance eessi-bot-mc-aws for CPU micro-architecture aarch64-generic for repository eessi.io-2023.06-compat in job dir /project/def-users/SHARED/jobs/2024.12/pr_209/36532

date job status comment
Dec 24 14:21:42 UTC 2024 submitted job id 36532 awaits release by job manager
Dec 24 14:22:27 UTC 2024 released job awaits launch by Slurm scheduler
Dec 24 14:27:35 UTC 2024 running job 36532 is running
Dec 24 14:47:39 UTC 2024 finished
🤷 UNKNOWN (click triangle for detailed information)
  • Job results file _bot_job36532.result does not exist in job directory or reading it failed.
  • No artefacts were found/reported.
Dec 24 14:47:39 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job36532.test does not exist in job directory or reading it failed.

@bedroge
Copy link
Collaborator Author

bedroge commented Dec 24, 2024

bot: build arch:x86_64/generic repo:eessi.io-2023.06-compat

(This will fail because we don't have a package set yet, and because we need #179, but I just want to check how far it gets.)

Copy link

eessi-bot bot commented Dec 24, 2024

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build arch:x86_64/generic repo:eessi.io-2023.06-compat from bedroge

    • expanded format: build architecture:x86_64/generic repository:eessi.io-2023.06-compat
  • handling command build architecture:x86_64/generic repository:eessi.io-2023.06-compat resulted in:

Copy link

eessi-bot bot commented Dec 24, 2024

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build arch:x86_64/generic repo:eessi.io-2023.06-compat from bedroge

    • expanded format: build architecture:x86_64/generic repository:eessi.io-2023.06-compat
  • handling command build architecture:x86_64/generic repository:eessi.io-2023.06-compat resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Dec 24, 2024

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-generic for repository eessi.io-2023.06-compat in job dir /project/def-users/SHARED/jobs/2024.12/pr_209/36533

date job status comment
Dec 24 14:47:40 UTC 2024 submitted job id 36533 awaits release by job manager
Dec 24 14:48:43 UTC 2024 released job awaits launch by Slurm scheduler
Dec 24 14:49:45 UTC 2024 running job 36533 is running
Dec 24 17:43:47 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-36533.out
❌ some task failed
✅ found tarball
Artefacts
eessi-2023.06-compat-linux-x86_64-1735062134.tar.gzsize: 1184 MiB (1241737476 bytes)
entries: 172022
Dec 24 17:43:47 UTC 2024 test result
🤷 UNKNOWN (click triangle for detailed information)
  • Job test file _bot_job36533.test does not exist in job directory or reading it failed.

@bedroge
Copy link
Collaborator Author

bedroge commented Feb 18, 2025

Trying again, the bot will now request 3 days for the build job.

bot: build repo:riscv.eessi.io-20240402 arch:riscv64/generic

Copy link

eessi-bot bot commented Feb 18, 2025

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Feb 18, 2025

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

    • no jobs were submitted

@riscv-eessi-io-bot
Copy link

riscv-eessi-io-bot bot commented Feb 18, 2025

Updates by the bot instance eessi-bot-riscv (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

@riscv-eessi-io-bot
Copy link

riscv-eessi-io-bot bot commented Feb 18, 2025

New job on instance eessi-bot-riscv for CPU micro-architecture riscv64-generic for repository riscv.eessi.io-20240402 in job dir /home/eessibot/shared/jobs/2025.02/pr_209/223379

date job status comment
Feb 18 12:43:54 UTC 2025 submitted job id 223379 awaits release by job manager
Feb 18 12:47:32 UTC 2025 released job awaits launch by Slurm scheduler
Feb 18 12:48:37 UTC 2025 running job 223379 is running
Feb 20 12:37:23 UTC 2025 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-223379.out
❌ some task failed
✅ found tarball
Artefacts
eessi-2025.02-compat-linux-riscv64-1739985741.tar.gzsize: 1027 MiB (1077191110 bytes)
entries: 290671
Feb 20 12:37:23 UTC 2025 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
✅ job output file slurm-223379.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge
Copy link
Collaborator Author

bedroge commented Feb 20, 2025

Haven't looked into the details yet, but it looks like the RISC-V build failed at installing GCC 14 in stage 3 of the bootstrap.

@boegel
Copy link
Contributor

boegel commented Feb 20, 2025

Haven't looked into the details yet, but it looks like the RISC-V build failed at installing GCC 14 in stage 3 of the bootstrap.

Why GCC 14? We want a slightly older GCC in compat layer?

@bedroge
Copy link
Collaborator Author

bedroge commented Feb 20, 2025

Haven't looked into the details yet, but it looks like the RISC-V build failed at installing GCC 14 in stage 3 of the bootstrap.

Why GCC 14? We want a slightly older GCC in compat layer?

That's a good question... I'm not sure if we had discussed this in a meeting, but this PR has been using GCC 14 for a while (by masking GCC >= 15). Let me mask >= 14 and try again in parallel to the manual build (as I'd still like to know why 14 doesn't work).

@bedroge
Copy link
Collaborator Author

bedroge commented Feb 20, 2025

bot: build arch:x86_64/generic repo:eessi.io-2023.06-compat
bot: build arch:aarch64/generic repo:eessi.io-2023.06-compat

Copy link

eessi-bot bot commented Feb 20, 2025

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • received bot command build arch:x86_64/generic repo:eessi.io-2023.06-compat from bedroge

    • expanded format: build architecture:x86_64/generic repository:eessi.io-2023.06-compat
  • received bot command build arch:aarch64/generic repo:eessi.io-2023.06-compat from bedroge

    • expanded format: build architecture:aarch64/generic repository:eessi.io-2023.06-compat
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

    • no jobs were submitted
  • handling command build architecture:x86_64/generic repository:eessi.io-2023.06-compat resulted in:

  • handling command build architecture:aarch64/generic repository:eessi.io-2023.06-compat resulted in:

Copy link

eessi-bot bot commented Feb 20, 2025

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • received bot command build arch:x86_64/generic repo:eessi.io-2023.06-compat from bedroge

    • expanded format: build architecture:x86_64/generic repository:eessi.io-2023.06-compat
  • received bot command build arch:aarch64/generic repo:eessi.io-2023.06-compat from bedroge

    • expanded format: build architecture:aarch64/generic repository:eessi.io-2023.06-compat
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

    • no jobs were submitted
  • handling command build architecture:x86_64/generic repository:eessi.io-2023.06-compat resulted in:

    • no jobs were submitted
  • handling command build architecture:aarch64/generic repository:eessi.io-2023.06-compat resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Feb 20, 2025

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-generic for repository eessi.io-2023.06-compat in job dir /project/def-users/SHARED/jobs/2025.02/pr_209/46980

date job status comment
Feb 20 15:56:08 UTC 2025 submitted job id 46980 awaits release by job manager
Feb 20 15:56:58 UTC 2025 released job awaits launch by Slurm scheduler
Feb 20 16:04:07 UTC 2025 running job 46980 is running
Feb 20 19:21:01 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-46980.out
✅ no task failed
✅ found tarball
Artefacts
eessi-2025.02-compat-linux-x86_64-1740079108.tar.gzsize: 1746 MiB (1831270568 bytes)
entries: 194561
Feb 20 19:21:01 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] ( 1/23) SymlinksToHostFilesTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %symlink_to_host=lib64/libnss_centrifydc.so.2 /aa9161d2 @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.262s sanity: 0.005s performance: 0.003s total: 0.801s
[ OK ] ( 2/23) SymlinksToHostFilesTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %symlink_to_host=etc/resolv.conf /f5a67d10 @Generic:default+builtin
==> setup: 0.010s compile: 0.010s run: 0.547s sanity: 0.004s performance: 0.003s total: 1.076s
[ OK ] ( 3/23) SymlinksToHostFilesTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %symlink_to_host=etc/hosts /95abe083 @Generic:default+builtin
==> setup: 0.009s compile: 0.010s run: 0.543s sanity: 0.004s performance: 0.003s total: 1.063s
[ OK ] ( 4/23) SymlinksToHostFilesTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %symlink_to_host=etc/passwd /ab3eb751 @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.539s sanity: 0.004s performance: 0.003s total: 1.051s
[ OK ] ( 5/23) SymlinksToHostFilesTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %symlink_to_host=etc/group /08176824 @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.533s sanity: 0.004s performance: 0.003s total: 1.039s
[ OK ] ( 6/23) Utf8LocaleTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /072d8343 @Generic:default+builtin
==> setup: 0.010s compile: 0.010s run: 0.487s sanity: 0.004s performance: 0.002s total: 1.015s
[ OK ] ( 7/23) PipCheckTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /e278a089 @Generic:default+builtin
==> setup: 0.016s compile: 0.010s run: 0.973s sanity: 0.004s performance: 0.003s total: 1.543s
[ OK ] ( 8/23) GlibcEnvFileTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /61b13482 @Generic:default+builtin
==> setup: 0.010s compile: 0.010s run: 0.968s sanity: 0.004s performance: 0.003s total: 1.525s
[ OK ] ( 9/23) EessiSetInstalledTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /d33e3f82 @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.650s sanity: 0.008s performance: 0.003s total: 1.343s
[ OK ] (10/23) LmodTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /54d978fd @Generic:default+builtin
==> setup: 0.016s compile: 0.011s run: 0.642s sanity: 0.007s performance: 0.003s total: 1.319s
[ OK ] (11/23) ArchspecTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /8302bf41 @Generic:default+builtin
==> setup: 0.010s compile: 0.010s run: 0.632s sanity: 0.004s performance: 0.003s total: 1.300s
[ OK ] (12/23) EessiSetTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /83d74b52 @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.982s sanity: 0.007s performance: 0.005s total: 1.667s
[ OK ] (13/23) RunEqueryTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /88bedc87 @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.945s sanity: 0.006s performance: 0.004s total: 1.607s
[ OK ] (14/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %tool=patchelf /978ef8e4 @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.684s sanity: 0.004s performance: 0.003s total: 1.578s
[ OK ] (15/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %tool=patch /a1456e15 @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.681s sanity: 0.004s performance: 0.003s total: 1.565s
[ OK ] (16/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %tool=make /8e53b1dc @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.678s sanity: 0.003s performance: 0.003s total: 1.552s
[ OK ] (17/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %tool=ld.bfd /ca169078 @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.676s sanity: 0.007s performance: 0.003s total: 1.543s
[ OK ] (18/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %tool=equery /6cfa392a @Generic:default+builtin
==> setup: 0.010s compile: 0.010s run: 0.571s sanity: 0.004s performance: 0.003s total: 1.751s
[ OK ] (19/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %tool=emerge /31c50cde @Generic:default+builtin
==> setup: 0.010s compile: 0.011s run: 0.569s sanity: 0.006s performance: 0.003s total: 1.742s
[ OK ] (20/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux %tool=archspec /86c8e437 @Generic:default+builtin
==> setup: 0.010s compile: 0.010s run: 0.565s sanity: 0.004s performance: 0.003s total: 1.729s
[ OK ] (21/23) EchoTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /ed5c048c @Generic:default+builtin
==> setup: 0.010s compile: 0.010s run: 0.561s sanity: 0.004s performance: 0.003s total: 1.716s
[ OK ] (22/23) GentooOverlayGitTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /f2b53803 @Generic:default+builtin
==> setup: 0.010s compile: 0.010s run: 1.832s sanity: 0.004s performance: 0.003s total: 2.380s
[ OK ] (23/23) RunEmergeTest %eessi_version=2025.02 %eessi_arch=x86_64 %eessi_os=linux /a921dca2 @Generic:default+builtin
==> setup: 0.011s compile: 0.010s run: 1.427s sanity: 0.004s performance: 0.003s total: 2.329s
[ PASSED ] Ran 23/23 test case(s) from 23 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-46980.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

Copy link

eessi-bot bot commented Feb 20, 2025

New job on instance eessi-bot-mc-aws for CPU micro-architecture aarch64-generic for repository eessi.io-2023.06-compat in job dir /project/def-users/SHARED/jobs/2025.02/pr_209/46981

date job status comment
Feb 20 15:56:14 UTC 2025 submitted job id 46981 awaits release by job manager
Feb 20 15:56:55 UTC 2025 released job awaits launch by Slurm scheduler
Feb 20 16:03:02 UTC 2025 running job 46981 is running
Feb 20 19:24:05 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-46981.out
✅ no task failed
✅ found tarball
Artefacts
eessi-2025.02-compat-linux-aarch64-1740079230.tar.gzsize: 1825 MiB (1913987184 bytes)
entries: 195395
Feb 20 19:24:05 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ OK ] ( 1/23) SymlinksToHostFilesTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %symlink_to_host=lib64/libnss_centrifydc.so.2 /caa5df58 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.298s sanity: 0.005s performance: 0.003s total: 0.896s
[ OK ] ( 2/23) SymlinksToHostFilesTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %symlink_to_host=etc/resolv.conf /23db6a34 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.296s sanity: 0.005s performance: 0.003s total: 0.883s
[ OK ] ( 3/23) SymlinksToHostFilesTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %symlink_to_host=etc/hosts /c17c71be @Generic:default+builtin
==> setup: 0.012s compile: 0.012s run: 0.593s sanity: 0.005s performance: 0.003s total: 1.171s
[ OK ] ( 4/23) SymlinksToHostFilesTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %symlink_to_host=etc/passwd /99ffb7b2 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.589s sanity: 0.006s performance: 0.003s total: 1.158s
[ OK ] ( 5/23) SymlinksToHostFilesTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %symlink_to_host=etc/group /d5305fc4 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.585s sanity: 0.005s performance: 0.003s total: 1.145s
[ OK ] ( 6/23) Utf8LocaleTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /5038ca62 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.531s sanity: 0.006s performance: 0.003s total: 1.120s
[ OK ] ( 7/23) EessiSetInstalledTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /d8055f60 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.531s sanity: 0.007s performance: 0.003s total: 1.109s
[ OK ] ( 8/23) PipCheckTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /6f617a47 @Generic:default+builtin
==> setup: 0.019s compile: 0.011s run: 1.052s sanity: 0.005s performance: 0.003s total: 1.688s
[ OK ] ( 9/23) GlibcEnvFileTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /cd6ec10d @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 1.049s sanity: 0.004s performance: 0.003s total: 1.667s
[ OK ] (10/23) LmodTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /fedea6e6 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.666s sanity: 0.006s performance: 0.003s total: 1.414s
[ OK ] (11/23) ArchspecTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /02d8b830 @Generic:default+builtin
==> setup: 0.013s compile: 0.011s run: 0.663s sanity: 0.004s performance: 0.003s total: 1.400s
[ OK ] (12/23) EessiSetTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /761fefe8 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 1.010s sanity: 0.005s performance: 0.003s total: 1.769s
[ OK ] (13/23) RunEqueryTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /c9c483bf @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.973s sanity: 0.004s performance: 0.003s total: 1.701s
[ OK ] (14/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %tool=patchelf /77b1e119 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.683s sanity: 0.005s performance: 0.003s total: 1.665s
[ OK ] (15/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %tool=patch /621e63db @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.680s sanity: 0.004s performance: 0.003s total: 1.651s
[ OK ] (16/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %tool=make /b6763f21 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.678s sanity: 0.004s performance: 0.003s total: 1.636s
[ OK ] (17/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %tool=ld.bfd /651d30ae @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.674s sanity: 0.005s performance: 0.003s total: 1.623s
[ OK ] (18/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %tool=equery /98200eb8 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.614s sanity: 0.005s performance: 0.003s total: 1.878s
[ OK ] (19/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %tool=emerge /564ead0c @Generic:default+builtin
==> setup: 0.012s compile: 0.012s run: 0.611s sanity: 0.005s performance: 0.003s total: 1.864s
[ OK ] (20/23) ToolsAvailableTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux %tool=archspec /6890e532 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.608s sanity: 0.004s performance: 0.003s total: 1.850s
[ OK ] (21/23) EchoTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /ceb61360 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 0.605s sanity: 0.005s performance: 0.003s total: 1.836s
[ OK ] (22/23) GentooOverlayGitTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /c07398c5 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 1.973s sanity: 0.005s performance: 0.003s total: 2.581s
[ OK ] (23/23) RunEmergeTest %eessi_version=2025.02 %eessi_arch=aarch64 %eessi_os=linux /3a0979e7 @Generic:default+builtin
==> setup: 0.012s compile: 0.011s run: 1.671s sanity: 0.004s performance: 0.003s total: 2.389s
[ PASSED ] Ran 23/23 test case(s) from 23 check(s) (0 failure(s), 0 skipped, 0 aborted)
Details
✅ job output file slurm-46981.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge
Copy link
Collaborator Author

bedroge commented Feb 20, 2025

bot: build repo:riscv.eessi.io-20240402 arch:riscv64/generic

Copy link

eessi-bot bot commented Feb 20, 2025

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Feb 20, 2025

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

    • no jobs were submitted

@riscv-eessi-io-bot
Copy link

riscv-eessi-io-bot bot commented Feb 20, 2025

Updates by the bot instance eessi-bot-riscv (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

@riscv-eessi-io-bot
Copy link

riscv-eessi-io-bot bot commented Feb 20, 2025

New job on instance eessi-bot-riscv for CPU micro-architecture riscv64-generic for repository riscv.eessi.io-20240402 in job dir /home/eessibot/shared/jobs/2025.02/pr_209/223568

date job status comment
Feb 20 15:57:35 UTC 2025 submitted job id 223568 awaits release by job manager
Feb 20 15:57:46 UTC 2025 released job awaits launch by Slurm scheduler
Feb 20 15:58:50 UTC 2025 running job 223568 is running
Feb 23 00:43:48 UTC 2025 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-223568.out
❌ some task failed
✅ found tarball
Artefacts
eessi-2025.02-compat-linux-riscv64-1740270388.tar.gzsize: 1787 MiB (1873881649 bytes)
entries: 194433
Feb 23 00:43:48 UTC 2025 test result
😢 FAILURE (click triangle for details)
Reason
EESSI test suite was not run, test step itself failed to execute.
Details
✅ job output file slurm-223568.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@boegel
Copy link
Contributor

boegel commented Feb 20, 2025

Haven't looked into the details yet, but it looks like the RISC-V build failed at installing GCC 14 in stage 3 of the bootstrap.

Why GCC 14? We want a slightly older GCC in compat layer?

That's a good question... I'm not sure if we had discussed this in a meeting, but this PR has been using GCC 14 for a while (by masking GCC >= 15). Let me mask >= 14 and try again in parallel to the manual build (as I'd still like to know why 14 doesn't work).

I would at least stick to GCC 13.x, to avoid trouble if we do end up having to installed pre-2024a toolchains in this new EESSI version (though that's not the plan currently)

@bedroge
Copy link
Collaborator Author

bedroge commented Feb 23, 2025

New job on instance eessi-bot-riscv for CPU micro-architecture riscv64-generic for repository riscv.eessi.io-20240402 in job dir /home/eessibot/shared/jobs/2025.02/pr_209/223568

date job status comment
Feb 20 15:57:35 UTC 2025 submitted job id 223568 awaits release by job manager
Feb 20 15:57:46 UTC 2025 released job awaits launch by Slurm scheduler
Feb 20 15:58:50 UTC 2025 running job 223568 is running
Feb 23 00:43:48 UTC 2025 finished
😢 FAILURE (click triangle for details)
Feb 23 00:43:48 UTC 2025 test result
😢 FAILURE (click triangle for details)

The very last (test) step of the playbook failed, because ReFrame could not be installed:

cargo build --manifest-path Cargo.toml --message-format=json-
render-diagnostics --release -v --no-default-features --locked\n            error: package `clap v4.5.7` cannot be built because it requires rustc 1.74 or newer, while the curr
ently active rustc version is 1.70.0\n            Either upgrade to rustc 1.74 or newer, or use\n            cargo update -p [email protected] --precise ver\n            where `ver` i
s the latest version of `clap` supporting rustc 1.70.0\n            error: `cargo build --manifest-path Cargo.toml --message-format=json-render-diagnostics --release -v --no-de
fault-features --locked` failed with code 101\n            [end of output]\n      \n        note: This error originates from a subprocess, and is likely not a problem with pip.
\n        ERROR: Failed building wheel for maturin\n      Failed to build maturin\n      ERROR: Failed to build installable wheels for some pyproject.toml based projects (matur
in)\n      [end of output]\n  \n  note: This error originates from a subprocess, and is likely not a problem with pip.\nerror: subprocess-exited-with-error\n\n× pip subprocess 
to install build dependencies did not run successfully.\n│ exit code: 1\n╰─> See above for output.\n\nnote: This error originates from a subprocess, and is likely not a problem
 with pip.\n"

@bedroge
Copy link
Collaborator Author

bedroge commented Feb 27, 2025

bot: build repo:riscv.eessi.io-20240402 arch:riscv64/generic

Copy link

eessi-bot bot commented Feb 27, 2025

Updates by the bot instance eessi-bot-mc-aws (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

    • no jobs were submitted

Copy link

eessi-bot bot commented Feb 27, 2025

Updates by the bot instance eessi-bot-mc-azure (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

    • no jobs were submitted

@riscv-eessi-io-bot
Copy link

riscv-eessi-io-bot bot commented Feb 27, 2025

Updates by the bot instance eessi-bot-riscv (click for details)
  • received bot command build repo:riscv.eessi.io-20240402 arch:riscv64/generic from bedroge

    • expanded format: build repository:riscv.eessi.io-20240402 architecture:riscv64/generic
  • handling command build repository:riscv.eessi.io-20240402 architecture:riscv64/generic resulted in:

@riscv-eessi-io-bot
Copy link

riscv-eessi-io-bot bot commented Feb 27, 2025

New job on instance eessi-bot-riscv for CPU micro-architecture riscv64-generic for repository riscv.eessi.io-20240402 in job dir /home/eessibot/shared/jobs/2025.02/pr_209/224108

date job status comment
Feb 27 14:47:22 UTC 2025 submitted job id 224108 awaits release by job manager
Feb 27 14:48:17 UTC 2025 released job awaits launch by Slurm scheduler
Feb 27 14:49:22 UTC 2025 running job 224108 is running
Mar 03 08:53:32 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-224108.out
✅ no task failed
✅ found tarball
Artefacts
eessi-2025.02-compat-linux-riscv64-1740874406.tar.gzsize: 1789 MiB (1876827723 bytes)
entries: 194442
Mar 03 08:53:32 UTC 2025 test result
😢 FAILURE (click triangle for details)
Reason
Failed for unknown reason
Details
✅ job output file slurm-224108.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants