Skip to content

Add dev.eessi.io support including project subdirectories #885

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 114 commits into
base: 2023.06-software.eessi.io
Choose a base branch
from
Draft

Add dev.eessi.io support including project subdirectories #885

wants to merge 114 commits into from
+46 −20

Conversation

Neves-P
Copy link
Member

@Neves-P Neves-P commented Jan 24, 2025

This PR replaces open WIP PR #804 (to merge from a more up to date and tested branch) and adds support for building into the dev.eessi.io repository.

Documentation for how to install into dev.eessi.io is available in https://www.eessi.io/docs/adding_software/adding_development_software/, with maintainer documentation to come in EESSI/dev.eessi.io-example#12

With this PR, software builds are installed into /cvmfs/dev.eessi.io/2023.06/$EESSI_DEV_PROJECT/. $EESSI_DEV_PROJECT is determined automatically during the build process and comes from the name of the GitHub repository that the bot is listening according to the format: dev.eessi.io-EESSI_DEV_PROJECT. See: https://github.com/EESSI/dev.eessi.io-example

Existing builds to dev.eessi.io were tested with the code that is about to be merged as verified in EESSI/dev.eessi.io-example#14

Neves-P and others added 30 commits November 1, 2024 11:26
@Neves-P
Add EESSI_DEV_PROJET to prefix
8a6cd13
@Neves-P
Merge branch 'EESSI:2023.06-software.eessi.io' into feature/dev.eessi.io
ee6aea9
@Neves-P
Print EESSI_CVMFS_REPO to debug
0e9402b
@Neves-P
Merge branch 'feature/dev.eessi.io' of https://github.com/Neves-P/sof…
8e628be 
…tware-layer into feature/dev.eessi.io
@Neves-P
Check if running in subshell is the cause of some variables being reset
888b874
@Neves-P
Revert to run minimal_eessi_env in subshell and add log line
1af43f1
@Neves-P
Fix condition to build with subdir in prefix in dev.eessi.io
25e8a5f
@Neves-P
Add some logs to see where EESSI_CVMFS_REPO is being ovewritten
3e5e2af
@Neves-P
Add more log output for EESSI_DEV_PROJECT variable
722ca22
@Neves-P
export EESSI_DEV_PROJECT to compat layer env
1c3f20a
@Neves-P
Expose cvmfs and version override in eessi_defaults
7c9dee8
@Neves-P
Also expose EESSI_CVMFS_REPO in defaults
d5d1522
@Neves-P
Try exporting EESSI_CVMFS_INSTALL
fb45d7e
@Neves-P
Overwrite EASYBUILD_INSTALLPATH and use EESSI_CVMFS_REPO_OVERRIDE in …
a1f11fe 
…minimal_eessi_env
@Neves-P
Load $EASYBUILD_INSTALLPATH modules in dev.eessi.io
dd9fccd
@Neves-P
Use EESSI_DEV_PROJECT for check instead of EESSI_CVMFS_REPO in EASYBU…
821455b 
…ILD_INSTALLPATH override
@Neves-P
Fix running install_scripts.sh only if not in dev.eessi.io
a19c79c
@Neves-P
Remove debug printing to log
afaa94f
@Neves-P
Improved logging when $EESSI_DEV_PROJECT is set
2c3e74e
@Neves-P
Fix tarball creations in dev.eessi.io
3d9424d
@Neves-P
Actually set install_prefix_dir
028f935
@Neves-P
Log EESSI_DEV_PROJECT and export it
4f06864
@Neves-P
Fix test checking for ${install_prefix_dir}
9eca5e4
@Neves-P
Look for installed software in the right directory
0e68f18
@Neves-P
Fix error reporting of input in create_tarball.sh
82d36c7
@Neves-P
Fix installpath to include cpu target
3248438
@Neves-P
Merge branch 'EESSI:2023.06-software.eessi.io' into feature/dev.eessi.io
d162ef3
@Neves-P
Track EASYBUILD_EXPERIMENTAL set
4db1083
@Neves-P
Fix typo in path
720d6e9
@Neves-P
Use $TOPDIR to load_eessi_extend_module.sh
e126f78
@Neves-P Neves-P mentioned this pull request Mar 3, 2025
Closed
Neves-P added 20 commits March 4, 2025 15:40
@Neves-P
Fix overlay_upper_dir in create_tarball
d6d2f1b
@Neves-P
Remove repeated project name
dbc0c82
@Neves-P
Fix comment
a0f2570
@Neves-P
Inspect script looks in project subdir
e481b17
@Neves-P
Remove project subdir before overaly-upper
f3a45f2
@Neves-P
Add missing /
76c19fc
@Neves-P
Correct cvmfs_repo_name in container script
dd52011
@Neves-P
Leave rest of cvmfs_repo_name untouched
ece8127 
Only remove EESSI_DEV_PROJECT
@Neves-P
EESSI_DEV_PROJECT comes after overlays
9d980f9
@Neves-P
Fix overlay paths in container
e98ce2b
@Neves-P
Print debug output
16c77b5
@Neves-P
Don't create child directory
38f129c
@Neves-P
Create child dir, more debug output
82d3828
@Neves-P
Print created overlay dir in container
013d942
@Neves-P
Create dir, but don´t add subdir to envvar
3758ecd
@Neves-P
No special handling of tarball path in check-build
38b6b07
@Neves-P
Cleanup
d0b5df6
@Neves-P
Handle .lmod files in dev.eessi.io builds
74ea9ec
@Neves-P
Handle LMOD_PACKAGE_PATH that was missing
8e3e010
@Neves-P
Format tarball name
4bb1559
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ocaisa ocaisa ocaisa requested changes

Requested changes must be addressed to merge this pull request.

Assignees
No one assigned
Labels
dev.eessi.io enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Neves-P @ocaisa