Spack Working Group @ SDSC - Meeting - 2024/03/22

[mkandes]

Attendance

• Marty Kandes
• Mahidahr Tatineni
• Subhashini Sivagnanam
• Jerry Greenberg
• Nicole Wolter
• Yuwu Chen
• Fernando Garzon
• Trevor Cooper

Agenda

1. Announcements

• Latest Spack Release: v0.21.2 (2024/03/01)
• Next Meeting: April, 19th, 2024 @ 1PM PT / 4PM ET
• Tutorial: Setting up your personal fork

2. General Discussion and/or Updates

3. Open Issues

• TSCC2: TSC-322

4. Upgrade of Production Instances on Expanse

• 2024/03/29: Create development spack instance(s) based on a subset of the current production instances: expanse/0.17.3/cpu/b and expanse/0.17.3/gpu/b
• 2024/04/05: Create a new deployment branch for spack-0.21.2 and then roll forward development spack instance(s) from spack-0.17.3 to spack-0.21.2
• 2024/06/14: Roll forward full production spack instance(s) for Expanse on spack-0.21.2 deployment branch
• 2024/07/05: Retire original production spack instances: expanse/0.15.4/cpu and expanse/0.15.4/gpu
• 2024/07/12: Deploy new production instances expanse/0.21.2/cpu and expanse/0.21.2/gpu

5. Tutorial: Setting up your personal fork

Before you can start helping make changes to the production Spack instances deployed from the sdsc/spack repository, you must have a fork of the project in your personal GitHub account. To create a fork:

1. Login to your GitHub account at https://github.com/login.
2. Once logged in, navigate to the repository at https://github.com/sdsc/spack.
3. Find the Fork button in the upper-right hand corner on the page and then click it to Create a new fork.
4. Before the fork is created, you will be asked to confirm the GitHub user or organization that should be the Owner of the fork, the Repository name and, optionally, its Description. Please leave the default values unchanged, unless your personal GitHub account is not the default Owner of the fork. If you are not the default Owner for some reason, please make this correction.
5. Before you proceed, check the Copy the sdsc-X.YY.Z branch only option. This will create your initial fork with a copy of the latest default deployment branch in use.
6. Finally, click the Create fork button in the bottom-right hand side of the page.

For additional details, you may refer to the GitHub documentation about how to Fork a repository.

To complete the initial configuration of your personal fork, you will also need to obtain a copy of the latest develop branch from the main spack/spack GitHub repository.

1. Clone a copy of your fork to any system.

   Command:

   git clone https://github.com/username/spack.git
   

   Output:

   $ git clone https://github.com/username/spack.git
   Cloning into 'spack'...
   remote: Enumerating objects: 318292, done.
   remote: Total 318292 (delta 0), reused 0 (delta 0), pack-reused 318292
   Receiving objects: 100% (318292/318292), 152.41 MiB | 42.62 MiB/s, done.
   Resolving deltas: 100% (154549/154549), done.
   Updating files: 100% (12424/12424), done.
   

2. Change your directory to the local cloned fork.

   Command:

   cd spack
   

3. Check the configruation of the fork's remotes.

   Command:

   git remote -v
   

   Output:

   $ git remote -v
   origin	    https://github.com/mkandes/spack.git (fetch)
   origin	    https://github.com/mkandes/spack.git (push)
   

4. Add the sdsc/spack repository as your fork's upstream remote, and then check the remote configuration again.

   Command:

   git remote add upstream https://github.com/sdsc/spack.git
   

   Output:

   $ git remote add upstream https://github.com/sdsc/spack.git
   $ git remote -v
   origin	    https://github.com/mkandes/spack.git (fetch)
   origin	    https://github.com/mkandes/spack.git (push)
   upstream	    https://github.com/sdsc/spack.git (fetch)
   upstream	    https://github.com/sdsc/spack.git (push)
   

5. Next, add the main spack/spack repository as a secondary upstream remote called develop, and then check the remote configuration again.

   Command:

   git remote add develop https://github.com/spack/spack.git
   

   Output:

   $ git remote add develop https://github.com/spack/spack.git
   $ git remote -v
   develop	https://github.com/spack/spack.git (fetch)
   develop	https://github.com/spack/spack.git (push)
   origin	    https://github.com/mkandes/spack.git (fetch)
   origin	    https://github.com/mkandes/spack.git (push)
   upstream	    https://github.com/sdsc/spack.git (fetch)
   upstream	    https://github.com/sdsc/spack.git (push)
   

6. Fetch the develop branch from spack/spack.

   Command:

   git fetch --tags develop develop
   

   Output:

   $ git fetch --tags develop develop
   remote: Enumerating objects: 245539, done.
   remote: Counting objects: 100% (46376/46376), done.
   remote: Compressing objects: 100% (208/208), done.
   remote: Total 245539 (delta 46046), reused 46322 (delta 46038), pack-reused 199163
   Receiving objects: 100% (245539/245539), 90.34 MiB | 52.41 MiB/s, done.
   Resolving deltas: 100% (106389/106389), completed with 8910 local objects.
   From https://github.com/spack/spack
    * branch                  develop            -> FETCH_HEAD
    * [new tag]               2021.08.19         -> 2021.08.19
    * [new tag]               NCSA-v1            -> NCSA-v1
    * [new tag]               NCSA-v2            -> NCSA-v2
    * [new tag]               develop-2023-05-14 -> develop-2023-05-14
    * [new tag]               develop-2023-05-18 -> develop-2023-05-18
    * [new tag]               develop-2023-05-21 -> develop-2023-05-21
    * [new tag]               develop-2023-06-04 -> develop-2023-06-04
    * [new tag]               develop-2023-06-11 -> develop-2023-06-11
    * [new tag]               develop-2023-06-25 -> develop-2023-06-25
    * [new tag]               develop-2023-07-02 -> develop-2023-07-02
    * [new tag]               develop-2023-07-09 -> develop-2023-07-09
    * [new tag]               develop-2023-07-23 -> develop-2023-07-23
    * [new tag]               develop-2023-07-30 -> develop-2023-07-30
    * [new tag]               develop-2023-08-06 -> develop-2023-08-06
    * [new tag]               develop-2023-08-13 -> develop-2023-08-13
    * [new tag]               develop-2023-08-20 -> develop-2023-08-20
    * [new tag]               develop-2023-08-27 -> develop-2023-08-27
    * [new tag]               develop-2023-09-03 -> develop-2023-09-03
    * [new tag]               develop-2023-09-10 -> develop-2023-09-10
    * [new tag]               develop-2023-09-17 -> develop-2023-09-17
    * [new tag]               develop-2023-09-24 -> develop-2023-09-24
    * [new tag]               develop-2023-10-01 -> develop-2023-10-01
    * [new tag]               develop-2023-10-08 -> develop-2023-10-08
    * [new tag]               develop-2023-10-15 -> develop-2023-10-15
    * [new tag]               develop-2023-10-22 -> develop-2023-10-22
    * [new tag]               develop-2023-10-29 -> develop-2023-10-29
    * [new tag]               develop-2023-11-05 -> develop-2023-11-05
    * [new tag]               develop-2023-11-12 -> develop-2023-11-12
    * [new tag]               develop-2023-11-19 -> develop-2023-11-19
    * [new tag]               develop-2023-11-26 -> develop-2023-11-26
    * [new tag]               develop-2023-12-03 -> develop-2023-12-03
    * [new tag]               develop-2023-12-10 -> develop-2023-12-10
    * [new tag]               develop-2023-12-17 -> develop-2023-12-17
    * [new tag]               develop-2023-12-24 -> develop-2023-12-24
    * [new tag]               develop-2023-12-31 -> develop-2023-12-31
    * [new tag]               develop-2024-01-07 -> develop-2024-01-07
    * [new tag]               develop-2024-01-14 -> develop-2024-01-14
    * [new tag]               develop-2024-01-21 -> develop-2024-01-21
    * [new tag]               develop-2024-01-28 -> develop-2024-01-28
    * [new tag]               develop-2024-02-04 -> develop-2024-02-04
    * [new tag]               develop-2024-02-11 -> develop-2024-02-11
    * [new tag]               develop-2024-02-18 -> develop-2024-02-18
    * [new tag]               develop-2024-02-25 -> develop-2024-02-25
    * [new tag]               develop-2024-03-03 -> develop-2024-03-03
    * [new tag]               develop-2024-03-10 -> develop-2024-03-10
    * [new tag]               develop-2024-03-17 -> develop-2024-03-17
    * [new tag]               e4s-21.02          -> e4s-21.02
    * [new tag]               e4s-21.05          -> e4s-21.05
    * [new tag]               efischer/docs-v1   -> efischer/docs-v1
    * [new tag]               llnl-tce-craype    -> llnl-tce-craype
    * [new tag]               old-install-layout -> old-install-layout
    * [new tag]               releases/latest    -> releases/latest
    * [new tag]               v0.10.0            -> v0.10.0
    * [new tag]               v0.11.0            -> v0.11.0
    * [new tag]               v0.11.1            -> v0.11.1
    * [new tag]               v0.11.2            -> v0.11.2
    * [new tag]               v0.12.0            -> v0.12.0
    * [new tag]               v0.12.1            -> v0.12.1
    * [new tag]               v0.13.0            -> v0.13.0
    * [new tag]               v0.13.1            -> v0.13.1
    * [new tag]               v0.13.2            -> v0.13.2
    * [new tag]               v0.13.3            -> v0.13.3
    * [new tag]               v0.13.4            -> v0.13.4
    * [new tag]               v0.13.4-shared     -> v0.13.4-shared
    * [new tag]               v0.14.0            -> v0.14.0
    * [new tag]               v0.14.1            -> v0.14.1
    * [new tag]               v0.14.2            -> v0.14.2
    * [new tag]               v0.14.2-shared     -> v0.14.2-shared
    * [new tag]               v0.15.0            -> v0.15.0
    * [new tag]               v0.15.0-shared     -> v0.15.0-shared
    * [new tag]               v0.15.1            -> v0.15.1
    * [new tag]               v0.15.1-shared     -> v0.15.1-shared
    * [new tag]               v0.15.2            -> v0.15.2
    * [new tag]               v0.15.3            -> v0.15.3
    * [new tag]               v0.15.3-shared     -> v0.15.3-shared
    * [new tag]               v0.15.4            -> v0.15.4
    * [new tag]               v0.16.0            -> v0.16.0
    * [new tag]               v0.16.1            -> v0.16.1
    * [new tag]               v0.16.2            -> v0.16.2
    * [new tag]               v0.16.3            -> v0.16.3
    * [new tag]               v0.17.0            -> v0.17.0
    * [new tag]               v0.17.1            -> v0.17.1
    * [new tag]               v0.17.2            -> v0.17.2
    * [new tag]               v0.17.2.0-emcc     -> v0.17.2.0-emcc
    * [new tag]               v0.17.2.1-emcc     -> v0.17.2.1-emcc
    * [new tag]               v0.17.2.2-emcc     -> v0.17.2.2-emcc
    * [new tag]               v0.17.2.3-emcc     -> v0.17.2.3-emcc
    * [new tag]               v0.17.3            -> v0.17.3
    * [new tag]               v0.18.0            -> v0.18.0
    * [new tag]               v0.18.1            -> v0.18.1
    * [new tag]               v0.19.0            -> v0.19.0
    * [new tag]               v0.19.1            -> v0.19.1
    * [new tag]               v0.19.2            -> v0.19.2
    * [new tag]               v0.20.0            -> v0.20.0
    * [new tag]               v0.20.1            -> v0.20.1
    * [new tag]               v0.20.2            -> v0.20.2
    * [new tag]               v0.20.3            -> v0.20.3
    * [new tag]               v0.21.0            -> v0.21.0
    * [new tag]               v0.21.1            -> v0.21.1
    * [new tag]               v0.21.2            -> v0.21.2
    * [new tag]               v0.8               -> v0.8
    * [new tag]               v0.8.10            -> v0.8.10
    * [new tag]               v0.8.11            -> v0.8.11
    * [new tag]               v0.8.15            -> v0.8.15
    * [new tag]               v0.8.16            -> v0.8.16
    * [new tag]               v0.8.17            -> v0.8.17
    * [new tag]               v0.8.5             -> v0.8.5
    * [new tag]               v0.9               -> v0.9
    * [new tag]               v0.9.1             -> v0.9.1
    * [new tag]               windows-latest     -> windows-latest
    * [new branch]            develop            -> develop/develop
   

7. Create your copy of the develop branch, and check that you now have both a develop branch and the latest default sdsc-X.YY.Z deployment branch within the local clone.

   Command:

   git branch develop FETCH_HEAD
   

   Output:

   $ git branch
   * sdsc-0.17.3
   $ git branch develop FETCH_HEAD
   $ git branch
     develop
   * sdsc-0.17.3
   

8. Checkout the new develop branch.

   Command:

   git checkout develop
   

   Output:

   $ git checkout develop
   Switched to branch 'develop'
   $ git branch
   * develop
     sdsc-0.17.3
   

9. Set the upstream to the new develop branch to origin, and then push the branch back to your personal fork on GitHub.

   Command(s):

   git push --set-upstream origin develop
   

   git push --tags
   

   Output:

References:

[mkandes]

@mkandes - Send @jerrypgreenberg reminder about using v0.21.2 as next target for production instances.

[mkandes]

@mkandes - Follow-up with Todd about creating Spack role accounts and user group on TSCC2