@dqwu , @rljacob , I have noticed that two SCREAM-specific arguments are being used in the Frontier machine configuration (SCREAM_SYSTEM_WORKAROUND, SCREAM_SYSTEM_WORKAROUND_P3_PART2). I am a little concerned that these SCREAM-specific arguments are being used in the machine file, which should be shared by all other models. Is there a way to specify the SCREAM-specific arguments within the EAMxx settings?

SCREAM_SYSTEM_WORKAROUND_P3_PART2

SCREAM_SYSTEM_WORKAROUND_P3_PART2 was added by @trey-ornl

@grnydawn They are temporary workarounds which might be removed/disabled later (e.g. with newer versions of Rocm).

SCREAM_SYSTEM_WORKAROUND_P3_PART2

SCREAM_SYSTEM_WORKAROUND_P3_PART2 was added by @trey-ornl

Those changes were recommended to me by @ambrad.
E3SM-Project/scream#2969 (comment)

Instead of keying off of macro names, like these, we could key off of the build environment for Kokkos.

#ifdef KOKKOS_ENABLE_HIP

What exactly is the workaround doing? Use that for the root of the name instead of "SCREAM".

What exactly is the workaround doing? Use that for the root of the name instead of "SCREAM".

It is suggested by OLCFDEV-1655

Workarounds:
Run hipInit(0); at any point prior to MPI_Init(&argc, &argv);. You may need to add #include <hip/hip_runtime_api.h>.

In driver-mct/main/cime_comp_mod.F90, this macro is required to enable this workaround:

if defined(SCREAM_SYSTEM_WORKAROUND) && (SCREAM_SYSTEM_WORKAROUND == 1)
    call atm_init_hip_mct()
#endif
    call mpi_init(ierr)

@rljacob FYI, this macro name was suggested by @ambrad in PR E3SM-Project/scream#2918

What do you think of adding a more generic flag that we can use in all future instances for this same purpose? I'm thinking something like SCREAM_SYSTEM_WORKAROUND. To make this approach maximally flexible (example in a moment), we'd want to permit setting integer values. Then any place in general E3SM code that requires a workaround would have something like

#if !defined SCREAM_SYSTEM_WORKAROUND || SCREAM_SYSTEM_WORKAROUND != 1
... this code should run in general ...
#endif

Once that flag is available, we would be able to use it as needed without messing with the build system again.

The purpose for the integer complication is as follows. In the future one can imagine needing separate workarounds for Aurora and Frontier. We might then say that Frontier is assigned 1 and Aurora is assigned 2.

We are trying to get rid of indiscriminate use of the word "SCREAM" so this would be better named "MPINIT_WORKAROUND"

We are trying to get rid of indiscriminate use of the word "SCREAM" so this would be better named "MPINIT_WORKAROUND"

What should be the new name for "SCREAM_SYSTEM_WORKAROUND_P3_PART2"?

I'd call that CLANGOPT_WORKAROUND.

Agreed. Don't worry about the old naming scheme. In retrospect, it wasn't a good system.

If there's a gh issue, I would recommend adding _ISSUE_XYZ in the macro name. It would greatly help users to quickly track its origin.

If no gh issue exist, I would create one, document as much as possible, then go back to my suggestion above.

Please don't put issue number in cpp names. In general, we don't want github things in the source code. Source code is forever while github could go away tomorrow if Microsoft wanted to.

I created PR #7082 to resolve this issue by applying the renaming suggestions. @dqwu, please check if this PR fixes the issue you encountered.