Increase flexibility for multi-model ensembles, add REFS config file - #38

Draft

mkavulich wants to merge 43 commits into

feature/increase_flexibility

Commits on Jul 17, 2026

Convert remaining bash ex-scripts to Python

mkavulich
and
claude
committed
b4b2764
Suppress broken pipe error from conda env list in setup_conda.sh

mkavulich
and
claude
committed
9e84507
- Update CHECK_POST_OUTPUT.sh to call new python script. For now this requires a string-subst dictionary
mkavulich
committed
b9a1112
Converting jobs/GENENSPROD_OR_ENSEMBLESTAT.sh to use new python script; almost working
mkavulich
committed
110875c
Found error: set_vx_params.py was not consistent with set_vx_params.sh for ACCUM_HH definitions
mkavulich
committed
0d1082d
Update PCPCOMBINE.sh to use pcpcombine.py. Some PCP combine tasks have an ensemble member index and some don't,
mkavulich
committed
363e15f
All run scripts pythonized!
mkavulich
committed
75d66cc
Update new genensprod_or_ensemblestat.py for parallel task submission
mkavulich
committed
1067176
Add gridstat: and pointstat: config sections, give them each an execution: section with tasks_per_node, walltime, and memory, as well as a TASKS: variable. Update some WE2E tests to use more parall…
mkavulich
committed
57283a6
For tools that use a staging directory, need a different one for each parallel task
mkavulich
committed
18aa8d9
Add genensprod: and ensemblestat: config sections, give them each an execution: section with tasks_per_node, walltime, and memory, as well as a TASKS: variable, and apply memory and task settings t…
mkavulich
committed
b7477d0
Only check for obs_dir for ensemblestat
mkavulich
committed
2d74ee9
Ensure that numprocs is always an integer
mkavulich
committed
ddf8f8b
Remove unused/deprecated shell scripts
mkavulich
committed
6314e52
Deprecate and remove "echo_lowercase" and "echo_uppercase" bash functions
mkavulich
committed
7746d97
Deprecate and remove print_info_msg() bash function per Issue #15, replace with printf
mkavulich
committed
562d342
Deprecate and remove more unneeded bash functions: check_for_preexist_dir_file(), check_var_valid_value(), get_elem_inds(), is_element_of(), print_input_args(), and process_args()
mkavulich
committed
cf20e25
Remove the remaining unused bash functions: is_array() and create_symlink_to_file()
mkavulich
committed
0654972
Add explicit !int tags for all TASKS: entry in config_defaults.yaml
mkavulich
committed
84e9e20
Make sure one more TASKS entry is an int
mkavulich
committed
8be5b48
More processors!
mkavulich
committed
99175bc
Add checks for renamed/moved config sections in setup.py
mkavulich
committed
87613b5
Missed moving gridstat/pointstat settings to new section for MODE_AOD test
mkavulich
committed
f5cffd2
Fix linting issues with ush/setup.py
mkavulich
committed
6ef4227
Fix rest of the linting
mkavulich
committed
2b426c9

Commits on Jul 19, 2026

Commits on Jul 20, 2026

Remove trailing spaces from config files
mkavulich
committed
2ffee40
Update setup.py to check for all recently deprecated config settings
mkavulich
committed
bfdc27d
Make pylint happy
mkavulich
committed
8273a63