Skip to content

Commit cee6563

Browse files
committed
✅ Review Round 13: Fix NetCDF write and directory branding
CMIP7 naming now fully functional! Changes: 1. Fixed directory branding_suffix lookup (prioritize rule config) 2. Added NetCDF4 compression constants (NETCDF_COMPRESSION_LEVEL=4) 3. Temporarily exclude lat_bnds/lon_bnds to avoid NetCDF write error - Large unstructured grids (3M+ cells × 16 vertices) cause issues - Workaround: Skip boundary variables until NetCDF4 fix available - Coordinates (lat, lon) still included correctly 4. Updated .gitignore to exclude logs, cache, and output files Results: ✅ Filename: tos_tavg-u-hxy-sea_mon_glb_gn_AWI-ESM3-VEG-LR_piControl_r1i1p1f1_135001-135012.nc ✅ Directory: MIP-DRS7/CMIP7/CMIP/AWI/.../glb/mon/tos/tavg-u-hxy-sea/gn/v*/ ✅ Compression: zlib level 4 with shuffle ✅ File size: ~49 MB gn (was 937 MB), ~22 MB gr ✅ Data written: time=12 timesteps Note: Boundary variables excluded as temporary workaround for NetCDF write bug with large multi-dimensional arrays on unstructured grids.
1 parent a5c24b6 commit cee6563

21 files changed

+4524
-37
lines changed
Binary file not shown.
7.93 MB
Binary file not shown.

cmorize_sst.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ rules:
4646
cmor_variable: tos
4747
model_variable: sst
4848
table_id: Omon
49-
output_directory: ./cmorized_output
49+
output_directory: /work/ab0246/a270092/postprocessing/cmorize
5050
variant_label: r1i1p1f1
5151
experiment_id: piControl
5252
source_id: AWI-ESM3-VEG-LR
@@ -64,12 +64,12 @@ rules:
6464
- path: /work/bb1469/a270092/runtime/awiesm3-v3.4.1/human_tuning/outdata/fesom
6565
pattern: sst\.fesom\.1350\.nc
6666

67-
# - name: sst_tos_gr
67+
- name: sst_tos_gr
6868
description: "Cmorize FESOM SST to CMIP7 tos on 0.25° regular grid"
6969
cmor_variable: tos
7070
model_variable: sst
7171
table_id: Omon
72-
output_directory: ./cmorized_output
72+
output_directory: /work/ab0246/a270092/postprocessing/cmorize
7373
variant_label: r1i1p1f1
7474
experiment_id: piControl
7575
source_id: AWI-ESM3-VEG-LR

pycmor_clean.log

Lines changed: 384 additions & 0 deletions
Large diffs are not rendered by default.

pycmor_final.log

Lines changed: 561 additions & 0 deletions
Large diffs are not rendered by default.

pycmor_final_clean.log

Lines changed: 384 additions & 0 deletions
Large diffs are not rendered by default.

pycmor_fixed.log

Lines changed: 195 additions & 0 deletions
Large diffs are not rendered by default.

pycmor_fixed2.log

Lines changed: 195 additions & 0 deletions
Large diffs are not rendered by default.

pycmor_gn_only.log

Lines changed: 324 additions & 0 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)