Skip to content

Commit 4c0181c

Browse files
committed
add offload-grads test
1 parent 2623986 commit 4c0181c

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/binding/python/tests/recompute.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,7 @@ def disable_recompute(config: TrainingConfig):
3434
baseline_config.offload_quants = False
3535
baseline_config.offload_opt_v = False
3636
baseline_config.offload_opt_m = False
37+
baseline_config.offload_grads = False
3738
baseline_config.attn_bwd_chunks = 1
3839
baseline_config.memcpy_all_gather = False
3940
baseline_config.shard_weights = False

0 commit comments

Comments
 (0)