Skip to content

Commit 0eed9f5

Browse files
committed
feedback
1 parent 0af2b9b commit 0eed9f5

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

docs/source/en/training/distributed_inference.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -288,8 +288,10 @@ finally:
288288

289289
[`ContextParallelConfig`] supports Ulysses Attention through the `ulysses_degree` argument. This determines how many devices to use for Ulysses Attention.
290290

291+
Pass the [`ContextParallelConfig`] to [`~ModelMixin.enable_parallelism`].
292+
291293
```py
292-
pipeline.transformer.parallelize(config=ContextParallelConfig(ulysses_degree=2))
294+
pipeline.transformer.enable_parallelism(config=ContextParallelConfig(ulysses_degree=2))
293295
```
294296

295297
- Take a look at this [script](https://gist.github.com/sayakpaul/cfaebd221820d7b43fae638b4dfa01ba) for a minimal example of distributed inference with Accelerate.

0 commit comments

Comments
 (0)