使用配置文件运行时,如何指定并发任务量? #1889
Answered
by
tonysy
qing-yuan233
asked this question in
Q&A
使用配置文件运行时,如何指定并发任务量?
#1889
Replies: 1 comment
-
|
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
qing-yuan233
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
例如,我本机有8张卡,在使用命令行进行启动时,可以通过设置
--hf-num-gpus 2
--max-num-workers 4
表示,每张模型使用两张卡加载,一共开4个任务/进程。
然而,我在使用配置文件时:
from opencompass.models import HuggingFaceCausalLM
models = [
dict(
...
run_cfg=dict(num_gpus=2, num_procs=4),
...
)
]
并不能生效。我应该如何设置?
Beta Was this translation helpful? Give feedback.
All reactions