Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] compile_pipe使用-第一次warmup完(也就是静态图编译完),controlnet的参数controlnet_conditioning_scale会固定住? #1101

Open
cchen-reese opened this issue Sep 2, 2024 · 0 comments
Labels
Request-bug Something isn't working

Comments

@cchen-reese
Copy link

cchen-reese commented Sep 2, 2024

Your current environment information

PyTorch version: 2.3.1+cu118
Is debug build: False
CUDA used to build PyTorch: 11.8
ROCM used to build PyTorch: N/A

OneFlow version: version: 0.9.1.dev20240515+cu118, git_commit: ec7b682, cmake_build_type: Release, rdma: True, mlir: True, enterprise: False
Nexfort version: none
OneDiff version: 1.2.0.dev1
OneDiffX version: 1.1.0

Versions of relevant libraries:
[pip3] diffusers==0.29.2
[pip3] numpy==1.24.4
[pip3] open_clip_torch==2.7.0
[pip3] pytorch-lightning==2.3.0
[pip3] torch==2.3.1+cu118
[pip3] torchaudio==2.3.0+cu118
[pip3] torchmetrics==1.4.0.post0
[pip3] torchvision==0.18.0+cu118
[pip3] transformers==4.41.2
[pip3] triton==2.3.1
[conda] numpy 1.24.4
[conda] open_clip_torch 2.7.0
[conda] pytorch-lightning 2.3.0
[conda] torch 2.3.1+cu118
[conda] torchaudio 2.3.0+cu118
[conda] torchmetrics 1.4.0.post0
[conda] torchvision 0.18.0+cu118
[conda] triton 2.3.1

🐛 Describe the bug

from onediffx import compile_pipe
from diffusers import StableDiffusionControlNetPipeline

  1. 一开始将StableDiffusionControlNetPipeline load完毕,并且new_pipe=compile_pipe(pipe)
  2. 第一次Inference时,为warm up阶段,此时controlnet的参数controlnet_conditioning_scale是(0.5, 0.5)
  3. 接下来的多次inference,controlnet的参数都是不一样的。但是观察返回结果,实际的参数并没有改变,依旧是(0.5, 0.5)。

请问oneflow的编译静态图,会将controlnet的参数controlnet_conditioning_scale编译进去吗,后面的多次Inference,是否支持更换参数呢?

@cchen-reese cchen-reese added the Request-bug Something isn't working label Sep 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Request-bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant