How to apply ip adapter only to the style block for flux-dev?

[pin-lpt-heatherwick]

In the ip adapter doc, the code below is used to apply the ip adapter only to the style block.

# To use style block only
scale = {
    "up": {"block_0": [0.0, 1.0, 0.0]},
}
pipeline.set_ip_adapter_scale(scale)

I assume that is for SDXL. I'm wondering if it is possible to apply the same technique to flux-dev.

[asomoza]

Hi, actually it's unknown if it's possible to achieve the same with DiT models, those blocks are for just the SDXL models, personally I did some quick tests and couldn't find the same kind of functionality with Flux or SD3.5