[zoom_enhance] worse results and performance since v8

[JDadders]

Since version 8 of Unprompted, I'm getting much worse results and performance with [zoom_enhance]. Performance has dropped from ~6.5 it/s to 1.0it/s during the face replacement phase and the colour matching seems completely broken with the face being a completely different tone to the rest of the image. Prior to this version, the face tone perfectly matched the body tone.

Just to confirm v8 seems to be the issue, I grabbed the March 25th version of the project it and used it to replaced v8 in my extensions folder. The issues went away and I got the old performance and quality back.

Hopefully these can be fixed in a future version of Unprompted :)

[ThereforeGames]

Hi @JDadders,

To reclaim some speed, you can disable the color correction step with color_correct_method="none". This feature was implemented mainly to improve the Bodysnatcher template. I'll consider disabling for standalone calls to [zoom_enhance] where it isn't super useful.

I don't know if that will improve your it/s during the upscale step, though. I wonder why that's slowed down so much for you. I haven't noticed a performance drop on my device.

In previous versions (< 8.0.0), [zoom_enhance] would call [img2img] for the upscale, but this was incompatible with extensions that hijack the inference pipeline - ControlNet in particular. Now it uses a monkeypatched process_images_inner() with a clone of the p object, which shouldn't be any slower unless maybe you're running into some memory limitations.

[JDadders]

@ThereforeGames Thanks for the reply!

The performance drop is very strange, as you say. I'm running an 8gb 2070 so it is possible I'm hitting a memory limit somewhere.

More worrying than the slow performance though is the lower quality results (the sudden mismatch between face and body tone) that wasn't there previously. Previously, the head and body matched perfectly and now the heads look distinctly "pasted on". If needed I can make some comparision images for you to show the difference.

Also I'd just like to say thank you for developing and maintaining Unprompted. It's an excellent tool and has become an essential part of my workflow (zoom enhance especially). It has made SD much more flexbile.