Skip to content

Commit 6c5284c

Browse files
gblong1frenchwrRyanMetcalfeInt8
authored
Adding support for GIMP 3.0 (#159)
* Set config and model paths dynamically from environment vars Signed-off-by: Will French <[email protected]> * Centralizing ENV VARs into tools_utils. * Fixing default path. * fixing test for python executable logic * Adding threading to SR to avoid not responding messages. * removing debug statement * Improvements to ease packaging work on Linux (#156) * Allow model_setup to be run from any directory * Store plugin scripts with executable permissions * Remove typing as it ships with stdlib since python 3.5 * Install plugin files with executable permissions preserved * Revert data_files addition to avoid complexity * Install plugins from source repo instead of venv * Revert permissions changes to test failure inside snap * Initial update of SR to GIMP 3.0. * Updating Save Image to work with GIMP 3.0 * Removing unneeded comments. * Initial update of Segmentation to GIMP 3.0 * Removing uneeded files. * Updating install path * Moving to latest OpenVINO - 2024.6.0 * removing unneeded log.info calls. * Updating proc id for GIMP 3.0 * Updating plugin version number * Initial update of SD to GIMP 3.0 * Updating option caching in SD. * removed files that are no longer used. * Implemented SDOptionCache to address issues with options being saved run-to-run. * Removed debug prints, unneeded syspath extention * remove commented syspath line * Adding version support for plugins. * updated install flow. removed need to call complete_install separately. * Hiding console for SR and SS. SD is still WIP * removed .json config, as it should be created from scratch everytime. * restored alignment of OV logo. * Updated NPU Arch logic to support next gen NPUs * Updated NPU Arch logic to support next gen NPUs * update ARCH_NEXT and tweak logic * Fixed NPU Arch logic to work correctly. * Add check for dNPU to avoid NPU turbo enabling exception for those devices * workaround for 3700 series being reported incorrectly in OV2024.5+ * restore running complete_install post setup * update tools_utils import * subprocess call is diff for Linux vs Windows * Removing import of install_utils. It relies on importing openvino, which was causing issues in Linux for some reason. For now, we are have the get_plugin_version code duplicated here. Need to find a way to remove it in the future. * Longer timeout needed for some systems. * Updating title bar to show just the plugin version. * updating process name to work with Linux * Adding linux support for BIOS discovery * Really fixing issue #158 this time. * Updating linux build docs * fixing issue with ENV var installation and commandline model installs. * Updating download links for GIMP3 RC2 * Updating figure for GIMP3 RC2 * Updating setup complete figure for GIMP3 RC2 * Updates for Docs and Figures for GIMP 3.0 --------- Signed-off-by: Garth Long <[email protected]> Signed-off-by: Will French <[email protected]> Co-authored-by: Will French <[email protected]> Co-authored-by: Ryan Metcalfe <[email protected]>
1 parent e7395e3 commit 6c5284c

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

50 files changed

+1045
-1313
lines changed

Docs/GIMP_StableDiffusion_Usage.md

Lines changed: 65 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,65 @@
1+
2+
3+
# Using Stable Diffusion in GIMP
4+
5+
After installing GIMP and the GIMP AI plugins with OpenVINO™, you can now start GIMP application from Start Menu on Windows, or from the Application Launcher in Ubuntu.
6+
7+
>Notes: This section runs `SD-1.5 Square (512x512)` as an example.
8+
9+
## Download & Install Stable Diffusion Models
10+
- Once GIMP application is started, Click "__Layer__" \> "__OpenVINO-AI-Plugins__" \> "__Stable diffusion__".
11+
- Once Stable Diffusion Plugin UI opens up, click on Model Button on the top left corner as show in the below picture:
12+
13+
![](figs/stable-diffusion_model1.png)
14+
- This now opens the Stable Diffusion Model Management window from where you can install the required models by clicking on "Install" button next to the model name.
15+
16+
![](figs/stable-diffusion_model2.png)
17+
18+
- Download Stable Diffusion 1.5 Square as an instance.
19+
20+
![](figs/stable-diffusion_model3.png)
21+
22+
- You can select multiple models at once, and the Model Manager will queue them for installation.
23+
24+
![](figs/stable-diffusion_model3_1.png)
25+
26+
- Once installation process is completed, you will see the "Install" button is updated to "Installed" and you will find the models in the drop-down list
27+
28+
![](figs/stable-diffusion_model4.png)
29+
30+
>**Notes:**
31+
> - The downloaded models include INT8, INT8A16, and FP16 precision
32+
> - Weights is saved at `C:\Users\<user_name>\openvino-ai-plugins-gimp\weights`.
33+
34+
35+
36+
## Execute Stable-Diffusion – Stable Diffusion 1.5 INT8A16
37+
38+
Please follow below steps to execute Stable-Diffusion - Stable Diffusion 1.5 INT8A16. For other features, please refer to [OpenVINO™ Image Generator Plugin with Stable Diffusion](https://github.com/intel/openvino-ai-plugins-gimp/tree/main?tab=readme-ov-file#openvino-image-generator-plugin-with-stable-diffusion) section.
39+
40+
- Following previous section to launch GIMP
41+
42+
![](figs/gimp_launch.png)
43+
44+
- Click "__Layer__" \> "__OpenVINO-AI-Plugins__" \> "__Stable diffusion__".
45+
46+
![](figs/gimp_execute_SD.png)
47+
48+
- Change the selected fields to set "Stable Diffusion" configuration and choose the desired "Power Mode" you want, then click "Load Models" to the load models into the target devices based on your power mode selection.
49+
50+
![](figs/gimp_load_model.png)
51+
52+
> **Notes:** It takes time in this step.
53+
54+
- Finally, you can optionally enter any text or changes the parameters in the selected field, then click "Generate" to generate image.
55+
56+
![](figs/gimp_sd_ui.png)
57+
58+
>**Notes:**
59+
> - Only Intel® devices are supported (CPU, NPU, integraged GPU, Intel® discrete GPUs)
60+
> - Power Mode is now enabled- Users can select between the following options depending on their use case:
61+
> - Best Performance
62+
> - Best Power Efficiency
63+
> - Balanced
64+
> - If you wish to generate more images in single run, please modify the Number of Images section.
65+

Docs/figs/gimp_execute_SD.png

82 KB
Loading
72.5 KB
Loading
69 KB
Loading

Docs/figs/gimp_launch.png

-74.9 KB
Loading

Docs/figs/gimp_load_model.png

208 Bytes
Loading

Docs/figs/gimp_sd_ui.png

2.86 KB
Loading

Docs/figs/stable-diffusion_3.png

39.9 KB
Loading
4.81 KB
Loading
7.84 KB
Loading

0 commit comments

Comments
 (0)