OpenVINO backend: add Windows support by avbelova · Pull Request #24670 · pytorch/executorch

avbelova · 2026-11-05T15:58:08Z

Summary

Add an ability and instructions to build executorch with OpenVINO backend on Windows - both cpp and python wheel. Enabled Yolo2.6, Llama3.2, Qwen2.5 and Stable Diffusion models on Windows.

Test plan

Tested manually following the instructions at backends/openvino/README.md, examples/models/yolo26/README.md, examples/openvino/llama/README.md, examples/openvino/qwen2_5/README.md and examples/openvino/stable_diffusion/README.md

cc @nil-is-all

pytorch-bot · 2026-11-05T15:58:12Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24670

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

⚠️ 27 Awaiting Approval

As of commit e12c0cd with merge base 20f7ac9 ():

AWAITING APPROVAL - The following workflows need approval before CI can run:

Build Aarch64 Linux CUDA Wheels (gh)
Build Aarch64 Linux Native Wheels (gh)
Build Aarch64 Linux Wheels (gh)
Build documentation (gh)
Build Linux CUDA Wheels (gh)
Build Linux Native Wheels (gh)
Build Linux Wheels (gh)
Build macOS Wheels (gh)
Build Presets (gh)
Build Windows CUDA Wheels (gh)
Build Windows Wheels (gh)
Cadence Build & Test (gh)
Core AI (gh)
Lint (gh)
periodic (gh)
pull (gh)
Test ARM Backend (gh)
Test CoreML Backend (gh)
Test Cortex-M Backend (gh)
Test CPU Backend (gh)
Test NXP Backend (gh)
Test QNN Backend (gh)
Test QNN Windows MSVC build (gh)
Test Vulkan Backend (gh)
Test Vulkan Backend (specialized runners) (gh)
Test WebGPU Backend (gh)
Test XNNPACK Backend (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

meta-cla · 2026-11-05T15:58:15Z

Hi @avbelova!

Thank you for your pull request and welcome to our community.

Action Required

In order to merge any pull request (code, docs, etc.), we require contributors to sign our Contributor License Agreement, and we don't seem to have one on file for you.

Process

In order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with CLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us at cla@meta.com. Thanks!

linux-foundation-easycla · 2026-11-05T15:58:17Z

✅ login: Copilot / name: Copilot Autofix powered by AI (c445206)
✅ login: suryasidd / name: Surya Siddharth Pemmaraju (e12c0cd)
❌ - login: @avbelova / name: Anna. The commit (6b34264, 84df304, a5cbaef, b05da38) is not authorized under a signed CLA. Please click here to be authorized. For further assistance with EasyCLA, please visit our EasyCLA portal and chat with our support bot.
❌ - login: @avbelova / name: Anna Gubenkova. The commit (11be67d, 9363811, c445206, db8e8cd) is not authorized under a signed CLA. Please click here to be authorized. For further assistance with EasyCLA, please visit our EasyCLA portal and chat with our support bot.

Copilot

🟡 Changes recommended

Unresolved errors and omissions in the Windows instructions—including model paths, PowerShell downloads, OpenVINO discovery, and toolchain prerequisites—can block the documented builds and inference runs.

6 open issues

What changed in this PR

This PR adds Windows build and usage instructions for ExecuTorch’s OpenVINO backend, alongside targeted packaging and runtime changes.

Changes:

Documents PowerShell setup, Python package builds, and C++ runtime builds.
Adds Windows commands for Llama, Qwen2.5, and YOLO26 examples.
Updates read-only cache cleanup, Windows runner library selection, and execution-handle state.

File	Description
`setup.py`	Retries cache removal after clearing read-only permissions.
`examples/openvino/qwen2_5/README.md`	Adds Windows export, build, and inference commands.
`examples/openvino/llama/README.md`	Adds Windows instructions and updates tokenizer guidance.
`examples/models/yolo26/README.md`	Documents Windows demo build and execution commands.
`examples/models/llama/runner/CMakeLists.txt`	Applies static-library selection to all Windows toolchains.
`backends/openvino/runtime/OpenvinoBackend.h`	Adds an OpenVINO core pointer to execution handles.
`backends/openvino/README.md`	Separates Linux and Windows setup and build flows.

_{Review effort: Balanced}

+- Pip package:
+
+  ```powershell
+  python -m pip install openvino


+
+    ```powershell
+    cd $HOME\Downloads
+    curl -L https://storage.openvinotoolkit.org/repositories/openvino/packages/2026.2.1/windows/openvino_toolkit_windows_2026.2.1.21919.ede283a88e3_x86_64.zip --output openvino_2026.2.1.zip


+
+For additional source build details, refer to the [OpenVINO Build Instructions](https://github.com/openvinotoolkit/openvino/blob/master/docs/dev/build_windows.md).
+
+#### Build Commands (Windows)


+
+#### Windows (PowerShell):
+```powershell
+<executorch_root>\cmake-out\examples\models\llama\Release\llama_main.exe --model_path="llama3_2_ov.pte" --tokenizer_path="C:\path\to\model\tokenizer.json" --prompt="Your custom prompt" --max_new_tokens=128


+
+```powershell
+.\cmake-out\examples\models\llama\Release\llama_main.exe `
+  --model_path=<executorch_root>\examples\openvino\qwen2_5\qwen2_5_1_5b_ov.pte `


…chain versions and Clang tools' Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

meta-cla · 2026-11-09T17:43:29Z

Hi @avbelova!

Thank you for your pull request and welcome to our community.

Action Required

In order to merge any pull request (code, docs, etc.), we require contributors to sign our Contributor License Agreement, and we don't seem to have one on file for you.

Process

In order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with CLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us at cla@meta.com. Thanks!

Copilot

🔵 Needs a closer look

The documented setup and inference flows still fail due to PowerShell-incompatible curl usage, missing CMake discovery for pip installs, and incorrect OpenVINO and model paths.

5 open issues

1 previously missed issue

In code that hasn't changed since last review

Use the OpenVINO directory version installed by the instructions

examples/openvino/llama/README.md:15

The linked Windows archive instructions install OpenVINO into openvino_2026.2.1, not openvino_2026.2.0. Following those instructions leaves this script path nonexistent. Use the same versioned directory here so environment initialization succeeds.

1 resolved since last review

Specify required Windows toolchain versions and Clang tools

_{Review effort: Balanced}

Copilot

🟡 Changes recommended

The Windows instructions omit required OpenVINO discovery settings, mark required Clang tools as optional, and use incorrect model paths and a PowerShell-incompatible download command, causing setup and inference failures.

7 open issues

_{Review effort: Balanced}

+#### Windows Prerequisites
+
+1. Windows 10 or 11 (x64)
+2. Visual Studio 2022 with Desktop development with C++ and the optional C++ Clang tools for Windows


+- Pip package:
+
+  ```powershell
+  python -m pip install openvino


avbelova added 7 commits November 5, 2026 15:55

Add yolo26 example instructions for Windows

6b34264

Fix llama_runner build on Windows

84df304

Add Windows build instructions to README

11be67d

Add llama instructions for Windows to README

9363811

Update README.md

db8e8cd

docs(openvino): add Windows instructions for Qwen2.5 README

b05da38

Enable Stable Diffusion on Windows with OpenVINO backend

a5cbaef

avbelova requested a review from larryliu0820 as a code owner November 5, 2026 15:58

Copilot AI balanced review requested due to automatic review settings November 5, 2026 15:58

Copilot started reviewing on behalf of avbelova November 5, 2026 15:58

View session

Copilot AI reviewed Nov 5, 2026

View reviewed changes

executorch-triage Bot added the community: contribution PRs coming from community (excluding hardware partners) label Nov 5, 2026

Potential fix for pull request finding 'Specify required Windows tool…

c445206

…chain versions and Clang tools' Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot AI balanced review requested due to automatic review settings November 9, 2026 17:43

Copilot started reviewing on behalf of avbelova November 9, 2026 17:44

View session

Copilot AI reviewed Nov 9, 2026

View reviewed changes

nil-is-all added release notes: openvino OpenVino backend related issues, features, bugs etc. module: openvino Issues and PRs related to backends/openvino module: windows labels Nov 9, 2026

mergennachin requested a review from suryasidd November 9, 2026 20:02

Merge branch 'main' into openvino_windows

e12c0cd

Copilot AI balanced review requested due to automatic review settings November 11, 2026 01:13

Copilot started reviewing on behalf of avbelova November 11, 2026 01:13

View session

Copilot AI reviewed Nov 11, 2026

View reviewed changes

Navigation Menu

Repository navigation

OpenVINO backend: add Windows support - #24670

OpenVINO backend: add Windows support#24670
avbelova wants to merge 9 commits into
pytorch:mainfrom
avbelova:openvino_windows

avbelova commented Nov 5, 2026 •

edited by pytorch-bot Bot

Loading

Uh oh!

pytorch-bot Bot commented Nov 5, 2026 •

edited

Loading

Uh oh!

meta-cla Bot commented Nov 5, 2026

Uh oh!

linux-foundation-easycla Bot commented Nov 5, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

meta-cla Bot commented Nov 9, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI left a comment

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants


		For additional source build details, refer to the [OpenVINO Build Instructions](https://github.com/openvinotoolkit/openvino/blob/master/docs/dev/build_windows.md).

		#### Build Commands (Windows)

Conversation

avbelova commented Nov 5, 2026 • edited by pytorch-bot Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Test plan

Uh oh!

pytorch-bot Bot commented Nov 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24670

⚠️ 27 Awaiting Approval

Uh oh!

meta-cla Bot commented Nov 5, 2026

Action Required

Process

Uh oh!

linux-foundation-easycla Bot commented Nov 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🟡 Changes recommended

Uh oh!

Uh oh!

meta-cla Bot commented Nov 9, 2026

Action Required

Process

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🔵 Needs a closer look

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🟡 Changes recommended

Uh oh!

This branch has not been deployed

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

avbelova commented Nov 5, 2026 •

edited by pytorch-bot Bot

Loading

pytorch-bot Bot commented Nov 5, 2026 •

edited

Loading

linux-foundation-easycla Bot commented Nov 5, 2026 •

edited

Loading