Skip to content

Arm backend: Enable planned Ethos-U scratch - #24336

Merged
emmakujala merged 1 commit into
pytorch:mainfrom
emmakujala:ethosu_scratch
Nov 2, 2026
Merged

emmakujala merged 1 commit into
pytorch:mainfrom
emmakujala:ethosu_scratch

Conversation

@emmakujala

@emmakujala emmakujala commented Oct 30, 2026 •

Copy link
Copy Markdown
Collaborator

Reserve scratch during AOT flow instead of allocating it at runtime. This is done through DelegateScratchSpec using the label "ethosu_scratch".

cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils @Sebastian-Larsson @robell @rascani

Reserve scratch during AOT flow instead of allocating it at runtime.
This is done through DelegateScratchSpec using the label
"ethosu_scratch", and it's enabled by setting
plan_delegate_scratch=True or by setting --plan-delegate-scratch in
the CLI.

The default is False as delegate scratch can only be used
on the CoreDriver backend. If a PTE that includes planned
delegated scratch is run on the LinuxDriver a warning is
issued since the memory will be unused.

Legacy PTEs that do not have planned delegate scratch will
continue to use the temporary allocator to allocate scratch in
the runtime.

Authored with AI assistance from OpenAI Codex.

Change-Id: I482571a4d7928201f7df48c3440042ed705b4eaf
Signed-off-by: Emma Kujala <Emma.Kujala@arm.com>
@emmakujala emmakujala added partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm ciflow/trunk release notes: arm Changes to the ARM backend delegate labels Oct 30, 2026
@pytorch-bot

pytorch-bot Bot commented Oct 30, 2026 •

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24336

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit d374616 with merge base 77b687d (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 30, 2026
@github-actions github-actions Bot added the module: arm Issues related to arm backend label Oct 30, 2026
@rascani
rascani requested a review from Erik-Lundell October 30, 2026 15:19

@zingo zingo left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK to merge, just make sure buck2 files are updates if needed for the added file (you can ask codex/claude)

@emmakujala
emmakujala merged commit f2564fb into pytorch:main Nov 2, 2026
485 of 492 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. module: arm Issues related to arm backend partner: arm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Arm release notes: arm Changes to the ARM backend delegate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants