I want to use python onnxruntime within a flutter application to load machine learning models within device.

[akhilchhetri]

I tried to install onnxruntime but its not resolved, So i wanted to be clear either.

1. onnxruntime package has the python wheels for android / ios?
2. If not, what are the steps needed to create a binary build for onnxruntime for android arm64-v8a / armeabi64-v7a?

[ap4499]

At my last look at Onnx on embedded devices/Android/iOS, you needed to compile binaries from source(ie. they haven't got arm64-v8a binaries).

I would build that wheel (C++), create the Python bindings, and then have it contained within your package.

I think the key question from a Flet POV would be whether you could place something like this within your reqs.txt / .toml requirements when working on an Android build:
CustomOnnxWheel @ file:///Users/USER/project_folder/GitHub/CustomOnnxWheel.whl

I would guess that you can - as you can on MacOS/Windows, and I use custom wheels/binaries. But I haven't done Flet -> Android.

Answering your question, I think the most relevant link to start this journey is this:
https://onnxruntime.ai/docs/tutorials/mobile/

[ap4499]

Although.. there might be an easier way of doing it if someone has already set this up for Flutter.

maybe this:
https://pub.dev/documentation/onnxruntime/latest/
https://pub.dev/packages/onnxruntime

Then you can use the extension mechanism that Flet introduced in 0.27: https://flet.dev/docs/extend/user-extensions/

[SamYuan1990]

I tested it today, https://github.com/SamYuan1990/i18n-agent-action/actions/runs/17670451604/job/50220801655?pr=104 related with microsoft/onnxruntime#26025 I am not sure if onnx runtime can provide a package.

[SamYuan1990]

hi @akhilchhetri , do you have any exp for me and others to use https://flet.dev/docs/extend/user-extensions/ as @ap4499 mentioned?

[SamYuan1990]

well, for me I am attempting sherpa_onnx for STT(sound to text). hope it help, https://github.com/SamYuan1990/flet_sherpa_onnx