Skip to content

Update QAIRT to 2.42 and Add v73 LLM fully demo #1694

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Milir-Radxa merged 4 commits into from
Apr 17, 2026
Merged

Update QAIRT to 2.42 and Add v73 LLM fully demo #1694

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
2ddaa73
docs: move qualcomm ai mdx files to common/ai/qualcomm
ZIFENG278 Apr 16, 2026
5a04e07
docs: add GENIE LLM models download link
ZIFENG278 Apr 16, 2026
65c7b2f
docs: move qualcomm ai en docs
ZIFENG278 Apr 17, 2026
d5e8d8d
docs: add qualcomm v73 LLM download link in en docs
ZIFENG278 Apr 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
0 docs/common/ai/_aimet.mdx → docs/common/ai/qualcomm/_aimet.mdx
View file
Open in desktop
File renamed without changes.
4 changes: 2 additions & 2 deletions docs/common/ai/_aotgan_qai-app-builder.mdx → ...n/ai/qualcomm/_aotgan_qai-app-builder.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@

**示例支持设备**

| 设备 | SoC |
| --------------------- | ------- |
| 设备 | SoC |
| -------------------- | ------- |
| Fogwise® AIRbox Q900 | QCS9075 |

## 安装 QAI AppBuilder
Expand Down
4 changes: 2 additions & 2 deletions docs/common/ai/_beit_qai-app-builder.mdx → ...mon/ai/qualcomm/_beit_qai-app-builder.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@

**示例支持设备**

| 设备 | SoC |
| --------------------- | ------- |
| 设备 | SoC |
| -------------------- | ------- |
| Fogwise® AIRbox Q900 | QCS9075 |

## 安装 QAI AppBuilder
Expand Down
1 change: 0 additions & 1 deletion ...ommon/ai/_casaos_app_install_qualcomm.mdx → ...qualcomm/_casaos_app_install_qualcomm.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,6 @@ Real-ESRGAN AI 图像修复 APP， 可最高将图像超分辨率到 2048x2048
```

**Devices** 设备挂载，将 NPU 挂载进 Docker 容器中，建议全部挂载

- Host:
```bash
/dev
Expand Down
0 ...mon/ai/_convnext_base_qai-app-builder.mdx → ...alcomm/_convnext_base_qai-app-builder.mdx
View file
Open in desktop
File renamed without changes.
0 ...mon/ai/_convnext_tiny_qai-app-builder.mdx → ...alcomm/_convnext_tiny_qai-app-builder.mdx
View file
Open in desktop
File renamed without changes.
4 changes: 2 additions & 2 deletions ...on/ai/_depth_anything_qai-app-builder.mdx → ...lcomm/_depth_anything_qai-app-builder.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@

**示例支持设备**

| 设备 | SoC |
| --------------------- | ------- |
| 设备 | SoC |
| -------------------- | ------- |
| Fogwise® AIRbox Q900 | QCS9075 |

## 安装 QAI AppBuilder
Expand Down
4 changes: 2 additions & 2 deletions docs/common/ai/_easy_ocr_qai-app-builder.mdx → ...ai/qualcomm/_easy_ocr_qai-app-builder.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@

**示例支持设备**

| 设备 | SoC |
| --------------------- | ------- |
| 设备 | SoC |
| -------------------- | ------- |
| Fogwise® AIRbox Q900 | QCS9075 |

## 安装 QAI AppBuilder
Expand Down
0 ...n/ai/_efficientnet_b0_qai-app-builder.mdx → ...comm/_efficientnet_b0_qai-app-builder.mdx
View file
Open in desktop
File renamed without changes.
0 ...n/ai/_efficientnet_b4_qai-app-builder.mdx → ...comm/_efficientnet_b4_qai-app-builder.mdx
View file
Open in desktop
File renamed without changes.
0 .../ai/_efficientnet_v2s_qai-app-builder.mdx → ...omm/_efficientnet_v2s_qai-app-builder.mdx
View file
Open in desktop
File renamed without changes.
4 changes: 2 additions & 2 deletions ...n/ai/_face_attrib_net_qai-app-builder.mdx → ...comm/_face_attrib_net_qai-app-builder.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@

**示例支持设备**

| 设备 | SoC |
| --------------------- | ------- |
| 设备 | SoC |
| -------------------- | ------- |
| Fogwise® AIRbox Q900 | QCS9075 |

## 安装 QAI AppBuilder
Expand Down
4 changes: 2 additions & 2 deletions ...mmon/ai/_facemap_3dmm_qai-app-builder.mdx → ...ualcomm/_facemap_3dmm_qai-app-builder.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@

**示例支持设备**

| 设备 | SoC |
| --------------------- | ------- |
| 设备 | SoC |
| -------------------- | ------- |
| Fogwise® AIRbox Q900 | QCS9075 |

## 安装 QAI AppBuilder
Expand Down
0 docs/common/ai/_fastrpc_setup.mdx → docs/common/ai/qualcomm/_fastrpc_setup.mdx
View file
Open in desktop
File renamed without changes.
0 ...ai/_fcn-resnet50_qai-app-builder-6490.mdx → ...mm/_fcn-resnet50_qai-app-builder-6490.mdx
View file
Open in desktop
File renamed without changes.
0 ...mmon/ai/_fcn-resnet50_qai-app-builder.mdx → ...ualcomm/_fcn-resnet50_qai-app-builder.mdx
View file
Open in desktop
File renamed without changes.
49 changes: 41 additions & 8 deletions docs/common/ai/_genie_ds_r1_qwen_7b.mdx → ...mmon/ai/qualcomm/_genie_ds_r1_qwen_7b.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,24 +24,57 @@

- 运行设备

| 设备 | SoC | dsp_arch |
| --------------------- | ------- | -------- |
| 设备 | SoC | dsp_arch |
| -------------------- | ------- | -------- |
| Fogwise® AIRbox Q900 | QCS9075 | v73 |

## 下载 genie 工具包

:::info
敬请期待
:::
<NewCodeBlock tip="Device" type="device">

```bash
wget https://github.com/ZIFENG278/ai-engine-direct-helper/releases/download/qcom-genie-sdk-v73/qcom-genie-sdk-v73.tar.gz
tar -xvf qcom-genie-sdk-v73.tar.gz
```

</NewCodeBlock>

### 导入环境变量

<NewCodeBlock tip="Device" type="device">

```bash
cd qcom-genie-sdk-v73
export ADSP_LIBRARY_PATH=$(pwd)
```

</NewCodeBlock>

## 下载模型

:::info
敬请期待
:::tip
请在 python 虚拟环境中安装 modelscope python 包，虚拟环境使用请参考 [**Python 虚拟环境使用**](/rock5/rock5b/app-development/venv-usage)
:::

<NewCodeBlock tip="Device" type="device">

```bash
pip3 install modelscope
modelscope download --model radxa/DeepSeek-R1-Distill-Qwen-7B-w4a16-4096-v73 --local_dir ./DeepSeek-R1-Distill-Qwen-7B-w4a16-4096-v73
```

</NewCodeBlock>

## 推理模型

<NewCodeBlock tip="Device" type="device">

```bash
cd DeepSeek-R1-Distill-Qwen-7B-w4a16-4096-v73
```

</NewCodeBlock>

### 构建 prompt

prompt 支持以文件形式或者参数形式传入
Expand Down Expand Up @@ -137,7 +170,7 @@ Qualcomm is a leading global technology company founded in 1985, renowned for it
genie-t2t-run -c DeepSeek-R1-Distill-Qwen-7B-htp.json --prompt_file chat.txt --profile profile.txt
```

| Fogwise® AIRbox Q900 | |
| Fogwise® AIRbox Q900 | |
| -------------------------- | -------------------------- |
| **GenieDialog_create** | 1,952,585 us |
| **num-prompt-tokens** | 46 |
Expand Down
49 changes: 41 additions & 8 deletions docs/common/ai/_genie_gemma_2_2b_it.mdx → ...mmon/ai/qualcomm/_genie_gemma_2_2b_it.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,24 +24,57 @@

- 运行设备

| 设备 | SoC | dsp_arch |
| --------------------- | ------- | -------- |
| 设备 | SoC | dsp_arch |
| -------------------- | ------- | -------- |
| Fogwise® AIRbox Q900 | QCS9075 | v73 |

## 下载 genie 工具包

:::info
敬请期待
:::
<NewCodeBlock tip="Device" type="device">

```bash
wget https://github.com/ZIFENG278/ai-engine-direct-helper/releases/download/qcom-genie-sdk-v73/qcom-genie-sdk-v73.tar.gz
tar -xvf qcom-genie-sdk-v73.tar.gz
```

</NewCodeBlock>

### 导入环境变量

<NewCodeBlock tip="Device" type="device">

```bash
cd qcom-genie-sdk-v73
export ADSP_LIBRARY_PATH=$(pwd)
```

</NewCodeBlock>

## 下载模型

:::info
敬请期待
:::tip
请在 python 虚拟环境中安装 modelscope python 包，虚拟环境使用请参考 [**Python 虚拟环境使用**](/rock5/rock5b/app-development/venv-usage)
:::

<NewCodeBlock tip="Device" type="device">

```bash
pip3 install modelscope
modelscope download --model radxa/Gemma-2-2B-it-w4a16-4096-v73 --local_dir ./Gemma-2-2B-it-w4a16-4096-v73
```

</NewCodeBlock>

## 推理模型

<NewCodeBlock tip="Device" type="device">

```bash
cd Gemma-2-2B-it-w4a16-4096-v73
```

</NewCodeBlock>

### 构建 prompt

prompt 支持以文件形式或者参数形式传入
Expand Down Expand Up @@ -136,7 +169,7 @@ I'm excited to see what we can create together! 😊
genie-t2t-run -c gemma-2-2b-it-htp.json --prompt_file chat.txt --profile profile.txt
```

| Fogwise® AIRbox Q900 | |
| Fogwise® AIRbox Q900 | |
| -------------------------- | --------------------------- |
| **GenieDialog_create** | 2,022,259 us |
| **num-prompt-tokens** | 14 |
Expand Down
49 changes: 41 additions & 8 deletions docs/common/ai/_genie_llama_2_7b_chat.mdx → ...on/ai/qualcomm/_genie_llama_2_7b_chat.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,24 +24,57 @@

- 运行设备

| 设备 | SoC | dsp_arch |
| --------------------- | ------- | -------- |
| 设备 | SoC | dsp_arch |
| -------------------- | ------- | -------- |
| Fogwise® AIRbox Q900 | QCS9075 | v73 |

## 下载 genie 工具包

:::info
敬请期待
:::
<NewCodeBlock tip="Device" type="device">

```bash
wget https://github.com/ZIFENG278/ai-engine-direct-helper/releases/download/qcom-genie-sdk-v73/qcom-genie-sdk-v73.tar.gz
tar -xvf qcom-genie-sdk-v73.tar.gz
```

</NewCodeBlock>

### 导入环境变量

<NewCodeBlock tip="Device" type="device">

```bash
cd qcom-genie-sdk-v73
export ADSP_LIBRARY_PATH=$(pwd)
```

</NewCodeBlock>

## 下载模型

:::info
敬请期待
:::tip
请在 python 虚拟环境中安装 modelscope python 包，虚拟环境使用请参考 [**Python 虚拟环境使用**](/rock5/rock5b/app-development/venv-usage)
:::

<NewCodeBlock tip="Device" type="device">

```bash
pip3 install modelscope
modelscope download --model radxa/Llama-2-7B-Chat-w4a16-4096-v73 --local_dir ./Llama-2-7B-Chat-w4a16-4096-v73
```

</NewCodeBlock>

## 推理模型

<NewCodeBlock tip="Device" type="device">

```bash
cd Llama-2-7B-Chat-w4a16-4096-v73
```

</NewCodeBlock>

### 构建 prompt

prompt 支持以文件形式或者参数形式传入
Expand Down Expand Up @@ -125,7 +158,7 @@ Using libGenie.so version 1.14.0
genie-t2t-run -c Llama2-7B-Chat-htp.json --prompt_file chat.txt --profile profile.txt
```

| Fogwise® AIRbox Q900 | |
| Fogwise® AIRbox Q900 | |
| -------------------------- | ---------------------------- |
| **GenieDialog_create** | 3,305,162 us |
| **num-prompt-tokens** | 38 |
Expand Down
49 changes: 41 additions & 8 deletions docs/common/ai/_genie_llama_31_8b.mdx → ...common/ai/qualcomm/_genie_llama_31_8b.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,24 +24,57 @@

- 运行设备

| 设备 | SoC | dsp_arch |
| --------------------- | ------- | -------- |
| 设备 | SoC | dsp_arch |
| -------------------- | ------- | -------- |
| Fogwise® AIRbox Q900 | QCS9075 | v73 |

## 下载 genie 工具包

:::info
敬请期待
:::
<NewCodeBlock tip="Device" type="device">

```bash
wget https://github.com/ZIFENG278/ai-engine-direct-helper/releases/download/qcom-genie-sdk-v73/qcom-genie-sdk-v73.tar.gz
tar -xvf qcom-genie-sdk-v73.tar.gz
```

</NewCodeBlock>

### 导入环境变量

<NewCodeBlock tip="Device" type="device">

```bash
cd qcom-genie-sdk-v73
export ADSP_LIBRARY_PATH=$(pwd)
```

</NewCodeBlock>

## 下载模型

:::info
敬请期待
:::tip
请在 python 虚拟环境中安装 modelscope python 包，虚拟环境使用请参考 [**Python 虚拟环境使用**](/rock5/rock5b/app-development/venv-usage)
:::

<NewCodeBlock tip="Device" type="device">

```bash
pip3 install modelscope
modelscope download --model radxa/Llama-3.1-8B-Instruct-w4a16-4096-v73 --local_dir ./Llama-3.1-8B-Instruct-w4a16-4096-v73
```

</NewCodeBlock>

## 推理模型

<NewCodeBlock tip="Device" type="device">

```bash
cd Llama-3.1-8B-Instruct-w4a16-4096-v73
```

</NewCodeBlock>

### 构建 prompt

prompt 支持以文件形式或者参数形式传入
Expand Down Expand Up @@ -125,7 +158,7 @@ Using libGenie.so version 1.14.0
genie-t2t-run -c Meta-Llama-3.1-8B-Instruct-htp.json --prompt_file chat.txt --profile profile.txt
```

| Fogwise® AIRbox Q900 | |
| Fogwise® AIRbox Q900 | |
| -------------------------- | -------------------------- |
| **GenieDialog_create** | 2,182,009 us |
| **num-prompt-tokens** | 32 |
Expand Down
Loading
Loading