Skip to content

edge-stt: build JOBS=2 (avoid 8GB OOM) + slow-PyPI note#6

Merged
ai-hpc merged 1 commit into
mainfrom
edge-stt-build-jobs-fix
Jun 12, 2026
Merged

edge-stt: build JOBS=2 (avoid 8GB OOM) + slow-PyPI note#6
ai-hpc merged 1 commit into
mainfrom
edge-stt-build-jobs-fix

Conversation

@ai-hpc

@ai-hpc ai-hpc commented Jun 12, 2026

Copy link
Copy Markdown
Member

Two small reproducibility fixes under deploy/parakeet-stt/edge-stt/, found during a fresh-clone Stage-1 rehearsal on the Jetson:

  • scripts/build-parakeet.sh: default JOBS 4 → 2. The -j4 ggml-cuda nvcc compile spikes ~1–2 GB/job and OOM-reboots the 8 GB Orin on a from-scratch build. JOBS=2 is the safe default; override with JOBS=.
  • README pip step: note that PyPI is slow on the Jetson (~tens of kB/s; ~17 MB of wheels ≈ several min) and add -v so it shows progress instead of looking hung.

Verified: fresh clone reproduces the gates — Mode A tdt(q5_k) 1.808 % / 61×, ctc(q8_0) 2.383 % / 107×, +435–510 MB.

The -j4 ggml-cuda nvcc compile spikes ~1-2 GB/job and OOM-reboots the 8 GB Orin during a
from-scratch build; JOBS=2 is the safe default (override with JOBS=). Also flag in the README
that pip install over PyPI is slow on the Jetson (~tens of kB/s) so it isn't mistaken for a hang.
@ai-hpc ai-hpc merged commit 5408a52 into main Jun 12, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant